cross-job cache misses
See original GitHub issueI have an action setup where a first job creates a cache directory, which is then used by a second jobs which “needs” the first one.
The issue here is that the second job is not picking up the cache that has been created by the first one.
workflow run: https://github.com/airbusgeo/godal/actions/runs/3173227767
relevant logs: In first job:
Run actions/cache@v3
with:
path: /optgdal
key: Linux-install-gdal-release/3.4-aae37644121b0e61978a51cb0d4481abe5363bfcd90970a442fab97c6ccf3ba2
Cache not found for input keys: Linux-install-gdal-release/3.4-aae37644121b0e61978a51cb0d4481abe5363bfcd90970a442fab97c6ccf3ba2
#create the cache artifact
Post job cleanup.
/usr/bin/tar --posix -z -cf cache.tgz --exclude cache.tgz -P -C /home/runner/work/godal/godal --files-from manifest.txt
Cache Size: ~28 MB (29473340 B)
Cache saved successfully
Cache saved with key: Linux-install-gdal-release/3.4-aae37644121b0e61978a51cb0d4481abe5363bfcd90970a442fab97c6ccf3ba2
In second job (ran after first one):
Run actions/cache@v3
with:
path: /optgdal
key: Linux-install-gdal-release/3.4-aae37644121b0e61978a51cb0d4481abe5363bfcd90970a442fab97c6ccf3ba2
env:
GODEBUG: cgocheck=2
Cache not found for input keys: Linux-install-gdal-release/3.4-aae37644121b0e61978a51cb0d4481abe5363bfcd90970a442fab97c6ccf3ba2
#create the cache artifact , this should not be needed
Post job cleanup.
/usr/bin/tar --posix -z -cf cache.tgz --exclude cache.tgz -P -C /home/runner/work/godal/godal --files-from manifest.txt
Failed to save: Unable to reserve cache with key Linux-install-gdal-release/3.4-aae37644121b0e61978a51cb0d4481abe5363bfcd90970a442fab97c6ccf3ba2, another job may be creating this cache. More details: Cache already exists. Scope: refs/heads/main, Key: Linux-install-gdal-release/3.4-aae37644121b0e61978a51cb0d4481abe5363bfcd90970a442fab97c6ccf3ba2, Version: 319ddfe8294d1fea971696ed640f65dff510001254b261687c4d7498b02d8573
Issue Analytics
- State:
- Created a year ago
- Comments:6 (2 by maintainers)
Top Results From Across the Web
Cache Miss – What It Is and How to Reduce It - Hostinger
Cache miss suggests that requested data is not available in cache memory. Read on to learn how to reduce them and make the...
Read more >What's a Cache Miss? Policies That Reduce ... - Hazelcast
A cache miss occurs when a system or application makes a request to retrieve data from a cache, but that specific data is...
Read more >Types of Cache Misses - GeeksforGeeks
Cache Miss occurs when data is not available in the Cache Memory. When the CPU detects a miss, it processes the miss by...
Read more >Caching directories between runs of a task · Issue #230 - GitHub
Common use case: fetching dependencies, syncing BOSH blobs, etc. Caching the directories that these fetch into and update would dramatically ...
Read more >Quiver: An Informed Storage Cache for Deep Learning - USENIX
User's input training data is fetched from cloud storage on a cache miss. Each job's dataset is sharded across multiple cache servers, and ......
Read more >Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start FreeTop Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found
Top GitHub Comments
ok found the issue, I was deleting /usr/local/bin as a leftover step in my build script, which is probably where zstd was installed on your runners. Something must have changed on the runners this september concerning the check for zstd and/or the location where it’s installed, as the issue was not present beforehand. Thnaks for your help @aparna-ravindra
Yes. I also found the same. Because of this, the cache version while restoring cache v/s saving cache is different. Is there anything in your workflow that alters the zstd package?