limit cache size?
See original GitHub issueI ran into an issue when running lots of astroquery
queries where my cache ballooned in size to ~10s of Gb—and I didn’t realize there was a cache until it was enormous, so this has caused some minor headaches with my home directory quota, etc. I raised the issue over at astroquery that there should be a (perhaps user-configurable) limit on the cache size, so that old stuff gets overwritten if need be? @keflavich suggested I make this same suggestion over here.
Issue Analytics
- State:
- Created 7 years ago
- Reactions:3
- Comments:9 (8 by maintainers)
Top Results From Across the Web
Cache size limits - IBM
The maximum theoretical cache size is 2 GB. The size of cache you can specify is limited by the amount of physical memory...
Read more >What is Chrome default cache size limit? - Super User
If I understand this correctly, the common cache size should be 1% of the available disk space, not 10%, considering most users should...
Read more >How to Change the Cache Size and the Drive Letter Designation
Use maximum cache size. Enter a numeric value from 100 to 1,048,576 (1 TB) in the Maximum size (MB) field to specify the...
Read more >Restrict Size of the Buffer Cache in Linux - Baeldung
Another way to limit the amount of memory that buffer caches use is via control groups (also referred to as cgroups). cgroups provide...
Read more >Limit cache memory footprint - HCL support
The Cache Size setting for dynacache allows you to limit the number of entries that the cache holds. However, at times you might...
Read more >
Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free
Top Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found
Caching is not for the faint-hearted, but yes, you can give it a try.
Let me add that the cache preserves modification and access times, if the underlying filesystem tracks those, so in about five lines of code you could delete from the cache anything that hasn’t been accessed in six months. (Or six months if big and a year if small, or…)