question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Caching of files for testing with remote_data

See original GitHub issue

Our test suite is very extensive, which also means it takes so long that running all tests is longer compatible with development. Fortunately, -P <something> really helps. But one thing that still is very painful is having to run remote-data tests, especially those that download large files, like the solar system ephemeris. Would it be possible to have a system where the download cache is shared between pytest invocations? Or perhaps is this possible already?

Issue Analytics

  • State:closed
  • Created 2 years ago
  • Comments:7 (7 by maintainers)

github_iconTop GitHub Comments

1reaction
mhvkcommented, Jun 3, 2021

I was actually wondering more about how to do it on my own machine, e.g., if I’m running pytest -P coordinates --remote-data=any multiple times.

0reactions
mhvkcommented, Jun 3, 2021

Yes, sorry, I would say this is a duplicate of #8748 and #9557. I guess this is now just a reminder that it would be useful to solve those…

Read more comments on GitHub >

github_iconTop Results From Across the Web

Persist astropy cache · Issue #9557 - GitHub
Description When astropy downloads remote files, it can store them in ... For any other tests that require remote data, we simply don't...
Read more >
Introducing Remote Content Caching with FSSpec - Anaconda
Now, caching of whole or partial remote data is available to anyone who uses python files! The Intake experience. Intake is all about...
Read more >
Why You Should Be Storing Remote Data in a Cache (and Not ...
A common pattern in React for handling remote data is to fetch inside useEffect and copy the result into component state. Something like...
Read more >
Data Cache for Remote Reads | 6.3.x - Cloudera Documentation
To enable remote data cache: In Cloudera Manager, navigate to Clusters > Impala Service > . In the Configuration tab, select Impala Daemon ......
Read more >
remotedata - PyPI
You want to cache the data locally for some time; Especially, when the files are used for testing. Installation. pip install remotedata. Usage....
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found