CI: frequent, intermittent failures to download testing data
See original GitHub issueThere have been a lot of issues on the CIs today where the “get testing data” step has failed. This failure is typical:
https://github.com/mne-tools/mne-python/pull/8669/checks?check_run_id=1623277082#step:10:4609
Successful downloads of the testing data have been intermittent among these failures, so that re-running a test will sometimes work on the second, third, or fourth attempt. I tried downloading the v0.112 testing data manually through my browser 5 times, and it failed 4 of those times. No obvious difference between codeload.github.com links versus regular github .../archive/filename.tar.gz links.
Issue Analytics
- State:
- Created 3 years ago
- Comments:10 (10 by maintainers)
Top Results From Across the Web
How to Fix Flaky Tests - Semaphore CI
Randomly failing tests are the hardest to debug. Here's a framework you can use to fix them and keep your test suite healthy....
Read more >Top 5 Reasons for CI Failure - DZone
Using a poor-quality server wastes everyone's time because the build takes too long to finish, resulting in intermittent test results and ...
Read more >Resolve Intermittent Test Failures in CI · Issue #4810 - GitHub
I have seen a few CI tests that consistently fail sometimes, but then succeed when re-running the test stage. When you restart a...
Read more >detecting and diagnosing intermittent job failures at Mozilla
We present a novel approach that automatically classifies failing jobs to determine whether job execution failures arise from an actual software ...
Read more >Avoid Frequently Failing Tests With Continuous Integration
In order to avoid frequently failed tests, there are several factors we should consider, and in this article, we'll look in detail at...
Read more >
Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free
Top Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found

our testing dataset is ~1GB so we should be good
Caching should be possible: https://docs.github.com/en/free-pro-team@latest/actions/guides/caching-dependencies-to-speed-up-workflows