question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

CI: frequent, intermittent failures to download testing data

See original GitHub issue

There have been a lot of issues on the CIs today where the “get testing data” step has failed. This failure is typical:

https://github.com/mne-tools/mne-python/pull/8669/checks?check_run_id=1623277082#step:10:4609

Successful downloads of the testing data have been intermittent among these failures, so that re-running a test will sometimes work on the second, third, or fourth attempt. I tried downloading the v0.112 testing data manually through my browser 5 times, and it failed 4 of those times. No obvious difference between codeload.github.com links versus regular github .../archive/filename.tar.gz links.

Issue Analytics

  • State:closed
  • Created 3 years ago
  • Comments:10 (10 by maintainers)

github_iconTop GitHub Comments

1reaction
larsonercommented, Jan 4, 2021

our testing dataset is ~1GB so we should be good

Read more comments on GitHub >

github_iconTop Results From Across the Web

How to Fix Flaky Tests - Semaphore CI
Randomly failing tests are the hardest to debug. Here's a framework you can use to fix them and keep your test suite healthy....
Read more >
Top 5 Reasons for CI Failure - DZone
Using a poor-quality server wastes everyone's time because the build takes too long to finish, resulting in intermittent test results and ...
Read more >
Resolve Intermittent Test Failures in CI · Issue #4810 - GitHub
I have seen a few CI tests that consistently fail sometimes, but then succeed when re-running the test stage. When you restart a...
Read more >
detecting and diagnosing intermittent job failures at Mozilla
We present a novel approach that automatically classifies failing jobs to determine whether job execution failures arise from an actual software ...
Read more >
Avoid Frequently Failing Tests With Continuous Integration
In order to avoid frequently failed tests, there are several factors we should consider, and in this article, we'll look in detail at...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found