Flaky `test_aio` CircleCI job due to size check
See original GitHub issueThe test_aio
CircleCI job sometimes fails false-positively with the payload size error (over 20kb diff):
FAIL: Commit c95802f26f80de933f8cf62898115bbe938fff94 uncompressed main-es2015 exceeded expected size by 500 bytes or >1% (expected: 453213, actual: 476811).
Example of the most recent failure in master can be found here. In that particular case, it was a docs-only commit.
Restarting the CircleCI job usually fixes the problem.
cc @gkalpak
Issue Analytics
- State:
- Created 3 years ago
- Comments:9 (8 by maintainers)
Top Results From Across the Web
How to reduce flaky test failures - CircleCI
Flaky tests, also known as flappers, fail to produce accurate and consistent results. These tests may be unreliable because of newly-written ...
Read more >Introducing Test Insights with flaky test detection - CircleCI
Test Insights includes a new layer of detection and analysis, specifically for flaky tests, which are tests that fail non-deterministically.
Read more >Collecting test data - CircleCI
You can access the test results from the Tests tab when viewing a job, ... This includes flaky test detection, viewing tests that...
Read more >Using Insights to Discover Flaky, Slow, and Failed Tests
A flaky test (one that passes sometimes and fails other times when the code hasn't changed) is hardly better than no test at...
Read more >tadashi0713/flaky-tests-notify - CircleCI Developer Hub
Use flaky-tests-notify elements in your existing workflows and jobs. Opt-in to use of uncertified orbs on your organization's Security settings ...
Read more >Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start FreeTop Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found
Top GitHub Comments
FYI, I created #37703 to capture more info to help debug this (the next time it happens).
This issue has been automatically locked due to inactivity. Please file a new issue if you are encountering a similar or related problem.
Read more about our automatic conversation locking policy.
This action has been performed automatically by a bot.