[prerelease] Performance regression?
See original GitHub issueAccording to nikolaizujev on Twitter:
Tested on several internal projects, noticed almost 2x slowdown compared to 6.2.5 on py3.8
Unfortunately no reproducer, but I got .prof
dumps from them: Dropbox - pytest - Simplify your life
Opening this to remind myself to have a look at those before the final release - but ideally we’d have a proper reproducer so we can e.g. bisect this. Does anyone have any guess what could be the culprit? I only see a very small slowdown for my own project.
@hroncok Is there perhaps a way to find out which packages in Fedora took significantly longer to run tests with pytest 7 compared to 6? This would mainly be for runs which still pass, because if there are failures, all bets regarding the runtime are off anyways.
Issue Analytics
- State:
- Created 2 years ago
- Comments:32 (32 by maintainers)
Top Results From Across the Web
Stage 4: Pre-release Testing - Documentation
Stage 4: Pre-release Testing. In this section we will look at the best practices for testing before a production release to ensure the...
Read more >Keeping sync fast with automated performance regression ...
When we specifically sought to improve sync performance, we used Apogee as pre-release validation that our improvements had the intended impact.
Read more >Prerelease buzz evolution patterns and new product performance ...
Functional regression shows that higher than average buzz volume throughout the prerelease period predicts greater sales, whereas a decreasing trend in ...
Read more >New Regression Testing Process for ISVs Using Pre-Release ...
ISVs have frequently asked us to provide better pre-release environments so that they can do more thorough testing ahead of each major Salesforce...
Read more >TW 5.2.0-prerelease significantly slower than TW 5.1.23 ...
Hello, I've tested the 5.2.0-prerelease over the past few days both on ... We don't have performance regression testing in place, so it's...
Read more >
Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free
Top Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found
I might be able to test that in Fedroa with the git HEAD as well even without rc.
Oh, also, how do folks feel about a quick 7.0.0rc2 now? We still need to take care of #9002 and #9471 (plus potentially “unknown unknowns” from #9415?), but that would mean it’s easy for people (and probably Fedora?) to test the fixes which we have so far (and it makes it easier to ask the original reporter to test this fix too).