question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

[prerelease] Performance regression?

See original GitHub issue

According to nikolaizujev on Twitter:

Tested on several internal projects, noticed almost 2x slowdown compared to 6.2.5 on py3.8

Unfortunately no reproducer, but I got .prof dumps from them: Dropbox - pytest - Simplify your life

Opening this to remind myself to have a look at those before the final release - but ideally we’d have a proper reproducer so we can e.g. bisect this. Does anyone have any guess what could be the culprit? I only see a very small slowdown for my own project.

@hroncok Is there perhaps a way to find out which packages in Fedora took significantly longer to run tests with pytest 7 compared to 6? This would mainly be for runs which still pass, because if there are failures, all bets regarding the runtime are off anyways.

Issue Analytics

  • State:closed
  • Created 2 years ago
  • Comments:32 (32 by maintainers)

github_iconTop GitHub Comments

1reaction
hroncokcommented, Jan 7, 2022

I might be able to test that in Fedroa with the git HEAD as well even without rc.

1reaction
The-Compilercommented, Jan 7, 2022

Oh, also, how do folks feel about a quick 7.0.0rc2 now? We still need to take care of #9002 and #9471 (plus potentially “unknown unknowns” from #9415?), but that would mean it’s easy for people (and probably Fedora?) to test the fixes which we have so far (and it makes it easier to ask the original reporter to test this fix too).

Read more comments on GitHub >

github_iconTop Results From Across the Web

Stage 4: Pre-release Testing - Documentation
Stage 4: Pre-release Testing. In this section we will look at the best practices for testing before a production release to ensure the...
Read more >
Keeping sync fast with automated performance regression ...
When we specifically sought to improve sync performance, we used Apogee as pre-release validation that our improvements had the intended impact.
Read more >
Prerelease buzz evolution patterns and new product performance ...
Functional regression shows that higher than average buzz volume throughout the prerelease period predicts greater sales, whereas a decreasing trend in ...
Read more >
New Regression Testing Process for ISVs Using Pre-Release ...
ISVs have frequently asked us to provide better pre-release environments so that they can do more thorough testing ahead of each major Salesforce...
Read more >
TW 5.2.0-prerelease significantly slower than TW 5.1.23 ...
Hello, I've tested the 5.2.0-prerelease over the past few days both on ... We don't have performance regression testing in place, so it's...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found