Stuck on an issue?
Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.
And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.
Scheduled Model Regression Test Performance Drops
See original GitHub issueThis is a testing PR. Please safely ignore it.
This PR is automatically created by the Scheduled Model Regression Test workflow. Checkout the Github Action Run here.
Some test performance scores decreased. Please look at the following table for more details.
Dataset: Carbon Bot, Dataset repository branch: main
| Configuration | Intent Classification Micro F1 | Entity Recognition Micro F1 | Response Selection Micro F1 |
|---|---|---|---|
BERT + DIET(bow) + ResponseSelector(bow)test: 1m30s, train: 4m16s, total: 5m45s |
0.7942 (0.01) | 0.7529 (0.00) | 0.5563 (-0.03) |
Issue Analytics
- State:
- Created 3 years ago
- Comments:6 (6 by maintainers)
Top Results From Across the Web
Performance Regression Testing - OctoPerf
How often should performance regression testing be run? What are the benefits of performance regression testing? The blog post answers all ...
Read more >What is Regression Testing? Definition, Tools, Method, and ...
Regression Testing is a Software Testing type in which test cases are re-executed in order to check whether the previous functionality of the ......
Read more >Regression Testing in Agile: Concepts, Challenges and ...
Regression testing in agile helps development teams concentrate on new functionality, while maintaining stability with every new product increment.
Read more >Regression Testing Guide: Definition, Strategies, and Mistakes
Regression testing consists of repeated testing of the existing features of any tool, application, or system as it receives new upgrades.
Read more >Solving the top 3 automated regression testing issues
The need for regression testing is continually increasing. Regression testing is essential to the quality performance of any and all software ...
Read more >
Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free
Top Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found
Great that you bring this up! I can add the GH issue integration for test failure in this PR 🥳
Does this PR also handle the case when a test completely fails? I know we already have a slack integration for it but do you plan to add the GH issue integration for it here itself or as a separate PR?