Incorrect test result view in Azure DevOps after upgrading MSTest to 2.2.4 and higher
See original GitHub issueDescription
After I updated MSTest.Framework and MSTest.Adapter to 2.2.4 and higher, the test results in Azure DevOps are displayed incorrectly. Each test interation is displayed in a new line. Before that, the interations were shown under a test case.
For example: A Test with 2 iterations
Before: TestCase12
- Iteration1
- Iteration2
Currently
- TestCase12
- TestCase12
This a screenshot for the test results on Azure DevOps For example: Test Case 1129
TRX-File look like different
After the upgrade, the trx file does not contain an <InnerResults>
element
Hier is a screenshot fom trx-file
I use VS 2019 16.11.6 I’m not sure if this is a bug or a new configuration. This is my test configuration: Configure unit tests by using a .runsettings file
Issue Analytics
- State:
- Created 2 years ago
- Reactions:2
- Comments:69 (23 by maintainers)
Top Results From Across the Web
Data driven tests are incompatible with Azure Test Plans ...
DuringExecution)] only the first iteration of the data driven tests is run. Environment. Azure DevOps MSTest.TestAdapter 2.2.4 and above. Sample ...
Read more >Upgrading to MSTest.Framework 2.2.4 from 2.1.2 cant find ...
If I right click the project, it fails with the same message every time having not detected one of over 2000 tests. What...
Read more >Test results are published correctly but not reflected in ...
1 Answer. We downgraded the MSTest package version to 2.2. 3 and now the Test results are shown correctly.
Read more >Update to MSTestV2 - Visual Studio (Windows)
You can upgrade your test project by retargeting the MSTest version referenced in your .csproj from the MSTestV1 to MSTestV2.
Read more >VSTest@2 - Visual Studio Test v2 task
Use this task to run unit and functional tests (Selenium, Appium, Coded UI test, etc.) using the Visual Studio Test (VSTest) runner.
Read more >Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start FreeTop Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found
Top GitHub Comments
Duly noted. Believe me, I am not happy about this either. We are looking into conditionally reverting this change until it is fixed in azdo.
This is not a bug, mstest now reports data driven tests as single tests. This was done to bring parity to how xunit and nunit does it.
@Haplois There are few duplicates of this issue. Could you link them all to a single one, and post an update on when the work on AzDO will be finished, please?
Also correct my statement above if I am wrong 😃