question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Incorrect test result view in Azure DevOps after upgrading MSTest to 2.2.4 and higher

See original GitHub issue

Description

After I updated MSTest.Framework and MSTest.Adapter to 2.2.4 and higher, the test results in Azure DevOps are displayed incorrectly. Each test interation is displayed in a new line. Before that, the interations were shown under a test case.

For example: A Test with 2 iterations

Before: TestCase12

  • Iteration1
  • Iteration2

Currently

  • TestCase12
  • TestCase12

This a screenshot for the test results on Azure DevOps For example: Test Case 1129 image


TRX-File look like different After the upgrade, the trx file does not contain an <InnerResults> element

Hier is a screenshot fom trx-file image


I use VS 2019 16.11.6 I’m not sure if this is a bug or a new configuration. This is my test configuration: Configure unit tests by using a .runsettings file

Issue Analytics

  • State:closed
  • Created 2 years ago
  • Reactions:2
  • Comments:69 (23 by maintainers)

github_iconTop GitHub Comments

4reactions
nohwndcommented, Mar 15, 2022

Duly noted. Believe me, I am not happy about this either. We are looking into conditionally reverting this change until it is fixed in azdo.

3reactions
nohwndcommented, Mar 12, 2022

This is not a bug, mstest now reports data driven tests as single tests. This was done to bring parity to how xunit and nunit does it.

@Haplois There are few duplicates of this issue. Could you link them all to a single one, and post an update on when the work on AzDO will be finished, please?

Also correct my statement above if I am wrong 😃

Read more comments on GitHub >

github_iconTop Results From Across the Web

Data driven tests are incompatible with Azure Test Plans ...
DuringExecution)] only the first iteration of the data driven tests is run. Environment. Azure DevOps MSTest.TestAdapter 2.2.4 and above. Sample ...
Read more >
Upgrading to MSTest.Framework 2.2.4 from 2.1.2 cant find ...
If I right click the project, it fails with the same message every time having not detected one of over 2000 tests. What...
Read more >
Test results are published correctly but not reflected in ...
1 Answer. We downgraded the MSTest package version to 2.2. 3 and now the Test results are shown correctly.
Read more >
Update to MSTestV2 - Visual Studio (Windows)
You can upgrade your test project by retargeting the MSTest version referenced in your .csproj from the MSTestV1 to MSTestV2.
Read more >
VSTest@2 - Visual Studio Test v2 task
Use this task to run unit and functional tests (Selenium, Appium, Coded UI test, etc.) using the Visual Studio Test (VSTest) runner.
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found