Allure Report: Wrong default order of TestNG DataProvider cases
See original GitHub issueI’m submitting a …
- bug report
- feature request
- support request => Please do not submit support request here, see note at the top of this template.
What is the current behavior?
Wrong case order in allure-report.
Steps to reproduce:
- Create any TestNG test class with @DataProvider and @Test methods. E.g.:
public class DataProviderTest {
@DataProvider
public Object[][] args() {
return new String[][]{{"One"},{"Two"},{"Three"},{"Four"},{"Five"}};
}
@Test(dataProvider = "args")
public void test(String arg) {
System.out.println(arg);
}
}
- Run tests with Allure 2 enabled.
- Generate Alllure 2 report.
- Open report and look at cases default order (for parameters): Five, One, Three, Two, Four.
What is the expected behavior?
Cases order should correspond to run order: One, Two, Three, Four, Five.
What is the motivation / use case for changing the behavior?
Our Allure report should show cases in the order as they run.
Please tell us about your environment:
Allure version | 2.x |
---|---|
Test framework | testng@6.10 |
Allure adaptor | allure-testng@2.0-BETA21 |
Generate report using | allure-maven@2.9 |
Report version | 2.0.1 |
Issue Analytics
- State:
- Created 6 years ago
- Reactions:1
- Comments:8 (6 by maintainers)
Top Results From Across the Web
java - Allure TestNG: Custom test method names while using ...
I have tests that are using @DataProvider. My test implements ITest to change the test method instance name during runtime. When I run...
Read more >Allure Report Selenium and TestNG Tutorial
Allure Report Selenium and TestNG integration will be explained in all details. Allure is a test reporting framework from Yandex Team.
Read more >Preserver Order in Testng - Selenium Easy
In TestNg bydefault the preserve-order attribute will be set to 'true', this means, TestNG will run your tests in the order they are...
Read more >Removing Parameters in Allure Reports | by Rommel Malqued
Parameters passed as arguments on testNG test method. So I've been working on this project and I needed to data drive my tests...
Read more >TestNG Report Generation in Selenium WebDriver - H2k Infosys
Allure serve C:\Users\admin\eclipse-workspace\AllureReporting\allure-results. It will automatically generate the Allure Reports. Facebook ...
Read more >
Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free
Top Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found
Is there a way to set the default order by attribute? Say I would like to always have them ordered by the Order field
The order number is not in order because you use ordering by name. Use ordering by number by clicking “order”.