question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

[TestNG] Make "Display disabled tests in report" configurable

See original GitHub issue

I’m submitting a …

  • bug report
  • feature request
  • support request => Please do not submit support request here, see note at the top of this template.

What is the current behavior?

Disabled tests (@Test(enabled = false)) appear as unknown in the report.

https://github.com/allure-framework/allure-java/pull/275

What is the expected behavior?

Make it configurable so there would be an option to allow disabled tests to appear in report or not.

What is the motivation / use case for changing the behavior?

We have a test suite which supports the same application with different features in multiple countries. Some countries do not have features that other countries have thus we’re using Annotation Transformer to disable those tests for those countries.

It would be nice to not see those disabled tests in the report as they clutter the report and create a distraction.

Please tell us about your environment:

Allure version 2.8
Test framework testng@6.14.3
Allure integration -
Generate report using allure-gradle@2.5

We are not updating to the newest versions because of that behavior and we would love to avoid forking and changing this behavior in forked Allure projects.

Issue Analytics

  • State:closed
  • Created 4 years ago
  • Comments:16 (6 by maintainers)

github_iconTop GitHub Comments

7reactions
Dilshat517commented, Jan 4, 2022

is this issue still open? no solutions yet?

1reaction
baevcommented, Sep 27, 2022

@baev by any chance, do we have similar configurable implementation in place to be used as an example to speed-up things?

not sure. Simply add desired field to AllureTestNG, create a AllureTestNgConfig POJO with the same field, add a constructor to AllureTestNG that accepts AllureTestNgConfig, update default constructor so it load allure properties and init AllureTestNgConfig from property values and passes config to other constructor. That’s should be it. And don’t forget a test for that

Read more comments on GitHub >

github_iconTop Results From Across the Web

Allure reports showing the testng tests that are not run as ...
And yeah, Allure show all tests, including configuration methods and disabled tests, you can fix it in your custom adaptor.
Read more >
Documentation - TestNG
TestNG is a testing framework designed to simplify a broad range of testing needs, from unit testing (testing a class in isolation of...
Read more >
IntelliJ IDEA - Run/Debug Configuration: TestNG - JetBrains
The TestNG run/debug configuration is used to launch the tests that comply with the TestNG framework. The dialog consists of the following tabs:....
Read more >
Maven Surefire Plugin – Using TestNG
Another alternative is to use TestNG suite XML files. This allows flexible configuration of the tests to be run. These files are created...
Read more >
Allure Framework
You could disable such a test, that is a trivial solution. However what if you do not want to do that? Say you...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found