Multiple testNG tests run by @Factory are marked as "retries" instead of being separate

I’m submitting a …

• bug report
• feature request
• support request => Please do not submit support request here, see note at the top of this template.

What is the current behavior?

When running tests with TestNG @Factory annotation, multiple runs are considered as “retries” instead of appearing as separate test runs.

If the current behavior is a bug, please provide the steps to reproduce and if possible a minimal

Run the following class:

import io.qameta.allure.Step;
import org.testng.Assert;
import org.testng.annotations.Factory;
import org.testng.annotations.Test;

public class TestPoc {
    int i = 1;

    public TestPoc() {

    }

    public TestPoc(int i) {
        this.i = i;
    }

    @Test
    public void stepFailDemo() {
        try {
            failStep();
        } catch (AssertionError e) {/*do nothing*/
        }
    }

    @Step("Failing step")
    private void failStep() {
        Assert.fail("Failing an inner step  " + i);
    }

    @Factory
    public Object[] myFactory() {
        return new Object[]{new TestPoc(5), new TestPoc(6),new TestPoc(7)};
    }
}

What is the expected behavior?

Expected behaviour - Tests should show as separate entities.

What is the motivation / use case for changing the behavior?

Current behaviour is a bug - This is running a data driven test for 3 separate test cases (different parameters for test method)

Please tell us about your environment:

Allure version	2.2.0
Test framework	testng@6.11
Allure integration	allure-testng@2.0-BETA16
Generate report using	allure-maven@2.8
Report version	2.3.3

Other information

allure-results.zip

[nitintsocial]

Kindly provide workaround for the same to show tests instead of retries in allure report.

[baev]

I just added brand new TestInstanceParameter annotation that can be used to add parameters from test instance:

import io.qameta.allure.Step;
import org.testng.Assert;
import org.testng.annotations.Factory;
import org.testng.annotations.Test;

public class TestPoc {
    @TestInstanceParameter("Interation") // will add a parameter with name Interation to each test result
    int i = 1;

    public TestPoc() {

    }

    public TestPoc(int i) {
        this.i = i;
    }

    @Test
    public void stepFailDemo() {
        try {
            failStep();
        } catch (AssertionError e) {/*do nothing*/
        }
    }

    @Step("Failing step")
    private void failStep() {
        Assert.fail("Failing an inner step  " + i);
    }

    @Factory
    public Object[] myFactory() {
        return new Object[]{new TestPoc(5), new TestPoc(6),new TestPoc(7)};
    }
}