ITestListener/onTestFailure Not doing anything

TestNG Version

7.5

Expected behavior

ITestListener picks up failed tests and performs a screenshot. Previously worked on 7.4.0

Actual behavior

Test not being detected as failed, so inside methods not being ran.

Is the issue reproducible on runner?

• Shell
• Maven
• Gradle
• Ant
• Eclipse
• IntelliJ
• NetBeans

Test case sample

This code previous to 7.5 would run and perform the methods within. When I update to 7.5 the listener doesn’t seem to pick up the tests even though the listener is stated on every class. Has something changed?

Test classes are using Annotation @Listeners({TestListener.class})

package TestListeners;
import org.testng.ITestListener;
import org.testng.ITestResult;

public class TestListener1 implements ITestListener {

    @Override
    public void onTestFailure(ITestResult iTestResult){
        System.out.println("Test has failed");
    }

}

Test

package TestListeners;

import org.testng.annotations.Listeners;
import org.testng.annotations.Test;

@Listeners({TestListener1.class})
public class SimpleTestFailure {

    @Test
    public void sampleTest() {
        throw new AssertionError("force fail");
    }

}

Output:

java.lang.AssertionError: force fail

[krmahadevan]

@garyc0221 i can try taking a jab at it since I am a selenium literate.

Can you please create a sample project and attach it here which uses all the dependencies that your actual project has and which has a failing test along with a failure listener that takes screenshots?

Keep it as close to your actual project as possible so that we are looking at a replica of your actual project.

[garyc0221]

@garyc0221 - Then I think you would need to take this up with Allure. So we can perhaps go ahead and close this out ?

Yes can close this issue