Configurable whether process should exit with non-zero exit code when tests failed?

We run tests on Jenkins using Karma and Grunt. Karma produces JUnit reports using the karma-junit-reporter, and we’ve configured Jenkins to set the build as unstable (yellow) if test failures are found in these report files.

The problem is that whenever a test fails, Karma (and Grunt) exits with a non-zero exit code and this makes the build failed (red).

I think the process still should fail in all those cases where the tests haven’t been completely executed, for example when a browser has been disconnected.

Is there any way to configure this today? If not, I’ll gladly provide a pull request.

[costincaraivan]

I’m kind of surprised that this is the case. Is no one using Karma with tools like Jenkins? 😦

[dougludlow]

Just to help any other googlers, the failOnFailingTestSuite option was added. Looks like maybe --no-fail-failing-test-suite could work from the command line?