Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Require configuration failiure tests?

See original GitHub issue

Some extensions have tests that check whether broken configurations are handled as expected (e.g. DefaultLocaleTests). Should all extensions do that? (E.g. DefaulTimeZoneTests, which doesn’t at the moment.)

Issue Analytics

State:
Created 4 years ago
Comments:6 (6 by maintainers)

Top GitHub Comments

1reaction

Bukamacommented, Jun 11, 2020

Does not check / do they need to?

DefaultTimeZoneExtension

TimeoutExtension

For the `DefaultTimeZoneExtension´ @Michael1993 has opened PR #272 .

The other is still up for grabs.

1reaction

Bukamacommented, Jun 6, 2020

If I have not overseen anything this should be the extensions which as of today (don’t) check if the configuration is correct:

Checks config:

RangeSourceArgumentsProvider
DefaultLocaleExtension
EnvironmentVariableExtension
IssueExtension
RepeatFailedTestExtension
ReportEntryExtension
StdIOExtension
SystemPropertyExtension
TempDirectoryExtension

Does not check / do they need to?

DefaultTimeZoneExtension
TimeoutExtension

@Michael1993 , @beatngu13 @NPException Did I oversee anything?

Top Results From Across the Web

How to generate a configuration failure in TestNG?

I'm trying to reproduce a particular case from my production environment. In which tests will be skipped after getting a Configuration failure.

Operations Center Troubleshooting Guide

These self tests check for common configuration problems and issue warnings or ... Section 2.3.2, Setting Tests to Halt Component Startup on Test...

What is Configuration Testing? Example Test Cases - Guru99

Configuration Testing is a software testing technique in which the software application is tested with multiple combinations of software and ...

testNG Configuration Failures, Policy, and alwaysRun

testNG Configuration Failures, Policy, and alwaysRun. This article describes the use of the testNG attribute configFailurePolicy and alwaysRun.

Testing Configuration Changes in Context to ... - USENIX

We present ctests, a new type of tests for detecting failure-inducing configuration changes to prevent production failures. The idea behind ctests is simple--- ......