Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Report all experiment validation errors at once

See original GitHub issue

Currently, when a chaos validate command is run, it shows the first error and exits. This is a process to repeat when fixing each error, when using an experiment that contains multiple syntax issues.

It could be nice to do a full validation of the file and outputs all errors at once. It can either be default behavior or behavior to be activated with a CLI flag (--full-validation, --global, …)

The following experiment contains multiple errors:

    "version": "1.0.0",
    "title": "Invalid syntax experiment",
    "description": "This experiment contains multiple synatx errors to be raised at validation step",
    "tags": [
    "steady-state-hypothesis": {
    "method": [
        {"type": "invalid"}
    "rollbacks": [{"type":"invalid"}]

Issue Analytics

  • State:closed
  • Created 4 years ago
  • Reactions:1
  • Comments:14 (7 by maintainers)

github_iconTop GitHub Comments

Lawouachcommented, Nov 14, 2019

Hi all,

Good feature request. I don’t think we need a new flag, this should become the default behavior and not impact compatibility.

However, there is a lot of workto change the code internally I’m afraid. This will take some work.

nstjeljacommented, Nov 22, 2019

@dmartin35 i think i would suggest going through option 1. The only risk/issue/ problem i see is that the original function was written with the flow being interrupted by the exception being raised so it would require us to write code in amore defensive manner.

Read more comments on GitHub >

github_iconTop Results From Across the Web

FEC | Reporting | Validation errors explained
Explanations for error messages returned when using the validator for electronic filings with the Federal Election Commission.
Read more >
Validation-Errors-Warnings - Research and Development
NOTE: When Data Validation is ON, the system is constantly validating, which makes response time slow. Keep Data Validation OFF while entering your...
Read more >
EDGAR XBRL Validation Errors
Message ID Message Subsection cp‑0501‑File‑Name‑Length Document file name must not exceed 32 characters. 5.1.1 cp‑0501‑File‑Character Disallowed character '' in file at line col cp‑0502‑File‑Entity‑Code Disallowed...
Read more >
How to Report Errors in Forms: 10 Design Guidelines
Help users recover from errors by clearly identifying the problems and allowing users to access and correct erroneous fields easily.
Read more >
Guidance for the Validation of Analytical Methodology and ...
The UNODC Laboratory and Scientific Section provides support to laboratories in introducing and implementing a quality management system through a number of.
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Post

No results found

github_iconTop Related Hashnode Post

No results found