question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Add option to output checks skipped from baseline

See original GitHub issue

Is your feature request related to a problem? Please describe. Yes. We’ve inherited a terraform repo with a lot of legacy problems. We’ve introduced checkov to ensure new config going forward meets our standards. We’ve also generated baseline files for all of the existing legacy terraform config, so that we only fail checks for new problems. However, we’d like to keep visibility on all of the baseline/legacy config that we’re skipping. In particular, with junitxml output, we’d like to see the checks that are being skipped due to the baseline. So we’d effectively be treating all of the legacy config as skipped tests with visibility on those as we update/fix them.

Describe the solution you’d like Add the ability to explicitly output baseline-skipped checks as baseline-skipped. For junitxml output formatting, render these as skipped tests.

Describe alternatives you’ve considered We’ve considered running checkov twice. Once with the --baseline flag and once without, and then comparing the output junitxml files. Failures unique to the run without the --baseline flag would basically be those skipped checks, so we could post-process the result XML and display those as skipped tests. However, this is pretty ugly.

Issue Analytics

  • State:closed
  • Created 2 years ago
  • Comments:5 (1 by maintainers)

github_iconTop GitHub Comments

1reaction
oliver-phamcommented, Nov 1, 2021

@chtnnh you can go ahead 🚀

0reactions
chtnnhcommented, Oct 29, 2021

@nimrodkor I could give this a shot, if @oliver-pham isn’t already working on this

Read more comments on GitHub >

github_iconTop Results From Across the Web

[analyse] Add option --remove-ignored-errors-from-baseline
Feature request I'm using PHPStan on big monolith that is very old. Our baseline contains 39.276 lines at the moment.
Read more >
CLI Command Reference - checkov
--add-check, Generate a new check via CLI prompt ... --output-baseline-as-skipped, Output checks that are skipped due to baseline file presence.
Read more >
Monitor security baselines and profiles in Microsoft Intune
Check the error, conflict, and success status when deploying security baselines to users and devices in Microsoft Intune MDM.
Read more >
Upgrading vCenter Server 7.0 fails during precheck with "Host ...
In vSphere Lifecycle Manager, use Baseline Group upgrade method to create and combine the baselines as described below: Create baseline say “ ...
Read more >
Baseline configuration - Documentation for BMC Discovery ...
Appliance Baseline is a set of conditions that are verified to get a health check of an appliance and decide whether it is...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found