question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Add semantics for "expected failures"

See original GitHub issue

Sometimes, esp. in TDD, it’s convenient to add a test that is expected to fail at first, but will be fixed to succeed (e.g. by adding an implementation in the application) later on. In contrast to config(enabled = false) these tests should be executed but be clearly marked (e.g. in yellow) in the output to document them as “TODOs”. The commit adding the implementation then typically also re-configures the test from an expected failure to a regular test that is expected to succeed.

Issue Analytics

  • State:open
  • Created 6 years ago
  • Reactions:2
  • Comments:32 (26 by maintainers)

github_iconTop GitHub Comments

2reactions
sksamuelcommented, Jun 16, 2022

pending = true could easily:

  • imply a tag (if we want to do that?)
  • add PENDING to output (and in Kotest 6 be highlighted properly)
  • invert the result
1reaction
sksamuelcommented, Jun 16, 2022

That makes sense:

test("foo").config(pending = true) { 
 //
}

And this is inverted - if it passes it fails and vice versa.

Read more comments on GitHub >

github_iconTop Results From Across the Web

Add semantics for "expected failures" · Issue #3061 · kotest/kotest ...
in TDD, it's convenient to add a test that is expected to fail at first, but will be fixed to succeed (e.g. by...
Read more >
Embrace Expected Failures in XCTest - WWDC21 - Videos
Testing is a crucial part of building a great app: Great tests can help you track down important issues before release, improve your......
Read more >
RFC: Add check for warnings in test/Semantics/test_errors.py - Flang ...
Hello! A majority of the tests in Semantics uses test_errors.py, which asserts that the errors emitted by flang are the same as those...
Read more >
The Silent Semantic Failures That Break Distributed Systems
This week, we look at the silent semantic errors that can hamper your distributed systems. We also look at Golang's new memory model, ......
Read more >
Failure Trace Semantics for a Process Algebra with Time-outs
testing scenario, an environment can see their difference, one would expect, analogously to the situation with failures semantics, ...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found