question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Revisit xpassed tests and remove xfail from them

See original GitHub issue

For example, there are 3 xpassed tests in https://travis-ci.org/astropy/astropy/jobs/283303458 and https://ci.appveyor.com/project/Astropy/astropy/build/1.0.8822 , respectively (probably the same ones). We should remove xfail from those because they are no longer failing.

astropy\table\tests\test_mixin.py .....................................sss.s.s...................................................X.............
astropy\table\tests\test_operations.py .......x...x.x.x...........x.....x.......................x...xXX.x.........................x.............

Hint: Using this setting turns any xpass into a failure (ref: https://docs.pytest.org/en/latest/skipping.html).

[tool:pytest]
xfail_strict=true

Issue Analytics

  • State:closed
  • Created 6 years ago
  • Comments:7 (7 by maintainers)

github_iconTop GitHub Comments

2reactions
mhvkcommented, Oct 13, 2017

Closing, since the passing tests are now all enabled! (And crossing fingers that they continue to pass…)

1reaction
bsipoczcommented, Oct 12, 2017

So the 2 xpassing one is due to the heisenbug in operations: https://github.com/astropy/astropy/issues/6291 It’s great that it’s passing, but we need to make sure it’s indeed gone for good.

In there, it’s suggested (https://github.com/astropy/astropy/issues/6291#issuecomment-312958701) that running the test as pytest astropy/table/tests/test_operations.py --pdb -sv -k test_col_meta_merge_inner always makes it fail, but it’s still xpasses for me now on master, but also on 2.0…

Read more comments on GitHub >

github_iconTop Results From Across the Web

How to use skip and xfail to deal with tests that cannot succeed
Skipping test functions¶. The simplest way to skip a test function is to mark it with the skip decorator which may be passed...
Read more >
How and why I use pytest's xfail - Paul Ganssle
They can be used as a sentinel for when unrelated behavior changes fix known bugs — and they give you regression tests for...
Read more >
New feature: Present xfailed and xpassed in report-portal plugin
When you mark your test with the "xfail" marker, it means the results of that test will not impact the whole execution results...
Read more >
Pytest - Xfail/Skip Tests - Tutorialspoint
Pytest - Xfail/Skip Tests, In this chapter, we will learn about the Skip and Xfail ... Later, when the test becomes relevant we...
Read more >
In py.test, when I explicitly skip a test that is marked as xfail ...
It seems like I am asking, "How can I remove the xfail marking form this test in my pytest_runtest_setup() hook?" Thanks. python ·...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found