Revisit xpassed tests and remove xfail from them
See original GitHub issueFor example, there are 3 xpassed
tests in https://travis-ci.org/astropy/astropy/jobs/283303458 and https://ci.appveyor.com/project/Astropy/astropy/build/1.0.8822 , respectively (probably the same ones). We should remove xfail
from those because they are no longer failing.
astropy\table\tests\test_mixin.py .....................................sss.s.s...................................................X.............
astropy\table\tests\test_operations.py .......x...x.x.x...........x.....x.......................x...xXX.x.........................x.............
Hint: Using this setting turns any xpass
into a failure (ref: https://docs.pytest.org/en/latest/skipping.html).
[tool:pytest]
xfail_strict=true
Issue Analytics
- State:
- Created 6 years ago
- Comments:7 (7 by maintainers)
Top Results From Across the Web
How to use skip and xfail to deal with tests that cannot succeed
Skipping test functions¶. The simplest way to skip a test function is to mark it with the skip decorator which may be passed...
Read more >How and why I use pytest's xfail - Paul Ganssle
They can be used as a sentinel for when unrelated behavior changes fix known bugs — and they give you regression tests for...
Read more >New feature: Present xfailed and xpassed in report-portal plugin
When you mark your test with the "xfail" marker, it means the results of that test will not impact the whole execution results...
Read more >Pytest - Xfail/Skip Tests - Tutorialspoint
Pytest - Xfail/Skip Tests, In this chapter, we will learn about the Skip and Xfail ... Later, when the test becomes relevant we...
Read more >In py.test, when I explicitly skip a test that is marked as xfail ...
It seems like I am asking, "How can I remove the xfail marking form this test in my pytest_runtest_setup() hook?" Thanks. python ·...
Read more >
Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free
Top Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found
Closing, since the passing tests are now all enabled! (And crossing fingers that they continue to pass…)
So the 2 xpassing one is due to the heisenbug in operations: https://github.com/astropy/astropy/issues/6291 It’s great that it’s passing, but we need to make sure it’s indeed gone for good.
In there, it’s suggested (https://github.com/astropy/astropy/issues/6291#issuecomment-312958701) that running the test as
pytest astropy/table/tests/test_operations.py --pdb -sv -k test_col_meta_merge_inner
always makes it fail, but it’s still xpasses for me now on master, but also on 2.0…