Test dicovery doesn't provide feedback on failure

I find quite often my tests “disappear” from the test window, or discovery appears to do nothing. This is almost always because I’ve introduced a syntax error in the package I’m testing which results in an import failure. The reason is clear in the Python Test Log, i.e. below I forgot to install a dependency culminating in discovery failing with exit code 2. If this should happen at the very least the test sidebar should provide some indication that test discovery exited abnormally - perhaps with a highlight on the “Show Test Output” icon since clicking on that is the first step in resolving the issue.

Test Discovery failed: 
Error: ============================= test session starts ==============================

<snip>

    import ahocorasick # pip install pyahocorasick
E   ModuleNotFoundError: No module named 'ahocorasick'
=========================== short test summary info ============================
ERROR tests/test_label_model.py
!!!!!!!!!!!!!!!!!!!! Interrupted: 1 error during collection !!!!!!!!!!!!!!!!!!!!
===================== 5 tests collected, 1 error in 2.00s ======================

Traceback (most recent call last):
  File "/home/david/.vscode/extensions/ms-python.python-2021.7.1060902895/pythonFiles/testing_tools/run_adapter.py", line 22, in <module>
    main(tool, cmd, subargs, toolargs)
  File "/home/david/.vscode/extensions/ms-python.python-2021.7.1060902895/pythonFiles/testing_tools/adapter/__main__.py", line 100, in main
    parents, result = run(toolargs, **subargs)
  File "/home/david/.vscode/extensions/ms-python.python-2021.7.1060902895/pythonFiles/testing_tools/adapter/pytest/_discovery.py", line 44, in discover
    raise Exception("pytest discovery failed (exit code {})".format(ec))
Exception: pytest discovery failed (exit code 2)

[karthiknadig]

Depends on the test framework, and type of error. On unittest, the test in that particular file with syntax error will be skipped. In pytest, currently syntax errors means it won’t be able to see any of the other tests. We have plans on making that part better when we update our integration with pytest.

[aholmes]

In pytest, currently syntax errors means it won’t be able to see any of the other tests.

Yeah this is a huge bummer w/ pytest.

We have plans on making that part better when we update our integration with pytest.

Great! Looking forward to it.