When debugging pytest tests, extension displays "Ok" in the problems window

Environment data

• VS Code version: GH Codespaces
• Extension version (available under the Extensions sidebar): 2020.11.371526539
• Python version (& distribution if applicable, e.g. Anaconda): 3.9.0
• Type of virtual environment used (N/A | venv | virtualenv | conda | …): None
• Relevant/affected Python packages and their versions: pytest==6.1.2
• Relevant/affected Python-related VS Code extensions and their versions: Pylance 2020.11.2
• Value of the python.languageServer setting Pylance

[NOTE: If you suspect that your issue is related to the Microsoft Python Language Server (python.languageServer: 'Microsoft'), please download our new language server Pylance from the VS Code marketplace to see if that fixes your issue]

Actual behaviour

When starting to debug a test with pytest, this is the message displayed by pytest:

Steps to reproduce:

[NOTE: Self-contained, minimal reproducing code samples are extremely helpful and will expedite addressing your issue]

1. Start a GH Codespace for https://github.com/microsoft/python-sample-tweeterapp, make sure to use the fixwarnings branch.
2. Run python manage.py migrate and python manage.py loaddata initial_data in the terminal
3. Configure tests by running the “Python: Configure Tests” command. Select “pytest” and then “tweeter”.
4. Open the test viewer and debug a test.

Logs

Output for Python in the Output panel (View→Output, change the drop-down the upper-right of the Output panel to Python)

User belongs to experiment group 'ShowPlayIcon - start'
User belongs to experiment group 'ShowExtensionSurveyPrompt - control'
User belongs to experiment group 'DebugAdapterFactory - experiment'
User belongs to experiment group 'PtvsdWheels37 - experiment'
User belongs to experiment group 'UseTerminalToGetActivatedEnvVars - control'
User belongs to experiment group 'LocalZMQKernel - experiment'
User belongs to experiment group 'CollectLSRequestTiming - control'
User belongs to experiment group 'CollectNodeLSRequestTiming - experiment'
User belongs to experiment group 'EnableIPyWidgets - experiment'
User belongs to experiment group 'RunByLine - experiment'
User belongs to experiment group 'CustomEditorSupport - control'
> conda --version
> conda info --json
> pyenv root
> python3.7 ~/.vscode-remote/extensions/ms-python.python-2020.11.371526539/pythonFiles/pyvsc-run-isolated.py -c "import sys;print(sys.executable)"
> python3.6 ~/.vscode-remote/extensions/ms-python.python-2020.11.371526539/pythonFiles/pyvsc-run-isolated.py -c "import sys;print(sys.executable)"
> python3 ~/.vscode-remote/extensions/ms-python.python-2020.11.371526539/pythonFiles/pyvsc-run-isolated.py -c "import sys;print(sys.executable)"
> python2 ~/.vscode-remote/extensions/ms-python.python-2020.11.371526539/pythonFiles/pyvsc-run-isolated.py -c "import sys;print(sys.executable)"
> python ~/.vscode-remote/extensions/ms-python.python-2020.11.371526539/pythonFiles/pyvsc-run-isolated.py -c "import sys;print(sys.executable)"
> /usr/local/bin/python ~/.vscode-remote/extensions/ms-python.python-2020.11.371526539/pythonFiles/pyvsc-run-isolated.py -c "import sys;print(sys.executable)"
Error 2020-12-02 08:59:46: Failed to check if file needs to be fixed EntryNotFound (FileSystemError): Unable to read file 'vscode-remote://vsonline+f206027f-0efb-4a62-b3ad-cdca607daff2/root/.config/Code - Insiders/User/settings.json' (EntryNotFound (FileSystemError): Error: ENOENT: no such file or directory, open '/root/.config/Code - Insiders/User/settings.json')
    at _handleError (/root/.vscode-remote/bin/bf21395291146c014220eb70b54fdfc0a15956b5/out/vs/server/remoteExtensionHostProcess.js:765:473)
    at processTicksAndRejections (internal/process/task_queues.js:94:5)
    at y.readText (/root/.vscode-remote/extensions/ms-python.python-2020.11.371526539/out/client/extension.js:9:152841)
    at p.doesFileNeedToBeFixed (/root/.vscode-remote/extensions/ms-python.python-2020.11.371526539/out/client/extension.js:39:469606)
    at /root/.vscode-remote/extensions/ms-python.python-2020.11.371526539/out/client/extension.js:39:468733
    at async Promise.all (index 0)
    at p.getFilesToBeFixed (/root/.vscode-remote/extensions/ms-python.python-2020.11.371526539/out/client/extension.js:39:468679)
    at p.updateTestSettings (/root/.vscode-remote/extensions/ms-python.python-2020.11.371526539/out/client/extension.js:39:468306) {
  code: 'FileNotFound',
  name: 'EntryNotFound (FileSystemError)'
}
Error 2020-12-02 08:59:46: Failed to check if file needs to be fixed EntryNotFound (FileSystemError): Unable to read file 'vscode-remote://vsonline+f206027f-0efb-4a62-b3ad-cdca607daff2/root/workspace/python-sample-tweeterapp/.vscode/settings.json' (EntryNotFound (FileSystemError): Error: ENOENT: no such file or directory, open '/root/workspace/python-sample-tweeterapp/.vscode/settings.json')
    at _handleError (/root/.vscode-remote/bin/bf21395291146c014220eb70b54fdfc0a15956b5/out/vs/server/remoteExtensionHostProcess.js:765:473)
    at processTicksAndRejections (internal/process/task_queues.js:94:5)
    at y.readText (/root/.vscode-remote/extensions/ms-python.python-2020.11.371526539/out/client/extension.js:9:152841)
    at p.doesFileNeedToBeFixed (/root/.vscode-remote/extensions/ms-python.python-2020.11.371526539/out/client/extension.js:39:469606)
    at /root/.vscode-remote/extensions/ms-python.python-2020.11.371526539/out/client/extension.js:39:468733
    at async Promise.all (index 1)
    at p.getFilesToBeFixed (/root/.vscode-remote/extensions/ms-python.python-2020.11.371526539/out/client/extension.js:39:468679)
    at p.updateTestSettings (/root/.vscode-remote/extensions/ms-python.python-2020.11.371526539/out/client/extension.js:39:468306) {
  code: 'FileNotFound',
  name: 'EntryNotFound (FileSystemError)'
}
> pyenv root
> pyenv root
> pyenv root
> pyenv root
Starting Pylance language server.
Python interpreter path: /usr/local/bin/python
> conda --version
> /usr/local/bin/python ~/.vscode-remote/extensions/ms-python.python-2020.11.371526539/pythonFiles/pyvsc-run-isolated.py -c "import pytest"
> /usr/local/bin/python ~/.vscode-remote/extensions/ms-python.python-2020.11.371526539/pythonFiles/pyvsc-run-isolated.py -c "import pytest"
> conda info --json
> conda --version
> /usr/local/bin/python ~/.vscode-remote/extensions/ms-python.python-2020.11.371526539/pythonFiles/pyvsc-run-isolated.py -c "import pip"
> /usr/local/bin/python ~/.vscode-remote/extensions/ms-python.python-2020.11.371526539/pythonFiles/pyvsc-run-isolated.py -c "import pip"
> /usr/local/bin/python ~/.vscode-remote/extensions/ms-python.python-2020.11.371526539/pythonFiles/pyvsc-run-isolated.py -c "import pytest"
> /usr/local/bin/python ~/.vscode-remote/extensions/ms-python.python-2020.11.371526539/pythonFiles/pyvsc-run-isolated.py -c "import pytest"
> /usr/local/bin/python ~/.vscode-remote/extensions/ms-python.python-2020.11.371526539/pythonFiles/testing_tools/run_adapter.py discover pytest -- --rootdir ~/workspace/python-sample-tweeterapp -s --cache-clear tweeter
cwd: ~/workspace/python-sample-tweeterapp
> /usr/local/bin/python ~/.vscode-remote/extensions/ms-python.python-2020.11.371526539/pythonFiles/testing_tools/run_adapter.py discover pytest -- --rootdir ~/workspace/python-sample-tweeterapp -s --cache-clear tweeter
cwd: ~/workspace/python-sample-tweeterapp
> /usr/local/bin/python ~/.vscode-remote/extensions/ms-python.python-2020.11.371526539/pythonFiles/pyvsc-run-isolated.py pytest --override-ini junit_family=xunit1 --rootdir ~/workspace/python-sample-tweeterapp --junit-xml=/tmp/tmp-1438SSgpcI5MgcV.xml tweeter
cwd: ~/workspace/python-sample-tweeterapp
> /usr/local/bin/python ~/.vscode-remote/extensions/ms-python.python-2020.11.371526539/pythonFiles/pyvsc-run-isolated.py pytest --override-ini junit_family=xunit1 --rootdir ~/workspace/python-sample-tweeterapp --junit-xml=/tmp/tmp-1438SSgpcI5MgcV.xml tweeter
cwd: ~/workspace/python-sample-tweeterapp
> /usr/local/bin/python ~/.vscode-remote/extensions/ms-python.python-2020.11.371526539/pythonFiles/pyvsc-run-isolated.py pytest --override-ini junit_family=xunit1 --rootdir ~/workspace/python-sample-tweeterapp --junit-xml=/tmp/tmp-1431NjahWwWZk07.xml ./tweeter/tests.py::TestTweets::test_tweet_creation
cwd: ~/workspace/python-sample-tweeterapp
> /usr/local/bin/python ~/.vscode-remote/extensions/ms-python.python-2020.11.371526539/pythonFiles/pyvsc-run-isolated.py pytest --override-ini junit_family=xunit1 --rootdir ~/workspace/python-sample-tweeterapp --junit-xml=/tmp/tmp-1431NjahWwWZk07.xml ./tweeter/tests.py::TestTweets::test_tweet_creation
cwd: ~/workspace/python-sample-tweeterapp

Output for Python Test Log in the Output panel (View→Output, change the drop-down the upper-right of the Output panel to Python)

python /root/.vscode-remote/extensions/ms-python.python-2020.11.371526539/pythonFiles/testing_tools/run_adapter.py discover pytest -- --rootdir /root/workspace/python-sample-tweeterapp -s --cache-clear tweeter
============================= test session starts ==============================
platform linux -- Python 3.9.0, pytest-6.1.2, py-1.9.0, pluggy-0.13.1
rootdir: /root/workspace/python-sample-tweeterapp, configfile: pytest.ini
collected 3 items

tweeter/tests.py ...                                                     [100%]

--------------- generated xml file: /tmp/tmp-1438SSgpcI5MgcV.xml ---------------
============================== 3 passed in 0.26s ===============================
============================= test session starts ==============================
platform linux -- Python 3.9.0, pytest-6.1.2, py-1.9.0, pluggy-0.13.1
rootdir: /root/workspace/python-sample-tweeterapp, configfile: pytest.ini
collected 1 item

tweeter/tests.py .                                                       [100%]

--------------- generated xml file: /tmp/tmp-1431NjahWwWZk07.xml ---------------
============================== 1 passed in 0.22s ===============================

[ericsnowcurrently]

That’s part of the fix we are working on. Up to now we were simply ignoring the results.

[luabud]

@ericsnowcurrently actually no, I’m able to reproduce it locally too!