question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

UCX tests broken after `distributed.utils_test.cleanup` import removed

See original GitHub issue

After #4888 which removed from distributed.utils_test import cleanup from files, the UCX test now fails as below:

________________________________________________________ ERROR at setup of test_large_cupy[1000000000] _________________________________________________________file /datasets/pentschev/miniconda3/envs/ucx-1.9-112-21.08.210608/lib/python3.8/site-packages/distributed/comm/tests/test_ucx.py, line 228
  @pytest.mark.slow
  @pytest.mark.asyncio
  @pytest.mark.parametrize("n", [int(1e9), int(2.5e9)])
  async def test_large_cupy(n, cleanup):
      cupy = pytest.importorskip("cupy")
      com, serv_com = await get_comm_pair()

      arr = cupy.ones(n, dtype="u1")                                                                                                                                  msg = {"op": "ping", "data": to_serialize(arr)}

      _, result = await asyncio.gather(com.write(msg), serv_com.read())                                                                                               data2 = result.pop("data")

      assert result["op"] == "ping"                                                                                                                                   assert len(data2) == len(arr)
      await com.close()
      await serv_com.close()                                                                                                                                    E       fixture 'cleanup' not found
>       available fixtures: cache, capfd, capfdbinary, caplog, capsys, capsysbinary, doctest_namespace, event_loop, monkeypatch, pytestconfig, record_property,
record_testsuite_property, record_xml_attribute, recwarn, tmp_path, tmp_path_factory, tmpdir, tmpdir_factory, unused_tcp_port, unused_tcp_port_factory          >       use 'pytest --fixtures [testpath]' for help on them.

/datasets/pentschev/miniconda3/envs/ucx-1.9-112-21.08.210608/lib/python3.8/site-packages/distributed/comm/tests/test_ucx.py:228

This is a file which isn’t tested by Distributed’s CI currently, which is supposedly the reason the error above wasn’t catched. However, it seems that https://github.com/dask/distributed/pull/4888/files#diff-a31c7ed5d35f5ed8233994868c54d625b18e6bacb6794344c4531e62bd9dde59R19-R20 should make the fixture available for all tests, I’m not sure though why that isn’t the case for that file in particular.

@fjetter do you happen to have any ideas how to resolve the above without adding the import back? I verified that if I add the import back it then works.

Issue Analytics

  • State:closed
  • Created 2 years ago
  • Comments:21 (21 by maintainers)

github_iconTop GitHub Comments

2reactions
jakirkhamcommented, Jun 23, 2021

Peter is currently OOTO. Let’s wait until he’s back

1reaction
pentschevcommented, Jul 22, 2021

Yup, all good from my side. Thanks @jakirkham and @jrbourbeau !

Read more comments on GitHub >

github_iconTop Results From Across the Web

Untitled
(philip.copeland@oracle.com) - liveinst was not built since ... policy - Resolves: Bug 1663829 - import task should not be deleted after import finishes...
Read more >
Untitled
README 389-ds-base-git.sh 389-ds-base-revert-db-home-fix.patch 389-ds-base.spec ... 0002-Remove-dependency-on-jna.patch 0003-Remove-Java-14-tests.patch ...
Read more >
mozilla-release: changeset 536054 ... - Mercurial
If a copy of the MPL was not distributed with this # file, You can obtain one at ... +++ b/devtools/client/debugger/src/utils/test-head.js @@ -10,16...
Read more >
Simple index - piwheels
... odoo14-addon-pattern-import-export-csv django-sites-groups cred-client bumbleview makemd test-code2001 siliqua demomath pymmaopt cinq-auditor-cloudtrail ...
Read more >
AllParam.txt · 小海/Pentest_Dic - Gitee.com
0 1 11 12 13 14 15 16 17 2 21 22 23 3 4 a A a1 a2 aa aaa aab aac...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found