Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

[BUG] CI Broken with the latest distributed release `2021.10.0`

See original GitHub issue

[BUG] CI Broken with distributed `2021.10.0`

Minimal Complete Verifiable Example:

Create Environment

conda env create -f ci/environment-latest.yaml --name=dask-ml-dev

Run Tests:

pytest .

=================================================================================================================== ERRORS ===================================================================================================================
__________________________________________________________________________________________ ERROR collecting tests/model_selection/test_hyperband.py __________________________________________________________________________________________
tests/model_selection/test_hyperband.py:163: in <module>
    def test_hyperband_patience(c, s, a, b):
/datasets/vjawa/miniconda3/envs/dask-ml-dev-oct-16/lib/python3.8/site-packages/distributed/utils_test.py:922: in _
    raise RuntimeError("gen_cluster only works for coroutine functions.")
E   RuntimeError: gen_cluster only works for coroutine functions.
_________________________________________________________________________________________ ERROR collecting tests/model_selection/test_incremental.py _________________________________________________________________________________________
tests/model_selection/test_incremental.py:338: in <module>
    def test_search_plateau_patience(c, s, a, b):
/datasets/vjawa/miniconda3/envs/dask-ml-dev-oct-16/lib/python3.8/site-packages/distributed/utils_test.py:922: in _
    raise RuntimeError("gen_cluster only works for coroutine functions.")
E   RuntimeError: gen_cluster only works for coroutine functions.
______________________________________________________________________________________ ERROR collecting tests/model_selection/test_incremental_warns.py ______________________________________________________________________________________
tests/model_selection/test_incremental_warns.py:11: in <module>
    def test_warns_decay_rate(c, s, a, b):
/datasets/vjawa/miniconda3/envs/dask-ml-dev-oct-16/lib/python3.8/site-packages/distributed/utils_test.py:922: in _
    raise RuntimeError("gen_cluster only works for coroutine functions.")
E   RuntimeError: gen_cluster only works for coroutine functions.
____________________________________________________________________________________________ ERROR collecting tests/model_selection/test_keras.py ____________________________________________________________________________________________
tests/model_selection/test_keras.py:47: in <module>
    def test_keras(c, s, a, b):
/datasets/vjawa/miniconda3/envs/dask-ml-dev-oct-16/lib/python3.8/site-packages/distributed/utils_test.py:922: in _
    raise RuntimeError("gen_cluster only works for coroutine functions.")
E   RuntimeError: gen_cluster only works for coroutine functions.
___________________________________________________________________________________________ ERROR collecting tests/model_selection/test_pytorch.py ___________________________________________________________________________________________
tests/model_selection/test_pytorch.py:29: in <module>
    def test_pytorch(c, s, a, b):
/datasets/vjawa/miniconda3/envs/dask-ml-dev-oct-16/lib/python3.8/site-packages/distributed/utils_test.py:922: in _
    raise RuntimeError("gen_cluster only works for coroutine functions.")
E   RuntimeError: gen_cluster only works for coroutine functions.
_____________________________________________________________________________________ ERROR collecting tests/model_selection/test_successive_halving.py ______________________________________________________________________________________
tests/model_selection/test_successive_halving.py:15: in <module>
    def test_basic_successive_halving(c, s, a, b):
/datasets/vjawa/miniconda3/envs/dask-ml-dev-oct-16/lib/python3.8/site-packages/distributed/utils_test.py:922: in _
    raise RuntimeError("gen_cluster only works for coroutine functions.")
E   RuntimeError: gen_cluster only works for coroutine functions.
!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! Interrupted: 6 errors during collection !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
============================================================================================================= 6 errors in 1.04s ==============================================================================================================

What happened:

The above pytests seem to be failing with the latest distributed release. Above works with distributed/dask=2021.9.1 .

Environment:

Dask version: 2021.10.0
Python version: 3.8.12
Operating System: linux
Install method (conda, pip, source): conda

Issue Analytics

State:
Created 2 years ago
Comments:6 (5 by maintainers)

Top GitHub Comments

1reaction

VibhuJawacommented, Oct 27, 2021

Thanks for the help and the context guys, Working on a push on this today.

1reaction

jakirkhamcommented, Oct 26, 2021

cc @fjetter (for awareness)

Top Results From Across the Web

Worker reconnection deadlock #5480 - dask/distributed - GitHub

I've experienced a deadlock around a worker's connection to the scheduler breaking and trying to restart. I'm opening this general issue to ...

Changelog — Dask.distributed 2022.12.1 documentation

This release fixed a potential security vulnerability relating to single-machine Dask clusters. Clusters started with dask.distributed.LocalCluster or dask.

Release notes — Anaconda documentation

This is the last release of Anaconda Distribution that will support Windows 32-bit (win-32). ... decorator 5.1.0 -> 5.1.1; distributed 2021.10.0 -> 2022.2.1 ......

Release Notes for 2021.9.0 release of Adobe Experience ...

Experience Manager Screens as a Cloud Service · What is New · Bug Fixes.

Release Notes — EvalML 0.64.0 documentation - Alteryx

Fixed bug where TimeSeriesFeaturizer could not encode Ordinal columns with non numeric categories #3812. Updated demo dataset links to point to new endpoint ......