Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Downpin msgpack to 0.6.2 for dask 2.9

See original GitHub issue

The new version of msgpack 1.0.0 is creating following errors

2020-02-26 13:19:44,102 INFO Register tls://xx.x.xxx.xx:xxxxx (distributed.scheduler) 2020-02-26 13:19:44,105 INFO Starting worker compute stream, tls:/xx.x.xxx.xx:xxxxx (distributed.scheduler) 2020-02-26 13:19:44,107 INFO Starting established connection (distributed.core) 2020-02-26 13:19:44,138 CRITICAL Failed to deserialize (distributed.protocol.core) Traceback (most recent call last): File "/mnt/mesos/sandbox/venv/lib/python3.6/site-packages/distributed/protocol/core.py", line 106, in loads header = msgpack.loads(header, use_list=False, **msgpack_opts) File "msgpack/_unpacker.pyx", line 195, in msgpack._cmsgpack.unpackb ValueError: tuple is not allowed for map key

I guess the issue can be reproduced with the following code.

` import dask, os

from dask.distributed import Client

endpoint = os.environ[“ENDPOINT_DISTRIBUTED”]

def wrap_test(n): return n

with Client(address=endpoint): delayed = dask.delayed(wrap_test)(2) result = delayed.compute() `

dask, distributed versions 2.9.0

Issue Analytics

State:
Created 4 years ago
Comments:6 (3 by maintainers)

Top GitHub Comments

1reaction

jrbourbeaucommented, Feb 26, 2020

Older versions of distributed on conda-forge should now set a constraint on the msgpack version used (xref https://github.com/conda-forge/conda-forge-repodata-patches-feedstock/pull/32). I don’t think there’s an equivalent patch that can be made on PyPI – though I would be happy to hear if there is. Closing this issue. Thanks again for raising this point @kondabathula!

0reactions

kondabathulacommented, Feb 27, 2020

Thank you @jrbourbeau

Top Results From Across the Web

Can't figure out what Dask wants in terms of msgpack ... - GitHub

I can't figure out what Dask wants in terms of msgpack/msgpack-python and I've read all about it. I am trying to run it...

msgpack 0.6.2 - PyPI

MessagePack is an efficient binary serialization format. It lets you exchange data among multiple languages like JSON.

Changelog - Dask documentation

This is the last release with support for NumPy 1.17 and pandas 0.25. Beginning with the next release, NumPy 1.18 and pandas 1.0...

Parallel computing with Dask · Workbook - Jennifer Chang

set up SLURM clusters; scale clusters; use adaptive clusters; view Dask diagnostics. This tutorial will demonstrate how to use Dask to manage compute...

Dask - Blue Waters User Portal

Dask is a scalable data analytics framework for Python with interfaces to ... --user msgpack==0.6.0 pip install --user bokeh==1.0.0 # apparently pandas 0.23 ......