Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.
And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.
Error trying to deserialize an object
See original GitHub issuefrom distributed.protocol import deserialize_bytes
What happened:
Error trying to deserialize an object dask_ml.decomposition.PCA already fitted.
OSError: Timed out trying to connect to tcp://10.xxx.120.x31:35487 after 30 s
I do a fit with my data and export a serialized file. When trying to instantiate on a different cluster, it appears that the file tries to connect with the scheduler of the cluster it was trained on.
What you expected to happen:
I expected that, regardless of the context (cluster ip, number of workers…), I would be able to import my PCA object.
I’ve already tried to dump using the pickle and dill libraries
deserialize_bytes('gs://file.pkl')
Issue Analytics
- State:
- Created 2 years ago
- Comments:5 (2 by maintainers)
Top Results From Across the Web
Top Related Medium Post
Top Related StackOverflow Question
Troubleshoot Live Code
Top Related Reddit Thread
Top Related Hackernoon Post
Top Related Tweet
Top Related Dev.to Post
Top Related Hashnode Post
Can you give a reproducible example? And perhaps post the full traceback?
Just looking at the code, I don’t see what attribute would be causing the issue.
Hey @TomAugspurger, thanks for the opportunity. I will try as soon as possible, but I believe I won’t be able to make the changes anytime soon.