upload_file fails on one specific script

Trying to upload a specific python file to the workers, through upload_file, throws an exception “Exception: object Future can’t be used in ‘await’ expression”. I’m running out of ideas of what the problem could be, which is why I need your help. But these are my current hypothesis:

• It somehow doesn’t like that I’m uploading a script that contains potentially unwanted pandas usages, as it allows uploading the file if I remove certain apply methods (although, if I just remove some surrounding code and leave there the supposedly conflicting pandas line, it also starts working).

• It has a certain memory limit as to the file size that I want to upload (which would be strange as the file is only 10KB and other dummy examples with several lines of code work just fine).

Here’s the full error message:

What I’m doing in the notebook before calling upload_file:

The file that I’m trying to upload:

utils.py.zip

Please help me as I’m really feeling clueless here!

[mrocklin]

Can you try https://github.com/dask/distributed/pull/2934 ?

[mrocklin]

For maintainers, this was introduced when we changed yield to await in many places.

Torando coroutines do a few things better than async/await does. In particular, you can yield concurrent.futures.Future objects and things work well. The await keyword doesn’t handle this.