question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

order versions appear broken due to recent fsspec changes

See original GitHub issue

@martindurant I see that fsspec.asyn module got rid of maybe_sync function, but older versions of s3fs still rely on the method which now fails to import. For example s3fs==0.5.2 now does not seem to work after a clean install. I see that s3fs requirements.txt asked for fsspec>=0.8.0 and that is now incompatible without an upper boundary.

Issue Analytics

  • State:closed
  • Created 2 years ago
  • Comments:6 (3 by maintainers)

github_iconTop GitHub Comments

2reactions
martindurantcommented, Apr 14, 2021

Yes, you are right. This is not unusual! If you know you need an older version of s3fs, then you will have to analyse your full set of packages to find compatible versions.

For reference, I mean in the future to do two things:

  • move to calendar versioning, since the “semantics” of x.y.z are often confusing for a dev-facing library like this
  • always release fsspec, s3fs and gcsfs together
  • explicitly pin s3fs and gcsfs’s version to the co-released fsspec. That means more work for me.
1reaction
jmcgrath207commented, Apr 19, 2021

Had a similar issue where fspec 0.9.0 and above don’t work when I use s3fs.S3FileSystem(asynchronous=True however when I downgrade to version 0.8.7 my code is working again. It appears they removed the maybe_sync method.

Traceback (most recent call last):
  File "<frozen importlib._bootstrap>", line 991, in _find_and_load
  File "<frozen importlib._bootstrap>", line 961, in _find_and_load_unlocked
  File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
  File "/home/john/PycharmProjects/da_data_pipeline/normalized-redis-lambda/sam/service_logic/__init__.py", line 18, in <module>
    import s3fs
  File "..................../s3fs/__init__.py", line 1, in <module>
    from .core import S3FileSystem, S3File
  File "..................../s3fs/core.py", line 12, in <module>
    from fsspec.asyn import AsyncFileSystem, sync, sync_wrapper, maybe_sync
ImportError: cannot import name 'maybe_sync' from 'fsspec.asyn' (..................../fsspec/asyn.py)

Process finished with exit code 1

Read more comments on GitHub >

github_iconTop Results From Across the Web

order versions appear broken due to recent fsspec changes
S3FileSystem(asynchronous=True however when I downgrade to version 0.8.7 my code is working again. It appears they removed the maybe_sync method ...
Read more >
API Reference — fsspec 2022.11.0+13.g0974514.dirty ...
This uses fusepy to make it appear as if a given path on an fsspec ... Unique value for current version of file...
Read more >
fsspec Documentation - Read the Docs
In order for an implementation to chain successfully like this, it must look for exactly those named arguments. 4.3.12 Caching Files Locally fsspec...
Read more >
kedro Changelog - pyup.io
Set up new display props to standalone React component. ... that release >=3.8.0 will not work with projects created with older versions of...
Read more >
Accessing GRIB2 files as a single cloud-friendly dataset in ...
syntax seems to have changed from the linked example, and I am not sure where to get the details to update kerchunk and...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found