gcsfuse entrypoint conflicts with Google Cloud Platform's fuse solution
See original GitHub issueI use gcsfs to easily load and dump data distributively with Dask. Recently I needed to install Google Cloud’s official fuse tool, called gcsfuse, and I ran into a conflict between Google Cloud’s “gcsfuse” cli and this repo’s “gcsfuse” cli. I had to uninstall gcsfs to fix the conflict.
- What are the differentiators between Dask’s gcsfuse and Google Cloud’s?
- Would it be possible to rename the
console_scripts
entrypoint insetup.py
from “gcsfuse” to “gcsfs” so that it remains consistent with the naming of this repo?
Happy to make the change in 2 if needed.
Issue Analytics
- State:
- Created 5 years ago
- Comments:6 (4 by maintainers)
Top Results From Across the Web
Using Cloud Storage FUSE with Cloud Run tutorial
This tutorial shows how to mount Cloud Storage as a network file system onto a Cloud Run service. The tutorial uses the open...
Read more >GCSfuse and kubernetes conflict · Issue #366 - GitHub
I'm running a flask application that serves an ML model that loads in a wordembeddings file (2GB) on k8s. This file is being...
Read more >GCSFuse Provided scope(s) are not authroized error
I am using gcsfuse with public access Google Cloud Storage. When i try to mount storage with command( gcsfuse -o allow_other --implicit-dirs ...
Read more >permission errors using gcsfuse as nonroot user on google ...
Is gcsfuse the right way to go about this or is there a better solution for mounting a google cloud storage bucket available...
Read more >Google Cloud Platform Resources Official Blog - GCP Weekly
This is UKG's solution to help their small and medium business get realtime insights with Google Cloud and Machine Learning. UKG discusses the...
Read more >Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start FreeTop Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found
Top GitHub Comments
My past experience with google developing rapidly is mixed 😃 We shall see. I don’t think there’s much point in gcsfs wrapping google’s library, but maybe the fuse component here can eventually be dropped if indeed google’s tool becomes popular. Indeed, whenever I get around to integrating all the filesystems into fsspec, the call for setting up fuse will be different anyway (support is there, https://github.com/martindurant/filesystem_spec/pull/34 , but no CLI at all yet).
Sorry for the late reply on this, I was able to cleanly unlink gcsfs’s fuse via
which gcsfuse | rm -rf
. For anyone else using this solution keep in mind that I installed gcsfs after installation of google’s gcsfuse, which is why that command selected for removal of gcsfs’s fuse tool.From my experience with the two tools I think google’s gcsfuse covers everything that gcsfs’s intends to, but is a focused repository on its own and will likely make “faster” progress. Although it’s also listed as beta-quality software, so if it’s really important for gcsfs to have a fuse component maybe it could instead wrap around google’s gcsfuse?
Regardless, I’ve found it really useful to use both in my workflow. gcsfuse sets up a shared filesystem to help orchestrate all of my distributed components, and gcsfs makes it really easy to load and dump data not related to system orchestration.