question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

gcsfuse entrypoint conflicts with Google Cloud Platform's fuse solution

See original GitHub issue

I use gcsfs to easily load and dump data distributively with Dask. Recently I needed to install Google Cloud’s official fuse tool, called gcsfuse, and I ran into a conflict between Google Cloud’s “gcsfuse” cli and this repo’s “gcsfuse” cli. I had to uninstall gcsfs to fix the conflict.

  1. What are the differentiators between Dask’s gcsfuse and Google Cloud’s?
  2. Would it be possible to rename the console_scripts entrypoint in setup.py from “gcsfuse” to “gcsfs” so that it remains consistent with the naming of this repo?

Happy to make the change in 2 if needed.

Issue Analytics

  • State:open
  • Created 5 years ago
  • Comments:6 (4 by maintainers)

github_iconTop GitHub Comments

1reaction
martindurantcommented, Mar 11, 2019

My past experience with google developing rapidly is mixed 😃 We shall see. I don’t think there’s much point in gcsfs wrapping google’s library, but maybe the fuse component here can eventually be dropped if indeed google’s tool becomes popular. Indeed, whenever I get around to integrating all the filesystems into fsspec, the call for setting up fuse will be different anyway (support is there, https://github.com/martindurant/filesystem_spec/pull/34 , but no CLI at all yet).

0reactions
AneeshSachdevacommented, Mar 11, 2019

Sorry for the late reply on this, I was able to cleanly unlink gcsfs’s fuse via which gcsfuse | rm -rf. For anyone else using this solution keep in mind that I installed gcsfs after installation of google’s gcsfuse, which is why that command selected for removal of gcsfs’s fuse tool.

From my experience with the two tools I think google’s gcsfuse covers everything that gcsfs’s intends to, but is a focused repository on its own and will likely make “faster” progress. Although it’s also listed as beta-quality software, so if it’s really important for gcsfs to have a fuse component maybe it could instead wrap around google’s gcsfuse?

Regardless, I’ve found it really useful to use both in my workflow. gcsfuse sets up a shared filesystem to help orchestrate all of my distributed components, and gcsfs makes it really easy to load and dump data not related to system orchestration.

Read more comments on GitHub >

github_iconTop Results From Across the Web

Using Cloud Storage FUSE with Cloud Run tutorial
This tutorial shows how to mount Cloud Storage as a network file system onto a Cloud Run service. The tutorial uses the open...
Read more >
GCSfuse and kubernetes conflict · Issue #366 - GitHub
I'm running a flask application that serves an ML model that loads in a wordembeddings file (2GB) on k8s. This file is being...
Read more >
GCSFuse Provided scope(s) are not authroized error
I am using gcsfuse with public access Google Cloud Storage. When i try to mount storage with command( gcsfuse -o allow_other --implicit-dirs ...
Read more >
permission errors using gcsfuse as nonroot user on google ...
Is gcsfuse the right way to go about this or is there a better solution for mounting a google cloud storage bucket available...
Read more >
Google Cloud Platform Resources Official Blog - GCP Weekly
This is UKG's solution to help their small and medium business get realtime insights with Google Cloud and Machine Learning. UKG discusses the...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found