question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

dvc push: fails with Google Cloud Storage when remote URL is set to the bucket's root directory

See original GitHub issue

Bug Report

Description

dvc push gives the error:

ERROR: unexpected error - ‘name’

when trying to push files to the default remote in a newly created project. Changing the remote’s URL from gs://mybucket to gs://mybucket/subfolder fixed it.

Reproduce

  1. dvc init
  2. Copy dataset.zip to the directory
  3. dvc add dataset.zip
  4. dvc remote add -d myremote gs://mybucket
  5. dvc push

Expected

Push should be successful.

Environment information

Ubuntu with snap dvc installation. Also happened with pip installation.

Additional Information (if any):

I don’t think this should be the expected behavior, because, if a bucket was created exclusively to host the dvc files for the project, it would be normal to upload the results of the push command to the bucket’s root directory. If this is expected behavior, at least someone googling the error will now find a result.

Issue Analytics

  • State:closed
  • Created 2 years ago
  • Comments:9 (3 by maintainers)

github_iconTop GitHub Comments

4reactions
m7rcelocommented, Jul 9, 2021

@isidentical This issue appears to be fixed on DVC 2.5.0. I was able to push to the root directory of the remote bucket with no problems. Thank you!

3reactions
isidenticalcommented, Jun 28, 2021

I think this is a regression, @isidentical we are still supposed default to using the root / even if it’s not included in the URL, right?

Right. I’ll submit a patch for this

Read more comments on GitHub >

github_iconTop Results From Across the Web

How to Setup a Google Drive DVC Remote
In this guide we explain the existing ways to setup Google Drive remote storage for your DVC projectsDVC projects, along with the different...
Read more >
support subfolders in the remote storage as the root ... - GitHub
I host my data on google cloud storage: gs://bucket/dvc-datastore , and I would like to have subfolders in this place for my projects,...
Read more >
Troubleshooting | Cloud Storage
Issue : Requests to a public bucket directly, or via Cloud CDN, are failing with a HTTP 401: Unauthorized and an Authentication Required...
Read more >
Getting an error when using ObjectStorage with DVC - Linode
I am still having issues with using Linode Object Storage with dvc. ... dvc remote list myremote s3://data-storage/piper myremote1 ...
Read more >
Recently Active 'dvc' Questions - Stack Overflow
Trying to push data into a bucket in Google Cloud Platform (GCP) from ... dvc init Add bucket url dvc remote add -d...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found