question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

dvc list: option to specify dvc remote

See original GitHub issue

I have a project with several DVC remotes. When I execute dvc list . data/some/dirs in my workspace sometimes I need to specify dvc remote. Similar with -r option in pull/push commands.

Issue Analytics

  • State:closed
  • Created 2 years ago
  • Comments:10 (10 by maintainers)

github_iconTop GitHub Comments

1reaction
nik123commented, Jun 29, 2021

Ok, let’s then close this issue in favor of #2466 Since mirroring wasn’t really intuitive for you (user) and it is not close in terms of implementation (there are questions about pushing, for example) and is overall a more of a stretch, we can put it aside for now, until we get a better scenario.

@efiop I don’t mind closing it in favor of #2466. Probably description of that issue should be changed and mention not only get but also import and list.

1reaction
nik123commented, Jun 20, 2021

Thanks for sharing! Very interesting use case. I guess what you are really looking for here is a mirroring mechanism, where your fast remote would have a higher priority, but when/if we are failing to connect to it - we would ideally automatically switch to the next one - your external remote. Or am I misinterpreting your use case?

There is no misinterpretation of my use case. But honestly, I didn’t think about it in this way. Since I often use -r option with pull/push commands, I was concentrated on expanding this workflow on list command.

However, having a mechanism which automatically switches from one remote to another is a neat solution. It eliminates the need for -r option in list command for me. If such mechanism will cover other commands like pull/push then in my case there would be no need in -r option at all. In sum, the proposed mechanism fits me perfectly, but it seems it should go well beyond list command.

Read more comments on GitHub >

github_iconTop Results From Across the Web

remote | Data Version Control - DVC
A set of commands to set up and manage data remotes: add, default, list, modify, remove, ... We use the -d ( --default...
Read more >
shcheklein/example-get-started: Get started DVC project
This is a read-only HTTP remote. $ dvc remote list storage https://remote.dvc.org/get-started. You can run dvc pull to download the data: $ dvc...
Read more >
DVC Shared Windows Directory Setup - linux - Stack Overflow
If you are using a local remote this way, you won't be able to have to the same url on both platforms since...
Read more >
Cheat Sheet | GlobalSQA
dvc push. Share Data. Show all available remotes. $ dvc remote list ... Set up a remote to keep and share data files....
Read more >
Syncing Data to AWS S3 - Iterative.ai
Set up a DVC project · Create a default remote · Add AWS credentials · Push and pull data with DVC.
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found