question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

external-outs: mention `dvc add url`

See original GitHub issue

Currently, we only mention that you can specify your remote output in the dvc run command, but we don’t say anything about an ability to dvc add your remote files.

Issue Analytics

  • State:closed
  • Created 4 years ago
  • Comments:5 (5 by maintainers)

github_iconTop GitHub Comments

1reaction
AJ-54commented, May 5, 2019

I have made a pull request by performing the required changes as understood by me. Kindly have a look @efiop and suggest changes if required. Thank you for the coordination!!

0reactions
efiopcommented, May 5, 2019

@AJ-54 For example

    # Add S3 remote to be uses as cache location for S3 files
    $ dvc remote add s3cache s3://mybucket/cache

    # Tell dvc to use the 's3cache' remote as S3 cache location
    $ dvc config cache.s3 s3cache

    # Add data on S3 directly
    $ dvc add s3://mybucket/mydata

    # Run the stage with external S3 output
    $ dvc run \
              -d data.txt \
              -o s3://mybucket/data.txt \
              aws s3 cp data.txt s3://mybucket/data.txt
Read more comments on GitHub >

github_iconTop Results From Across the Web

Importing External Data | Data Version Control - DVC
To define files or directories in an external location as stage dependencies, specify their remote URLs or external paths in dvc.yaml ( deps...
Read more >
Managing External Data | Data Version Control - DVC
To use existing files or directories in an external location as outputs, give their remote URLs or external paths to dvc add ,...
Read more >
add | Data Version Control - DVC
Open-source version control system for Data Science and Machine Learning projects. Git-like experience to organize your data, models, and experiments.
Read more >
remote add | Data Version Control - DVC
url specifies a location to store your data. It can represent a cloud storage service, an SSH server, network-attached storage, or even a...
Read more >
import-url | Data Version Control - DVC
out Destination path to put files in. Description. In some cases it's convenient to add a data file or directory from an external...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found