question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

pull: Unclear error message when remote support is not installed

See original GitHub issue

Bug Report

Description

If you’ve installed DVC via pip without the remote support you need (for example S3), the error message is very unclear.

Reproduce

  1. Setup fresh repo & pip install dvc[s3]
  2. Copy dataset.zip to repo
  3. dvc init & dvc add dataset.zip
  4. Setup remote & dvc push
  5. Move to fresh python environment
  6. pip install dvc
  7. Clone repo
  8. dvc pull -v

Expected

I would’ve expected an error message saying something like: “the remote type (s3) is not supported in your dvc installation”.

Instead you get the following output:

$ dvc pull -v
2021-10-26 10:35:07,698 DEBUG: failed to pull cache for 'models'      
2021-10-26 10:35:07,699 DEBUG: failed to pull cache for 'data/evaluation'
2021-10-26 10:35:08,269 WARNING: No file hash info found for 'data/evaluation'. It won't be created.                                                                                                                                            
2021-10-26 10:35:08,304 WARNING: No file hash info found for 'models'. It won't be created.                                                                                                                                                     
2 files failed                                                                                                                                                                                                                                  
2021-10-26 10:35:08,326 ERROR: failed to pull data from the cloud - Checkout failed for following targets:
data/evaluation
models
Is your cache up to date?
<https://error.dvc.org/missing-files>

Took me a couple hours to figure it out I had to reinstall dvc with s3 support enabled 😅

Environment information

Output of dvc doctor:

$ dvc doctor

DVC version: 2.8.2 (pip)
---------------------------------
Platform: Python 3.9.7 on Linux-4.14.246-187.474.amzn2.x86_64-x86_64-with-glibc2.31
Supports:
        webhdfs (fsspec = 2021.10.1),
        http (aiohttp = 3.7.4.post0, aiohttp-retry = 2.4.5),
        https (aiohttp = 3.7.4.post0, aiohttp-retry = 2.4.5),
Cache types: hardlink, symlink
Cache directory: nfs4 on xxxxxx.efs.eu-west-1.amazonaws.com:/data-pvc
Caches: local
Remotes: s3
Workspace directory: nfs4 on xxxxx.efs.eu-west-1.amazonaws.com:/data-pvc
Repo: dvc, git

Issue Analytics

  • State:closed
  • Created 2 years ago
  • Reactions:1
  • Comments:10 (8 by maintainers)

github_iconTop GitHub Comments

2reactions
efiopcommented, Oct 26, 2021

Hm, the everything is up to date is definitely a bug though. And I can indeed reproduce that warning as well, looking into it…

EDIT: when odb (aka cache dir) is not accessible, we fail to load the corresponding object and thus checkout throws those warnings that are clearly no longer relevant.

1reaction
nsorroscommented, Apr 7, 2022

@nsorros Please post full verbose log for dvc pull -v and post dvc doctor output.

The error I was getting will be addressed by #7501

Read more comments on GitHub >

github_iconTop Results From Across the Web

git pull fails "unable to resolve reference ... - Stack Overflow
Try cleaning-up your local repository with: $ git gc --prune=now $ git remote prune origin. man git-gc(1): git-gc - Cleanup unnecessary files and...
Read more >
Solve PC problems remotely with Remote Assistance and ...
Then, on the Remote tab, select the Allow Remote Assistance connections to this computer check box, and then select OK. To get help:...
Read more >
Dealing with non-fast-forward errors - GitHub Docs
Sometimes, Git can't make your change to a remote repository without losing commits. When this happens, your push is refused.
Read more >
9 Common Remote Desktop Connection and Screen Issues ...
Remote desktop connections can be tricky to set up. Use these troubleshooting tips to connect to and service PCs from anywhere.
Read more >
Common Dameware installation error messages
Ensure that the network is up, that you can access the remote computer, and that the firewall has not blocked the connection. Winsock...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found