Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

dvc push is extremely slow if you don't specify a particular thing to push

See original GitHub issue

I’m so used to just doing git push that I sometimes mistakenly do dvc push, but it is incredibly slow because of cache querying. It would be great if it could be made faster so that you didn’t have to always be careful to just push the last thing you added.

Issue Analytics

State:
Created 3 years ago
Reactions:1
Comments:6 (2 by maintainers)

Top GitHub Comments

2reactions

greabercommented, May 9, 2020

Multiple pulls and pushes make no difference, as the image shows.

There is not a large number of dvc files, but there are a lot of directories with many files that I add. Probably it would be a lot faster if I used archive files, but I know you suggest adding the unpacked directory structures directly, rather than archive files.

1reaction

efiopcommented, Oct 8, 2021

Closing as stale.

We are working on pre-requisites for speeding up status though. So please stay tuned 🙂

Top Results From Across the Web

push | Data Version Control - DVC

Open-source version control system for Data Science and Machine Learning projects. Git-like experience to organize your data, models, and experiments.

Revert a dvc remove -p command - Stack Overflow

The process I used is: conduct data for training (manually using Python script) -> training -> dvc add training data and h5 models...

Using DVC to create an efficient version control system for ...

Then we synchronize the remote using DVC's push and pull commands. Cache isn't cleared automatically. When its footprints gets too wide we use ......

Avoid Git LFS if possible - Hacker News

The git-lfs devs obviously don't use ssh, so you get the feeling they ... Us: you just clone and push to the new...

DVC (Git For Data): A Complete Intro - DEV Community ‍ ‍

What if we can get a Git kind of versioning control system for data ... To push the data files in DVC repository,...