question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

dvc: windows dir out containing files with / in their name will explode

See original GitHub issue

Using master branch.

When we save dir cache we convert filenames in it to posix style in a lossy way:

"hey\there" -> "hey/there"
"hey/there" -> "hey/there"

which will lead to hey/there becoming hey\there after back transform, making filename contain path sep, which will lead to cache mismatch and other interesting behavior.

Issue Analytics

  • State:closed
  • Created 4 years ago
  • Reactions:2
  • Comments:10 (9 by maintainers)

github_iconTop GitHub Comments

1reaction
Suorcommented, May 29, 2019

So we may just not permit having / in filenames on Windows or escape it somehow when converting it to posix. That latter could be messy though.

0reactions
daavoocommented, Dec 20, 2022

Okay here’s a repro that breaks a plot when there’s a \ in the path. The plot path\fail.png doesn’t show up in rendered HTML of dvc plots show, while path/pass.png does. The same goes for the plot rendering in the DVC VSCode extension.

The repro is in main, then in fix-offending-plot the \ is swapped for / in the offending plot, then in remove-offending-plot the offending plot is commented out of dvc.yaml. Each branch has the output of dvc plots show committed as well.

Closing in favor of https://github.com/iterative/dvc/issues/8689

Read more comments on GitHub >

github_iconTop Results From Across the Web

Conceptual Overview on Data version control — DVC
You need some kind of remote storage for the data and model files controlled by DVC. This can be as simple as another...
Read more >
python - ERROR: bad DVC file name 'Training_Batch_Files ...
The file you want to add (or the folder that contains it) is probably already in the .gitgnore file. If this is the...
Read more >
Fuzzing Microsoft's RDP Client using Virtual Channels
This article begins my three-part series on fuzzing Microsoft's RDP client. In this first installment, I set up a methodology for fuzzing ...
Read more >
DVC RGB-HD A User Guide
The Extron DVC RGB-HD A is a one VGA input, one HDMI output converter that digitizes analog RGBHV video to HDMI, with analog...
Read more >
ashleve/lightning-hydra-template
A clean and scalable template to kickstart your deep learning project ⚡ ... Feel free to file a new issue, discussion or PR...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found