question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

[bug] conan tries to extract broken downloads

See original GitHub issue

When CTRL + C while conan downloads the prebuilt archives of a package, the subsequent execution of conan install tries to extract from those half-downloaded archives from the download_cache. This does ONLY happens when you use a download_cache.

2 possible ideas:

  • add a hash to check if the downloaded archives are not corrupt
  • restart the download when the extraction fails

Environment Details (include every applicable attribute)

  • Operating System+version: Ubuntu 18.04 WSL2
  • Compiler+version: gcc 7.4
  • Conan version: 1.33.1
  • Python version: 3.6.9

relevant conan settings: download_cache = /tmp/conan_download_cache

Steps to reproduce (Include if Applicable)

Its easy to replicate with a “big” package, maybe something like opencv, that is available as prebuilt on the remote of your choice. If not, use your own conan repo, build and upload your package.

  1. conan install opencv/4.5.0@ and hit CTRL + C when conan says: Downloading 834c114e736468c70cf2b5d0781c6c8db5787764b30d718ac40d45e51ec34c0d: 23%|##2 | 2.64M/11.7M
  2. rerun conan install opencv/4.5.0@ and see:
Downloading binary packages in 8 parallel threads
opencv/4.5.0: Retrieving package 05ae15556d4c5439324a478fdaea5d0109fda60e from remote 'luminar' 
Decompressing conan_package.tgz:  61%|######    | 3.15M/5.18M [00:00<00:00, 33.1MB/s]opencv/4.5.0: ERROR: Exception while getting package: 05ae15556d4c5439324a478fdaea5d0109fda60e
opencv/4.5.0: ERROR: Exception: <class 'conans.errors.ConanException'> Error while downloading/extracting files to /home/fberchtold/.conan/data/opencv/4.5.0/_/_/package/05ae15556d4c5439324a478fdaea5d0109fda60e
Compressed file ended before the end-of-stream marker was reached
Folder removed
ERROR: Error while downloading/extracting files to /home/fberchtold/.conan/data/opencv/4.5.0/_/_/package/05ae15556d4c5439324a478fdaea5d0109fda60e
Compressed file ended before the end-of-stream marker was reached
Folder removed

Issue Analytics

  • State:closed
  • Created 3 years ago
  • Comments:5 (5 by maintainers)

github_iconTop GitHub Comments

2reactions
memshardedcommented, Mar 17, 2021

Hi @blackliner

Yes, I have realized too that when using revisions, the checksum is simply not there for Conan cached artifacts, as it relies on the revision. I am working on a fix using the “dirty” functionality we are using in other places.

0reactions
memshardedcommented, Mar 23, 2021

Fixed in https://github.com/conan-io/conan/pull/8664, will be released in 1.35

Read more comments on GitHub >

github_iconTop Results From Across the Web

[bug] Conan is not able to download big packages · Issue #5708
Possible causes: Artifactory limitation, the file to be download is 3.31.GB. tqdm bug or side-effect from connection interruption.
Read more >
Corrupt Download Files :: Conan Exiles General Discussions
I've been stuck in a corrupted download file loop ever since I've bought this game yesterday afternoon. I had a brief 1 hour...
Read more >
Troubleshooting — conan 1.55.0 documentation
ERROR : Failed to remove folder (Windows)​​ The user has some file or folder open (in a file editor, in the terminal), so...
Read more >
60 - Add "Remove" to the menu on items in the download bar
2) Right-click on a specific download and choose "Remove" ... I understand now, and I think that's a separate bug from this one...
Read more >
Conan does not find packages since GitLab update to 13.11.1
Conan returns this error while the package has not changed : ERROR: Unable to find ... It seems this mechanism is broken since...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found