[bug] conan tries to extract broken downloads
See original GitHub issueWhen CTRL + C while conan downloads the prebuilt archives of a package, the subsequent execution of conan install tries to extract from those half-downloaded archives from the download_cache. This does ONLY happens when you use a download_cache.
2 possible ideas:
- add a hash to check if the downloaded archives are not corrupt
- restart the download when the extraction fails
Environment Details (include every applicable attribute)
- Operating System+version: Ubuntu 18.04 WSL2
- Compiler+version: gcc 7.4
- Conan version: 1.33.1
- Python version: 3.6.9
relevant conan settings: download_cache = /tmp/conan_download_cache
Steps to reproduce (Include if Applicable)
Its easy to replicate with a “big” package, maybe something like opencv, that is available as prebuilt on the remote of your choice. If not, use your own conan repo, build and upload your package.
conan install opencv/4.5.0@and hitCTRL + Cwhen conan says:Downloading 834c114e736468c70cf2b5d0781c6c8db5787764b30d718ac40d45e51ec34c0d: 23%|##2 | 2.64M/11.7M- rerun
conan install opencv/4.5.0@and see:
Downloading binary packages in 8 parallel threads
opencv/4.5.0: Retrieving package 05ae15556d4c5439324a478fdaea5d0109fda60e from remote 'luminar'
Decompressing conan_package.tgz: 61%|###### | 3.15M/5.18M [00:00<00:00, 33.1MB/s]opencv/4.5.0: ERROR: Exception while getting package: 05ae15556d4c5439324a478fdaea5d0109fda60e
opencv/4.5.0: ERROR: Exception: <class 'conans.errors.ConanException'> Error while downloading/extracting files to /home/fberchtold/.conan/data/opencv/4.5.0/_/_/package/05ae15556d4c5439324a478fdaea5d0109fda60e
Compressed file ended before the end-of-stream marker was reached
Folder removed
ERROR: Error while downloading/extracting files to /home/fberchtold/.conan/data/opencv/4.5.0/_/_/package/05ae15556d4c5439324a478fdaea5d0109fda60e
Compressed file ended before the end-of-stream marker was reached
Folder removed
Issue Analytics
- State:
- Created 3 years ago
- Comments:5 (5 by maintainers)
Top Results From Across the Web
[bug] Conan is not able to download big packages · Issue #5708
Possible causes: Artifactory limitation, the file to be download is 3.31.GB. tqdm bug or side-effect from connection interruption.
Read more >Corrupt Download Files :: Conan Exiles General Discussions
I've been stuck in a corrupted download file loop ever since I've bought this game yesterday afternoon. I had a brief 1 hour...
Read more >Troubleshooting — conan 1.55.0 documentation
ERROR : Failed to remove folder (Windows) The user has some file or folder open (in a file editor, in the terminal), so...
Read more >60 - Add "Remove" to the menu on items in the download bar
2) Right-click on a specific download and choose "Remove" ... I understand now, and I think that's a separate bug from this one...
Read more >Conan does not find packages since GitLab update to 13.11.1
Conan returns this error while the package has not changed : ERROR: Unable to find ... It seems this mechanism is broken since...
Read more >
Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free
Top Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found

Hi @blackliner
Yes, I have realized too that when using revisions, the checksum is simply not there for Conan cached artifacts, as it relies on the revision. I am working on a fix using the “dirty” functionality we are using in other places.
Fixed in https://github.com/conan-io/conan/pull/8664, will be released in 1.35