azure/gs/s3: re-design checksum computation for external dependencies/outputs
See original GitHub issue Unlike S3, azure does provide content-md5
(need to investigate if it still works, since s3 had support for it some time ago and doesn’t have it right now) This is related to external outs/deps feature, that is not implemented yet. Usual push/pull
are not going to be affected.
Issue Analytics
- State:
- Created 5 years ago
- Reactions:1
- Comments:8 (7 by maintainers)
Top Results From Across the Web
Azure Blob Storage pricing
See pricing details for Azure Blob storage, an enterprise-grade cloud storage service for data storage. No upfront costs. Pay as you go. Try...
Read more >Azure Storage blob inventory - Microsoft Learn
Azure Storage inventory is a tool to help get an overview of all your blob data within a storage account.
Read more >Move your data from AWS S3 to Azure Storage using AzCopy
AzCopy v10, the next generation data transfer utility for Azure Storage, has been redesigned from scratch to provide data movement at greater ...
Read more >azcopy --put-md5 ; calculated where - Microsoft Q&A
When using the --put-md5 switch in azcopy, is the md5 checksum value calculated at the source (e.g. my computer) or the destination (Azure)? ......
Read more >Azure Cloud Storage Solutions and Services
Explore a variety of Azure storage products and tools. Find massively scalable cloud storage systems to secure your data from unauthorized access.
Read more >
Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free
Top Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found
https://github.com/aws/aws-sdk-java/issues/1303 that has been generally considered undocumented and shouldn’t be used as per aws-sdk-java
Actually, the head_object has the part count and the size, using that is less hacky.