question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

azure/gs/s3: re-design checksum computation for external dependencies/outputs

See original GitHub issue

Unlike S3, azure does provide content-md5(need to investigate if it still works, since s3 had support for it some time ago and doesn’t have it right now) This is related to external outs/deps feature, that is not implemented yet. Usual push/pull are not going to be affected.

Issue Analytics

  • State:closed
  • Created 5 years ago
  • Reactions:1
  • Comments:8 (7 by maintainers)

github_iconTop GitHub Comments

2reactions
harshavardhanacommented, Mar 10, 2020

Actually, the head_object has the part count and the size, using that is less hacky.

https://github.com/aws/aws-sdk-java/issues/1303 that has been generally considered undocumented and shouldn’t be used as per aws-sdk-java

1reaction
olveirapcommented, Apr 6, 2019

Actually, the head_object has the part count and the size, using that is less hacky.

Read more comments on GitHub >

github_iconTop Results From Across the Web

Azure Blob Storage pricing
See pricing details for Azure Blob storage, an enterprise-grade cloud storage service for data storage. No upfront costs. Pay as you go. Try...
Read more >
Azure Storage blob inventory - Microsoft Learn
Azure Storage inventory is a tool to help get an overview of all your blob data within a storage account.
Read more >
Move your data from AWS S3 to Azure Storage using AzCopy
AzCopy v10, the next generation data transfer utility for Azure Storage, has been redesigned from scratch to provide data movement at greater ...
Read more >
azcopy --put-md5 ; calculated where - Microsoft Q&A
When using the --put-md5 switch in azcopy, is the md5 checksum value calculated at the source (e.g. my computer) or the destination (Azure)? ......
Read more >
Azure Cloud Storage Solutions and Services
Explore a variety of Azure storage products and tools. Find massively scalable cloud storage systems to secure your data from unauthorized access.
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found