Upload Object hashing
See original GitHub issueThe UploadObject
and UploadObjectAsync
methods should include md5Hash
and crc32c
properties in UploadObjectOptions
. According to the documentation, supplying these will enforce server-side validation of the uploaded data to ensure it was not tampered with during transit.
After reviewing the source code, it appears there is hash validation for download, but not upload. There should be something in place to verify uploads.
Issue Analytics
- State:
- Created 6 years ago
- Comments:15 (6 by maintainers)
Top Results From Across the Web
Upload an object
A PUT given a path to an object uploads the request body as an object. A SHA256 hash of the object is a...
Read more >Upload Object hashing · Issue #1417
I haven't found any way of specifying an overall object hash at the end of a resumable upload. GCS has multiple protocols for...
Read more >Using Hashing to prevent file duplicates and save storage
This article aims to show a method of preventing duplicate files and saving storage space by using hashing algorithms.
Read more >Hashes and ETags: best practices | Cloud Storage
Cloud Storage encourages you to validate the data you transfer to/from your buckets. This page describes best practices for performing validations using ...
Read more >Multipart upload to S3 with hash verification
Both upload-part and put-object commands of s3api support content verification using hash. And s4cmd does verify uploads using custom content ...
Read more >
Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free
Top Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found
Reducing this to P2 to indicate that I’m not expecting to get to this soon - mostly because I still don’t really know what the best option is. I’ll talk to the Storage team about options though.
While it’s unlikely, it’s possible that between our code finishing the upload and trying to delete it, another version is uploaded from somewhere else. We wouldn’t want to delete that file.