[FEATURE REQ] Align with azcopy retry settings (20 attempts)
See original GitHub issueLibrary or service name.
All of Azure.Storage
Is your feature request related to a problem? Please describe. I have ran into timeouts that look like this, trying to upload ~400MB files using slow connections:
System.AggregateException: Retry failed after 6 tries. (Error while copying content to a stream.) (Error while copying content to a stream.) (Error while copying content to a stream.) (Error while copying content to a stream.) (Error while copying content to a stream.) (Error while copying content to a stream.)
---> Azure.RequestFailedException: Error while copying content to a stream.
---> System.Net.Http.HttpRequestException: Error while copying content to a stream.
---> System.IO.IOException: Unable to read data from the transport connection: An existing connection was forcibly closed by the remote host..
---> System.Net.Sockets.SocketException (10054): An existing connection was forcibly closed by the remote host.
I suspect azcopy
has more optimized retry parameters, especially for upload. Looking at their code, the main difference seems to be the retry count of 20 (for uploads): https://github.com/Azure/azure-storage-azcopy/blob/2c30af330b681d3a1f31db32e11245eafce9c5c3/ste/xfer.go#L36
Compare this to the Azure SDK retry count of 5 (which translates to a total of 6 attempts): https://github.com/Azure/azure-sdk-for-net/blob/00d31be869a010d4b5801726d11bf83f39031248/sdk/storage/Azure.Storage.Common/src/Shared/Constants.cs#L15
Issue Analytics
- State:
- Created 3 years ago
- Comments:10 (3 by maintainers)
Top Results From Across the Web
Find errors & resume jobs with logs in AzCopy (Azure ...
For errors such as network errors, timeouts and Server Busy errors, AzCopy will retry up to 20 times and usually the retry process...
Read more >Troubleshoot problems with AzCopy (Azure Storage)
This article describes common issues you might encounter while using AzCopy, helps you identify the causes of those issues, and then ...
Read more >azcopy from Google Cloud to Azure just hangs
It just hangs. It does this if I try and copy a single named file or a recursive directory copy. Anything. Any ideas,...
Read more >ChangeLog.md - Azure/azure-storage-azcopy
Fixed an issue where LMT data is not returned on list command for Azure Files. Version 10.20.0. New Features. Mac M1/ARM64 Support; Force...
Read more >Introducing Asynchronous Cross-Account Copy Blob
When a copy is pending, any attempt to modify, snapshot, or lease the destination blob will fail. Below we break down the key...
Read more >Top Related Medium Post
No results found
Top Related StackOverflow Question
No results found
Troubleshoot Live Code
Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start FreeTop Related Reddit Thread
No results found
Top Related Hackernoon Post
No results found
Top Related Tweet
No results found
Top Related Dev.to Post
No results found
Top Related Hashnode Post
No results found
Top GitHub Comments
Thank you for your feedback. Tagging and routing to the team best able to assist.
Hi @ohadschn, since you haven’t asked that we “
/unresolve
” the issue, we’ll close this out. If you believe further discussion is needed, please add a comment “/unresolve
” to reopen the issue.