question-mark
Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

[FEATURE REQ] Align with azcopy retry settings (20 attempts)

See original GitHub issue

Library or service name. All of Azure.Storage

Is your feature request related to a problem? Please describe. I have ran into timeouts that look like this, trying to upload ~400MB files using slow connections:

System.AggregateException: Retry failed after 6 tries. (Error while copying content to a stream.) (Error while copying content to a stream.) (Error while copying content to a stream.) (Error while copying content to a stream.) (Error while copying content to a stream.) (Error while copying content to a stream.)
 ---> Azure.RequestFailedException: Error while copying content to a stream.
 ---> System.Net.Http.HttpRequestException: Error while copying content to a stream.
 ---> System.IO.IOException: Unable to read data from the transport connection: An existing connection was forcibly closed by the remote host..
 ---> System.Net.Sockets.SocketException (10054): An existing connection was forcibly closed by the remote host.

I suspect azcopy has more optimized retry parameters, especially for upload. Looking at their code, the main difference seems to be the retry count of 20 (for uploads): https://github.com/Azure/azure-storage-azcopy/blob/2c30af330b681d3a1f31db32e11245eafce9c5c3/ste/xfer.go#L36

Compare this to the Azure SDK retry count of 5 (which translates to a total of 6 attempts): https://github.com/Azure/azure-sdk-for-net/blob/00d31be869a010d4b5801726d11bf83f39031248/sdk/storage/Azure.Storage.Common/src/Shared/Constants.cs#L15

Issue Analytics

  • State:closed
  • Created 3 years ago
  • Comments:10 (3 by maintainers)

github_iconTop GitHub Comments

1reaction
jsquirecommented, Sep 1, 2020

Thank you for your feedback. Tagging and routing to the team best able to assist.

0reactions
msftbot[bot]commented, Nov 3, 2021

Hi @ohadschn, since you haven’t asked that we “/unresolve” the issue, we’ll close this out. If you believe further discussion is needed, please add a comment “/unresolve” to reopen the issue.

Read more comments on GitHub >

github_iconTop Results From Across the Web

Find errors & resume jobs with logs in AzCopy (Azure ...
For errors such as network errors, timeouts and Server Busy errors, AzCopy will retry up to 20 times and usually the retry process...
Read more >
Troubleshoot problems with AzCopy (Azure Storage)
This article describes common issues you might encounter while using AzCopy, helps you identify the causes of those issues, and then ...
Read more >
azcopy from Google Cloud to Azure just hangs
It just hangs. It does this if I try and copy a single named file or a recursive directory copy. Anything. Any ideas,...
Read more >
ChangeLog.md - Azure/azure-storage-azcopy
Fixed an issue where LMT data is not returned on list command for Azure Files. Version 10.20.0. New Features. Mac M1/ARM64 Support; Force...
Read more >
Introducing Asynchronous Cross-Account Copy Blob
When a copy is pending, any attempt to modify, snapshot, or lease the destination blob will fail. Below we break down the key...
Read more >

github_iconTop Related Medium Post

No results found

github_iconTop Related StackOverflow Question

No results found

github_iconTroubleshoot Live Code

Lightrun enables developers to add logs, metrics and snapshots to live code - no restarts or redeploys required.
Start Free

github_iconTop Related Reddit Thread

No results found

github_iconTop Related Hackernoon Post

No results found

github_iconTop Related Tweet

No results found

github_iconTop Related Dev.to Post

No results found

github_iconTop Related Hashnode Post

No results found