Stuck on an issue?

Lightrun Answers was designed to reduce the constant googling that comes with debugging 3rd party libraries. It collects links to all the places you might be looking at while hunting down a tough bug.

And, if you’re still stuck at the end, we’re happy to hop on a call to see how we can help out.

Darc gather-drop failing to download files larger than 2GB

See original GitHub issue

This issue is blocking
This issue is causing unreasonable pain

Installer now publishes files that are larger than 2GB. A fix was made in arcade to allow the publishing of these files, but this fix now needs to be applied to gather-drop for downloading the files as well. The error message looks like this:

fail: Microsoft.DotNet.Darc.Operations.Operation[0]
      There was an error executing method 'GET' against URI 'https://dotnetcli.blob.core.windows.net/dotnet/Sdk//dotnet-sdk-source-6.0.100-rc.1.21375.5.tar.gz' after 3 attempts. Exception: System.Net.Http.HttpRequestException: Cannot write more bytes to the buffer than the configured maximum buffer size: 2147483647.
         at System.Net.Http.HttpClient.<SendAsync>g__Core|83_0(HttpRequestMessage request, HttpCompletionOption completionOption, CancellationTokenSource cts, Boolean disposeCts, CancellationTokenSource pendingRequestsCts, CancellationToken originalCancellationToken) in System.Net.Http.dll:token 0x6000275+0x216
         at Microsoft.DotNet.DarcLib.HttpRequestManager.ExecuteAsync(Int32 retryCount) in /_/src/Microsoft.DotNet.Darc/src/DarcLib/Helpers/HttpRequestManager.cs:line 76

Full log: https://dev.azure.com/dnceng/internal/_build/results?buildId=1257973&view=logs&j=40e1e683-ea82-5be9-b25e-899b65e1c0cb&t=94a692ec-20f2-55dd-1884-cf0cad1763a4&l=423

/cc: @riarenas