Official runtime builds for .NET 7 and 8 frequently failing during artifact upload

Build

https://dev.azure.com/dnceng/internal/_build/results?buildId=2141349&view=logs&j=4d50a8bf-a143-51c7-5cc8-defff437e23b&t=0b0b242f-bbcb-57b5-fe9f-26dc042642ec&l=8624

Build leg reported

Prepare artifacts and upload to build

Pull Request

No response

Action required for the engineering services team

To triage this issue (First Responder / @dotnet/dnceng):

• Open the failing build above and investigate
• Add a comment explaining your findings

If this is an issue that is causing build breaks across multiple builds and would get benefit from being listed on the build analysis check, follow the next steps:

1. Add the label “Known Build Error”
2. Edit this issue and add an error string in the Json below that can help us match this issue with future build breaks. You should use the known issues documentation

{
   "ErrorMessage" : "A connection attempt failed because the connected party did not properly respond after a period of time, or established connection failed because connected host has failed to respond. (dev.azure.com:443)",
   "BuildRetry": false,
   "ErrorPattern": "",
   "ExcludeConsoleLog": false
}

Release Note Category

• Feature changes/additions
• Bug fixes
• Internal Infrastructure Improvements

Release Note Description

Additional information about the issue reported

This seems to appear only during artifact upload after signing has completed. The machine’s connection to AzDO is getting throttled.

Report

Build	Definition	Step Name	Console log	Pull Request
366070	dotnet/performance	Send job to Helix (Windows)	Log	dotnet/performance#3235

Summary

24-Hour Hit Count	7-Day Hit Count	1-Month Count
0	0	1

Known issue validation

Build: 🔎 https://dev.azure.com/dnceng-public/public/_build/results?buildId=316909 Error message validated: A connection attempt failed because the connected party did not properly respond after a period of time, or established connection failed because connected host has failed to respond. (dev.azure.com:443) Result validation: ❌ Known issue did not match with the provided build. Validation performed at: 6/28/2023 9:03:47 PM UTC

[epananth]

Created ICM https://portal.microsofticm.com/imp/v3/incidents/details/377257323/home

[mmitche]

Yep. Nothing that requires us to sit on a bridge on Friday though 😃