dotnet/runtime Helix jobs are timing out

Build

https://dev.azure.com/dnceng/9ee6d478-d288-47f7-aacc-f6e6d082ae6d/_build/results?buildId=1825606

3 other jobs in my PR timed out in the same way

Build leg reported

Libraries Test Run checked coreclr Linux_musl arm Release

Pull Request

https://github.com/dotnet/runtime/pull/70765

Action required for the engineering services team

To triage this issue (First Responder / @dotnet/dnceng):

• Open the failing build above and investigate
• Add a comment explaining your findings

If this is an issue that is causing build breaks across multiple builds and would get benefit from being listed on the build analysis check, follow the next steps:

1. Add the label “Known Build Error”
2. Edit this issue and add an error string in the Json below that can help us match this issue with future build breaks. You should use the known issues documentation

{
   "ErrorMessage" : ""
}

Additional information about the issue reported

No response

Report

Summary

24-Hour Hit Count	7-Day Hit Count	1-Month Count
0	0	0

[MattGal]

@jkotas to answer your previous question (I only did it for the first 2 lines; generalization is pretty easy). you can just get the build ids back from Kusto. Example:

let jobIds = 
WorkItems
| where Started >= datetime(2022-06-15 06:23:38.0460000) and Started <= datetime(2022-06-15 09:03:33.6950000)
| where QueueName == "ubuntu.1804.armarch.open" and Name != JobName
| project JobId;
Jobs | where JobId  in (jobIds)
| where Source == "ci/public/dotnet/runtime/refs/heads/main"
| where Type startswith "test/functional/cli"
| extend props = parse_json(Properties)
| summarize by tostring(props["BuildId"])

which leads me to these 8 main runs:

https://dnceng.visualstudio.com/public/_build/results?buildId=1825546 https://dnceng.visualstudio.com/public/_build/results?buildId=1825417 https://dnceng.visualstudio.com/public/_build/results?buildId=1825437 https://dnceng.visualstudio.com/public/_build/results?buildId=1825354 https://dnceng.visualstudio.com/public/_build/results?buildId=1825352 https://dnceng.visualstudio.com/public/_build/results?buildId=1825357 https://dnceng.visualstudio.com/public/_build/results?buildId=1825350 https://dnceng.visualstudio.com/public/_build/results?buildId=1825347

Skimming these, it would seem the majority are manually run runs from @agocke and @BruceForstall

[MattGal]

The fix for https://github.com/dotnet/arcade/issues/9694 is merged and rolled out. As there’s nothing more we can do presently if too much work gets sent, I am closing this issue. Feel free to reach out if you feel this is in error.