Failure on Helix tests - Tests timing out

[MiYanni]

Build Information

Build: https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_build/results?buildId=635799 Build error leg or test failing: Microsoft.DotNet.MSBuildSdkResolver.Tests.dll.3.WorkItemExecution Pull request: https://github.com/dotnet/sdk/pull/40059

Error Message

Fill the error message using step by step known issues guidance.

{
  "ErrorMessage": "END OF WORK ITEM LOG: Command timed out, and was killed",
  "BuildRetry": false,
  "ExcludeConsoleLog": false
}

Known issue validation

Build: :mag_right: https://dev.azure.com/dnceng-public/public/_build/results?buildId=635799 Error message validated: [END OF WORK ITEM LOG: Command timed out, and was killed] Result validation: :white_check_mark: Known issue matched with the provided build. Validation performed at: 4/9/2024 5:21:23 PM UTC

Report

Build	Definition	Test	Pull Request
2856924	dotnet-sdk	Microsoft.NET.Build.Tests.dll.22.WorkItemExecution	#55911
2856926	dotnet-sdk	dotnet.Tests.dll.13.WorkItemExecution	#55910
2856806	dotnet-sdk	dotnet.Tests.dll.13.WorkItemExecution	#55910
1221408	dotnet/sdk	dotnet-watch.Tests.dll.2.WorkItemExecution	dotnet/sdk#52041
2854229	dotnet-sdk	Microsoft.NET.Publish.Tests.dll.7.WorkItemExecution	#55556
2854227	dotnet-sdk	Microsoft.NET.Publish.Tests.dll.7.WorkItemExecution	#55557
2851417	dotnet-sdk	Microsoft.NET.Build.Tests.dll.22.WorkItemExecution	#55692
2848501	dotnet-sdk	Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution	#55556
1213128	dotnet/sdk	Microsoft.NET.Sdk.Razor.Tool.Tests.dll.1.WorkItemExecution	dotnet/sdk#51714
1206490	dotnet/sdk	Microsoft.CodeAnalysis.NetAnalyzers.UnitTests.dll.41.WorkItemExecution	dotnet/sdk#51790
1203938	dotnet/sdk	dotnet-watch.Tests.dll.2.WorkItemExecution	dotnet/sdk#51659
1203007	dotnet/sdk	dotnet-watch.Tests.dll.2.WorkItemExecution

Summary

24-Hour Hit Count	7-Day Hit Count	1-Month Count
0	3	12

[nagilson]

@tmat May you please look at this dotnet watch failure?

[tmat]

@nagilson I checked a few logs from above and it looks like the failures are in release/8.0.1xx branch. That wouldn't have various test infra fixes.

[nagilson]

Thank you for checking :) @tmat, which test infra fixes are you referring to? It may be worth porting them over to 8.0.1xx. Any disagreements @marcpopMSFT?

[nagilson]

We also just hit it in main, so there might be another existing problem: https://github.com/dotnet/sdk/pull/41045

[baronfel]

@tmat this is popping up again in the rc1 branches, when you get back can you take a look?

[tmat]

@baronfel I can take a look. Do you have a link to the failed run? The test log should be good enough to determine the issue on main/rc1 branches.

[baronfel]

The helix timeouts are most of the failed tests in this pipeline, but you can't access them right now due to helix auth issues.