runtime icon indicating copy to clipboard operation
runtime copied to clipboard

System.Net.Quic tests timeout

Open ericstj opened this issue 1 year ago • 4 comments

Build Information

Build: https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_build/results?buildId=805750 Build error leg or test failing: System.Net.Quic.Functional.Tests.WorkItemExecution Pull request: https://github.com/dotnet/runtime/pull/107724

Error Message

Fill the error message using step by step known issues guidance.

{
  "ErrorMessage": "",
  "ErrorPattern": "'System.Net.Quic.Functional.Tests' END OF WORK ITEM LOG: Command timed out, and was killed]",
  "BuildRetry": false,
  "ExcludeConsoleLog": false
}

Known issue validation

Build: :mag_right: https://dev.azure.com/dnceng-public/public/_build/results?buildId=805750 Error message validated: ['System.Net.Quic.Functional.Tests' END OF WORK ITEM LOG: Command timed out, and was killed]] Result validation: :white_check_mark: Known issue matched with the provided build. Validation performed at: 9/12/2024 7:56:17 PM UTC

Report

Build Definition Test Pull Request
866047 dotnet/runtime System.Net.Quic.Functional.Tests.WorkItemExecution dotnet/runtime#108620
859797 dotnet/runtime System.Net.Quic.Functional.Tests.WorkItemExecution dotnet/runtime#109482
849068 dotnet/runtime System.Net.Quic.Functional.Tests.WorkItemExecution dotnet/runtime#108932

Summary

24-Hour Hit Count 7-Day Hit Count 1-Month Count
0 1 3

ericstj avatar Sep 12 '24 19:09 ericstj

Tagging subscribers to this area: @dotnet/area-infrastructure-libraries See info in area-owners.md if you want to be subscribed.

Tagging subscribers to this area: @dotnet/ncl See info in area-owners.md if you want to be subscribed.

Related to #103482

Log:

Console log: 'System.Net.Quic.Functional.Tests' from job 670b66ae-06e5-4b53-92f3-603cb67faae9 workitem c9d3b0a1-5903-476a-af61-2c2df727e696 (osx.1200.amd64.open) executed on machine dci-mac-build-193 running macOS-12.7.2
+ export __TestArchitecture=x64
+ __TestArchitecture=x64
+ find /tmp/helix/working/A7D00979/p -name createdump
+ xargs -n 1 codesign -s - -f --preserve-metadata=entitlements
/tmp/helix/working/A7D00979/p/shared/Microsoft.NETCore.App/9.0.0/createdump: replacing existing signature
+ ./RunTests.sh --runtime-path /tmp/helix/working/A7D00979/p
========================= Begin custom configuration settings ==============================
export __IsXUnitLogCheckerSupported=1
export XUNIT_HIDE_PASSING_OUTPUT_DIAGNOSTICS=1
========================== End custom configuration settings ===============================
----- start Wed Sep 11 20:47:08 EDT 2024 =============== To repro directly: =====================================================
pushd .
/tmp/helix/working/A7D00979/p/dotnet exec --runtimeconfig System.Net.Quic.Functional.Tests.runtimeconfig.json --depsfile System.Net.Quic.Functional.Tests.deps.json xunit.console.dll System.Net.Quic.Functional.Tests.dll -xml testResults.xml -nologo -nocolor -notrait category=IgnoreForCI -notrait category=OuterLoop -notrait category=failing 
popd
===========================================================================================================
/private/tmp/helix/working/A7D00979/w/ACE20948/e /private/tmp/helix/working/A7D00979/w/ACE20948/e
  Discovering: System.Net.Quic.Functional.Tests (method display = ClassAndMethod, method display options = None)
  Discovered:  System.Net.Quic.Functional.Tests (found 138 of 152 test cases)
  Starting:    System.Net.Quic.Functional.Tests (parallel test collections = on [12 threads], stop on fail = off)
MsQuic supported and using 'libmsquic.dylib 2.4.0.0 (e0385b047d7bd622319e9f6c4c00184a1294eea8)'.
    System.Net.Quic.Tests.MsQuicPlatformDetectionTests.UnsupportedPlatforms_ThrowsPlatformNotSupportedException [SKIP]
      Condition(s) not met: "IsQuicUnsupported"
   System.Net.Quic.Functional.Tests: [Long Running Test] 'System.Net.Quic.Tests.QuicStreamConformanceTests.ConcurrentBidirectionalReadsWrites_Success', Elapsed: 00:02:06
   System.Net.Quic.Functional.Tests: [Long Running Test] 'System.Net.Quic.Tests.QuicStreamConformanceTests.ConcurrentBidirectionalReadsWrites_Success', Elapsed: 00:04:07
   System.Net.Quic.Functional.Tests: [Long Running Test] 'System.Net.Quic.Tests.QuicStreamConformanceTests.ConcurrentBidirectionalReadsWrites_Success', Elapsed: 00:06:09
   System.Net.Quic.Functional.Tests: [Long Running Test] 'System.Net.Quic.Tests.QuicStreamConformanceTests.ConcurrentBidirectionalReadsWrites_Success', Elapsed: 00:08:10
   System.Net.Quic.Functional.Tests: [Long Running Test] 'System.Net.Quic.Tests.QuicStreamConformanceTests.ConcurrentBidirectionalReadsWrites_Success', Elapsed: 00:10:12
   System.Net.Quic.Functional.Tests: [Long Running Test] 'System.Net.Quic.Tests.QuicStreamConformanceTests.ConcurrentBidirectionalReadsWrites_Success', Elapsed: 00:12:13
['System.Net.Quic.Functional.Tests' END OF WORK ITEM LOG: Command timed out, and was killed]

liveans avatar Sep 14 '24 10:09 liveans

Tagging subscribers to this area: @dotnet/ncl See info in area-owners.md if you want to be subscribed.

@karelz can y'all take a look? this is hitting just about every PR'ish. has something gotten much worse here?

jeffschwMSFT avatar Mar 28 '25 19:03 jeffschwMSFT

Seems like something is wrong with azurelinux3 queue in Azure because this is the either third or fourth report that we got from different suites.

liveans avatar Mar 28 '25 20:03 liveans

Duplicate of https://github.com/dotnet/dnceng/issues/5329

karelz avatar Apr 04 '25 07:04 karelz

Dupe of https://github.com/dotnet/dnceng/issues/5329

ManickaP avatar Apr 04 '25 07:04 ManickaP

So originally this had nothing to do with AzureLinux 3 (it was an OSX issue) but now it catches the AZL3 timeouts here 🤦 So this will need to get cleaned up once we're done with https://github.com/dotnet/dnceng/issues/5329. As the original was waiting for us to update msquic in OSX helix machines.

ManickaP avatar Apr 04 '25 07:04 ManickaP