Test failure: baseservices/threading/regressions/115178/115178/115178.cmd
Failed in: runtime-coreclr outerloop 20250527.7
Failed tests:
coreclr windows x86 Checked @ Windows.10.Amd64.Open
- baseservices/threading/regressions/115178/115178/115178.cmd
coreclr windows arm64 Checked no_tiered_compilation @ Windows.11.Arm64.Open
- baseservices/threading/regressions/115178/115178/115178.cmd
Error message:
Return code: 1
Raw output file: C:hwB6310A12wB0C00963uploads
egressions115178115178output.txt
Raw output:
BEGIN EXECUTION
"C:hwB6310A12pcorerun.exe" -p "System.Reflection.Metadata.MetadataUpdater.IsSupported=false" -p "System.Runtime.Serialization.EnableUnsafeBinaryFormatterSerialization=true" 115178.dll
Running RunTestUsingInfiniteWait test.
Waiting for thread to enter wait...
Starting thread waiting on event.
Queue user APC.
Waiting for APC to execute...
Signaling wait event.
Waiting for thread to leave wait...
Stopping thread waiting on event.
RunTestUsingInfiniteWait test executed.
Running RunTestUsingTimedWait test.
Waiting for thread to enter wait...
Starting thread waiting on event.
Queue user APC's.
Error waiting on event, wait returned too early.
Stopping thread waiting on event.
Waiting for thread to leave wait...
RunTestUsingTimedWait test executed.
Running RunTestInterruptInfiniteWait test.
Waiting for thread to enter wait...
Starting thread waiting on event.
Queue user APC.
Waiting for APC to execute...
Interrupting thread wait...
Thread was interrupted as expected.
Stopping thread waiting on event.
Signaling wait event.
Waiting for thread to leave wait...
RunTestInterruptInfiniteWait test executed.
Xunit.Sdk.EqualException: Assert.Equal() Failure: Values differ
Expected: 100
Actual: 5
at Xunit.Assert.Equal[T](T expected, T actual, IEqualityComparer`1 comparer) in /_/src/arcade/src/Microsoft.DotNet.XUnitAssert/src/EqualityAsserts.cs:line 174
at Xunit.Assert.Equal[T](T expected, T actual) in /_/src/arcade/src/Microsoft.DotNet.XUnitAssert/src/EqualityAsserts.cs:line 96
at __GeneratedMainWrapper.Main()
Expected: 100
Actual: 101
END EXECUTION - FAILED
FAILED
Test failed. Trying to see if dump file was created in C:cores since 5/28/2025 2:45:59 AM
Finished looking for *.dmp. No new files created.
Test Harness Exitcode is : 1
To run the test:
Set up CORE_ROOT and run.
> C:hwB6310A12wB0C00963easeservices hreading hreading_group1../regressions/115178/115178/115178.cmd
Stack trace:
at Xunit.Assert.True(Nullable`1 condition, String userMessage) in /_/src/arcade/src/Microsoft.DotNet.XUnitAssert/src/BooleanAsserts.cs:line 141
at TestLibrary.OutOfProcessTest.RunOutOfProcessTest(String assemblyPath, String testPathPrefix)
at Program.<<Main>$>g__TestExecutor75|0_76(StreamWriter tempLogSw, StreamWriter statsCsvSw, <>c__DisplayClass0_0&)
Known Issue Error Message
Fill the error message using step by step known issues guidance.
{
"ErrorMessage": "Failed test: baseservices/threading/regressions/115178",
"ErrorPattern": "",
"BuildRetry": false,
"ExcludeConsoleLog": false
}
Known issue validation
Build: :mag_right: https://dev.azure.com/dnceng-public/public/_build/results?buildId=1052601
Error message validated: [Failed test: baseservices/threading/regressions/115178]
Result validation: :white_check_mark: Known issue matched with the provided build.
Validation performed at: 5/28/2025 2:29:26 PM UTC
Report
Summary
| 24-Hour Hit Count | 7-Day Hit Count | 1-Month Count |
|---|---|---|
| 0 | 0 | 78 |
Tagging subscribers to this area: @mangod9 See info in area-owners.md if you want to be subscribed.
Test introduced in #116001, cc @lateralusX
OK, my plan was to run outer test loop on that PR, but it got merged before I had a chance to trigger the test suite. It is probably a timer resolution issue, I see that CoreCLR internal waits uses lowres ticks and test uses StopWatch and higres ticks. I can create a PR, that output the waited time and run it on outer test loop and see what we get on these platforms and then adjust the accepted deviation accordingly.
Failed in: runtime-coreclr jitstress 20250527.1
Failed tests:
coreclr windows x86 Checked tailcallstress @ Windows.10.Amd64.Open
- baseservices/threading/regressions/115178/115178/115178.cmd
coreclr windows arm64 Checked disabler2r @ Windows.11.Arm64.Open
- baseservices/threading/regressions/115178/115178/115178.cmd
coreclr windows x64 Checked jitstress2_tiered @ Windows.10.Amd64.Open
- baseservices/threading/regressions/115178/115178/115178.cmd
coreclr windows x64 Checked jitstress1_tiered @ Windows.10.Amd64.Open
- baseservices/threading/regressions/115178/115178/115178.cmd
coreclr windows arm64 Checked jitminopts @ Windows.11.Arm64.Open
- baseservices/threading/regressions/115178/115178/115178.cmd
Error message:
Return code: 1
Raw output file: C:hwC0B909DBwB60409E0uploads
egressions115178115178output.txt
Raw output:
BEGIN EXECUTION
"C:hwC0B909DBpcorerun.exe" -p "System.Reflection.Metadata.MetadataUpdater.IsSupported=false" -p "System.Runtime.Serialization.EnableUnsafeBinaryFormatterSerialization=true" 115178.dll
Running RunTestUsingInfiniteWait test.
Waiting for thread to enter wait...
Starting thread waiting on event.
Queue user APC.
Waiting for APC to execute...
Signaling wait event.
Waiting for thread to leave wait...
Stopping thread waiting on event.
RunTestUsingInfiniteWait test executed.
Running RunTestUsingTimedWait test.
Waiting for thread to enter wait...
Starting thread waiting on event.
Queue user APC's.
Error waiting on event, wait returned too early.
Stopping thread waiting on event.
Waiting for thread to leave wait...
RunTestUsingTimedWait test executed.
Running RunTestInterruptInfiniteWait test.
Waiting for thread to enter wait...
Starting thread waiting on event.
Queue user APC.
Waiting for APC to execute...
Interrupting thread wait...
Thread was interrupted as expected.
Stopping thread waiting on event.
Signaling wait event.
Waiting for thread to leave wait...
RunTestInterruptInfiniteWait test executed.
Xunit.Sdk.EqualException: Assert.Equal() Failure: Values differ
Expected: 100
Actual: 5
at Xunit.Assert.Equal[T](T expected, T actual, IEqualityComparer`1 comparer) in /_/src/arcade/src/Microsoft.DotNet.XUnitAssert/src/EqualityAsserts.cs:line 174
at __GeneratedMainWrapper.Main()
Expected: 100
Actual: 101
END EXECUTION - FAILED
FAILED
Test failed. Trying to see if dump file was created in C:cores since 5/28/2025 5:42:01 AM
Test Harness Exitcode is : 1
To run the test:
Set up CORE_ROOT and run.
> C:hwC0B909DBwB60409E0easeservices hreading hreading_group1../regressions/115178/115178/115178.cmd
Stack trace:
at Xunit.Assert.True(Nullable`1 condition, String userMessage) in /_/src/arcade/src/Microsoft.DotNet.XUnitAssert/src/BooleanAsserts.cs:line 141
at Xunit.Assert.True(Boolean condition, String userMessage) in /_/src/arcade/src/Microsoft.DotNet.XUnitAssert/src/BooleanAsserts.cs:line 123
at Program.<<Main>$>g__TestExecutor75|0_76(StreamWriter tempLogSw, StreamWriter statsCsvSw, <>c__DisplayClass0_0&)
Hey @lateralusX, could you please disable the test for now since it's affecting CI?
Failed in: runtime-coreclr jitstress 20250528.2
Failed tests:
coreclr windows x86 Checked disabler2r @ Windows.10.Amd64.Open
- baseservices/threading/regressions/115178/115178/115178.cmd
coreclr windows x64 Checked jitstress2 @ Windows.10.Amd64.Open
- baseservices/threading/regressions/115178/115178/115178.cmd
coreclr windows x86 Checked tailcallstress @ Windows.10.Amd64.Open
- baseservices/threading/regressions/115178/115178/115178.cmd
coreclr windows x64 Checked jitminopts @ Windows.10.Amd64.Open
- baseservices/threading/regressions/115178/115178/115178.cmd
coreclr windows arm64 Checked jitminopts @ Windows.11.Arm64.Open
- baseservices/threading/regressions/115178/115178/115178.cmd
coreclr windows arm64 Checked disabler2r @ Windows.11.Arm64.Open
- baseservices/threading/regressions/115178/115178/115178.cmd
coreclr windows arm64 Checked tailcallstress @ Windows.11.Arm64.Open
- baseservices/threading/regressions/115178/115178/115178.cmd
Error message:
Return code: 1
Raw output file: C:hw9671083AwA7F80965uploads
egressions115178115178output.txt
Raw output:
BEGIN EXECUTION
"C:hw9671083Apcorerun.exe" -p "System.Reflection.Metadata.MetadataUpdater.IsSupported=false" -p "System.Runtime.Serialization.EnableUnsafeBinaryFormatterSerialization=true" 115178.dll
Running RunTestUsingInfiniteWait test.
Waiting for thread to enter wait...
Starting thread waiting on event.
Queue user APC.
Waiting for APC to execute...
Signaling wait event.
Waiting for thread to leave wait...
Stopping thread waiting on event.
RunTestUsingInfiniteWait test executed.
Running RunTestUsingTimedWait test.
Waiting for thread to enter wait...
Starting thread waiting on event.
Queue user APC's.
Error waiting on event, wait returned too early.
Stopping thread waiting on event.
Waiting for thread to leave wait...
RunTestUsingTimedWait test executed.
Running RunTestInterruptInfiniteWait test.
Waiting for thread to enter wait...
Starting thread waiting on event.
Queue user APC.
Waiting for APC to execute...
Interrupting thread wait...
Thread was interrupted as expected.
Stopping thread waiting on event.
Signaling wait event.
Waiting for thread to leave wait...
RunTestInterruptInfiniteWait test executed.
Xunit.Sdk.EqualException: Assert.Equal() Failure: Values differ
Expected: 100
Actual: 5
at Xunit.Assert.Equal[T](T expected, T actual, IEqualityComparer`1 comparer) in /_/src/arcade/src/Microsoft.DotNet.XUnitAssert/src/EqualityAsserts.cs:line 174
at __GeneratedMainWrapper.Main()
Expected: 100
Actual: 101
END EXECUTION - FAILED
FAILED
Test failed. Trying to see if dump file was created in C:cores since 5/29/2025 6:06:16 AM
Test Harness Exitcode is : 1
To run the test:
Set up CORE_ROOT and run.
> C:hw9671083AwA7F80965easeservices hreading hreading_group1../regressions/115178/115178/115178.cmd
Stack trace:
at Xunit.Assert.True(Nullable`1 condition, String userMessage) in /_/src/arcade/src/Microsoft.DotNet.XUnitAssert/src/BooleanAsserts.cs:line 141
at TestLibrary.OutOfProcessTest.RunOutOfProcessTest(String assemblyPath, String testPathPrefix)
at Program.<<Main>$>g__TestExecutor75|0_76(StreamWriter tempLogSw, StreamWriter statsCsvSw, <>c__DisplayClass0_0&)
Test disabled by #116106.
Hey @lateralusX, could you please disable the test for now since it's affecting CI?
Sorry was OOF, but had a fix running in https://github.com/dotnet/runtime/pull/116066 that seems to have fixed the difference in timer resolution between test and CoreCLR wait implementation. I will re-enable the test as part of that PR.
Failed in: runtime-coreclr r2r 20250529.1
Failed tests:
R2R-CG2 windows arm64 Checked @ Windows.11.Arm64.Open
- baseservices/threading/regressions/115178/115178/115178.cmd
R2R-CG2 windows x64 Checked no_tiered_compilation @ Windows.10.Amd64.Open
- baseservices/threading/regressions/115178/115178/115178.cmd
Error message:
Return code: 1
Raw output file: C:hwB5E8097DwAB5109ADuploads
egressions115178115178output.txt
Raw output:
BEGIN EXECUTION
115178.dll
TestLibrary.dll
2 file(s) copied.
6:50:51.99
Response file: C:hwB5E8097DwAB5109ADeaseservices hreading
egressions115178115178115178.dll.rsp
C:hwB5E8097DwAB5109ADeaseservices hreading
egressions115178115178IL-CG2115178.dll
-O
-o:C:hwB5E8097DwAB5109ADeaseservices hreading
egressions115178115178115178.dll
--targetarch:arm64
--targetos:windows
--verify-type-and-field-layout
--method-layout:random
-r:C:hwB5E8097DpSystem.*.dll
-r:C:hwB5E8097DpMicrosoft.*.dll
-r:C:hwB5E8097Dp\xunit.*.dll
-r:C:hwB5E8097Dpmscorlib.dll
-r:C:hwB5E8097Dp
etstandard.dll
"Running CrossGen2: "C:hwB5E8097Dpcrossgen2crossgen2.exe" @"C:hwB5E8097DwAB5109ADeaseservices hreading
egressions115178115178115178.dll.rsp" -r:C:hwB5E8097DwAB5109ADeaseservices hreading hreading_group1IL-CG2*.dll -r:C:hwB5E8097DwAB5109ADeaseservices hreading
egressions115178115178IL-CG2*.dll"
Emitting R2R PE file: C:hwB5E8097DwAB5109ADeaseservices hreading
egressions115178115178115178.dll
"Running R2RDump: "dotnet" "C:hwB5E8097Dp
2rdump
2rdump.dll" --header --sc --in C:hwB5E8097DwAB5109ADeaseservices hreading
egressions115178115178115178.dll --out C:hwB5E8097DwAB5109ADeaseservices hreading
egressions115178115178115178.dll.r2rdump --val"
6:50:52.99
6:50:52.99
Response file: C:hwB5E8097DwAB5109ADeaseservices hreading
egressions115178115178TestLibrary.dll.rsp
C:hwB5E8097DwAB5109ADeaseservices hreading
egressions115178115178IL-CG2TestLibrary.dll
-O
-o:C:hwB5E8097DwAB5109ADeaseservices hreading
egressions115178115178TestLibrary.dll
--targetarch:arm64
--targetos:windows
--verify-type-and-field-layout
--method-layout:random
-r:C:hwB5E8097DpSystem.*.dll
-r:C:hwB5E8097DpMicrosoft.*.dll
-r:C:hwB5E8097Dp\xunit.*.dll
-r:C:hwB5E8097Dpmscorlib.dll
-r:C:hwB5E8097Dp
etstandard.dll
"Running CrossGen2: "C:hwB5E8097Dpcrossgen2crossgen2.exe" @"C:hwB5E8097DwAB5109ADeaseservices hreading
egressions115178115178TestLibrary.dll.rsp" -r:C:hwB5E8097DwAB5109ADeaseservices hreading hreading_group1IL-CG2*.dll -r:C:hwB5E8097DwAB5109ADeaseservices hreading
egressions115178115178IL-CG2*.dll"
Emitting R2R PE file: C:hwB5E8097DwAB5109ADeaseservices hreading
egressions115178115178TestLibrary.dll
"Running R2RDump: "dotnet" "C:hwB5E8097Dp
2rdump
2rdump.dll" --header --sc --in C:hwB5E8097DwAB5109ADeaseservices hreading
egressions115178115178TestLibrary.dll --out C:hwB5E8097DwAB5109ADeaseservices hreading
egressions115178115178TestLibrary.dll.r2rdump --val"
6:50:53.42
"C:hwB5E8097Dpcorerun.exe" -p "System.Reflection.Metadata.MetadataUpdater.IsSupported=false" -p "System.Runtime.Serialization.EnableUnsafeBinaryFormatterSerialization=true" 115178.dll
Running RunTestUsingInfiniteWait test.
Waiting for thread to enter wait...
Starting thread waiting on event.
Queue user APC.
Waiting for APC to execute...
Signaling wait event.
Waiting for thread to leave wait...
Stopping thread waiting on event.
RunTestUsingInfiniteWait test executed.
Running RunTestUsingTimedWait test.
Waiting for thread to enter wait...
Starting thread waiting on event.
Queue user APC's.
Error waiting on event, wait returned too early.
Stopping thread waiting on event.
Waiting for thread to leave wait...
RunTestUsingTimedWait test executed.
Running RunTestInterruptInfiniteWait test.
Starting thread waiting on event.
Waiting for thread to enter wait...
Queue user APC.
Waiting for APC to execute...
Interrupting thread wait...
Thread was interrupted as expected.
Stopping thread waiting on event.
Signaling wait event.
Waiting for thread to leave wait...
RunTestInterruptInfiniteWait test executed.
Xunit.Sdk.EqualException: Assert.Equal() Failure: Values differ
Expected: 100
Actual: 5
at Xunit.Assert.Equal[T](T expected, T actual, IEqualityComparer`1 comparer) in /_/src/arcade/src/Microsoft.DotNet.XUnitAssert/src/EqualityAsserts.cs:line 174
at Xunit.Assert.Equal[T](T expected, T
Stack trace:
at Xunit.Assert.True(Nullable`1 condition, String userMessage) in /_/src/arcade/src/Microsoft.DotNet.XUnitAssert/src/BooleanAsserts.cs:line 141
at Xunit.Assert.True(Boolean condition, String userMessage) in /_/src/arcade/src/Microsoft.DotNet.XUnitAssert/src/BooleanAsserts.cs:line 123
at TestLibrary.OutOfProcessTest.RunOutOfProcessTest(String assemblyPath, String testPathPrefix)
at Program.<<Main>$>g__TestExecutor75|0_76(StreamWriter tempLogSw, StreamWriter statsCsvSw, <>c__DisplayClass0_0&)
hey @lateralusX, have you made the fix so this can be enabled again?
Have been working on some other work items lately, but I have the PR that increase the accepted window, so the PR was "ready", but then it exposed a suble issue in CoreCLR waiting logic that needed to be addressed and didn't have time to get back to it yet, will try to get to it today or tomrrow.
This is still failing (at least in jit stress)
This is still failing (at least in jit stress)
Could you please open a new issue on it, with links to logs, etc.?
I have looked at the last jit stress run and I do not see it failing there: https://dev.azure.com/dnceng-public/public/_build/results?buildId=1118914&view=results
https://github.com/dotnet/runtime/issues/118598