runtime icon indicating copy to clipboard operation
runtime copied to clipboard

Test failure: NullReferenceException in Internal.JitInterface.CorInfoImpl._beginInlining

Open v-wenyuxu opened this issue 1 year ago • 86 comments
trafficstars

Failed in: runtime-coreclr outerloop 20240724.3

Failed tests:

R2R-CG2 linux arm64 Checked @ (Alpine.317.Arm64.Open)[email protected]/dotnet-buildtools/prereqs:alpine-3.17-helix-arm64v8
    - Regressions/coreclr/GitHub_87879/test87879/test87879.cmd

Error message:

 /root/helix/work/workitem/e/Regressions/Regressions/../coreclr/GitHub_87879/test87879/test87879.sh: line 315: -r:/root/helix/work/workitem/e/Regressions/coreclr/GitHub_87879/test87879/IL-CG2/*.dll: No such file or directory
Unhandled exception. ILCompiler.CodeGenerationFailedException: Code generation failed for method '[test87879]__GeneratedMainWrapper..ctor()'
 ---> System.NullReferenceException: Object reference not set to an instance of an object.
   at Internal.JitInterface.CorInfoImpl._beginInlining(IntPtr thisHandle, IntPtr* ppException, CORINFO_METHOD_STRUCT_* inlinerHnd, CORINFO_METHOD_STRUCT_* inlineeHnd) in /_/src/coreclr/tools/Common/JitInterface/CorInfoImpl_generated.cs:line 154
   --- End of inner exception stack trace ---
   at Internal.JitInterface.CorInfoImpl.CompileMethodInternal(IMethodNode methodCodeNodeNeedingCode, MethodIL methodIL) in /_/src/coreclr/tools/Common/JitInterface/CorInfoImpl.cs:line 381
   at Internal.JitInterface.CorInfoImpl.CompileMethod(MethodWithGCInfo methodCodeNodeNeedingCode, Logger logger) in /_/src/coreclr/tools/aot/ILCompiler.ReadyToRun/JitInterface/CorInfoImpl.ReadyToRun.cs:line 810
   at ILCompiler.ReadyToRunCodegenCompilation.<>c__DisplayClass50_0.<ComputeDependencyNodeDependencies>g__CompileOneMethod|5(DependencyNodeCore`1 dependency, Int32 compileThreadId) in /_/src/coreclr/tools/aot/ILCompiler.ReadyToRun/Compiler/ReadyToRunCodegenCompilation.cs:line 898
   at ILCompiler.ReadyToRunCodegenCompilation.<>c__DisplayClass50_0.<ComputeDependencyNodeDependencies>g__CompileOnThread|4(Int32 compilationThreadId) in /_/src/coreclr/tools/aot/ILCompiler.ReadyToRun/Compiler/ReadyToRunCodegenCompilation.cs:line 833
   at ILCompiler.ReadyToRunCodegenCompilation.<>c__DisplayClass50_0.<ComputeDependencyNodeDependencies>g__CompilationThread|3(Object objThreadId) in /_/src/coreclr/tools/aot/ILCompiler.ReadyToRun/Compiler/ReadyToRunCodegenCompilation.cs:line 811
Unhandled exception. System.ArgumentNullException: Value cannot be null. (Parameter 'array')
   at System.Array.Clear(Array array, Int32 index, Int32 length)
   at Internal.JitInterface.CorInfoImpl.CompileMethodCleanup() in /_/src/coreclr/tools/Common/JitInterface/CorInfoImpl.cs:line 700
   at Internal.JitInterface.CorInfoImpl.CompileMethod(MethodWithGCInfo methodCodeNodeNeedingCode, Logger logger) in /_/src/coreclr/tools/aot/ILCompiler.ReadyToRun/JitInterface/CorInfoImpl.ReadyToRun.cs:line 826
   at ILCompiler.ReadyToRunCodegenCompilation.<>c__DisplayClass50_0.<ComputeDependencyNodeDependencies>g__CompileOneMethod|5(DependencyNodeCore`1 dependency, Int32 compileThreadId) in /_/src/coreclr/tools/aot/ILCompiler.ReadyToRun/Compiler/ReadyToRunCodegenCompilation.cs:line 898
   at ILCompiler.ReadyToRunCodegenCompilation.<>c__DisplayClass50_0.<ComputeDependencyNodeDependencies>g__CompileOnThread|4(Int32 compilationThreadId) in /_/src/coreclr/tools/aot/ILCompiler.ReadyToRun/Compiler/ReadyToRunCodegenCompilation.cs:line 833
   at ILCompiler.ReadyToRunCodegenCompilation.<>c__DisplayClass50_0.<ComputeDependencyNodeDependencies>g__CompilationThread|3(Object objThreadId) in /_/src/coreclr/tools/aot/ILCompiler.ReadyToRun/Compiler/ReadyToRunCodegenCompilation.cs:line 811
/root/helix/work/workitem/e/Regressions/Regressions/../coreclr/GitHub_87879/test87879/test87879.sh: line 254:  4711 Aborted                 (core dumped) $__Command

Return code:      1
Raw output file:      /root/helix/work/workitem/uploads/coreclr/GitHub_87879/test87879/output.txt
Raw output:
BEGIN EXECUTION
in takeLock
/root/helix/work/workitem/e/Regressions/coreclr/GitHub_87879/test87879/IL-CG2/test87879.dll
19:50:09
Response file: /root/helix/work/workitem/e/Regressions/coreclr/GitHub_87879/test87879/test87879.dll.rsp
/root/helix/work/workitem/e/Regressions/coreclr/GitHub_87879/test87879/IL-CG2/test87879.dll
-o:/root/helix/work/workitem/e/Regressions/coreclr/GitHub_87879/test87879/test87879.dll
-r:/root/helix/work/correlation/System.*.dll
-r:/root/helix/work/correlation/Microsoft.*.

Stack trace:

   at TestLibrary.OutOfProcessTest.RunOutOfProcessTest(String assemblyPath, String testPathPrefix)
   at Program.<<Main>$>g__TestExecutor74|0_75(StreamWriter tempLogSw, StreamWriter statsCsvSw, <>c__DisplayClass0_0&)

Known Issue Error Message

Fill the error message using step by step known issues guidance.

{
  "ErrorMessage": ["NullReferenceException","_beginInlining"],
  "ErrorPattern": "",
  "BuildRetry": false,
  "ExcludeConsoleLog": false
}

Known issue validation

Build: :mag_right: https://dev.azure.com/dnceng-public/public/_build/results?buildId=753860 Error message validated: [NullReferenceException _beginInlining] Result validation: :white_check_mark: Known issue matched with the provided build. Validation performed at: 7/27/2024 1:53:56 AM UTC

Report

Build Definition Step Name Console log Pull Request
2580533 dotnet-runtime Build managed CoreCLR and host components, all libraries, and packs Log
2578580 dotnet-runtime Build managed CoreCLR and host components, all libraries, and packs Log
2575423 dotnet-runtime Build managed CoreCLR and host components, all libraries, and packs Log
2568689 dotnet-runtime Build managed CoreCLR and host components, all libraries, and packs Log
2566517 dotnet-runtime Build managed CoreCLR and host components, all libraries, and packs Log
2563367 dotnet-runtime Build managed CoreCLR and host components, all libraries, and packs Log
2563082 dotnet-runtime Build managed CoreCLR and host components, all libraries, and packs Log
2561971 dotnet-runtime Build managed CoreCLR and host components, all libraries, and packs Log
Build Definition Test Pull Request
846630 dotnet/runtime baseservices/TieredCompilation/BasicTest_QuickJitOff_R2r/BasicTest_QuickJitOff_R2r.cmd

Summary

24-Hour Hit Count 7-Day Hit Count 1-Month Count
0 2 9

v-wenyuxu avatar Jul 25 '24 01:07 v-wenyuxu

@steveisok We have picked up intermittent crossgen crash on arm64 in _beginInlining method. It is causing a lot of noise (see duplicate issues). Could you please take a look?

jkotas avatar Jul 25 '24 21:07 jkotas

I think it was likely introduced by the #104696 toolset update, so it is not easy to roll-back.

jkotas avatar Jul 25 '24 21:07 jkotas

@steveisok We have picked up intermittent crossgen crash on arm64 in _beginInlining method. It is causing a lot of noise (see duplicate issues). Could you please take a look?

Yep, I can have someone take a closer look.

steveisok avatar Jul 25 '24 21:07 steveisok

Failed in: runtime-coreclr outerloop 20240725.5

Failed tests:

R2R-CG2 linux arm64 Checked @ (Ubuntu.2004.Arm64.Open)[email protected]/dotnet-buildtools/prereqs:ubuntu-20.04-helix-arm64v8
    - reflection/SetValue/TrySetReadonlyStaticField/TrySetReadonlyStaticField.cmd

Error message:

 /root/helix/work/workitem/e/reflection/reflection/../SetValue/TrySetReadonlyStaticField/TrySetReadonlyStaticField.sh: line 315: -r:/root/helix/work/workitem/e/reflection/SetValue/TrySetReadonlyStaticField/IL-CG2/*.dll: No such file or directory
Unhandled exception. ILCompiler.CodeGenerationFailedException: Code generation failed for method '[TrySetReadonlyStaticField]X.Set(string,bool)'
 ---> System.NullReferenceException: Object reference not set to an instance of an object.
   at Internal.JitInterface.CorInfoImpl._beginInlining(IntPtr thisHandle, IntPtr* ppException, CORINFO_METHOD_STRUCT_* inlinerHnd, CORINFO_METHOD_STRUCT_* inlineeHnd) in /_/src/coreclr/tools/Common/JitInterface/CorInfoImpl_generated.cs:line 154
   --- End of inner exception stack trace ---
   at Internal.JitInterface.CorInfoImpl.CompileMethodInternal(IMethodNode methodCodeNodeNeedingCode, MethodIL methodIL) in /_/src/coreclr/tools/Common/JitInterface/CorInfoImpl.cs:line 381
   at Internal.JitInterface.CorInfoImpl.CompileMethod(MethodWithGCInfo methodCodeNodeNeedingCode, Logger logger) in /_/src/coreclr/tools/aot/ILCompiler.ReadyToRun/JitInterface/CorInfoImpl.ReadyToRun.cs:line 810
   at ILCompiler.ReadyToRunCodegenCompilation.<>c__DisplayClass50_0.<ComputeDependencyNodeDependencies>g__CompileOneMethod|5(DependencyNodeCore`1 dependency, Int32 compileThreadId) in /_/src/coreclr/tools/aot/ILCompiler.ReadyToRun/Compiler/ReadyToRunCodegenCompilation.cs:line 898
   at ILCompiler.ReadyToRunCodegenCompilation.<>c__DisplayClass50_0.<ComputeDependencyNodeDependencies>g__CompileOnThread|4(Int32 compilationThreadId) in /_/src/coreclr/tools/aot/ILCompiler.ReadyToRun/Compiler/ReadyToRunCodegenCompilation.cs:line 833
   at ILCompiler.ReadyToRunCodegenCompilation.<>c__DisplayClass50_0.<ComputeDependencyNodeDependencies>g__CompilationThread|3(Object objThreadId) in /_/src/coreclr/tools/aot/ILCompiler.ReadyToRun/Compiler/ReadyToRunCodegenCompilation.cs:line 811
Unhandled exception. System.ArgumentNullException: Value cannot be null. (Parameter 'array')
   at System.Array.Clear(Array array, Int32 index, Int32 length)
   at Internal.JitInterface.CorInfoImpl.CompileMethodCleanup() in /_/src/coreclr/tools/Common/JitInterface/CorInfoImpl.cs:line 700
   at Internal.JitInterface.CorInfoImpl.CompileMethod(MethodWithGCInfo methodCodeNodeNeedingCode, Logger logger) in /_/src/coreclr/tools/aot/ILCompiler.ReadyToRun/JitInterface/CorInfoImpl.ReadyToRun.cs:line 826
   at ILCompiler.ReadyToRunCodegenCompilation.<>c__DisplayClass50_0.<ComputeDependencyNodeDependencies>g__CompileOneMethod|5(DependencyNodeCore`1 dependency, Int32 compileThreadId) in /_/src/coreclr/tools/aot/ILCompiler.ReadyToRun/Compiler/ReadyToRunCodegenCompilation.cs:line 898
   at ILCompiler.ReadyToRunCodegenCompilation.<>c__DisplayClass50_0.<ComputeDependencyNodeDependencies>g__CompileOnThread|4(Int32 compilationThreadId) in /_/src/coreclr/tools/aot/ILCompiler.ReadyToRun/Compiler/ReadyToRunCodegenCompilation.cs:line 833
   at ILCompiler.ReadyToRunCodegenCompilation.<>c__DisplayClass50_0.<ComputeDependencyNodeDependencies>g__CompilationThread|3(Object objThreadId) in /_/src/coreclr/tools/aot/ILCompiler.ReadyToRun/Compiler/ReadyToRunCodegenCompilation.cs:line 811
/root/helix/work/workitem/e/reflection/reflection/../SetValue/TrySetReadonlyStaticField/TrySetReadonlyStaticField.sh: line 254:   954 Aborted                 (core dumped) $__Command

Return code:      1
Raw output file:      /root/helix/work/workitem/uploads/SetValue/TrySetReadonlyStaticField/output.txt
Raw output:
BEGIN EXECUTION
in takeLock
/root/helix/work/workitem/e/reflection/SetValue/TrySetReadonlyStaticField/IL-CG2/TrySetReadonlyStaticField.dll
20:03:02
Response file: /root/helix/work/workitem/e/reflection/SetValue/TrySetReadonlyStaticField/TrySetReadonlyStaticField.dll.rsp
/root/helix/work/workitem/e/reflection/SetValue/TrySetReadonlyStaticField/IL-CG2/TrySetReadonlyStaticField.dll
-o:/root/helix/work/workitem/e/reflection/SetValue/TrySetReadonlyStaticFi

Stack trace:

   at TestLibrary.OutOfProcessTest.RunOutOfProcessTest(String assemblyPath, String testPathPrefix)
   at Program.<<Main>$>g__TestExecutor13|0_14(StreamWriter tempLogSw, StreamWriter statsCsvSw, <>c__DisplayClass0_0&)

v-wenyuxu avatar Jul 26 '24 01:07 v-wenyuxu

This might be the same issue as #102370 and #104123.

jakobbotsch avatar Jul 26 '24 10:07 jakobbotsch

I think we should keep this open since it will keep failing with P6. We should consider adding workaround setting DOTNET_TailCallOpt=0 during our builds.

jakobbotsch avatar Jul 26 '24 18:07 jakobbotsch

Failed in: runtime-coreclr outerloop 20240728.2

Failed tests:

R2R-CG2 linux arm64 Checked no_tiered_compilation @ (Alpine.317.Arm64.Open)[email protected]/dotnet-buildtools/prereqs:alpine-3.17-helix-arm64v8
    - JIT/Stress/ABI/tailcalls_do/tailcalls_do.cmd

Error message:

 /root/helix/work/workitem/e/JIT/JIT_do/../Stress/ABI/tailcalls_do/tailcalls_do.sh: line 334: -r:/root/helix/work/workitem/e/JIT/Stress/ABI/tailcalls_do/IL-CG2/*.dll: No such file or directory
Unhandled exception. ILCompiler.CodeGenerationFailedException: Code generation failed for method '[tailcalls_do]ABIStress.Win86Abi.get_TailCalleeCandidateArgTypes()'
 ---> System.NullReferenceException: Object reference not set to an instance of an object.
   at Internal.JitInterface.CorInfoImpl._beginInlining(IntPtr thisHandle, IntPtr* ppException, CORINFO_METHOD_STRUCT_* inlinerHnd, CORINFO_METHOD_STRUCT_* inlineeHnd) in /_/src/coreclr/tools/Common/JitInterface/CorInfoImpl_generated.cs:line 154
   --- End of inner exception stack trace ---
   at Internal.JitInterface.CorInfoImpl.CompileMethodInternal(IMethodNode methodCodeNodeNeedingCode, MethodIL methodIL) in /_/src/coreclr/tools/Common/JitInterface/CorInfoImpl.cs:line 381
   at Internal.JitInterface.CorInfoImpl.CompileMethod(MethodWithGCInfo methodCodeNodeNeedingCode, Logger logger) in /_/src/coreclr/tools/aot/ILCompiler.ReadyToRun/JitInterface/CorInfoImpl.ReadyToRun.cs:line 810
   at ILCompiler.ReadyToRunCodegenCompilation.<>c__DisplayClass50_0.<ComputeDependencyNodeDependencies>g__CompileOneMethod|5(DependencyNodeCore`1 dependency, Int32 compileThreadId) in /_/src/coreclr/tools/aot/ILCompiler.ReadyToRun/Compiler/ReadyToRunCodegenCompilation.cs:line 898
   at ILCompiler.ReadyToRunCodegenCompilation.<>c__DisplayClass50_0.<ComputeDependencyNodeDependencies>g__CompileOnThread|4(Int32 compilationThreadId) in /_/src/coreclr/tools/aot/ILCompiler.ReadyToRun/Compiler/ReadyToRunCodegenCompilation.cs:line 833
   at ILCompiler.ReadyToRunCodegenCompilation.<>c__DisplayClass50_0.<ComputeDependencyNodeDependencies>g__CompilationThread|3(Object objThreadId) in /_/src/coreclr/tools/aot/ILCompiler.ReadyToRun/Compiler/ReadyToRunCodegenCompilation.cs:line 811
Unhandled exception. System.ArgumentNullException: Value cannot be null. (Parameter 'array')
   at System.Array.Clear(Array array, Int32 index, Int32 length)
   at Internal.JitInterface.CorInfoImpl.CompileMethodCleanup() in /_/src/coreclr/tools/Common/JitInterface/CorInfoImpl.cs:line 700
   at Internal.JitInterface.CorInfoImpl.CompileMethod(MethodWithGCInfo methodCodeNodeNeedingCode, Logger logger) in /_/src/coreclr/tools/aot/ILCompiler.ReadyToRun/JitInterface/CorInfoImpl.ReadyToRun.cs:line 826
   at ILCompiler.ReadyToRunCodegenCompilation.<>c__DisplayClass50_0.<ComputeDependencyNodeDependencies>g__CompileOneMethod|5(DependencyNodeCore`1 dependency, Int32 compileThreadId) in /_/src/coreclr/tools/aot/ILCompiler.ReadyToRun/Compiler/ReadyToRunCodegenCompilation.cs:line 898
   at ILCompiler.ReadyToRunCodegenCompilation.<>c__DisplayClass50_0.<ComputeDependencyNodeDependencies>g__CompileOnThread|4(Int32 compilationThreadId) in /_/src/coreclr/tools/aot/ILCompiler.ReadyToRun/Compiler/ReadyToRunCodegenCompilation.cs:line 833
   at ILCompiler.ReadyToRunCodegenCompilation.<>c__DisplayClass50_0.<ComputeDependencyNodeDependencies>g__CompilationThread|3(Object objThreadId) in /_/src/coreclr/tools/aot/ILCompiler.ReadyToRun/Compiler/ReadyToRunCodegenCompilation.cs:line 811
/root/helix/work/workitem/e/JIT/JIT_do/../Stress/ABI/tailcalls_do/tailcalls_do.sh: line 273:   213 Aborted                 (core dumped) $__Command

Return code:      1
Raw output file:      /root/helix/work/workitem/uploads/Stress/ABI/tailcalls_do/output.txt
Raw output:
BEGIN EXECUTION
in takeLock
/root/helix/work/workitem/e/JIT/Stress/ABI/tailcalls_do/IL-CG2/tailcalls_do.dll
20:39:30
Response file: /root/helix/work/workitem/e/JIT/Stress/ABI/tailcalls_do/tailcalls_do.dll.rsp
/root/helix/work/workitem/e/JIT/Stress/ABI/tailcalls_do/IL-CG2/tailcalls_do.dll
-o:/root/helix/work/workitem/e/JIT/Stress/ABI/tailcalls_do/tailcalls_do.dll
-r:/root/helix/work/correlation/System.*.dll
-r:/root/helix/work/correlation/Microsoft.*.dll
-r:/root/helix/work/correlation/xunit.*.dll
-r:/root/helix/work/correlation

Stack trace:

   at Xunit.Assert.True(Nullable`1 condition, String userMessage) in /_/src/Microsoft.DotNet.XUnitAssert/src/BooleanAsserts.cs:line 146
   at Xunit.Assert.True(Boolean condition, String userMessage) in /_/src/Microsoft.DotNet.XUnitAssert/src/BooleanAsserts.cs:line 128
   at TestLibrary.OutOfProcessTest.RunOutOfProcessTest(String assemblyPath, String testPathPrefix)
   at Program.<<Main>$>g__TestExecutor3|0_4(StreamWriter tempLogSw, StreamWriter statsCsvSw, <>c__DisplayClass0_0&)

v-wenyuxu avatar Jul 29 '24 01:07 v-wenyuxu

Failed in: runtime-coreclr r2r-extra 20240728.1

Failed tests:

R2R-CG2 linux arm64 Checked jitstressregs8 @ (Ubuntu.2004.Arm64.Open)[email protected]/dotnet-buildtools/prereqs:ubuntu-20.04-helix-arm64v8
    - baseservices/exceptions/generics/try-fault03/try-fault03.cmd
R2R-CG2 linux arm64 Checked jitstress2 @ (Ubuntu.2004.Arm64.Open)[email protected]/dotnet-buildtools/prereqs:ubuntu-20.04-helix-arm64v8
    - baseservices/exceptions/generics/try-fault-struct02/try-fault-struct02.cmd
R2R-CG2 linux arm64 Checked jitstressregs0x1000 @ (Ubuntu.2004.Arm64.Open)[email protected]/dotnet-buildtools/prereqs:ubuntu-20.04-helix-arm64v8
    - baseservices/exceptions/generics/try-filter-finally01/try-filter-finally01.cmd
R2R-CG2 linux arm64 Checked jitstress1 @ (Ubuntu.2004.Arm64.Open)[email protected]/dotnet-buildtools/prereqs:ubuntu-20.04-helix-arm64v8
    - JIT/Methodical/explicit/rotate/rotate_u2_d/rotate_u2_d.cmd
R2R-CG2 linux arm64 Checked jitstressregs3 @ (Ubuntu.2004.Arm64.Open)[email protected]/dotnet-buildtools/prereqs:ubuntu-20.04-helix-arm64v8
    - JIT/opt/virtualstubdispatch/mixed/mixed_cs_r/mixed_cs_r.cmd
R2R-CG2 linux arm64 Checked jitstressregs2 @ (Ubuntu.2004.Arm64.Open)[email protected]/dotnet-buildtools/prereqs:ubuntu-20.04-helix-arm64v8
    - JIT/jit64/hfa/main/testC/hfa_nd0C_r/hfa_nd0C_r.cmd

Error message:

 /root/helix/work/workitem/e/baseservices/exceptions/baseservices-exceptions/../generics/try-fault03/try-fault03.sh: line 315: -r:/root/helix/work/workitem/e/baseservices/exceptions/generics/try-fault03/IL-CG2/*.dll: No such file or directory
Unhandled exception. ILCompiler.CodeGenerationFailedException: Code generation failed for method '[try-fault03]RefY0..ctor()'
 ---> System.NullReferenceException: Object reference not set to an instance of an object.
   at Internal.JitInterface.CorInfoImpl._beginInlining(IntPtr thisHandle, IntPtr* ppException, CORINFO_METHOD_STRUCT_* inlinerHnd, CORINFO_METHOD_STRUCT_* inlineeHnd) in /_/src/coreclr/tools/Common/JitInterface/CorInfoImpl_generated.cs:line 154
   --- End of inner exception stack trace ---
   at Internal.JitInterface.CorInfoImpl.CompileMethodInternal(IMethodNode methodCodeNodeNeedingCode, MethodIL methodIL) in /_/src/coreclr/tools/Common/JitInterface/CorInfoImpl.cs:line 381
   at Internal.JitInterface.CorInfoImpl.CompileMethod(MethodWithGCInfo methodCodeNodeNeedingCode, Logger logger) in /_/src/coreclr/tools/aot/ILCompiler.ReadyToRun/JitInterface/CorInfoImpl.ReadyToRun.cs:line 810
   at ILCompiler.ReadyToRunCodegenCompilation.<>c__DisplayClass50_0.<ComputeDependencyNodeDependencies>g__CompileOneMethod|5(DependencyNodeCore`1 dependency, Int32 compileThreadId) in /_/src/coreclr/tools/aot/ILCompiler.ReadyToRun/Compiler/ReadyToRunCodegenCompilation.cs:line 898
   at ILCompiler.ReadyToRunCodegenCompilation.<>c__DisplayClass50_0.<ComputeDependencyNodeDependencies>g__CompileOnThread|4(Int32 compilationThreadId) in /_/src/coreclr/tools/aot/ILCompiler.ReadyToRun/Compiler/ReadyToRunCodegenCompilation.cs:line 833
   at ILCompiler.ReadyToRunCodegenCompilation.<>c__DisplayClass50_0.<ComputeDependencyNodeDependencies>g__CompilationThread|3(Object objThreadId) in /_/src/coreclr/tools/aot/ILCompiler.ReadyToRun/Compiler/ReadyToRunCodegenCompilation.cs:line 811
Unhandled exception. System.ArgumentNullException: Value cannot be null. (Parameter 'array')
   at System.Array.Clear(Array array, Int32 index, Int32 length)
   at Internal.JitInterface.CorInfoImpl.CompileMethodCleanup() in /_/src/coreclr/tools/Common/JitInterface/CorInfoImpl.cs:line 700
   at Internal.JitInterface.CorInfoImpl.CompileMethod(MethodWithGCInfo methodCodeNodeNeedingCode, Logger logger) in /_/src/coreclr/tools/aot/ILCompiler.ReadyToRun/JitInterface/CorInfoImpl.ReadyToRun.cs:line 826
   at ILCompiler.ReadyToRunCodegenCompilation.<>c__DisplayClass50_0.<ComputeDependencyNodeDependencies>g__CompileOneMethod|5(DependencyNodeCore`1 dependency, Int32 compileThreadId) in /_/src/coreclr/tools/aot/ILCompiler.ReadyToRun/Compiler/ReadyToRunCodegenCompilation.cs:line 898
   at ILCompiler.ReadyToRunCodegenCompilation.<>c__DisplayClass50_0.<ComputeDependencyNodeDependencies>g__CompileOnThread|4(Int32 compilationThreadId) in /_/src/coreclr/tools/aot/ILCompiler.ReadyToRun/Compiler/ReadyToRunCodegenCompilation.cs:line 833
   at ILCompiler.ReadyToRunCodegenCompilation.<>c__DisplayClass50_0.<ComputeDependencyNodeDependencies>g__CompilationThread|3(Object objThreadId) in /_/src/coreclr/tools/aot/ILCompiler.ReadyToRun/Compiler/ReadyToRunCodegenCompilation.cs:line 811
/root/helix/work/workitem/e/baseservices/exceptions/baseservices-exceptions/../generics/try-fault03/try-fault03.sh: line 254:  2221 Aborted                 (core dumped) $__Command

Return code:      1
Raw output file:      /root/helix/work/workitem/uploads/generics/try-fault03/output.txt
Raw output:
BEGIN EXECUTION
in takeLock
/root/helix/work/workitem/e/baseservices/exceptions/generics/try-fault03/IL-CG2/try-fault03.dll
04:48:15
Response file: /root/helix/work/workitem/e/baseservices/exceptions/generics/try-fault03/try-fault03.dll.rsp
/root/helix/work/workitem/e/baseservices/exceptions/generics/try-fault03/IL-CG2/try-fault03.dll
-o:/root/helix/work/workitem/e/baseservices/exceptions/generics/try-fault03/try-fault03.dll
-r:/root/helix/work/correlation/System.*.dll
-r:/root/helix/work

Stack trace:

   at Xunit.Assert.True(Nullable`1 condition, String userMessage) in /_/src/Microsoft.DotNet.XUnitAssert/src/BooleanAsserts.cs:line 146
   at Xunit.Assert.True(Boolean condition, String userMessage) in /_/src/Microsoft.DotNet.XUnitAssert/src/BooleanAsserts.cs:line 128
   at TestLibrary.OutOfProcessTest.RunOutOfProcessTest(String assemblyPath, String testPathPrefix)
   at Program.<<Main>$>g__TestExecutor90|0_91(StreamWriter tempLogSw, StreamWriter statsCsvSw, <>c__DisplayClass0_0&)

v-wenyuxu avatar Jul 30 '24 01:07 v-wenyuxu

Failed in: runtime-coreclr outerloop 20240730.2

Failed tests:

R2R-CG2 linux arm64 Checked no_tiered_compilation @ (Alpine.317.Arm64.Open)[email protected]/dotnet-buildtools/prereqs:alpine-3.17-helix-arm64v8
    - Loader/classloader/TypeInitialization/CircularCctors/CircularCctorThreeThreads03/CircularCctorThreeThreads03.cmd

Error message:

 /root/helix/work/workitem/e/Loader/Loader/../classloader/TypeInitialization/CircularCctors/CircularCctorThreeThreads03/CircularCctorThreeThreads03.sh: line 315: -r:/root/helix/work/workitem/e/Loader/classloader/TypeInitialization/CircularCctors/CircularCctorThreeThreads03/IL-CG2/*.dll: No such file or directory
Unhandled exception. ILCompiler.CodeGenerationFailedException: Code generation failed for method '[CircularCctorThreeThreads03]A.SomeMethod()'
 ---> System.NullReferenceException: Object reference not set to an instance of an object.
   at Internal.JitInterface.CorInfoImpl._beginInlining(IntPtr thisHandle, IntPtr* ppException, CORINFO_METHOD_STRUCT_* inlinerHnd, CORINFO_METHOD_STRUCT_* inlineeHnd) in /_/src/coreclr/tools/Common/JitInterface/CorInfoImpl_generated.cs:line 154
   --- End of inner exception stack trace ---
   at Internal.JitInterface.CorInfoImpl.CompileMethodInternal(IMethodNode methodCodeNodeNeedingCode, MethodIL methodIL) in /_/src/coreclr/tools/Common/JitInterface/CorInfoImpl.cs:line 381
   at Internal.JitInterface.CorInfoImpl.CompileMethod(MethodWithGCInfo methodCodeNodeNeedingCode, Logger logger) in /_/src/coreclr/tools/aot/ILCompiler.ReadyToRun/JitInterface/CorInfoImpl.ReadyToRun.cs:line 810
   at ILCompiler.ReadyToRunCodegenCompilation.<>c__DisplayClass50_0.<ComputeDependencyNodeDependencies>g__CompileOneMethod|5(DependencyNodeCore`1 dependency, Int32 compileThreadId) in /_/src/coreclr/tools/aot/ILCompiler.ReadyToRun/Compiler/ReadyToRunCodegenCompilation.cs:line 898
   at ILCompiler.ReadyToRunCodegenCompilation.<>c__DisplayClass50_0.<ComputeDependencyNodeDependencies>g__CompileOnThread|4(Int32 compilationThreadId) in /_/src/coreclr/tools/aot/ILCompiler.ReadyToRun/Compiler/ReadyToRunCodegenCompilation.cs:line 833
   at ILCompiler.ReadyToRunCodegenCompilation.<>c__DisplayClass50_0.<ComputeDependencyNodeDependencies>g__CompilationThread|3(Object objThreadId) in /_/src/coreclr/tools/aot/ILCompiler.ReadyToRun/Compiler/ReadyToRunCodegenCompilation.cs:line 811
Unhandled exception. System.ArgumentNullException: Value cannot be null. (Parameter 'array')
   at System.Array.Clear(Array array, Int32 index, Int32 length)
   at Internal.JitInterface.CorInfoImpl.CompileMethodCleanup() in /_/src/coreclr/tools/Common/JitInterface/CorInfoImpl.cs:line 700
   at Internal.JitInterface.CorInfoImpl.CompileMethod(MethodWithGCInfo methodCodeNodeNeedingCode, Logger logger) in /_/src/coreclr/tools/aot/ILCompiler.ReadyToRun/JitInterface/CorInfoImpl.ReadyToRun.cs:line 826
   at ILCompiler.ReadyToRunCodegenCompilation.<>c__DisplayClass50_0.<ComputeDependencyNodeDependencies>g__CompileOneMethod|5(DependencyNodeCore`1 dependency, Int32 compileThreadId) in /_/src/coreclr/tools/aot/ILCompiler.ReadyToRun/Compiler/ReadyToRunCodegenCompilation.cs:line 898
   at ILCompiler.ReadyToRunCodegenCompilation.<>c__DisplayClass50_0.<ComputeDependencyNodeDependencies>g__CompileOnThread|4(Int32 compilationThreadId) in /_/src/coreclr/tools/aot/ILCompiler.ReadyToRun/Compiler/ReadyToRunCodegenCompilation.cs:line 833
   at ILCompiler.ReadyToRunCodegenCompilation.<>c__DisplayClass50_0.<ComputeDependencyNodeDependencies>g__CompilationThread|3(Object objThreadId) in /_/src/coreclr/tools/aot/ILCompiler.ReadyToRun/Compiler/ReadyToRunCodegenCompilation.cs:line 811
/root/helix/work/workitem/e/Loader/Loader/../classloader/TypeInitialization/CircularCctors/CircularCctorThreeThreads03/CircularCctorThreeThreads03.sh: line 254: 13197 Aborted                 (core dumped) $__Command

Return code:      1
Raw output file:      /root/helix/work/workitem/uploads/classloader/TypeInitialization/CircularCctors/CircularCctorThreeThreads03/output.txt
Raw output:
BEGIN EXECUTION
in takeLock
/root/helix/work/workitem/e/Loader/classloader/TypeInitialization/CircularCctors/CircularCctorThreeThreads03/IL-CG2/CircularCctorThreeThreads03.dll
19:57:05
Response file: /root/helix/work/workitem/e/Loader/classloader/TypeInitialization/CircularCctors/CircularCctorThreeThreads03/Circular

Stack trace:

   at Xunit.Assert.True(Nullable`1 condition, String userMessage) in /_/src/Microsoft.DotNet.XUnitAssert/src/BooleanAsserts.cs:line 146
   at Xunit.Assert.True(Boolean condition, String userMessage) in /_/src/Microsoft.DotNet.XUnitAssert/src/BooleanAsserts.cs:line 128
   at TestLibrary.OutOfProcessTest.RunOutOfProcessTest(String assemblyPath, String testPathPrefix)
   at Program.<<Main>$>g__TestExecutor264|0_265(StreamWriter tempLogSw, StreamWriter statsCsvSw, <>c__DisplayClass0_0&)

v-wenyuxu avatar Jul 31 '24 01:07 v-wenyuxu

Failed in: runtime-coreclr r2r 20240730.1

Failed tests:

R2R-CG2 osx arm64 Checked @ OSX.1200.ARM64.Open
    - GC/Scenarios/BinTree/thdtreegrowingobj/thdtreegrowingobj.sh

Error message:

 /private/tmp/helix/working/9C26088A/w/AB5A0919/e/GC/Scenarios/BinTree/thdtreegrowingobj/thdtreegrowingobj.sh: line 329: -r:/private/tmp/helix/working/9C26088A/w/AB5A0919/e/GC/Scenarios/BinTree/thdtreegrowingobj/IL-CG2/*.dll: No such file or directory
Unhandled exception. ILCompiler.CodeGenerationFailedException: Code generation failed for method '[thdtreegrowingobj]DefaultNamespace.ThdTreeGrowingObj..ctor()'
 ---> System.NullReferenceException: Object reference not set to an instance of an object.
   at Internal.JitInterface.CorInfoImpl._beginInlining(IntPtr thisHandle, IntPtr* ppException, CORINFO_METHOD_STRUCT_* inlinerHnd, CORINFO_METHOD_STRUCT_* inlineeHnd) in /_/src/coreclr/tools/Common/JitInterface/CorInfoImpl_generated.cs:line 154
   --- End of inner exception stack trace ---
   at Internal.JitInterface.CorInfoImpl.CompileMethodInternal(IMethodNode methodCodeNodeNeedingCode, MethodIL methodIL) in /_/src/coreclr/tools/Common/JitInterface/CorInfoImpl.cs:line 381
   at Internal.JitInterface.CorInfoImpl.CompileMethod(MethodWithGCInfo methodCodeNodeNeedingCode, Logger logger) in /_/src/coreclr/tools/aot/ILCompiler.ReadyToRun/JitInterface/CorInfoImpl.ReadyToRun.cs:line 810
   at ILCompiler.ReadyToRunCodegenCompilation.<>c__DisplayClass50_0.<ComputeDependencyNodeDependencies>g__CompileOneMethod|5(DependencyNodeCore`1 dependency, Int32 compileThreadId) in /_/src/coreclr/tools/aot/ILCompiler.ReadyToRun/Compiler/ReadyToRunCodegenCompilation.cs:line 898
   at ILCompiler.ReadyToRunCodegenCompilation.<>c__DisplayClass50_0.<ComputeDependencyNodeDependencies>g__CompileOnThread|4(Int32 compilationThreadId) in /_/src/coreclr/tools/aot/ILCompiler.ReadyToRun/Compiler/ReadyToRunCodegenCompilation.cs:line 833
   at ILCompiler.ReadyToRunCodegenCompilation.<>c__DisplayClass50_0.<ComputeDependencyNodeDependencies>g__CompilationThread|3(Object objThreadId) in /_/src/coreclr/tools/aot/ILCompiler.ReadyToRun/Compiler/ReadyToRunCodegenCompilation.cs:line 811
   at System.Threading.Thread.StartCallback()
Unhandled exception. System.ArgumentNullException: Value cannot be null. (Parameter 'array')
   at System.Array.Clear(Array array, Int32 index, Int32 length)
   at Internal.JitInterface.CorInfoImpl.CompileMethodCleanup() in /_/src/coreclr/tools/Common/JitInterface/CorInfoImpl.cs:line 700
   at Internal.JitInterface.CorInfoImpl.CompileMethod(MethodWithGCInfo methodCodeNodeNeedingCode, Logger logger) in /_/src/coreclr/tools/aot/ILCompiler.ReadyToRun/JitInterface/CorInfoImpl.ReadyToRun.cs:line 826
   at ILCompiler.ReadyToRunCodegenCompilation.<>c__DisplayClass50_0.<ComputeDependencyNodeDependencies>g__CompileOneMethod|5(DependencyNodeCore`1 dependency, Int32 compileThreadId) in /_/src/coreclr/tools/aot/ILCompiler.ReadyToRun/Compiler/ReadyToRunCodegenCompilation.cs:line 898
   at ILCompiler.ReadyToRunCodegenCompilation.<>c__DisplayClass50_0.<ComputeDependencyNodeDependencies>g__CompileOnThread|4(Int32 compilationThreadId) in /_/src/coreclr/tools/aot/ILCompiler.ReadyToRun/Compiler/ReadyToRunCodegenCompilation.cs:line 833
   at ILCompiler.ReadyToRunCodegenCompilation.<>c__DisplayClass50_0.<ComputeDependencyNodeDependencies>g__CompilationThread|3(Object objThreadId) in /_/src/coreclr/tools/aot/ILCompiler.ReadyToRun/Compiler/ReadyToRunCodegenCompilation.cs:line 811
   at System.Threading.Thread.StartCallback()
/private/tmp/helix/working/9C26088A/w/AB5A0919/e/GC/Scenarios/BinTree/thdtreegrowingobj/thdtreegrowingobj.sh: line 268: 25243 Abort trap: 6           (core dumped) $__Command

Return code:      1
Raw output file:      /tmp/helix/working/9C26088A/w/AB5A0919/uploads/Reports/GC.Scenarios/BinTree/thdtreegrowingobj/thdtreegrowingobj.output.txt
Raw output:
BEGIN EXECUTION
in takeLock
/private/tmp/helix/working/9C26088A/w/AB5A0919/e/GC/Scenarios/BinTree/thdtreegrowingobj/IL-CG2/bintree.dll
23:45:28
Response file: /private/tmp/helix/working/9C26088A/w/AB5A0919/e/GC/Scenarios/BinTree/thdtreegrowingobj/bintree.dll.rsp
/private/tmp/helix/working/9C26088A/w/AB5A0

Stack trace:

   at GC_Scenarios._BinTree_thdtreegrowingobj_thdtreegrowingobj_._BinTree_thdtreegrowingobj_thdtreegrowingobj_sh()

   at System.RuntimeMethodHandle.InvokeMethod(Object target, Void** arguments, Signature sig, Boolean isConstructor)
   at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Object obj, BindingFlags invokeAttr)
Queued Pipeline Pipeline_Configuration OS Arch Test Outcome Properties BuildReason
2024-07-31T06:39:41.908Z runtime-coreclr r2r Checked osx.1200.arm64.open arm64 GC/Scenarios/BinTree/thdtreegrowingobj/thdtreegrowingobj.sh Failed {"DefinitionId":"120","System.StageName":"Build","System.JobName":"__default","System.JobAttempt":"1","configuration":"Checked","DefinitionName":"runtime-coreclr r2r","System.PhaseName":"run_test_p1_R2R_osx_arm64_checked","System.PhaseAttempt":"1","operatingSystem":"OSX.1200.ARM64.Open","Project":"public","CollectionUri":"https://dev.azure.com/dnceng-public/","BuildNumber":"20240730.1","Reason":"Schedule","System.JobId":"99f15f99-448d-5593-a271-dbdf553789a6","System.StageAttempt":"1","AzurePipelinesTestRunId":"19334568","BuildId":"761217","architecture":"arm64"} Schedule
2024-07-24T21:50:17.939Z runtime-extra-platforms Release ubuntu.2204.amd64.android.29.open.rt x64 GC/Scenarios/BinTree/thdtreegrowingobj/thdtreegrowingobj.sh Failed {"System.JobAttempt":"1","DefinitionName":"runtime-extra-platforms","operatingSystem":"Ubuntu.2204.Amd64.Android.29.Open","System.JobName":"__default","BuildNumber":"20240724.5","BuildId":"754176","configuration":"Release","Project":"public","DefinitionId":"154","System.StageAttempt":"1","System.PhaseAttempt":"1","System.PhaseName":"build_android_x64_Release_AllSubsets_Mono_RuntimeTests_Interp","AzurePipelinesTestRunId":"19114356","architecture":"x64","CollectionUri":"https://dev.azure.com/dnceng-public/","System.StageName":"Build","System.JobId":"e847dbc9-1eac-5acf-c55e-fa567d2d051e","Reason":"Schedule"} Schedule
2024-05-09T02:18:47.007Z runtime-coreclr outerloop Checked-no_tiered_compilation ubuntu.2004.armarch.open arm GC/Scenarios/BinTree/thdtreegrowingobj/thdtreegrowingobj.sh Failed {"System.JobName":"__default","Reason":"Schedule","System.PhaseAttempt":"1","architecture":"arm","configuration":"Checked-no_tiered_compilation","CollectionUri":"https://dev.azure.com/dnceng-public/","System.JobId":"860c965f-b28e-50d5-65d2-e40bd59f3a69","Project":"public","DefinitionName":"runtime-coreclr outerloop","operatingSystem":"(Ubuntu.1804.Arm32.Open)[email protected]/dotnet-buildtools/prereqs:ubuntu-18.04-helix-arm32v7","BuildId":"670046","System.StageAttempt":"1","System.JobAttempt":"1","System.StageName":"Build","System.PhaseName":"run_test_p1__linux_arm_checked","BuildNumber":"20240508.3","DefinitionId":"108","AzurePipelinesTestRunId":"16612930"} Schedule
2024-05-09T02:18:45.812Z runtime-coreclr outerloop Checked ubuntu.2004.armarch.open arm GC/Scenarios/BinTree/thdtreegrowingobj/thdtreegrowingobj.sh Failed {"DefinitionId":"108","DefinitionName":"runtime-coreclr outerloop","System.StageName":"Build","System.JobAttempt":"1","BuildId":"670046","Reason":"Schedule","System.JobId":"860c965f-b28e-50d5-65d2-e40bd59f3a69","Project":"public","BuildNumber":"20240508.3","operatingSystem":"(Ubuntu.1804.Arm32.Open)[email protected]/dotnet-buildtools/prereqs:ubuntu-18.04-helix-arm32v7","AzurePipelinesTestRunId":"16612920","configuration":"Checked","architecture":"arm","System.PhaseName":"run_test_p1__linux_arm_checked","CollectionUri":"https://dev.azure.com/dnceng-public/","System.StageAttempt":"1","System.PhaseAttempt":"1","System.JobName":"__default"} Schedule
2024-05-08T23:33:04.014Z runtime-nativeaot-outerloop Checked ubuntu.2004.armarch.open arm GC/Scenarios/BinTree/thdtreegrowingobj/thdtreegrowingobj.sh Failed {"System.PhaseName":"build_linux_arm_Checked_NativeAOT_Pri0","System.JobAttempt":"1","System.JobId":"531ca2ce-eccb-527e-1ec0-55002e52e870","DefinitionId":"265","BuildNumber":"20240508.2","operatingSystem":"(Ubuntu.1804.Arm32.Open)[email protected]/dotnet-buildtools/prereqs:ubuntu-18.04-helix-arm32v7","System.StageAttempt":"1","configuration":"Checked","System.StageName":"Build","Reason":"Schedule","AzurePipelinesTestRunId":"16610852","BuildId":"669858","Project":"public","DefinitionName":"runtime-nativeaot-outerloop","System.JobName":"__default","System.PhaseAttempt":"1","CollectionUri":"https://dev.azure.com/dnceng-public/","architecture":"arm"} Schedule
2024-05-08T20:55:20.943Z runtime Checked-no_tiered_compilation ubuntu.2004.armarch.open arm GC/Scenarios/BinTree/thdtreegrowingobj/thdtreegrowingobj.sh Failed {"System.JobAttempt":"1","System.PhaseName":"run_test_p0_coreclr__linux_arm_checked","Reason":"Schedule","System.StageName":"Build","operatingSystem":"(Ubuntu.1804.Arm32.Open)[email protected]/dotnet-buildtools/prereqs:ubuntu-18.04-helix-arm32v7","System.JobId":"5875517b-40f2-5b27-5b45-8b8aba144595","configuration":"Checked-no_tiered_compilation","DefinitionName":"runtime","DefinitionId":"129","System.JobName":"__default","System.PhaseAttempt":"1","BuildId":"669797","architecture":"arm","AzurePipelinesTestRunId":"16607856","BuildNumber":"20240508.40","Project":"public","System.StageAttempt":"1","CollectionUri":"https://dev.azure.com/dnceng-public/"} Schedule
More failures
Queued Pipeline Pipeline_Configuration OS Arch Test Outcome Properties BuildReason
2024-05-08T20:55:19.474Z runtime Checked ubuntu.2004.armarch.open arm GC/Scenarios/BinTree/thdtreegrowingobj/thdtreegrowingobj.sh Failed {"DefinitionName":"runtime","operatingSystem":"(Ubuntu.1804.Arm32.Open)[email protected]/dotnet-buildtools/prereqs:ubuntu-18.04-helix-arm32v7","System.PhaseName":"run_test_p0_coreclr__linux_arm_checked","configuration":"Checked","DefinitionId":"129","BuildNumber":"20240508.40","System.JobAttempt":"1","System.StageName":"Build","BuildId":"669797","CollectionUri":"https://dev.azure.com/dnceng-public/","System.JobName":"__default","Reason":"Schedule","System.StageAttempt":"1","System.JobId":"5875517b-40f2-5b27-5b45-8b8aba144595","Project":"public","System.PhaseAttempt":"1","AzurePipelinesTestRunId":"16607854","architecture":"arm"} Schedule
2024-05-08T19:20:43.463Z runtime-coreclr outerloop Checked-no_tiered_compilation ubuntu.2004.armarch.open arm GC/Scenarios/BinTree/thdtreegrowingobj/thdtreegrowingobj.sh Failed {"AzurePipelinesTestRunId":"16606342","DefinitionName":"runtime-coreclr outerloop","BuildId":"669628","architecture":"arm","configuration":"Checked-no_tiered_compilation","Project":"public","System.JobId":"860c965f-b28e-50d5-65d2-e40bd59f3a69","operatingSystem":"(Ubuntu.1804.Arm32.Open)[email protected]/dotnet-buildtools/prereqs:ubuntu-18.04-helix-arm32v7","System.JobAttempt":"1","System.PhaseName":"run_test_p1__linux_arm_checked","Reason":"Schedule","System.PhaseAttempt":"1","System.StageAttempt":"1","System.JobName":"__default","CollectionUri":"https://dev.azure.com/dnceng-public/","BuildNumber":"20240508.2","DefinitionId":"108","System.StageName":"Build"} Schedule
2024-05-08T19:20:41.712Z runtime-coreclr outerloop Checked ubuntu.2004.armarch.open arm GC/Scenarios/BinTree/thdtreegrowingobj/thdtreegrowingobj.sh Failed {"BuildNumber":"20240508.2","DefinitionId":"108","System.JobId":"860c965f-b28e-50d5-65d2-e40bd59f3a69","System.JobName":"__default","DefinitionName":"runtime-coreclr outerloop","AzurePipelinesTestRunId":"16606340","System.StageName":"Build","Reason":"Schedule","System.PhaseAttempt":"1","configuration":"Checked","architecture":"arm","CollectionUri":"https://dev.azure.com/dnceng-public/","BuildId":"669628","System.JobAttempt":"1","System.StageAttempt":"1","Project":"public","System.PhaseName":"run_test_p1__linux_arm_checked","operatingSystem":"(Ubuntu.1804.Arm32.Open)[email protected]/dotnet-buildtools/prereqs:ubuntu-18.04-helix-arm32v7"} Schedule
2024-05-08T11:35:56.729Z runtime-nativeaot-outerloop Checked ubuntu.2004.armarch.open arm GC/Scenarios/BinTree/thdtreegrowingobj/thdtreegrowingobj.sh Failed {"System.PhaseAttempt":"1","System.StageName":"Build","configuration":"Checked","System.JobId":"531ca2ce-eccb-527e-1ec0-55002e52e870","BuildId":"669222","Reason":"Schedule","BuildNumber":"20240508.1","architecture":"arm","Project":"public","AzurePipelinesTestRunId":"16596980","operatingSystem":"(Ubuntu.1804.Arm32.Open)[email protected]/dotnet-buildtools/prereqs:ubuntu-18.04-helix-arm32v7","System.StageAttempt":"1","System.JobName":"__default","System.JobAttempt":"1","CollectionUri":"https://dev.azure.com/dnceng-public/","System.PhaseName":"build_linux_arm_Checked_NativeAOT_Pri0","DefinitionId":"265","DefinitionName":"runtime-nativeaot-outerloop"} Schedule
2024-05-08T10:18:34.795Z runtime-coreclr outerloop Checked-no_tiered_compilation ubuntu.2004.armarch.open arm GC/Scenarios/BinTree/thdtreegrowingobj/thdtreegrowingobj.sh Failed {"System.StageName":"Build","Project":"public","AzurePipelinesTestRunId":"16596180","System.PhaseName":"run_test_p1__linux_arm_checked","BuildNumber":"20240508.1","System.JobAttempt":"1","System.JobName":"__default","BuildId":"669221","configuration":"Checked-no_tiered_compilation","Reason":"Schedule","operatingSystem":"(Ubuntu.1804.Arm32.Open)[email protected]/dotnet-buildtools/prereqs:ubuntu-18.04-helix-arm32v7","System.StageAttempt":"1","architecture":"arm","DefinitionId":"108","System.PhaseAttempt":"1","DefinitionName":"runtime-coreclr outerloop","System.JobId":"860c965f-b28e-50d5-65d2-e40bd59f3a69","CollectionUri":"https://dev.azure.com/dnceng-public/"} Schedule
2024-05-08T10:18:33.232Z runtime-coreclr outerloop Checked ubuntu.2004.armarch.open arm GC/Scenarios/BinTree/thdtreegrowingobj/thdtreegrowingobj.sh Failed {"System.JobName":"__default","AzurePipelinesTestRunId":"16596178","System.PhaseName":"run_test_p1__linux_arm_checked","architecture":"arm","CollectionUri":"https://dev.azure.com/dnceng-public/","System.StageName":"Build","BuildId":"669221","DefinitionName":"runtime-coreclr outerloop","System.PhaseAttempt":"1","System.JobAttempt":"1","Project":"public","System.JobId":"860c965f-b28e-50d5-65d2-e40bd59f3a69","DefinitionId":"108","BuildNumber":"20240508.1","configuration":"Checked","Reason":"Schedule","System.StageAttempt":"1","operatingSystem":"(Ubuntu.1804.Arm32.Open)[email protected]/dotnet-buildtools/prereqs:ubuntu-18.04-helix-arm32v7"} Schedule
2024-05-08T09:16:15.601Z runtime-coreclr pgo Checked-defaultpgo ubuntu.2004.armarch.open arm GC/Scenarios/BinTree/thdtreegrowingobj/thdtreegrowingobj.sh Failed {"System.JobId":"860c965f-b28e-50d5-65d2-e40bd59f3a69","BuildNumber":"20240508.1","Reason":"Schedule","System.JobAttempt":"1","System.PhaseName":"run_test_p1__linux_arm_checked","System.PhaseAttempt":"1","BuildId":"669200","Project":"public","operatingSystem":"(Ubuntu.1804.Arm32.Open)[email protected]/dotnet-buildtools/prereqs:ubuntu-18.04-helix-arm32v7","System.JobName":"__default","DefinitionId":"144","AzurePipelinesTestRunId":"16595346","DefinitionName":"runtime-coreclr pgo","System.StageAttempt":"1","CollectionUri":"https://dev.azure.com/dnceng-public/","architecture":"arm","configuration":"Checked-defaultpgo","System.StageName":"Build"} Schedule
2024-05-08T08:55:12.152Z runtime Checked-no_tiered_compilation ubuntu.2004.armarch.open arm GC/Scenarios/BinTree/thdtreegrowingobj/thdtreegrowingobj.sh Failed {"System.StageName":"Build","AzurePipelinesTestRunId":"16594958","System.JobName":"__default","configuration":"Checked-no_tiered_compilation","BuildNumber":"20240508.1","CollectionUri":"https://dev.azure.com/dnceng-public/","System.StageAttempt":"1","DefinitionId":"129","System.JobId":"5875517b-40f2-5b27-5b45-8b8aba144595","System.PhaseName":"run_test_p0_coreclr__linux_arm_checked","architecture":"arm","Reason":"Schedule","System.PhaseAttempt":"1","operatingSystem":"(Ubuntu.1804.Arm32.Open)[email protected]/dotnet-buildtools/prereqs:ubuntu-18.04-helix-arm32v7","DefinitionName":"runtime","BuildId":"669202","System.JobAttempt":"1","Project":"public"} Schedule
2024-05-08T08:55:10.576Z runtime Checked ubuntu.2004.armarch.open arm GC/Scenarios/BinTree/thdtreegrowingobj/thdtreegrowingobj.sh Failed {"System.StageName":"Build","DefinitionId":"129","configuration":"Checked","System.StageAttempt":"1","BuildNumber":"20240508.1","System.JobId":"5875517b-40f2-5b27-5b45-8b8aba144595","AzurePipelinesTestRunId":"16594956","DefinitionName":"runtime","Reason":"Schedule","Project":"public","BuildId":"669202","System.JobAttempt":"1","System.PhaseAttempt":"1","CollectionUri":"https://dev.azure.com/dnceng-public/","operatingSystem":"(Ubuntu.1804.Arm32.Open)[email protected]/dotnet-buildtools/prereqs:ubuntu-18.04-helix-arm32v7","System.PhaseName":"run_test_p0_coreclr__linux_arm_checked","architecture":"arm","System.JobName":"__default"} Schedule
2024-05-08T07:27:00.809Z coreclr-release-outerloop-nightly Release-no_tiered_compilation ubuntu.2004.armarch.open arm GC/Scenarios/BinTree/thdtreegrowingobj/thdtreegrowingobj.sh Failed {"System.PhaseAttempt":"1","architecture":"arm","DefinitionName":"coreclr-release-outerloop-nightly","System.JobName":"__default","AzurePipelinesTestRunId":"16592990","configuration":"Release-no_tiered_compilation","BuildNumber":"20240507.1","BuildId":"669106","System.JobAttempt":"1","DefinitionId":"135","System.StageAttempt":"1","System.StageName":"Build","operatingSystem":"(Ubuntu.1804.Arm32.Open)[email protected]/dotnet-buildtools/prereqs:ubuntu-18.04-helix-arm32v7","Project":"public","System.PhaseName":"run_test_p1_R2R_linux_arm_release","System.JobId":"72dfe29e-04cf-5892-e89c-87a9854dd748","CollectionUri":"https://dev.azure.com/dnceng-public/","Reason":"Schedule"} Schedule
2024-05-08T07:27:00.809Z coreclr-release-outerloop-nightly Release-no_tiered_compilation ubuntu.2004.armarch.open arm GC/Scenarios/BinTree/thdtreegrowingobj/thdtreegrowingobj.sh Failed {"System.PhaseAttempt":"1","architecture":"arm","DefinitionName":"coreclr-release-outerloop-nightly","System.JobName":"__default","AzurePipelinesTestRunId":"16592990","configuration":"Release-no_tiered_compilation","BuildNumber":"20240507.1","BuildId":"669106","System.JobAttempt":"1","DefinitionId":"135","System.StageAttempt":"1","System.StageName":"Build","operatingSystem":"(Ubuntu.1804.Arm32.Open)[email protected]/dotnet-buildtools/prereqs:ubuntu-18.04-helix-arm32v7","Project":"public","System.PhaseName":"run_test_p1_R2R_linux_arm_release","System.JobId":"72dfe29e-04cf-5892-e89c-87a9854dd748","CollectionUri":"https://dev.azure.com/dnceng-public/","Reason":"Schedule"} Schedule
2024-05-08T07:26:57.972Z coreclr-release-outerloop-nightly Release ubuntu.2004.armarch.open arm GC/Scenarios/BinTree/thdtreegrowingobj/thdtreegrowingobj.sh Failed {"BuildId":"669106","AzurePipelinesTestRunId":"16592988","System.PhaseName":"run_test_p1_R2R_linux_arm_release","System.PhaseAttempt":"1","System.JobAttempt":"1","Reason":"Schedule","DefinitionId":"135","architecture":"arm","BuildNumber":"20240507.1","System.StageAttempt":"1","System.JobId":"72dfe29e-04cf-5892-e89c-87a9854dd748","CollectionUri":"https://dev.azure.com/dnceng-public/","Project":"public","System.JobName":"__default","System.StageName":"Build","DefinitionName":"coreclr-release-outerloop-nightly","operatingSystem":"(Ubuntu.1804.Arm32.Open)[email protected]/dotnet-buildtools/prereqs:ubuntu-18.04-helix-arm32v7","configuration":"Release"} Schedule
2024-05-08T07:23:41.546Z coreclr-release-outerloop-nightly Release-no_tiered_compilation ubuntu.2004.armarch.open arm GC/Scenarios/BinTree/thdtreegrowingobj/thdtreegrowingobj.sh Failed {"DefinitionName":"coreclr-release-outerloop-nightly","operatingSystem":"(Ubuntu.1804.Arm32.Open)[email protected]/dotnet-buildtools/prereqs:ubuntu-18.04-helix-arm32v7","System.PhaseName":"run_test_p1__linux_arm_release","Reason":"Schedule","System.StageAttempt":"1","DefinitionId":"135","System.JobName":"__default","BuildId":"669106","System.StageName":"Build","BuildNumber":"20240507.1","System.JobAttempt":"1","System.PhaseAttempt":"1","AzurePipelinesTestRunId":"16592840","architecture":"arm","configuration":"Release-no_tiered_compilation","Project":"public","CollectionUri":"https://dev.azure.com/dnceng-public/","System.JobId":"ae69a820-8040-5321-6217-15d430a2ab03"} Schedule
2024-05-08T07:23:40.155Z coreclr-release-outerloop-nightly Release ubuntu.2004.armarch.open arm GC/Scenarios/BinTree/thdtreegrowingobj/thdtreegrowingobj.sh Failed {"DefinitionId":"135","System.StageName":"Build","DefinitionName":"coreclr-release-outerloop-nightly","System.JobName":"__default","AzurePipelinesTestRunId":"16592838","Reason":"Schedule","configuration":"Release","System.JobId":"ae69a820-8040-5321-6217-15d430a2ab03","System.StageAttempt":"1","System.PhaseName":"run_test_p1__linux_arm_release","BuildNumber":"20240507.1","Project":"public","BuildId":"669106","System.PhaseAttempt":"1","System.JobAttempt":"1","architecture":"arm","CollectionUri":"https://dev.azure.com/dnceng-public/","operatingSystem":"(Ubuntu.1804.Arm32.Open)[email protected]/dotnet-buildtools/prereqs:ubuntu-18.04-helix-arm32v7"} Schedule
2024-05-06T05:24:02.857Z runtime-coreclr jitstress Checked-jitstress1 ubuntu.2204.amd64.open.rt x64 GC/Scenarios/BinTree/thdtreegrowingobj/thdtreegrowingobj.sh Failed {"Reason":"Schedule","Project":"public","System.JobAttempt":"1","configuration":"Checked-jitstress1","CollectionUri":"https://dev.azure.com/dnceng-public/","DefinitionId":"109","DefinitionName":"runtime-coreclr jitstress","architecture":"x64","System.PhaseName":"run_test_p1__linux_x64_checked","System.StageName":"Build","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","BuildId":"666407","AzurePipelinesTestRunId":"16528844","System.PhaseAttempt":"1","operatingSystem":"Ubuntu.2204.Amd64.Open","BuildNumber":"20240505.1","System.JobName":"__default","System.StageAttempt":"1"} Schedule
2024-05-06T05:24:01.384Z runtime-coreclr jitstress Checked-jitstress2_tiered ubuntu.2204.amd64.open.rt x64 GC/Scenarios/BinTree/thdtreegrowingobj/thdtreegrowingobj.sh Failed {"configuration":"Checked-jitstress2_tiered","System.StageAttempt":"1","AzurePipelinesTestRunId":"16528852","System.JobName":"__default","CollectionUri":"https://dev.azure.com/dnceng-public/","Reason":"Schedule","System.JobAttempt":"1","BuildNumber":"20240505.1","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","System.PhaseName":"run_test_p1__linux_x64_checked","operatingSystem":"Ubuntu.2204.Amd64.Open","System.StageName":"Build","System.PhaseAttempt":"1","DefinitionId":"109","BuildId":"666407","DefinitionName":"runtime-coreclr jitstress","architecture":"x64","Project":"public"} Schedule
2024-05-06T05:24:00.009Z runtime-coreclr jitstress Checked-jitstress2 ubuntu.2204.amd64.open.rt x64 GC/Scenarios/BinTree/thdtreegrowingobj/thdtreegrowingobj.sh Failed {"Project":"public","BuildNumber":"20240505.1","System.JobName":"__default","Reason":"Schedule","System.StageName":"Build","operatingSystem":"Ubuntu.2204.Amd64.Open","System.PhaseName":"run_test_p1__linux_x64_checked","CollectionUri":"https://dev.azure.com/dnceng-public/","BuildId":"666407","AzurePipelinesTestRunId":"16528842","configuration":"Checked-jitstress2","DefinitionId":"109","System.StageAttempt":"1","architecture":"x64","System.JobAttempt":"1","DefinitionName":"runtime-coreclr jitstress","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","System.PhaseAttempt":"1"} Schedule
2024-05-06T05:23:57.087Z runtime-coreclr jitstress Checked-jitstress1_tiered ubuntu.2204.amd64.open.rt x64 GC/Scenarios/BinTree/thdtreegrowingobj/thdtreegrowingobj.sh Failed {"architecture":"x64","System.StageAttempt":"1","System.PhaseName":"run_test_p1__linux_x64_checked","Reason":"Schedule","operatingSystem":"Ubuntu.2204.Amd64.Open","System.JobAttempt":"1","BuildId":"666407","AzurePipelinesTestRunId":"16528846","System.JobName":"__default","DefinitionName":"runtime-coreclr jitstress","Project":"public","System.PhaseAttempt":"1","DefinitionId":"109","BuildNumber":"20240505.1","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","System.StageName":"Build","configuration":"Checked-jitstress1_tiered","CollectionUri":"https://dev.azure.com/dnceng-public/"} Schedule
2024-05-06T03:30:58.033Z runtime-coreclr r2r-extra Checked-jitstress2_tiered ubuntu.2204.amd64.open.rt x64 GC/Scenarios/BinTree/thdtreegrowingobj/thdtreegrowingobj.sh Failed {"System.JobId":"45a39349-90d5-51c8-4429-a48b2907fbdd","AzurePipelinesTestRunId":"16527918","System.StageAttempt":"1","System.JobName":"__default","System.PhaseName":"run_test_p1_R2R_linux_x64_checked","CollectionUri":"https://dev.azure.com/dnceng-public/","Reason":"Schedule","architecture":"x64","BuildId":"666362","DefinitionName":"runtime-coreclr r2r-extra","System.PhaseAttempt":"1","System.StageName":"Build","operatingSystem":"Ubuntu.2204.Amd64.Open","BuildNumber":"20240505.1","Project":"public","DefinitionId":"114","System.JobAttempt":"1","configuration":"Checked-jitstress2_tiered"} Schedule
2024-05-05T19:45:00.715Z runtime-coreclr jitstress-random Checked-jitstress_random_1 osx.1200.arm64.open arm64 GC/Scenarios/BinTree/thdtreegrowingobj/thdtreegrowingobj.sh Failed {"System.JobName":"__default","System.JobAttempt":"1","architecture":"arm64","configuration":"Checked-jitstress_random_1","System.StageAttempt":"1","BuildNumber":"20240505.1","CollectionUri":"https://dev.azure.com/dnceng-public/","AzurePipelinesTestRunId":"16524458","Project":"public","DefinitionId":"159","Reason":"Schedule","System.StageName":"Build","System.JobId":"765fd5e9-e47f-5cb0-4cbf-499eaaaee93e","BuildId":"666195","DefinitionName":"runtime-coreclr jitstress-random","System.PhaseName":"run_test_p1__osx_arm64_checked","System.PhaseAttempt":"1","operatingSystem":"OSX.1200.ARM64.Open"} Schedule
2024-05-05T18:24:04.531Z runtime-coreclr jitstress2-jitstressregs Checked-jitstress2_jitstressregs0x80 ubuntu.2204.amd64.open.rt x64 GC/Scenarios/BinTree/thdtreegrowingobj/thdtreegrowingobj.sh Failed {"System.StageName":"Build","BuildId":"666175","System.StageAttempt":"1","System.PhaseAttempt":"1","BuildNumber":"20240505.1","configuration":"Checked-jitstress2_jitstressregs0x80","CollectionUri":"https://dev.azure.com/dnceng-public/","System.PhaseName":"run_test_p1__linux_x64_checked","architecture":"x64","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","DefinitionName":"runtime-coreclr jitstress2-jitstressregs","Project":"public","Reason":"Schedule","operatingSystem":"Ubuntu.2204.Amd64.Open","System.JobName":"__default","AzurePipelinesTestRunId":"16523722","System.JobAttempt":"1","DefinitionId":"111"} Schedule
2024-05-05T18:24:03.184Z runtime-coreclr jitstress2-jitstressregs Checked-jitstress2_jitstressregs0x2000 ubuntu.2204.amd64.open.rt x64 GC/Scenarios/BinTree/thdtreegrowingobj/thdtreegrowingobj.sh Failed {"architecture":"x64","DefinitionId":"111","configuration":"Checked-jitstress2_jitstressregs0x2000","System.PhaseName":"run_test_p1__linux_x64_checked","Project":"public","System.StageName":"Build","DefinitionName":"runtime-coreclr jitstress2-jitstressregs","Reason":"Schedule","System.JobAttempt":"1","BuildId":"666175","System.PhaseAttempt":"1","System.StageAttempt":"1","CollectionUri":"https://dev.azure.com/dnceng-public/","BuildNumber":"20240505.1","AzurePipelinesTestRunId":"16523730","System.JobName":"__default","operatingSystem":"Ubuntu.2204.Amd64.Open","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5"} Schedule
2024-05-05T18:24:01.282Z runtime-coreclr jitstress2-jitstressregs Checked-jitstress2_jitstressregs8 ubuntu.2204.amd64.open.rt x64 GC/Scenarios/BinTree/thdtreegrowingobj/thdtreegrowingobj.sh Failed {"System.JobName":"__default","System.StageAttempt":"1","DefinitionName":"runtime-coreclr jitstress2-jitstressregs","System.PhaseName":"run_test_p1__linux_x64_checked","Project":"public","System.StageName":"Build","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","operatingSystem":"Ubuntu.2204.Amd64.Open","architecture":"x64","BuildNumber":"20240505.1","BuildId":"666175","System.PhaseAttempt":"1","CollectionUri":"https://dev.azure.com/dnceng-public/","System.JobAttempt":"1","DefinitionId":"111","Reason":"Schedule","AzurePipelinesTestRunId":"16523724","configuration":"Checked-jitstress2_jitstressregs8"} Schedule
2024-05-05T18:23:59.746Z runtime-coreclr jitstress2-jitstressregs Checked-jitstress2_jitstressregs2 ubuntu.2204.amd64.open.rt x64 GC/Scenarios/BinTree/thdtreegrowingobj/thdtreegrowingobj.sh Failed {"System.PhaseName":"run_test_p1__linux_x64_checked","System.PhaseAttempt":"1","AzurePipelinesTestRunId":"16523728","configuration":"Checked-jitstress2_jitstressregs2","System.StageName":"Build","BuildNumber":"20240505.1","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","BuildId":"666175","Reason":"Schedule","DefinitionName":"runtime-coreclr jitstress2-jitstressregs","Project":"public","CollectionUri":"https://dev.azure.com/dnceng-public/","System.JobName":"__default","DefinitionId":"111","System.JobAttempt":"1","architecture":"x64","System.StageAttempt":"1","operatingSystem":"Ubuntu.2204.Amd64.Open"} Schedule
2024-05-05T18:23:57.921Z runtime-coreclr jitstress2-jitstressregs Checked-jitstress2_jitstressregs3 ubuntu.2204.amd64.open.rt x64 GC/Scenarios/BinTree/thdtreegrowingobj/thdtreegrowingobj.sh Failed {"operatingSystem":"Ubuntu.2204.Amd64.Open","architecture":"x64","System.StageAttempt":"1","DefinitionName":"runtime-coreclr jitstress2-jitstressregs","DefinitionId":"111","Project":"public","System.PhaseName":"run_test_p1__linux_x64_checked","BuildId":"666175","Reason":"Schedule","AzurePipelinesTestRunId":"16523726","System.JobName":"__default","configuration":"Checked-jitstress2_jitstressregs3","BuildNumber":"20240505.1","System.JobAttempt":"1","System.StageName":"Build","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","System.PhaseAttempt":"1","CollectionUri":"https://dev.azure.com/dnceng-public/"} Schedule
2024-05-05T18:23:56.453Z runtime-coreclr jitstress2-jitstressregs Checked-jitstress2_jitstressregs1 ubuntu.2204.amd64.open.rt x64 GC/Scenarios/BinTree/thdtreegrowingobj/thdtreegrowingobj.sh Failed {"System.JobAttempt":"1","operatingSystem":"Ubuntu.2204.Amd64.Open","System.StageName":"Build","BuildNumber":"20240505.1","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","configuration":"Checked-jitstress2_jitstressregs1","System.StageAttempt":"1","BuildId":"666175","DefinitionId":"111","System.PhaseName":"run_test_p1__linux_x64_checked","Reason":"Schedule","architecture":"x64","System.JobName":"__default","AzurePipelinesTestRunId":"16523714","DefinitionName":"runtime-coreclr jitstress2-jitstressregs","Project":"public","System.PhaseAttempt":"1","CollectionUri":"https://dev.azure.com/dnceng-public/"} Schedule
2024-05-05T18:23:54.983Z runtime-coreclr jitstress2-jitstressregs Checked-jitstress2_jitstressregs0x1000 ubuntu.2204.amd64.open.rt x64 GC/Scenarios/BinTree/thdtreegrowingobj/thdtreegrowingobj.sh Failed {"AzurePipelinesTestRunId":"16523720","CollectionUri":"https://dev.azure.com/dnceng-public/","operatingSystem":"Ubuntu.2204.Amd64.Open","System.PhaseName":"run_test_p1__linux_x64_checked","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","BuildId":"666175","System.JobName":"__default","System.PhaseAttempt":"1","Reason":"Schedule","System.StageAttempt":"1","System.JobAttempt":"1","Project":"public","DefinitionName":"runtime-coreclr jitstress2-jitstressregs","System.StageName":"Build","configuration":"Checked-jitstress2_jitstressregs0x1000","architecture":"x64","BuildNumber":"20240505.1","DefinitionId":"111"} Schedule
2024-05-05T18:23:53.463Z runtime-coreclr jitstress2-jitstressregs Checked-jitstress2_jitstressregs0x10 ubuntu.2204.amd64.open.rt x64 GC/Scenarios/BinTree/thdtreegrowingobj/thdtreegrowingobj.sh Failed {"System.StageAttempt":"1","DefinitionId":"111","System.PhaseAttempt":"1","System.JobName":"__default","System.StageName":"Build","BuildId":"666175","configuration":"Checked-jitstress2_jitstressregs0x10","DefinitionName":"runtime-coreclr jitstress2-jitstressregs","System.JobAttempt":"1","Project":"public","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","System.PhaseName":"run_test_p1__linux_x64_checked","AzurePipelinesTestRunId":"16523718","BuildNumber":"20240505.1","architecture":"x64","operatingSystem":"Ubuntu.2204.Amd64.Open","Reason":"Schedule","CollectionUri":"https://dev.azure.com/dnceng-public/"} Schedule
2024-05-05T18:23:52.046Z runtime-coreclr jitstress2-jitstressregs Checked-jitstress2_jitstressregs4 ubuntu.2204.amd64.open.rt x64 GC/Scenarios/BinTree/thdtreegrowingobj/thdtreegrowingobj.sh Failed {"configuration":"Checked-jitstress2_jitstressregs4","DefinitionName":"runtime-coreclr jitstress2-jitstressregs","BuildId":"666175","System.JobName":"__default","AzurePipelinesTestRunId":"16523716","operatingSystem":"Ubuntu.2204.Amd64.Open","System.PhaseAttempt":"1","System.JobAttempt":"1","System.StageName":"Build","System.StageAttempt":"1","System.PhaseName":"run_test_p1__linux_x64_checked","Reason":"Schedule","DefinitionId":"111","BuildNumber":"20240505.1","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","CollectionUri":"https://dev.azure.com/dnceng-public/","Project":"public","architecture":"x64"} Schedule
2024-05-05T05:23:23.043Z runtime-coreclr jitstress Checked-jitstress2 ubuntu.2204.amd64.open.rt x64 GC/Scenarios/BinTree/thdtreegrowingobj/thdtreegrowingobj.sh Failed {"operatingSystem":"Ubuntu.2204.Amd64.Open","System.StageName":"Build","System.JobName":"__default","BuildNumber":"20240504.1","System.StageAttempt":"1","architecture":"x64","CollectionUri":"https://dev.azure.com/dnceng-public/","DefinitionName":"runtime-coreclr jitstress","System.JobAttempt":"1","BuildId":"665914","System.PhaseName":"run_test_p1__linux_x64_checked","System.PhaseAttempt":"1","DefinitionId":"109","configuration":"Checked-jitstress2","Reason":"Schedule","AzurePipelinesTestRunId":"16515340","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","Project":"public"} Schedule
2024-05-05T05:23:21.689Z runtime-coreclr jitstress Checked-jitstress1_tiered ubuntu.2204.amd64.open.rt x64 GC/Scenarios/BinTree/thdtreegrowingobj/thdtreegrowingobj.sh Failed {"BuildNumber":"20240504.1","configuration":"Checked-jitstress1_tiered","Reason":"Schedule","DefinitionName":"runtime-coreclr jitstress","DefinitionId":"109","architecture":"x64","System.PhaseAttempt":"1","Project":"public","System.PhaseName":"run_test_p1__linux_x64_checked","AzurePipelinesTestRunId":"16515342","System.StageName":"Build","System.JobAttempt":"1","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","BuildId":"665914","System.JobName":"__default","operatingSystem":"Ubuntu.2204.Amd64.Open","CollectionUri":"https://dev.azure.com/dnceng-public/","System.StageAttempt":"1"} Schedule
2024-05-05T05:23:18.752Z runtime-coreclr jitstress Checked-jitstress1 ubuntu.2204.amd64.open.rt x64 GC/Scenarios/BinTree/thdtreegrowingobj/thdtreegrowingobj.sh Failed {"operatingSystem":"Ubuntu.2204.Amd64.Open","System.PhaseName":"run_test_p1__linux_x64_checked","DefinitionName":"runtime-coreclr jitstress","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","System.PhaseAttempt":"1","BuildNumber":"20240504.1","AzurePipelinesTestRunId":"16515336","System.JobName":"__default","Reason":"Schedule","Project":"public","System.JobAttempt":"1","System.StageAttempt":"1","System.StageName":"Build","architecture":"x64","CollectionUri":"https://dev.azure.com/dnceng-public/","DefinitionId":"109","BuildId":"665914","configuration":"Checked-jitstress1"} Schedule
2024-05-05T05:23:17.345Z runtime-coreclr jitstress Checked-jitstress2_tiered ubuntu.2204.amd64.open.rt x64 GC/Scenarios/BinTree/thdtreegrowingobj/thdtreegrowingobj.sh Failed {"BuildNumber":"20240504.1","DefinitionId":"109","System.PhaseName":"run_test_p1__linux_x64_checked","AzurePipelinesTestRunId":"16515338","System.StageAttempt":"1","BuildId":"665914","operatingSystem":"Ubuntu.2204.Amd64.Open","DefinitionName":"runtime-coreclr jitstress","System.JobName":"__default","Project":"public","CollectionUri":"https://dev.azure.com/dnceng-public/","Reason":"Schedule","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","configuration":"Checked-jitstress2_tiered","architecture":"x64","System.StageName":"Build","System.PhaseAttempt":"1","System.JobAttempt":"1"} Schedule
2024-05-05T03:29:14.895Z runtime-coreclr r2r-extra Checked-jitstress2_tiered ubuntu.2204.amd64.open.rt x64 GC/Scenarios/BinTree/thdtreegrowingobj/thdtreegrowingobj.sh Failed {"AzurePipelinesTestRunId":"16514730","System.JobName":"__default","BuildId":"665904","DefinitionName":"runtime-coreclr r2r-extra","Project":"public","System.JobId":"45a39349-90d5-51c8-4429-a48b2907fbdd","System.PhaseAttempt":"1","System.StageAttempt":"1","DefinitionId":"114","Reason":"Schedule","architecture":"x64","operatingSystem":"Ubuntu.2204.Amd64.Open","System.StageName":"Build","configuration":"Checked-jitstress2_tiered","CollectionUri":"https://dev.azure.com/dnceng-public/","System.JobAttempt":"1","BuildNumber":"20240504.1","System.PhaseName":"run_test_p1_R2R_linux_x64_checked"} Schedule
2024-05-04T21:29:31.966Z runtime-coreclr jitstress-isas-x86 Checked-jitstress_isas_2_x86_nossse3 ubuntu.2204.amd64.open.rt x64 GC/Scenarios/BinTree/thdtreegrowingobj/thdtreegrowingobj.sh Failed {"System.PhaseName":"run_test_p1__linux_x64_checked","System.JobName":"__default","System.StageName":"Build","System.StageAttempt":"1","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","System.PhaseAttempt":"1","BuildNumber":"20240504.1","configuration":"Checked-jitstress_isas_2_x86_nossse3","BuildId":"665757","DefinitionId":"115","Reason":"Schedule","CollectionUri":"https://dev.azure.com/dnceng-public/","Project":"public","DefinitionName":"runtime-coreclr jitstress-isas-x86","operatingSystem":"Ubuntu.2204.Amd64.Open","System.JobAttempt":"1","AzurePipelinesTestRunId":"16513136","architecture":"x64"} Schedule
2024-05-04T21:28:50.478Z runtime-coreclr jitstress-isas-x86 Checked-jitstress_isas_2_x86_nosse42 ubuntu.2204.amd64.open.rt x64 GC/Scenarios/BinTree/thdtreegrowingobj/thdtreegrowingobj.sh Failed {"Project":"public","configuration":"Checked-jitstress_isas_2_x86_nosse42","System.StageName":"Build","BuildId":"665757","System.JobName":"__default","DefinitionId":"115","System.PhaseAttempt":"1","operatingSystem":"Ubuntu.2204.Amd64.Open","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","Reason":"Schedule","architecture":"x64","System.JobAttempt":"1","AzurePipelinesTestRunId":"16513126","System.PhaseName":"run_test_p1__linux_x64_checked","DefinitionName":"runtime-coreclr jitstress-isas-x86","System.StageAttempt":"1","BuildNumber":"20240504.1","CollectionUri":"https://dev.azure.com/dnceng-public/"} Schedule
2024-05-04T21:28:31.425Z runtime-coreclr jitstress-isas-x86 Checked-jitstress_isas_2_x86_nosse41 ubuntu.2204.amd64.open.rt x64 GC/Scenarios/BinTree/thdtreegrowingobj/thdtreegrowingobj.sh Failed {"System.JobName":"__default","CollectionUri":"https://dev.azure.com/dnceng-public/","AzurePipelinesTestRunId":"16513124","operatingSystem":"Ubuntu.2204.Amd64.Open","DefinitionName":"runtime-coreclr jitstress-isas-x86","BuildNumber":"20240504.1","System.StageName":"Build","Project":"public","BuildId":"665757","System.JobAttempt":"1","DefinitionId":"115","Reason":"Schedule","System.StageAttempt":"1","System.PhaseName":"run_test_p1__linux_x64_checked","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","architecture":"x64","configuration":"Checked-jitstress_isas_2_x86_nosse41","System.PhaseAttempt":"1"} Schedule
2024-05-04T21:27:31.21Z runtime-coreclr jitstress-isas-x86 Checked-jitstress_isas_2_x86_nosse3_4 ubuntu.2204.amd64.open.rt x64 GC/Scenarios/BinTree/thdtreegrowingobj/thdtreegrowingobj.sh Failed {"operatingSystem":"Ubuntu.2204.Amd64.Open","architecture":"x64","System.PhaseName":"run_test_p1__linux_x64_checked","BuildId":"665757","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","System.JobName":"__default","Reason":"Schedule","System.StageName":"Build","configuration":"Checked-jitstress_isas_2_x86_nosse3_4","System.PhaseAttempt":"1","DefinitionId":"115","DefinitionName":"runtime-coreclr jitstress-isas-x86","System.StageAttempt":"1","System.JobAttempt":"1","AzurePipelinesTestRunId":"16513120","CollectionUri":"https://dev.azure.com/dnceng-public/","BuildNumber":"20240504.1","Project":"public"} Schedule
2024-05-04T21:01:37.259Z runtime-coreclr jitstress-isas-x86 Checked-jitstress_isas_1_x86_nopclmulqdq ubuntu.2204.amd64.open.rt x64 GC/Scenarios/BinTree/thdtreegrowingobj/thdtreegrowingobj.sh Failed {"System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","architecture":"x64","DefinitionName":"runtime-coreclr jitstress-isas-x86","System.PhaseName":"run_test_p1__linux_x64_checked","System.StageName":"Build","DefinitionId":"115","operatingSystem":"Ubuntu.2204.Amd64.Open","Project":"public","AzurePipelinesTestRunId":"16512600","Reason":"Schedule","System.JobAttempt":"1","System.JobName":"__default","System.StageAttempt":"1","CollectionUri":"https://dev.azure.com/dnceng-public/","BuildNumber":"20240504.1","BuildId":"665757","System.PhaseAttempt":"1","configuration":"Checked-jitstress_isas_1_x86_nopclmulqdq"} Schedule
2024-05-04T21:01:32.755Z runtime-coreclr jitstress-isas-x86 Checked-jitstress_isas_1_x86_noaes ubuntu.2204.amd64.open.rt x64 GC/Scenarios/BinTree/thdtreegrowingobj/thdtreegrowingobj.sh Failed {"configuration":"Checked-jitstress_isas_1_x86_noaes","AzurePipelinesTestRunId":"16512576","operatingSystem":"Ubuntu.2204.Amd64.Open","architecture":"x64","DefinitionId":"115","Reason":"Schedule","BuildId":"665757","DefinitionName":"runtime-coreclr jitstress-isas-x86","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","Project":"public","System.JobName":"__default","System.JobAttempt":"1","System.StageName":"Build","System.PhaseAttempt":"1","BuildNumber":"20240504.1","System.PhaseName":"run_test_p1__linux_x64_checked","System.StageAttempt":"1","CollectionUri":"https://dev.azure.com/dnceng-public/"} Schedule
2024-05-04T21:01:28.211Z runtime-coreclr jitstress-isas-x86 Checked-jitstress_isas_1_x86_nobmi2 ubuntu.2204.amd64.open.rt x64 GC/Scenarios/BinTree/thdtreegrowingobj/thdtreegrowingobj.sh Failed {"architecture":"x64","System.PhaseAttempt":"1","System.StageName":"Build","System.JobName":"__default","Reason":"Schedule","CollectionUri":"https://dev.azure.com/dnceng-public/","BuildNumber":"20240504.1","System.PhaseName":"run_test_p1__linux_x64_checked","AzurePipelinesTestRunId":"16512594","Project":"public","System.StageAttempt":"1","System.JobAttempt":"1","DefinitionName":"runtime-coreclr jitstress-isas-x86","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","operatingSystem":"Ubuntu.2204.Amd64.Open","BuildId":"665757","configuration":"Checked-jitstress_isas_1_x86_nobmi2","DefinitionId":"115"} Schedule
2024-05-04T21:01:26.552Z runtime-coreclr jitstress-isas-x86 Checked-jitstress_isas_1_x86_nolzcnt ubuntu.2204.amd64.open.rt x64 GC/Scenarios/BinTree/thdtreegrowingobj/thdtreegrowingobj.sh Failed {"CollectionUri":"https://dev.azure.com/dnceng-public/","operatingSystem":"Ubuntu.2204.Amd64.Open","configuration":"Checked-jitstress_isas_1_x86_nolzcnt","BuildId":"665757","architecture":"x64","Project":"public","System.PhaseAttempt":"1","Reason":"Schedule","System.StageName":"Build","System.PhaseName":"run_test_p1__linux_x64_checked","AzurePipelinesTestRunId":"16512598","DefinitionId":"115","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","DefinitionName":"runtime-coreclr jitstress-isas-x86","System.StageAttempt":"1","System.JobAttempt":"1","BuildNumber":"20240504.1","System.JobName":"__default"} Schedule
2024-05-04T21:01:25.051Z runtime-coreclr jitstress-isas-x86 Checked-jitstress_isas_1_x86_noavx2 ubuntu.2204.amd64.open.rt x64 GC/Scenarios/BinTree/thdtreegrowingobj/thdtreegrowingobj.sh Failed {"System.PhaseName":"run_test_p1__linux_x64_checked","System.StageName":"Build","System.StageAttempt":"1","Reason":"Schedule","architecture":"x64","BuildId":"665757","AzurePipelinesTestRunId":"16512602","operatingSystem":"Ubuntu.2204.Amd64.Open","configuration":"Checked-jitstress_isas_1_x86_noavx2","System.JobAttempt":"1","System.JobName":"__default","BuildNumber":"20240504.1","CollectionUri":"https://dev.azure.com/dnceng-public/","DefinitionName":"runtime-coreclr jitstress-isas-x86","Project":"public","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","DefinitionId":"115","System.PhaseAttempt":"1"} Schedule
2024-05-04T21:01:23.457Z runtime-coreclr jitstress-isas-x86 Checked-jitstress_isas_2_x86_nobmi2 ubuntu.2204.amd64.open.rt x64 GC/Scenarios/BinTree/thdtreegrowingobj/thdtreegrowingobj.sh Failed {"System.JobName":"__default","AzurePipelinesTestRunId":"16512588","System.StageName":"Build","System.JobAttempt":"1","System.PhaseAttempt":"1","BuildId":"665757","DefinitionName":"runtime-coreclr jitstress-isas-x86","architecture":"x64","BuildNumber":"20240504.1","configuration":"Checked-jitstress_isas_2_x86_nobmi2","System.PhaseName":"run_test_p1__linux_x64_checked","DefinitionId":"115","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","Reason":"Schedule","Project":"public","System.StageAttempt":"1","CollectionUri":"https://dev.azure.com/dnceng-public/","operatingSystem":"Ubuntu.2204.Amd64.Open"} Schedule
2024-05-04T21:01:21.878Z runtime-coreclr jitstress-isas-x86 Checked-jitstress_isas_1_x86_nohwintrinsic ubuntu.2204.amd64.open.rt x64 GC/Scenarios/BinTree/thdtreegrowingobj/thdtreegrowingobj.sh Failed {"DefinitionName":"runtime-coreclr jitstress-isas-x86","CollectionUri":"https://dev.azure.com/dnceng-public/","operatingSystem":"Ubuntu.2204.Amd64.Open","Reason":"Schedule","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","DefinitionId":"115","AzurePipelinesTestRunId":"16512572","configuration":"Checked-jitstress_isas_1_x86_nohwintrinsic","System.StageName":"Build","BuildId":"665757","System.PhaseName":"run_test_p1__linux_x64_checked","System.StageAttempt":"1","System.JobAttempt":"1","System.PhaseAttempt":"1","System.JobName":"__default","Project":"public","architecture":"x64","BuildNumber":"20240504.1"} Schedule
2024-05-04T21:01:19.011Z runtime-coreclr jitstress-isas-x86 Checked-jitstress_isas_2_x86_noavx512 ubuntu.2204.amd64.open.rt x64 GC/Scenarios/BinTree/thdtreegrowingobj/thdtreegrowingobj.sh Failed {"operatingSystem":"Ubuntu.2204.Amd64.Open","System.StageAttempt":"1","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","System.JobAttempt":"1","System.JobName":"__default","AzurePipelinesTestRunId":"16512564","BuildId":"665757","configuration":"Checked-jitstress_isas_2_x86_noavx512","DefinitionId":"115","Reason":"Schedule","architecture":"x64","System.PhaseAttempt":"1","System.StageName":"Build","DefinitionName":"runtime-coreclr jitstress-isas-x86","System.PhaseName":"run_test_p1__linux_x64_checked","CollectionUri":"https://dev.azure.com/dnceng-public/","BuildNumber":"20240504.1","Project":"public"} Schedule
2024-05-04T21:01:17.808Z runtime-coreclr jitstress-isas-x86 Checked-jitstress_isas_2_x86_nofma ubuntu.2204.amd64.open.rt x64 GC/Scenarios/BinTree/thdtreegrowingobj/thdtreegrowingobj.sh Failed {"System.PhaseAttempt":"1","Project":"public","Reason":"Schedule","BuildId":"665757","System.StageAttempt":"1","System.PhaseName":"run_test_p1__linux_x64_checked","AzurePipelinesTestRunId":"16512570","BuildNumber":"20240504.1","System.StageName":"Build","configuration":"Checked-jitstress_isas_2_x86_nofma","architecture":"x64","DefinitionId":"115","operatingSystem":"Ubuntu.2204.Amd64.Open","CollectionUri":"https://dev.azure.com/dnceng-public/","System.JobName":"__default","DefinitionName":"runtime-coreclr jitstress-isas-x86","System.JobAttempt":"1","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5"} Schedule
2024-05-04T21:01:15.179Z runtime-coreclr jitstress-isas-x86 Checked-jitstress_isas_2_x86_nosse3 ubuntu.2204.amd64.open.rt x64 GC/Scenarios/BinTree/thdtreegrowingobj/thdtreegrowingobj.sh Failed {"DefinitionName":"runtime-coreclr jitstress-isas-x86","Project":"public","System.PhaseName":"run_test_p1__linux_x64_checked","operatingSystem":"Ubuntu.2204.Amd64.Open","System.PhaseAttempt":"1","configuration":"Checked-jitstress_isas_2_x86_nosse3","BuildId":"665757","System.JobName":"__default","BuildNumber":"20240504.1","architecture":"x64","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","CollectionUri":"https://dev.azure.com/dnceng-public/","System.JobAttempt":"1","System.StageAttempt":"1","AzurePipelinesTestRunId":"16512586","DefinitionId":"115","System.StageName":"Build","Reason":"Schedule"} Schedule
2024-05-04T21:01:12.355Z runtime-coreclr jitstress-isas-x86 Checked-jitstress_isas_1_x86_nosse3_4 ubuntu.2204.amd64.open.rt x64 GC/Scenarios/BinTree/thdtreegrowingobj/thdtreegrowingobj.sh Failed {"System.JobName":"__default","BuildId":"665757","configuration":"Checked-jitstress_isas_1_x86_nosse3_4","System.StageAttempt":"1","System.StageName":"Build","System.PhaseAttempt":"1","Reason":"Schedule","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","AzurePipelinesTestRunId":"16512556","architecture":"x64","System.PhaseName":"run_test_p1__linux_x64_checked","DefinitionId":"115","CollectionUri":"https://dev.azure.com/dnceng-public/","System.JobAttempt":"1","Project":"public","operatingSystem":"Ubuntu.2204.Amd64.Open","DefinitionName":"runtime-coreclr jitstress-isas-x86","BuildNumber":"20240504.1"} Schedule
2024-05-04T21:01:10.703Z runtime-coreclr jitstress-isas-x86 Checked-jitstress_isas_1_x86_nosse41 ubuntu.2204.amd64.open.rt x64 GC/Scenarios/BinTree/thdtreegrowingobj/thdtreegrowingobj.sh Failed {"System.StageName":"Build","BuildId":"665757","operatingSystem":"Ubuntu.2204.Amd64.Open","System.StageAttempt":"1","CollectionUri":"https://dev.azure.com/dnceng-public/","AzurePipelinesTestRunId":"16512574","System.PhaseName":"run_test_p1__linux_x64_checked","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","DefinitionName":"runtime-coreclr jitstress-isas-x86","configuration":"Checked-jitstress_isas_1_x86_nosse41","DefinitionId":"115","architecture":"x64","System.JobName":"__default","System.JobAttempt":"1","System.PhaseAttempt":"1","BuildNumber":"20240504.1","Reason":"Schedule","Project":"public"} Schedule
2024-05-04T21:01:08.08Z runtime-coreclr jitstress-isas-x86 Checked-jitstress_isas_1_x86_noavx ubuntu.2204.amd64.open.rt x64 GC/Scenarios/BinTree/thdtreegrowingobj/thdtreegrowingobj.sh Failed {"AzurePipelinesTestRunId":"16512544","System.StageAttempt":"1","System.JobAttempt":"1","CollectionUri":"https://dev.azure.com/dnceng-public/","architecture":"x64","DefinitionName":"runtime-coreclr jitstress-isas-x86","System.PhaseName":"run_test_p1__linux_x64_checked","Project":"public","System.StageName":"Build","System.PhaseAttempt":"1","System.JobName":"__default","BuildNumber":"20240504.1","Reason":"Schedule","operatingSystem":"Ubuntu.2204.Amd64.Open","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","configuration":"Checked-jitstress_isas_1_x86_noavx","BuildId":"665757","DefinitionId":"115"} Schedule
2024-05-04T21:01:02.971Z runtime-coreclr jitstress-isas-x86 Checked-jitstress_isas_2_x86_noavx ubuntu.2204.amd64.open.rt x64 GC/Scenarios/BinTree/thdtreegrowingobj/thdtreegrowingobj.sh Failed {"BuildId":"665757","System.JobAttempt":"1","Reason":"Schedule","configuration":"Checked-jitstress_isas_2_x86_noavx","AzurePipelinesTestRunId":"16512566","Project":"public","System.PhaseAttempt":"1","System.PhaseName":"run_test_p1__linux_x64_checked","DefinitionId":"115","System.StageAttempt":"1","BuildNumber":"20240504.1","operatingSystem":"Ubuntu.2204.Amd64.Open","architecture":"x64","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","CollectionUri":"https://dev.azure.com/dnceng-public/","DefinitionName":"runtime-coreclr jitstress-isas-x86","System.StageName":"Build","System.JobName":"__default"} Schedule
2024-05-04T21:01:01.511Z runtime-coreclr jitstress-isas-x86 Checked-jitstress_isas_2_x86_noavx2 ubuntu.2204.amd64.open.rt x64 GC/Scenarios/BinTree/thdtreegrowingobj/thdtreegrowingobj.sh Failed {"System.PhaseAttempt":"1","operatingSystem":"Ubuntu.2204.Amd64.Open","System.StageName":"Build","configuration":"Checked-jitstress_isas_2_x86_noavx2","BuildNumber":"20240504.1","System.JobName":"__default","CollectionUri":"https://dev.azure.com/dnceng-public/","System.JobAttempt":"1","BuildId":"665757","System.StageAttempt":"1","Reason":"Schedule","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","AzurePipelinesTestRunId":"16512552","System.PhaseName":"run_test_p1__linux_x64_checked","architecture":"x64","DefinitionName":"runtime-coreclr jitstress-isas-x86","Project":"public","DefinitionId":"115"} Schedule
2024-05-04T21:01:00.266Z runtime-coreclr jitstress-isas-x86 Checked-jitstress_isas_1_x86_nosse ubuntu.2204.amd64.open.rt x64 GC/Scenarios/BinTree/thdtreegrowingobj/thdtreegrowingobj.sh Failed {"System.JobName":"__default","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","System.JobAttempt":"1","CollectionUri":"https://dev.azure.com/dnceng-public/","System.StageAttempt":"1","operatingSystem":"Ubuntu.2204.Amd64.Open","BuildNumber":"20240504.1","System.PhaseAttempt":"1","architecture":"x64","System.StageName":"Build","Project":"public","AzurePipelinesTestRunId":"16512560","DefinitionId":"115","System.PhaseName":"run_test_p1__linux_x64_checked","DefinitionName":"runtime-coreclr jitstress-isas-x86","BuildId":"665757","configuration":"Checked-jitstress_isas_1_x86_nosse","Reason":"Schedule"} Schedule
2024-05-04T21:00:58.734Z runtime-coreclr jitstress-isas-x86 Checked-jitstress_isas_1_x86_nossse3 ubuntu.2204.amd64.open.rt x64 GC/Scenarios/BinTree/thdtreegrowingobj/thdtreegrowingobj.sh Failed {"Reason":"Schedule","configuration":"Checked-jitstress_isas_1_x86_nossse3","System.PhaseAttempt":"1","System.StageName":"Build","DefinitionId":"115","System.PhaseName":"run_test_p1__linux_x64_checked","System.JobName":"__default","DefinitionName":"runtime-coreclr jitstress-isas-x86","Project":"public","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","System.StageAttempt":"1","operatingSystem":"Ubuntu.2204.Amd64.Open","AzurePipelinesTestRunId":"16512592","BuildNumber":"20240504.1","architecture":"x64","CollectionUri":"https://dev.azure.com/dnceng-public/","BuildId":"665757","System.JobAttempt":"1"} Schedule
2024-05-04T21:00:57.267Z runtime-coreclr jitstress-isas-x86 Checked-jitstress_isas_2_x86_nosse2 ubuntu.2204.amd64.open.rt x64 GC/Scenarios/BinTree/thdtreegrowingobj/thdtreegrowingobj.sh Failed {"System.JobName":"__default","configuration":"Checked-jitstress_isas_2_x86_nosse2","System.JobAttempt":"1","operatingSystem":"Ubuntu.2204.Amd64.Open","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","DefinitionId":"115","System.PhaseAttempt":"1","AzurePipelinesTestRunId":"16512512","System.PhaseName":"run_test_p1__linux_x64_checked","DefinitionName":"runtime-coreclr jitstress-isas-x86","CollectionUri":"https://dev.azure.com/dnceng-public/","Reason":"Schedule","System.StageAttempt":"1","Project":"public","System.StageName":"Build","BuildNumber":"20240504.1","architecture":"x64","BuildId":"665757"} Schedule
2024-05-04T21:00:51.399Z runtime-coreclr jitstress-isas-x86 Checked-jitstress_isas_1_x86_nobmi1 ubuntu.2204.amd64.open.rt x64 GC/Scenarios/BinTree/thdtreegrowingobj/thdtreegrowingobj.sh Failed {"System.JobAttempt":"1","operatingSystem":"Ubuntu.2204.Amd64.Open","BuildNumber":"20240504.1","BuildId":"665757","DefinitionName":"runtime-coreclr jitstress-isas-x86","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","Project":"public","System.StageName":"Build","System.PhaseAttempt":"1","System.PhaseName":"run_test_p1__linux_x64_checked","System.StageAttempt":"1","System.JobName":"__default","AzurePipelinesTestRunId":"16512542","DefinitionId":"115","CollectionUri":"https://dev.azure.com/dnceng-public/","architecture":"x64","Reason":"Schedule","configuration":"Checked-jitstress_isas_1_x86_nobmi1"} Schedule
2024-05-04T21:00:49.89Z runtime-coreclr jitstress-isas-x86 Checked-jitstress_isas_2_x86_nobmi1 ubuntu.2204.amd64.open.rt x64 GC/Scenarios/BinTree/thdtreegrowingobj/thdtreegrowingobj.sh Failed {"System.PhaseName":"run_test_p1__linux_x64_checked","Project":"public","configuration":"Checked-jitstress_isas_2_x86_nobmi1","DefinitionName":"runtime-coreclr jitstress-isas-x86","System.JobName":"__default","AzurePipelinesTestRunId":"16512516","BuildId":"665757","BuildNumber":"20240504.1","System.JobAttempt":"1","System.StageAttempt":"1","architecture":"x64","CollectionUri":"https://dev.azure.com/dnceng-public/","System.StageName":"Build","System.PhaseAttempt":"1","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","Reason":"Schedule","operatingSystem":"Ubuntu.2204.Amd64.Open","DefinitionId":"115"} Schedule
2024-05-04T21:00:48.53Z runtime-coreclr jitstress-isas-x86 Checked-jitstress_isas_1_x86_nosse3 ubuntu.2204.amd64.open.rt x64 GC/Scenarios/BinTree/thdtreegrowingobj/thdtreegrowingobj.sh Failed {"DefinitionId":"115","System.JobAttempt":"1","Reason":"Schedule","AzurePipelinesTestRunId":"16512504","configuration":"Checked-jitstress_isas_1_x86_nosse3","System.StageName":"Build","System.StageAttempt":"1","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","System.JobName":"__default","System.PhaseName":"run_test_p1__linux_x64_checked","System.PhaseAttempt":"1","BuildId":"665757","CollectionUri":"https://dev.azure.com/dnceng-public/","operatingSystem":"Ubuntu.2204.Amd64.Open","architecture":"x64","DefinitionName":"runtime-coreclr jitstress-isas-x86","BuildNumber":"20240504.1","Project":"public"} Schedule
2024-05-04T21:00:46.952Z runtime-coreclr jitstress-isas-x86 Checked-jitstress_isas_2_x86_nolzcnt ubuntu.2204.amd64.open.rt x64 GC/Scenarios/BinTree/thdtreegrowingobj/thdtreegrowingobj.sh Failed {"CollectionUri":"https://dev.azure.com/dnceng-public/","System.StageName":"Build","DefinitionId":"115","AzurePipelinesTestRunId":"16512526","Reason":"Schedule","DefinitionName":"runtime-coreclr jitstress-isas-x86","BuildNumber":"20240504.1","configuration":"Checked-jitstress_isas_2_x86_nolzcnt","architecture":"x64","System.JobAttempt":"1","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","System.PhaseName":"run_test_p1__linux_x64_checked","BuildId":"665757","Project":"public","System.PhaseAttempt":"1","System.JobName":"__default","operatingSystem":"Ubuntu.2204.Amd64.Open","System.StageAttempt":"1"} Schedule
2024-05-04T21:00:45.373Z runtime-coreclr jitstress-isas-x86 Checked-jitstress_isas_2_x86_nohwintrinsic ubuntu.2204.amd64.open.rt x64 GC/Scenarios/BinTree/thdtreegrowingobj/thdtreegrowingobj.sh Failed {"DefinitionName":"runtime-coreclr jitstress-isas-x86","Reason":"Schedule","System.StageAttempt":"1","BuildNumber":"20240504.1","AzurePipelinesTestRunId":"16512550","architecture":"x64","System.PhaseAttempt":"1","operatingSystem":"Ubuntu.2204.Amd64.Open","BuildId":"665757","Project":"public","DefinitionId":"115","CollectionUri":"https://dev.azure.com/dnceng-public/","System.StageName":"Build","System.JobName":"__default","System.JobAttempt":"1","System.PhaseName":"run_test_p1__linux_x64_checked","configuration":"Checked-jitstress_isas_2_x86_nohwintrinsic","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5"} Schedule
2024-05-04T21:00:42.467Z runtime-coreclr jitstress-isas-x86 Checked-jitstress_isas_2_x86_nosse ubuntu.2204.amd64.open.rt x64 GC/Scenarios/BinTree/thdtreegrowingobj/thdtreegrowingobj.sh Failed {"System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","CollectionUri":"https://dev.azure.com/dnceng-public/","System.JobAttempt":"1","BuildId":"665757","System.PhaseName":"run_test_p1__linux_x64_checked","BuildNumber":"20240504.1","operatingSystem":"Ubuntu.2204.Amd64.Open","configuration":"Checked-jitstress_isas_2_x86_nosse","System.JobName":"__default","architecture":"x64","Reason":"Schedule","Project":"public","AzurePipelinesTestRunId":"16512530","DefinitionName":"runtime-coreclr jitstress-isas-x86","System.PhaseAttempt":"1","DefinitionId":"115","System.StageAttempt":"1","System.StageName":"Build"} Schedule
2024-05-04T21:00:40.919Z runtime-coreclr jitstress-isas-x86 Checked-jitstress_isas_1_x86_nopopcnt ubuntu.2204.amd64.open.rt x64 GC/Scenarios/BinTree/thdtreegrowingobj/thdtreegrowingobj.sh Failed {"BuildNumber":"20240504.1","System.StageAttempt":"1","System.PhaseAttempt":"1","operatingSystem":"Ubuntu.2204.Amd64.Open","BuildId":"665757","configuration":"Checked-jitstress_isas_1_x86_nopopcnt","System.JobName":"__default","Project":"public","Reason":"Schedule","AzurePipelinesTestRunId":"16512522","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","System.JobAttempt":"1","System.PhaseName":"run_test_p1__linux_x64_checked","architecture":"x64","DefinitionId":"115","DefinitionName":"runtime-coreclr jitstress-isas-x86","CollectionUri":"https://dev.azure.com/dnceng-public/","System.StageName":"Build"} Schedule
2024-05-04T21:00:32.215Z runtime-coreclr jitstress-isas-x86 Checked-jitstress_isas_1_x86_noavx512 ubuntu.2204.amd64.open.rt x64 GC/Scenarios/BinTree/thdtreegrowingobj/thdtreegrowingobj.sh Failed {"BuildId":"665757","System.PhaseName":"run_test_p1__linux_x64_checked","CollectionUri":"https://dev.azure.com/dnceng-public/","AzurePipelinesTestRunId":"16512524","System.StageAttempt":"1","BuildNumber":"20240504.1","System.JobName":"__default","operatingSystem":"Ubuntu.2204.Amd64.Open","architecture":"x64","System.JobAttempt":"1","Reason":"Schedule","DefinitionName":"runtime-coreclr jitstress-isas-x86","DefinitionId":"115","System.PhaseAttempt":"1","System.StageName":"Build","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","Project":"public","configuration":"Checked-jitstress_isas_1_x86_noavx512"} Schedule
2024-05-04T21:00:30.733Z runtime-coreclr jitstress-isas-x86 Checked-jitstress_isas_1_x86_nosse42 ubuntu.2204.amd64.open.rt x64 GC/Scenarios/BinTree/thdtreegrowingobj/thdtreegrowingobj.sh Failed {"architecture":"x64","configuration":"Checked-jitstress_isas_1_x86_nosse42","System.PhaseName":"run_test_p1__linux_x64_checked","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","Reason":"Schedule","CollectionUri":"https://dev.azure.com/dnceng-public/","AzurePipelinesTestRunId":"16512502","BuildId":"665757","System.JobName":"__default","Project":"public","System.StageName":"Build","operatingSystem":"Ubuntu.2204.Amd64.Open","System.PhaseAttempt":"1","System.StageAttempt":"1","BuildNumber":"20240504.1","DefinitionName":"runtime-coreclr jitstress-isas-x86","System.JobAttempt":"1","DefinitionId":"115"} Schedule
2024-05-04T21:00:29.379Z runtime-coreclr jitstress-isas-x86 Checked-jitstress_isas_1_x86_nosse2 ubuntu.2204.amd64.open.rt x64 GC/Scenarios/BinTree/thdtreegrowingobj/thdtreegrowingobj.sh Failed {"System.JobAttempt":"1","BuildNumber":"20240504.1","System.PhaseAttempt":"1","DefinitionId":"115","configuration":"Checked-jitstress_isas_1_x86_nosse2","DefinitionName":"runtime-coreclr jitstress-isas-x86","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","Project":"public","Reason":"Schedule","operatingSystem":"Ubuntu.2204.Amd64.Open","System.StageAttempt":"1","System.PhaseName":"run_test_p1__linux_x64_checked","CollectionUri":"https://dev.azure.com/dnceng-public/","System.JobName":"__default","System.StageName":"Build","BuildId":"665757","architecture":"x64","AzurePipelinesTestRunId":"16512506"} Schedule
2024-05-04T21:00:26.176Z runtime-coreclr jitstress-isas-x86 Checked-jitstress_isas_2_x86_nopopcnt ubuntu.2204.amd64.open.rt x64 GC/Scenarios/BinTree/thdtreegrowingobj/thdtreegrowingobj.sh Failed {"System.StageAttempt":"1","CollectionUri":"https://dev.azure.com/dnceng-public/","System.PhaseAttempt":"1","DefinitionId":"115","operatingSystem":"Ubuntu.2204.Amd64.Open","AzurePipelinesTestRunId":"16512508","System.JobName":"__default","System.PhaseName":"run_test_p1__linux_x64_checked","configuration":"Checked-jitstress_isas_2_x86_nopopcnt","DefinitionName":"runtime-coreclr jitstress-isas-x86","Reason":"Schedule","System.StageName":"Build","System.JobAttempt":"1","architecture":"x64","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","BuildNumber":"20240504.1","Project":"public","BuildId":"665757"} Schedule
2024-05-04T21:00:22.863Z runtime-coreclr jitstress-isas-x86 Checked-jitstress_isas_2_x86_noaes ubuntu.2204.amd64.open.rt x64 GC/Scenarios/BinTree/thdtreegrowingobj/thdtreegrowingobj.sh Failed {"System.JobAttempt":"1","architecture":"x64","System.PhaseAttempt":"1","System.StageAttempt":"1","BuildId":"665757","configuration":"Checked-jitstress_isas_2_x86_noaes","System.StageName":"Build","CollectionUri":"https://dev.azure.com/dnceng-public/","DefinitionId":"115","BuildNumber":"20240504.1","operatingSystem":"Ubuntu.2204.Amd64.Open","AzurePipelinesTestRunId":"16512500","Project":"public","System.JobName":"__default","DefinitionName":"runtime-coreclr jitstress-isas-x86","System.PhaseName":"run_test_p1__linux_x64_checked","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","Reason":"Schedule"} Schedule
2024-05-04T21:00:18.816Z runtime-coreclr jitstress-isas-x86 Checked-jitstress_isas_2_x86_nopclmulqdq ubuntu.2204.amd64.open.rt x64 GC/Scenarios/BinTree/thdtreegrowingobj/thdtreegrowingobj.sh Failed {"System.StageName":"Build","DefinitionName":"runtime-coreclr jitstress-isas-x86","System.JobAttempt":"1","operatingSystem":"Ubuntu.2204.Amd64.Open","System.StageAttempt":"1","Reason":"Schedule","DefinitionId":"115","BuildId":"665757","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","AzurePipelinesTestRunId":"16512498","architecture":"x64","System.PhaseName":"run_test_p1__linux_x64_checked","System.PhaseAttempt":"1","System.JobName":"__default","configuration":"Checked-jitstress_isas_2_x86_nopclmulqdq","Project":"public","CollectionUri":"https://dev.azure.com/dnceng-public/","BuildNumber":"20240504.1"} Schedule
2024-05-04T21:00:17.263Z runtime-coreclr jitstress-isas-x86 Checked-jitstress_isas_1_x86_nofma ubuntu.2204.amd64.open.rt x64 GC/Scenarios/BinTree/thdtreegrowingobj/thdtreegrowingobj.sh Failed {"BuildNumber":"20240504.1","Project":"public","CollectionUri":"https://dev.azure.com/dnceng-public/","System.StageAttempt":"1","configuration":"Checked-jitstress_isas_1_x86_nofma","Reason":"Schedule","BuildId":"665757","System.PhaseName":"run_test_p1__linux_x64_checked","System.JobName":"__default","System.StageName":"Build","architecture":"x64","DefinitionName":"runtime-coreclr jitstress-isas-x86","System.JobAttempt":"1","AzurePipelinesTestRunId":"16512514","operatingSystem":"Ubuntu.2204.Amd64.Open","DefinitionId":"115","System.PhaseAttempt":"1","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5"} Schedule
2024-05-04T18:24:51.244Z runtime-coreclr jitstress2-jitstressregs Checked-jitstress2_jitstressregs0x80 ubuntu.2204.amd64.open.rt x64 GC/Scenarios/BinTree/thdtreegrowingobj/thdtreegrowingobj.sh Failed {"BuildId":"665686","Reason":"Schedule","System.StageName":"Build","System.PhaseName":"run_test_p1__linux_x64_checked","System.JobAttempt":"1","BuildNumber":"20240504.1","Project":"public","operatingSystem":"Ubuntu.2204.Amd64.Open","System.PhaseAttempt":"1","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","architecture":"x64","CollectionUri":"https://dev.azure.com/dnceng-public/","System.JobName":"__default","System.StageAttempt":"1","AzurePipelinesTestRunId":"16511542","DefinitionId":"111","DefinitionName":"runtime-coreclr jitstress2-jitstressregs","configuration":"Checked-jitstress2_jitstressregs0x80"} Schedule
2024-05-04T18:24:49.807Z runtime-coreclr jitstress2-jitstressregs Checked-jitstress2_jitstressregs8 ubuntu.2204.amd64.open.rt x64 GC/Scenarios/BinTree/thdtreegrowingobj/thdtreegrowingobj.sh Failed {"System.PhaseAttempt":"1","System.JobAttempt":"1","DefinitionName":"runtime-coreclr jitstress2-jitstressregs","System.StageAttempt":"1","DefinitionId":"111","System.PhaseName":"run_test_p1__linux_x64_checked","System.JobName":"__default","CollectionUri":"https://dev.azure.com/dnceng-public/","BuildNumber":"20240504.1","architecture":"x64","System.StageName":"Build","configuration":"Checked-jitstress2_jitstressregs8","operatingSystem":"Ubuntu.2204.Amd64.Open","BuildId":"665686","AzurePipelinesTestRunId":"16511550","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","Reason":"Schedule","Project":"public"} Schedule
2024-05-04T18:24:48.244Z runtime-coreclr jitstress2-jitstressregs Checked-jitstress2_jitstressregs0x1000 ubuntu.2204.amd64.open.rt x64 GC/Scenarios/BinTree/thdtreegrowingobj/thdtreegrowingobj.sh Failed {"Reason":"Schedule","configuration":"Checked-jitstress2_jitstressregs0x1000","CollectionUri":"https://dev.azure.com/dnceng-public/","AzurePipelinesTestRunId":"16511540","System.PhaseName":"run_test_p1__linux_x64_checked","DefinitionName":"runtime-coreclr jitstress2-jitstressregs","System.StageAttempt":"1","System.StageName":"Build","architecture":"x64","BuildId":"665686","Project":"public","operatingSystem":"Ubuntu.2204.Amd64.Open","System.PhaseAttempt":"1","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","System.JobName":"__default","DefinitionId":"111","System.JobAttempt":"1","BuildNumber":"20240504.1"} Schedule
2024-05-04T18:24:46.915Z runtime-coreclr jitstress2-jitstressregs Checked-jitstress2_jitstressregs0x10 ubuntu.2204.amd64.open.rt x64 GC/Scenarios/BinTree/thdtreegrowingobj/thdtreegrowingobj.sh Failed {"System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","System.JobAttempt":"1","operatingSystem":"Ubuntu.2204.Amd64.Open","AzurePipelinesTestRunId":"16511554","DefinitionId":"111","Reason":"Schedule","System.PhaseName":"run_test_p1__linux_x64_checked","architecture":"x64","configuration":"Checked-jitstress2_jitstressregs0x10","Project":"public","System.StageAttempt":"1","System.JobName":"__default","DefinitionName":"runtime-coreclr jitstress2-jitstressregs","BuildNumber":"20240504.1","System.PhaseAttempt":"1","CollectionUri":"https://dev.azure.com/dnceng-public/","BuildId":"665686","System.StageName":"Build"} Schedule
2024-05-04T18:24:45.479Z runtime-coreclr jitstress2-jitstressregs Checked-jitstress2_jitstressregs2 ubuntu.2204.amd64.open.rt x64 GC/Scenarios/BinTree/thdtreegrowingobj/thdtreegrowingobj.sh Failed {"Reason":"Schedule","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","Project":"public","System.PhaseName":"run_test_p1__linux_x64_checked","System.StageAttempt":"1","DefinitionId":"111","System.PhaseAttempt":"1","AzurePipelinesTestRunId":"16511544","CollectionUri":"https://dev.azure.com/dnceng-public/","System.JobAttempt":"1","DefinitionName":"runtime-coreclr jitstress2-jitstressregs","BuildId":"665686","operatingSystem":"Ubuntu.2204.Amd64.Open","System.StageName":"Build","BuildNumber":"20240504.1","System.JobName":"__default","configuration":"Checked-jitstress2_jitstressregs2","architecture":"x64"} Schedule
2024-05-04T18:24:43.947Z runtime-coreclr jitstress2-jitstressregs Checked-jitstress2_jitstressregs4 ubuntu.2204.amd64.open.rt x64 GC/Scenarios/BinTree/thdtreegrowingobj/thdtreegrowingobj.sh Failed {"AzurePipelinesTestRunId":"16511552","Project":"public","operatingSystem":"Ubuntu.2204.Amd64.Open","System.StageAttempt":"1","System.PhaseAttempt":"1","System.PhaseName":"run_test_p1__linux_x64_checked","CollectionUri":"https://dev.azure.com/dnceng-public/","DefinitionId":"111","System.StageName":"Build","System.JobAttempt":"1","configuration":"Checked-jitstress2_jitstressregs4","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","Reason":"Schedule","DefinitionName":"runtime-coreclr jitstress2-jitstressregs","System.JobName":"__default","BuildNumber":"20240504.1","architecture":"x64","BuildId":"665686"} Schedule
2024-05-04T18:24:42.243Z runtime-coreclr jitstress2-jitstressregs Checked-jitstress2_jitstressregs1 ubuntu.2204.amd64.open.rt x64 GC/Scenarios/BinTree/thdtreegrowingobj/thdtreegrowingobj.sh Failed {"configuration":"Checked-jitstress2_jitstressregs1","System.JobAttempt":"1","CollectionUri":"https://dev.azure.com/dnceng-public/","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","operatingSystem":"Ubuntu.2204.Amd64.Open","System.PhaseName":"run_test_p1__linux_x64_checked","System.StageName":"Build","System.JobName":"__default","AzurePipelinesTestRunId":"16511538","BuildId":"665686","BuildNumber":"20240504.1","Reason":"Schedule","System.StageAttempt":"1","Project":"public","DefinitionId":"111","architecture":"x64","System.PhaseAttempt":"1","DefinitionName":"runtime-coreclr jitstress2-jitstressregs"} Schedule
2024-05-04T18:24:40.774Z runtime-coreclr jitstress2-jitstressregs Checked-jitstress2_jitstressregs3 ubuntu.2204.amd64.open.rt x64 GC/Scenarios/BinTree/thdtreegrowingobj/thdtreegrowingobj.sh Failed {"System.StageName":"Build","configuration":"Checked-jitstress2_jitstressregs3","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","BuildNumber":"20240504.1","System.JobName":"__default","System.JobAttempt":"1","BuildId":"665686","DefinitionName":"runtime-coreclr jitstress2-jitstressregs","System.StageAttempt":"1","DefinitionId":"111","CollectionUri":"https://dev.azure.com/dnceng-public/","AzurePipelinesTestRunId":"16511548","architecture":"x64","operatingSystem":"Ubuntu.2204.Amd64.Open","System.PhaseAttempt":"1","Project":"public","Reason":"Schedule","System.PhaseName":"run_test_p1__linux_x64_checked"} Schedule
2024-05-04T18:24:39.166Z runtime-coreclr jitstress2-jitstressregs Checked-jitstress2_jitstressregs0x2000 ubuntu.2204.amd64.open.rt x64 GC/Scenarios/BinTree/thdtreegrowingobj/thdtreegrowingobj.sh Failed {"AzurePipelinesTestRunId":"16511546","architecture":"x64","System.PhaseAttempt":"1","System.PhaseName":"run_test_p1__linux_x64_checked","System.StageName":"Build","System.JobName":"__default","Project":"public","operatingSystem":"Ubuntu.2204.Amd64.Open","BuildNumber":"20240504.1","BuildId":"665686","DefinitionId":"111","configuration":"Checked-jitstress2_jitstressregs0x2000","System.JobAttempt":"1","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","CollectionUri":"https://dev.azure.com/dnceng-public/","System.StageAttempt":"1","Reason":"Schedule","DefinitionName":"runtime-coreclr jitstress2-jitstressregs"} Schedule
2024-05-04T05:26:23.627Z runtime-coreclr jitstress Checked-jitstress2 ubuntu.2204.amd64.open.rt x64 GC/Scenarios/BinTree/thdtreegrowingobj/thdtreegrowingobj.sh Failed {"CollectionUri":"https://dev.azure.com/dnceng-public/","architecture":"x64","Project":"public","DefinitionId":"109","System.JobAttempt":"1","System.StageAttempt":"1","DefinitionName":"runtime-coreclr jitstress","BuildNumber":"20240503.1","System.PhaseAttempt":"1","Reason":"Schedule","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","System.StageName":"Build","operatingSystem":"Ubuntu.2204.Amd64.Open","System.PhaseName":"run_test_p1__linux_x64_checked","BuildId":"665438","configuration":"Checked-jitstress2","System.JobName":"__default","AzurePipelinesTestRunId":"16503820"} Schedule
2024-05-04T05:26:21.923Z runtime-coreclr jitstress Checked-jitstress1_tiered ubuntu.2204.amd64.open.rt x64 GC/Scenarios/BinTree/thdtreegrowingobj/thdtreegrowingobj.sh Failed {"architecture":"x64","System.PhaseName":"run_test_p1__linux_x64_checked","AzurePipelinesTestRunId":"16503818","System.PhaseAttempt":"1","BuildId":"665438","DefinitionId":"109","System.JobName":"__default","Reason":"Schedule","operatingSystem":"Ubuntu.2204.Amd64.Open","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","Project":"public","DefinitionName":"runtime-coreclr jitstress","System.JobAttempt":"1","System.StageAttempt":"1","configuration":"Checked-jitstress1_tiered","BuildNumber":"20240503.1","System.StageName":"Build","CollectionUri":"https://dev.azure.com/dnceng-public/"} Schedule
2024-05-04T05:26:18.658Z runtime-coreclr jitstress Checked-jitstress1 ubuntu.2204.amd64.open.rt x64 GC/Scenarios/BinTree/thdtreegrowingobj/thdtreegrowingobj.sh Failed {"System.JobName":"__default","AzurePipelinesTestRunId":"16503822","operatingSystem":"Ubuntu.2204.Amd64.Open","System.JobAttempt":"1","System.PhaseName":"run_test_p1__linux_x64_checked","System.StageAttempt":"1","CollectionUri":"https://dev.azure.com/dnceng-public/","Project":"public","DefinitionId":"109","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","BuildId":"665438","System.StageName":"Build","DefinitionName":"runtime-coreclr jitstress","BuildNumber":"20240503.1","System.PhaseAttempt":"1","Reason":"Schedule","architecture":"x64","configuration":"Checked-jitstress1"} Schedule
2024-05-04T05:26:13.779Z runtime-coreclr jitstress Checked-jitstress2_tiered ubuntu.2204.amd64.open.rt x64 GC/Scenarios/BinTree/thdtreegrowingobj/thdtreegrowingobj.sh Failed {"System.StageName":"Build","System.PhaseName":"run_test_p1__linux_x64_checked","DefinitionId":"109","DefinitionName":"runtime-coreclr jitstress","operatingSystem":"Ubuntu.2204.Amd64.Open","architecture":"x64","CollectionUri":"https://dev.azure.com/dnceng-public/","BuildId":"665438","System.JobId":"6dfec640-5b96-5d95-2a5b-7c236ea2d5c5","AzurePipelinesTestRunId":"16503824","System.PhaseAttempt":"1","configuration":"Checked-jitstress2_tiered","System.JobAttempt":"1","System.StageAttempt":"1","Project":"public","System.JobName":"__default","Reason":"Schedule","BuildNumber":"20240503.1"} Schedule

v-wenyuxu avatar Aug 01 '24 01:08 v-wenyuxu

I initially suspected this was another instance of #102370, but after investigating some of the dumps I think there is a separate issue here. The symptoms of the dumps I have looked at are the same:

  1. No heap corruption
  2. The internal state of CorInfoImpl._stashedInlinedMethods has somehow been zeroed out:
0:011> !DumpObj /d 0000ffbf68954920
Name:        System.Collections.Generic.Stack`1[[System.Collections.Generic.HashSet`1[[Internal.TypeSystem.MethodDesc, ILCompiler.TypeSystem]], System.Private.CoreLib]]
MethodTable: 0000ffff7e1f54e8
EEClass:     0000ffff7d7d3af8
Tracked Type: false
Size:        32(0x20) bytes
File:        /root/helix/work/correlation/dotnet-cli/shared/Microsoft.NETCore.App/9.0.0-preview.6.24327.7/System.Collections.dll
Fields:
              MT    Field   Offset                 Type VT     Attr            Value Name
0000ffff7d11d5e8  40000a0        8     System.__Canon[]  0 instance 0000000000000000 _array
0000ffff7cfa6fe0  40000a1       10         System.Int32  1 instance                0 _size
0000ffff7cfa6fe0  40000a2       14         System.Int32  1 instance                0 _version
0:011> !DumpObj /d 0000ffbf68954900

These are the fields: https://github.com/dotnet/runtime/blob/8b078abecf549188a91c109b7d8890ddf5058f7b/src/coreclr/tools/aot/ILCompiler.ReadyToRun/JitInterface/CorInfoImpl.ReadyToRun.cs#L3176-L3185

It should not be possible for the internal array of a Stack<T> to become null. 3. The NullRef we see is during the _stashedInlinedMethods.Push call above in beginInlining. That null ref results in CompileMethod's finally block running, which calls CompileMethodCleanup which results in its own NRE due to the nulled out array in _stashedInlinedMethods. 4. The objects next to _stashedInlinedMethods look fine:

0:011> !lno 0000ffbf68954920
Before:                ffbf68954900 32 (0x20)                        System.Collections.Generic.Stack<System.Collections.Generic.List<ILCompiler.DependencyAnalysis.ISymbolNode>>
Current:               ffbf68954920 32 (0x20)                        System.Collections.Generic.Stack<System.Collections.Generic.HashSet<Internal.TypeSystem.MethodDesc>>
Next:                  ffbf68954940 80 (0x50)                        System.Collections.Generic.Dictionary<Internal.TypeSystem.MethodDesc, Internal.JitInterface.CorInfoImpl+PgoInstrumentationResults>
Heap local consistency confirmed.
0:011> !dumpobj /d ffbf68954900 ; _stashedPrecodeFixups right before it
Name:        System.Collections.Generic.Stack`1[[System.Collections.Generic.List`1[[ILCompiler.DependencyAnalysis.ISymbolNode, ILCompiler.ReadyToRun]], System.Private.CoreLib]]
MethodTable: 0000ffff7e1f5278
EEClass:     0000ffff7d7d3af8
Tracked Type: false
Size:        32(0x20) bytes
File:        /root/helix/work/correlation/dotnet-cli/shared/Microsoft.NETCore.App/9.0.0-preview.6.24327.7/System.Collections.dll
Fields:
              MT    Field   Offset                 Type VT     Attr            Value Name
0000ffff7d11d5e8  40000a0        8     System.__Canon[]  0 instance 0000ffbf689556d0 _array
0000ffff7cfa6fe0  40000a1       10         System.Int32  1 instance                0 _size
0000ffff7cfa6fe0  40000a2       14         System.Int32  1 instance                2 _version
0:011> !dumpobj /d ffbf68954920
Name:        System.Collections.Generic.Stack`1[[System.Collections.Generic.HashSet`1[[Internal.TypeSystem.MethodDesc, ILCompiler.TypeSystem]], System.Private.CoreLib]]
MethodTable: 0000ffff7e1f54e8
EEClass:     0000ffff7d7d3af8
Tracked Type: false
Size:        32(0x20) bytes
File:        /root/helix/work/correlation/dotnet-cli/shared/Microsoft.NETCore.App/9.0.0-preview.6.24327.7/System.Collections.dll
Fields:
              MT    Field   Offset                 Type VT     Attr            Value Name
0000ffff7d11d5e8  40000a0        8     System.__Canon[]  0 instance 0000000000000000 _array
0000ffff7cfa6fe0  40000a1       10         System.Int32  1 instance                0 _size
0000ffff7cfa6fe0  40000a2       14         System.Int32  1 instance                0 _version
0:011> !dumpobj /d ffbf68954940
Name:        System.Collections.Generic.Dictionary`2[[Internal.TypeSystem.MethodDesc, ILCompiler.TypeSystem],[Internal.JitInterface.CorInfoImpl+PgoInstrumentationResults, ILCompiler.ReadyToRun]]
MethodTable: 0000ffff7e1f6650
EEClass:     0000ffff7e204c88
Tracked Type: false
Size:        80(0x50) bytes
File:        /root/helix/work/correlation/dotnet-cli/shared/Microsoft.NETCore.App/9.0.0-preview.6.24327.7/System.Private.CoreLib.dll
Fields:
              MT    Field   Offset                 Type VT     Attr            Value Name
0000ffff7d028dd8  400225f        8       System.Int32[]  0 instance 0000ffbf68955600 _buckets
0000ffff7e220100  4002260       10 ...er.ReadyToRun]][]  0 instance 0000ffbf68955628 _entries
0000ffff7cfe68a0  4002261       30        System.UInt64  1 instance 6148914691236517206 _fastModMultiplier
0000ffff7cfa6fe0  4002262       38         System.Int32  1 instance                1 _count
0000ffff7cfa6fe0  4002263       3c         System.Int32  1 instance               -1 _freeList
0000ffff7cfa6fe0  4002264       40         System.Int32  1 instance                0 _freeCount
0000ffff7cfa6fe0  4002265       44         System.Int32  1 instance                1 _version
0000ffff7d04c4c0  4002266       18 ...Private.CoreLib]]  0 instance 0000ffbf68888d68 _comparer
0000000000000000  4002267       20                       0 instance 0000000000000000 _keys
0000000000000000  4002268       28                       0 instance 0000000000000000 _values

If this was some concurrency issue I would at least expect the _version field to be synchronized with the _version field of _stashedPrecodeFixups next to it, since those stacks are used similarly, but the _version field seems to have been zeroed out as well.

@jkotas do these symptoms ring any bells for you as to what may be happening?

jakobbotsch avatar Aug 01 '24 11:08 jakobbotsch

Yeah feels like if this fails in a more deterministic pattern where corInfoImpl._stashedInlinedMethods is always zeroed out its likely a separate issue. Seems like this has started occurring recently in the past two weeks as well.

mangod9 avatar Aug 01 '24 15:08 mangod9

@jkotas do these symptoms ring any bells for you as to what may be happening?

I think that that the most likely explanation of these symptoms is that the Stack<T> array field was not initialized in the first place.

The disassembly of the Stack<T> constructor inlined into CorInfoImpl constructor:

0000ffff`45f56a30 d2907900 mov         x0,#0x83C8
0000ffff`45f56a34 f2a8c1c0 movk        x0,#0x460E,lsl #0x10
0000ffff`45f56a38 f2dfffe0 movk        x0,#0xFFFF,lsl #0x20 (MT: System.Collections.Generic.Stack`1[[System.Collections.Generic.HashSet`1[[Internal.TypeSystem.MethodDesc, ILCompiler.TypeSystem]], System.Private.CoreLib]])
0000ffff`45f56a3c 97bfabf9 bl          CLRStub[JumpStub]@0000FFFF44F41A20 (0000ffff`44f41a20) // JIT_NewS_MP_FastPortable
0000ffff`45f56a40 aa0003f5 mov         x21,x0

0000ffff`45f56a44 d2854f0e mov         x14,#0x2A78
0000ffff`45f56a48 f2a8c22e movk        x14,#0x4611,lsl #0x10
0000ffff`45f56a4c f2dfffee movk        x14,#0xFFFF,lsl #0x20
0000ffff`45f56a50 b94001ce ldr         w14,[x14]
0000ffff`45f56a54 3600150e tbz        // Check whether the Array.Empty constructor run x14,#0,ILCompiler_ReadyToRun_ffbe96f79000!Internal.JitInterface.CorInfoImpl..ctor()+0x394 (0000ffff`45f56cf4)

0000ffff`45f56a58 d282f20e mov         x14,#0x1790
0000ffff`45f56a5c f2a5800e movk        x14,#0x2C00,lsl #0x10
0000ffff`45f56a60 f2dff7ee movk        x14,#0xFFBF,lsl #0x20
0000ffff`45f56a64 f94001cf ldr         x15,[x14] // Load the Array.Empty static field
0000ffff`45f56a68 910022ae add         x14,x21,#8
0000ffff`45f56a6c 977d2572 bl          0000ffff`43ea0034

... 

// Rare path of Array.Empty initialization
0000ffff`45f56cf4 d2853c00 mov         x0,#0x29E0
0000ffff`45f56cf8 f2a8c220 movk        x0,#0x4611,lsl #0x10
0000ffff`45f56cfc f2dfffe0 movk        x0,#0xFFFF,lsl #0x20 (MT: System.Array+EmptyArray`1[[System.Collections.Generic.HashSet`1[[Internal.TypeSystem.MethodDesc, ILCompiler.TypeSystem]], System.Private.CoreLib]])
0000ffff`45f56d00 97bfab50 bl          CLRStub[JumpStub]@0000FFFF44F41A40 (0000ffff`44f41a40) // JIT_GetGCStaticBase_Portable
0000ffff`45f56d04 17ffff55 b           ILCompiler_ReadyToRun_ffbe96f79000!Internal.JitInterface.CorInfoImpl..ctor()+0xf8 (0000ffff`45f56a58)

We check whether the Array.Empty constructor run, execute the rare path to run it if it did not, and then fetch the Array.Empty field. There are no memory barriers in this sequence. Can the hardware fetch the Array.Empty field before it got actually stored by the constructor? It would explain how we end up with the inner Stack array as null.

jkotas avatar Aug 01 '24 17:08 jkotas

One thing that doesn't add up for me with that explanation is the value of _stashedInlineMethods._version. _stashedPrecodeFixups and _stashedInlineMethods are two Stack<T> that always go through the same operations at the same time, so I would expect their _version fields to be the same. However, in the dumps I always see _stashedInlineMethods with a version of 0 while _stashedPrecodeFixups has a non-zero version.

jakobbotsch avatar Aug 01 '24 17:08 jakobbotsch

Actually, I suppose the 2 value can be explained by one call to _stashedPrecodeFixups.Push at the beginning of beginInlining before the NRE, and another call to _stashedPrecodeFixups.Clear in CompileMethodCleanup before the second NRE. Then it adds up.

jakobbotsch avatar Aug 01 '24 17:08 jakobbotsch

has anything recently changed in the implementation or around inlining decisions here?

mangod9 avatar Aug 01 '24 18:08 mangod9

has anything recently changed in the implementation or around inlining decisions here?

If my theory above is correct, the problem was likely triggered by #99183 .

jkotas avatar Aug 01 '24 18:08 jkotas

Ah, interesting. Yeah if the theory is correct wonder if that change would break the "static" statics invariant in other places?

mangod9 avatar Aug 01 '24 18:08 mangod9

If I'm understanding correctly, the fix should be to just make sure the load of the class flags in the JIT codegen has acquire semantics. I do wonder if it'll have any perf impact, though.

jakobbotsch avatar Aug 01 '24 19:08 jakobbotsch

The equivalent check in VM does use VolatileLoad: https://github.com/dotnet/runtime/blob/main/src/coreclr/vm/methodtable.h#L461

jkotas avatar Aug 01 '24 19:08 jkotas

We check whether the Array.Empty constructor run, execute the rare path to run it if it did not, and then fetch the Array.Empty field. There are no memory barriers in this sequence. Can the hardware fetch the Array.Empty field before it got actually stored by the constructor? It would explain how we end up with the inner Stack array as null.

I agree that this is it, although, I though it used to work like this:

if (classInited)
   x = staticFld;
else
   x = static_init() ...;

so while staticFld can be loaded before the class init check, it doesn't matter because it will be overwritten again by the fallback.

But still, adding volatile here sounds like the right thing to do

EgorBo avatar Aug 01 '24 20:08 EgorBo

Assume this failure would have the same cause: https://github.com/dotnet/runtime/issues/105444 ?

mangod9 avatar Aug 01 '24 20:08 mangod9

I also wonder if there's an issue with InterlockedOr possibly not not having full barrier semantics on arm64 like it does on x64. When LSE is active (dynamically checked by LLVM code) the InterlockedOr maps to

ldsetal w1, w0, [x0]

which does not do a load acquire because of the special semantics of an ignored destination, so later loads can happen before. So presumably if the sequence is

0 (runtime) acquire zeroed static storage
1 (jit, cctor) store to static field ;; no synch
2 (runtime) ldsetal   ;; flip bit to say class is inited. Does a store release but not a load acquire
3 (jit) check bit ;; no synch
4 (jit) read static field ;; no synch

The order could be 0, 4, 1, 2, 3 and we'd think the class was inited and have a zero value for the static field.

So a load acquire on either 2 or 3 fixes 4 from happening too early.

Normally we'd expect not to see many class init checks in optimized code, and the jit won't do this if not optimizing. These outerloop crossgen2 tests disable tiered compilation so are more likely to expose this kind of problem.

Would also perhaps explain why this is a linux-only problem because apparently MSVC inserts full barriers for InterlockedOr on arm64.

[Edit: I was wrong about there not being an acquire, see below -- but perhaps we do indeed need a full barrier here?]

AndyAyersMS avatar Aug 01 '24 20:08 AndyAyersMS

hm. that's an interesting point.

We used to call an explicit memory barrier for all non-MSVC interlocked intrinsics in the native code, then, we enabled that "outline LSE" feature that allowed us to still use LSE despite being compiled for non-LSE baseline. And it seems like you're right, when for (some?) LSE atomics we don't consume their value, the ordering becomes weaker? https://lore.kernel.org/linux-arm-kernel/[email protected]/

cc @VSadov

PS: I think we may have the same issue for jitted codegen then?

EgorBo avatar Aug 01 '24 20:08 EgorBo

There are dumps over in #105827 that hit the null array right after the initialization. Surprisingly I also see the FailFast during beginInlining being hit in some of the logs. I haven't drilled in further.

Edit: The beginInlining fail fast is a case where it was _stashedPrecodeFixups that ended up having the null array instead of _stashedInlinedMethods.

jakobbotsch avatar Aug 01 '24 23:08 jakobbotsch

FWIW I got a repro on my Volterra under WSL2, on the 51st run of the Regression_3 partition (6 hours):

Running CrossGen2:  dotnet /home/andya/bugs/arm64-crossgen-crash/./correlation-payload/crossgen2/crossgen2.dll @/home/andya/bugs/arm64-crossgen-crash/workitems/Regression_3/JIT/Regression/Regression_3/DevDiv_200492.dll.rsp  
Unhandled exception. ILCompiler.CodeGenerationFailedException: Code generation failed for method '[DevDiv_200492]Program+TestUlongAttribute.Store(uint64)'
 ---> System.NullReferenceException: Object reference not set to an instance of an object.
   at Internal.JitInterface.CorInfoImpl._beginInlining(IntPtr thisHandle, IntPtr* ppException, CORINFO_METHOD_STRUCT_* inlinerHnd, CORINFO_METHOD_STRUCT_* inlineeHnd) in /_/src/coreclr/tools/Common/JitInterface/CorInfoImpl_generated.cs:line 154
   --- End of inner exception stack trace ---

The Volterra CPU supportsatomic so if I understand properly would be using the LSE versions of the interlocked ops.

AndyAyersMS avatar Aug 02 '24 00:08 AndyAyersMS

For InterlockedOr on LSE HW, we end up calling into __sync_fetch_and_or but it seems recent guidance is to prefer __atomic_fetch_or - with the latter we could pass __ATOMIC_ACQ_REL and perhaps ensure we get acquire semantics on the load.

AndyAyersMS avatar Aug 02 '24 00:08 AndyAyersMS

For InterlockedOr on LSE HW, we end up calling into __sync_fetch_and_or but it seems recent guidance is to prefer __atomic_fetch_or - with the latter we could pass __ATOMIC_ACQ_REL and perhaps ensure we get acquire semantics on the load.

I wasn't able to see any difference: https://godbolt.org/z/5j817Wvvv

to be fair, I thought that all LSE instructions like that have acq-rel semantics by default (or actually even stronger - seq-cst). I even removed explicit memory barriers a while ago when LSE is enabled, see https://github.com/dotnet/runtime/pull/45970

EgorBo avatar Aug 02 '24 01:08 EgorBo

Ah, I was confused. xzr is x31, not x0, so there should be an acquire on the load. But maybe we need something stronger?

We need to be careful in the jit not to decide to use wzr/xzr in these sorts of instructions for unused results. I don't think we do this today.

Seems like LLVM has this bug too, in places at least: https://github.com/llvm/llvm-project/issues/68428. Look for atomicBarrierDroppedOnZero in their sources.

AndyAyersMS avatar Aug 02 '24 01:08 AndyAyersMS

Ah, I was confused. xzr is x31, not x0, so there should be an acquire on the load. But maybe we need something stronger?

We need to be careful in the jit not to decide to use wzr/xzr in these sorts of instructions for unused results. I don't think we do this today.

Seems like LLVM has this bug too, in places at least: llvm/llvm-project#68428. Look for atomicBarrierDroppedOnZero in their sources.

We do may use ZR reg as target for LSE it seems (I wasn't able to reproduce such a case locally), but we never emit anything listed in atomicReadDroppedOnZero e.g. for Interlocked.Or we emit ldsetal it's not listed in that switch

EgorBo avatar Aug 02 '24 01:08 EgorBo