runtime Test failure: JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv

trafficstars

Failed in: runtime-coreclr outerloop 20240819.3

Failed tests:

R2R-CG2 linux x64 Checked no_tiered_compilation @ (Alpine.317.Amd64.Open)[email protected]/dotnet-buildtools/prereqs:alpine-3.17-helix-amd64
    - JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.cmd

Error message:

 /root/helix/work/workitem/e/JIT/Regression/Regression_3/../JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.sh: line 327: -r:/root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/IL-CG2/*.dll: No such file or directory
/root/helix/work/workitem/e/JIT/Regression/Regression_3/../JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.sh: line 266:  7570 Killed                  $__Command

Return code:      1
Raw output file:      /root/helix/work/workitem/uploads/JitBlue/DevDiv_255294/DevDiv_255294/output.txt
Raw output:
BEGIN EXECUTION
in takeLock
/root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/IL-CG2/DevDiv_255294.dll
19:53:10
Response file: /root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll.rsp
/root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/IL-CG2/DevDiv_255294.dll
-o:/root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll
-r:/root/helix/work/correlation/System.*.dll
-r:/root/helix/work/correlation/Microsoft.*.dll
-r:/root/helix/work/correlation/xunit.*.dll
-r:/root/helix/work/correlation/mscorlib.dll
--verify-type-and-field-layout
--method-layout:random
--targetarch:x64
--targetos:linux
Running CrossGen2:  dotnet /root/helix/work/correlation/crossgen2/crossgen2.dll @/root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll.rsp  
Running R2RDump:  dotnet /root/helix/work/correlation/R2RDump/R2RDump.dll --header --sc --in /root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll --out /root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll.r2rdump --val
Error: System.BadImageFormatException: The file is not a ReadyToRun image
   at ILCompiler.Reflection.ReadyToRun.ReadyToRunReader.Initialize(IAssemblyMetadata metadata) in /_/src/coreclr/tools/aot/ILCompiler.Reflection.ReadyToRun/ReadyToRunReader.cs:line 467
   at R2RDump.Program.Run() in /_/src/coreclr/tools/r2rdump/Program.cs:line 449
19:53:22
Crossgen2 failed with exitcode: 137
in ReleaseLock
Test failed. Trying to see if dump file was created in /home/helixbot/dotnetbuild/dumps since 8/19/2024 7:53:10 PM
Test Harness Exitcode is : 1
To run the test:
Set up CORE_ROOT and run.
> /root/helix/work/workitem/e/JIT/Regression/Regression_3/../JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.sh

Stack trace:

   at Xunit.Assert.True(Nullable`1 condition, String userMessage) in /_/src/Microsoft.DotNet.XUnitAssert/src/BooleanAsserts.cs:line 146
   at Xunit.Assert.True(Boolean condition, String userMessage) in /_/src/Microsoft.DotNet.XUnitAssert/src/BooleanAsserts.cs:line 128
   at TestLibrary.OutOfProcessTest.RunOutOfProcessTest(String assemblyPath, String testPathPrefix)
   at Program.<<Main>$>g__TestExecutor322|0_323(StreamWriter tempLogSw, StreamWriter statsCsvSw, <>c__DisplayClass0_0&)

Known Issue Error Message

Fill the error message using step by step known issues guidance.

{
  "ErrorMessage": "Error: System.BadImageFormatException: The file is not a ReadyToRun image",
  "ErrorPattern": "",
  "BuildRetry": false,
  "ExcludeConsoleLog": false
}

Known issue validation

Build: :mag_right: Result validation: :warning: Provided build not found. Provide a valid build in the "Build: :mag_right:" line. Validation performed at: 6/1/2025 9:40:33 PM UTC

Report

Build	Definition	Test	Pull Request
1067003	dotnet/runtime	JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.cmd
1065484	dotnet/runtime	JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.cmd
1064388	dotnet/runtime	JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.cmd
1064030	dotnet/runtime	JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.cmd
1063355	dotnet/runtime	JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.cmd
1063256	dotnet/runtime	JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.cmd
1063030	dotnet/runtime	JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.cmd
1062941	dotnet/runtime	JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.cmd
1062899	dotnet/runtime	JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.cmd	dotnet/runtime#115750
1062814	dotnet/runtime	JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.cmd
1062529	dotnet/runtime	JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.cmd
1062484	dotnet/runtime	JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.cmd
1062323	dotnet/runtime	JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.cmd
1062060	dotnet/runtime	JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.cmd
1061409	dotnet/runtime	JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.cmd	dotnet/runtime#116196
1061326	dotnet/runtime	JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.cmd
1060685	dotnet/runtime	JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.cmd
1059496	dotnet/runtime	JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.cmd
1059015	dotnet/runtime	JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.cmd
1058629	dotnet/runtime	JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.cmd
1058624	dotnet/runtime	JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.cmd
1058103	dotnet/runtime	JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.cmd
1056634	dotnet/runtime	JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.cmd
1056373	dotnet/runtime	JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.cmd
1056340	dotnet/runtime	JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.cmd	dotnet/runtime#116197
1056315	dotnet/runtime	JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.cmd	dotnet/runtime#116096

Summary

24-Hour Hit Count	7-Day Hit Count	1-Month Count
0	14	26

Aug 20 '24 02:08 v-wenyuxu

This The file is not a ReadyToRun image error has been intermittently hitting on and off for a long time, with no apparent pattern. We have to investigate further to try to understand it. Setting it for .NET 10.

Aug 21 '24 22:08 ivdiazsa

Failed in: runtime-coreclr outerloop 20241126.1

Failed tests:

R2R-CG2 linux x64 Checked no_tiered_compilation @ (Alpine.317.Amd64.Open)[email protected]/dotnet-buildtools/prereqs:alpine-3.17-helix-amd64
    - JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.cmd

Error message:

 DOTNET_DbgEnableMiniDump is set and the createdump binary does not exist: /root/helix/work/correlation/crossgen2/createdump
/root/helix/work/workitem/e/JIT/Regression/Regression_3/../JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.sh: line 270:  6532 Killed                  $__Command

Return code:      1
Raw output file:      /root/helix/work/workitem/uploads/JitBlue/DevDiv_255294/DevDiv_255294/output.txt
Raw output:
BEGIN EXECUTION
in takeLock
/root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/IL-CG2/DevDiv_255294.dll
10:56:30
Response file: /root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll.rsp
/root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/IL-CG2/DevDiv_255294.dll
-o:/root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll
--targetarch:x64
--targetos:linux
--verify-type-and-field-layout
--method-layout:random
-r:/root/helix/work/correlation/System.*.dll
-r:/root/helix/work/correlation/Microsoft.*.dll
-r:/root/helix/work/correlation/xunit.*.dll
-r:/root/helix/work/correlation/mscorlib.dll
-r:/root/helix/work/correlation/netstandard.dll
Running CrossGen2:  /root/helix/work/correlation/crossgen2/crossgen2 @/root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll.rsp   -r:/root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/IL-CG2/*.dll
Running R2RDump:  dotnet /root/helix/work/correlation/R2RDump/R2RDump.dll --header --sc --in /root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll --out /root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll.r2rdump --val
Error: System.BadImageFormatException: The file is not a ReadyToRun image
   at ILCompiler.Reflection.ReadyToRun.ReadyToRunReader.Initialize(IAssemblyMetadata metadata) in /_/src/coreclr/tools/aot/ILCompiler.Reflection.ReadyToRun/ReadyToRunReader.cs:line 467
   at R2RDump.Program.Run() in /_/src/coreclr/tools/r2rdump/Program.cs:line 449
10:56:43
Crossgen2 failed with exitcode: 137
in ReleaseLock
Test failed. Trying to see if dump file was created in /home/helixbot/dotnetbuild/dumps since 11/26/2024 10:56:30 AM
Test Harness Exitcode is : 1
To run the test:
Set up CORE_ROOT and run.
> /root/helix/work/workitem/e/JIT/Regression/Regression_3/../JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.sh

Stack trace:

   at Xunit.Assert.True(Nullable`1 condition, String userMessage) in /_/src/Microsoft.DotNet.XUnitAssert/src/BooleanAsserts.cs:line 141
   at Xunit.Assert.True(Boolean condition, String userMessage) in /_/src/Microsoft.DotNet.XUnitAssert/src/BooleanAsserts.cs:line 123
   at TestLibrary.OutOfProcessTest.RunOutOfProcessTest(String assemblyPath, String testPathPrefix)
   at Program.<<Main>$>g__TestExecutor322|0_323(StreamWriter tempLogSw, StreamWriter statsCsvSw, <>c__DisplayClass0_0&)

Nov 27 '24 01:11 v-wenyuxu

Failed in: runtime-coreclr outerloop 20241218.4

Failed tests:

R2R-CG2 linux x64 Checked no_tiered_compilation @ (Alpine.321.Amd64.Open)[email protected]/dotnet-buildtools/prereqs:alpine-3.21-helix-amd64
    - JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.cmd

Error message:

 DOTNET_DbgEnableMiniDump is set and the createdump binary does not exist: /root/helix/work/correlation/crossgen2/createdump
/root/helix/work/workitem/e/JIT/Regression/Regression_3/../JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.sh: line 270:  6530 Killed                  $__Command

Return code:      1
Raw output file:      /root/helix/work/workitem/uploads/JitBlue/DevDiv_255294/DevDiv_255294/output.txt
Raw output:
BEGIN EXECUTION
in takeLock
/root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/IL-CG2/DevDiv_255294.dll
02:46:20
Response file: /root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll.rsp
/root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/IL-CG2/DevDiv_255294.dll
-o:/root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll
--targetarch:x64
--targetos:linux
--verify-type-and-field-layout
--method-layout:random
-r:/root/helix/work/correlation/System.*.dll
-r:/root/helix/work/correlation/Microsoft.*.dll
-r:/root/helix/work/correlation/xunit.*.dll
-r:/root/helix/work/correlation/mscorlib.dll
-r:/root/helix/work/correlation/netstandard.dll
Running CrossGen2:  /root/helix/work/correlation/crossgen2/crossgen2 @/root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll.rsp   -r:/root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/IL-CG2/*.dll
Running R2RDump:  dotnet /root/helix/work/correlation/R2RDump/R2RDump.dll --header --sc --in /root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll --out /root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll.r2rdump --val
Error: System.BadImageFormatException: The file is not a ReadyToRun image
   at ILCompiler.Reflection.ReadyToRun.ReadyToRunReader.Initialize(IAssemblyMetadata metadata) in /_/src/coreclr/tools/aot/ILCompiler.Reflection.ReadyToRun/ReadyToRunReader.cs:line 467
   at R2RDump.Program.Run() in /_/src/coreclr/tools/r2rdump/Program.cs:line 449
02:47:39
Crossgen2 failed with exitcode: 137
in ReleaseLock
Test failed. Trying to see if dump file was created in /home/helixbot/dotnetbuild/dumps since 12/19/2024 2:46:20 AM
Test Harness Exitcode is : 1
To run the test:
Set up CORE_ROOT and run.
> /root/helix/work/workitem/e/JIT/Regression/Regression_3/../JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.sh

Stack trace:

   at Xunit.Assert.True(Nullable`1 condition, String userMessage) in /_/src/Microsoft.DotNet.XUnitAssert/src/BooleanAsserts.cs:line 141
   at Xunit.Assert.True(Boolean condition, String userMessage) in /_/src/Microsoft.DotNet.XUnitAssert/src/BooleanAsserts.cs:line 123
   at TestLibrary.OutOfProcessTest.RunOutOfProcessTest(String assemblyPath, String testPathPrefix)
   at Program.<<Main>$>g__TestExecutor322|0_323(StreamWriter tempLogSw, StreamWriter statsCsvSw, <>c__DisplayClass0_0&)

Dec 19 '24 08:12 v-wenyuxu

Failed in: runtime-coreclr outerloop 20250211.8

Failed tests:

R2R-CG2 linux x64 Checked no_tiered_compilation @ (Alpine.321.Amd64.Open)[email protected]/dotnet-buildtools/prereqs:alpine-3.21-helix-amd64
    - JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.cmd

Error message:

 DOTNET_DbgEnableMiniDump is set and the createdump binary does not exist: /root/helix/work/correlation/crossgen2/createdump
/root/helix/work/workitem/e/JIT/Regression/Regression_3/../JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.sh: line 270:  7180 Killed                  $__Command

Return code:      1
Raw output file:      /root/helix/work/workitem/uploads/JitBlue/DevDiv_255294/DevDiv_255294/output.txt
Raw output:
BEGIN EXECUTION
in takeLock
/root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/IL-CG2/DevDiv_255294.dll
03:12:57
Response file: /root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll.rsp
/root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/IL-CG2/DevDiv_255294.dll
-o:/root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll
--targetarch:x64
--targetos:linux
--verify-type-and-field-layout
--method-layout:random
-r:/root/helix/work/correlation/System.*.dll
-r:/root/helix/work/correlation/Microsoft.*.dll
-r:/root/helix/work/correlation/xunit.*.dll
-r:/root/helix/work/correlation/mscorlib.dll
-r:/root/helix/work/correlation/netstandard.dll
Running CrossGen2:  /root/helix/work/correlation/crossgen2/crossgen2 @/root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll.rsp   -r:/root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/IL-CG2/*.dll
Running R2RDump:  dotnet /root/helix/work/correlation/R2RDump/R2RDump.dll --header --sc --in /root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll --out /root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll.r2rdump --val
Error: System.BadImageFormatException: The file is not a ReadyToRun image
   at ILCompiler.Reflection.ReadyToRun.ReadyToRunReader.Initialize(IAssemblyMetadata metadata) in /_/src/coreclr/tools/aot/ILCompiler.Reflection.ReadyToRun/ReadyToRunReader.cs:line 467
   at R2RDump.Program.Run() in /_/src/coreclr/tools/r2rdump/Program.cs:line 449
03:17:28
Crossgen2 failed with exitcode: 137
in ReleaseLock
Test failed. Trying to see if dump file was created in /home/helixbot/dotnetbuild/dumps since 2/12/2025 3:12:57 AM
Test Harness Exitcode is : 1
To run the test:
Set up CORE_ROOT and run.
> /root/helix/work/workitem/e/JIT/Regression/Regression_3/../JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.sh

Stack trace:

   at Xunit.Assert.True(Nullable`1 condition, String userMessage) in /_/src/Microsoft.DotNet.XUnitAssert/src/BooleanAsserts.cs:line 141
   at TestLibrary.OutOfProcessTest.RunOutOfProcessTest(String assemblyPath, String testPathPrefix)
   at Program.<<Main>$>g__TestExecutor322|0_323(StreamWriter tempLogSw, StreamWriter statsCsvSw, <>c__DisplayClass0_0&)

Feb 12 '25 08:02 v-wenyuxu

Hit in #116096

Jun 01 '25 21:06 jkotas

Failed in: runtime-coreclr outerloop 20250604.1

Failed tests:

R2R-CG2 linux x64 Checked no_tiered_compilation @ (Alpine.321.Amd64.Open)[email protected]/dotnet-buildtools/prereqs:alpine-3.21-helix-amd64
    - JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.cmd

Error message:

 DOTNET_DbgEnableMiniDump is set and the createdump binary does not exist: /root/helix/work/correlation/crossgen2/createdump
/root/helix/work/workitem/e/JIT/Regression/Regression_3/../JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.sh: line 270:  7195 Killed                  $__Command

Return code:      1
Raw output file:      /root/helix/work/workitem/uploads/JitBlue/DevDiv_255294/DevDiv_255294/output.txt
Raw output:
BEGIN EXECUTION
in takeLock
/root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/IL-CG2/DevDiv_255294.dll
11:09:49
Response file: /root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll.rsp
/root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/IL-CG2/DevDiv_255294.dll
-o:/root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll
--targetarch:x64
--targetos:linux
--verify-type-and-field-layout
--method-layout:random
-r:/root/helix/work/correlation/System.*.dll
-r:/root/helix/work/correlation/Microsoft.*.dll
-r:/root/helix/work/correlation/xunit.*.dll
-r:/root/helix/work/correlation/mscorlib.dll
-r:/root/helix/work/correlation/netstandard.dll
Running CrossGen2:  /root/helix/work/correlation/crossgen2/crossgen2 @/root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll.rsp   -r:/root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/IL-CG2/*.dll
Running R2RDump:  dotnet /root/helix/work/correlation/R2RDump/R2RDump.dll --header --sc --in /root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll --out /root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll.r2rdump --val
Error: System.BadImageFormatException: The file is not a ReadyToRun image
   at ILCompiler.Reflection.ReadyToRun.ReadyToRunReader.Initialize(IAssemblyMetadata metadata) in /_/src/coreclr/tools/aot/ILCompiler.Reflection.ReadyToRun/ReadyToRunReader.cs:line 508
   at R2RDump.Program.Run() in /_/src/coreclr/tools/r2rdump/Program.cs:line 449
11:10:02
Crossgen2 failed with exitcode: 137
in ReleaseLock
Test failed. Trying to see if dump file was created in /home/helixbot/dotnetbuild/dumps since 6/4/2025 11:09:49 AM
Test Harness Exitcode is : 1
To run the test:
Set up CORE_ROOT and run.
> /root/helix/work/workitem/e/JIT/Regression/Regression_3/../JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.sh

Stack trace:

   at Xunit.Assert.True(Nullable`1 condition, String userMessage) in /_/src/arcade/src/Microsoft.DotNet.XUnitAssert/src/BooleanAsserts.cs:line 141
   at TestLibrary.OutOfProcessTest.RunOutOfProcessTest(String assemblyPath, String testPathPrefix)
   at Program.<<Main>$>g__TestExecutor322|0_323(StreamWriter tempLogSw, StreamWriter statsCsvSw, <>c__DisplayClass0_0&)

Jun 05 '25 01:06 SakeTao

Failed in: runtime-coreclr outerloop 20250610.6

Failed tests:

R2R-CG2 linux x64 Checked no_tiered_compilation @ (Alpine.321.Amd64.Open)[email protected]/dotnet-buildtools/prereqs:alpine-3.21-helix-amd64
    - JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.cmd

Error message:

 DOTNET_DbgEnableMiniDump is set and the createdump binary does not exist: /root/helix/work/correlation/crossgen2/createdump
/root/helix/work/workitem/e/JIT/Regression/Regression_3/../JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.sh: line 270:  7196 Killed                  $__Command

Return code:      1
Raw output file:      /root/helix/work/workitem/uploads/JitBlue/DevDiv_255294/DevDiv_255294/output.txt
Raw output:
BEGIN EXECUTION
in takeLock
/root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/IL-CG2/DevDiv_255294.dll
02:55:52
Response file: /root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll.rsp
/root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/IL-CG2/DevDiv_255294.dll
-o:/root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll
--targetarch:x64
--targetos:linux
--verify-type-and-field-layout
--method-layout:random
-r:/root/helix/work/correlation/System.*.dll
-r:/root/helix/work/correlation/Microsoft.*.dll
-r:/root/helix/work/correlation/xunit.*.dll
-r:/root/helix/work/correlation/mscorlib.dll
-r:/root/helix/work/correlation/netstandard.dll
Running CrossGen2:  /root/helix/work/correlation/crossgen2/crossgen2 @/root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll.rsp   -r:/root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/IL-CG2/*.dll
Running R2RDump:  dotnet /root/helix/work/correlation/R2RDump/R2RDump.dll --header --sc --in /root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll --out /root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll.r2rdump --val
Error: System.BadImageFormatException: The file is not a ReadyToRun image
   at ILCompiler.Reflection.ReadyToRun.ReadyToRunReader.Initialize(IAssemblyMetadata metadata) in /_/src/coreclr/tools/aot/ILCompiler.Reflection.ReadyToRun/ReadyToRunReader.cs:line 508
   at R2RDump.Program.Run() in /_/src/coreclr/tools/r2rdump/Program.cs:line 449
03:00:02
Crossgen2 failed with exitcode: 137
in ReleaseLock
Test failed. Trying to see if dump file was created in /home/helixbot/dotnetbuild/dumps since 6/11/2025 2:55:52 AM
Test Harness Exitcode is : 1
To run the test:
Set up CORE_ROOT and run.
> /root/helix/work/workitem/e/JIT/Regression/Regression_3/../JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.sh

Stack trace:

   at Xunit.Assert.True(Nullable`1 condition, String userMessage) in /_/src/arcade/src/Microsoft.DotNet.XUnitAssert/src/BooleanAsserts.cs:line 141
   at TestLibrary.OutOfProcessTest.RunOutOfProcessTest(String assemblyPath, String testPathPrefix)
   at Program.<<Main>$>g__TestExecutor322|0_323(StreamWriter tempLogSw, StreamWriter statsCsvSw, <>c__DisplayClass0_0&)

Jun 11 '25 08:06 SakeTao

Failed in: runtime-coreclr outerloop 20250629.1

Failed tests:

R2R-CG2 linux x64 Checked no_tiered_compilation @ (Alpine.322.Amd64.Open)[email protected]/dotnet-buildtools/prereqs:alpine-3.22-helix-amd64
    - JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.cmd

Error message:

 DOTNET_DbgEnableMiniDump is set and the createdump binary does not exist: /root/helix/work/correlation/crossgen2/createdump
/root/helix/work/workitem/e/JIT/Regression/Regression_3/../JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.sh: line 270:  7196 Killed                  $__Command

Return code:      1
Raw output file:      /root/helix/work/workitem/uploads/JitBlue/DevDiv_255294/DevDiv_255294/output.txt
Raw output:
BEGIN EXECUTION
in takeLock
/root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/IL-CG2/DevDiv_255294.dll
20:00:30
Response file: /root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll.rsp
/root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/IL-CG2/DevDiv_255294.dll
-o:/root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll
--targetarch:x64
--targetos:linux
--verify-type-and-field-layout
--method-layout:random
-r:/root/helix/work/correlation/System.*.dll
-r:/root/helix/work/correlation/Microsoft.*.dll
-r:/root/helix/work/correlation/xunit.*.dll
-r:/root/helix/work/correlation/mscorlib.dll
-r:/root/helix/work/correlation/netstandard.dll
Running CrossGen2:  /root/helix/work/correlation/crossgen2/crossgen2 @/root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll.rsp   -r:/root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/IL-CG2/*.dll
Running R2RDump:  dotnet /root/helix/work/correlation/R2RDump/R2RDump.dll --header --sc --in /root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll --out /root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll.r2rdump --val
Error: System.BadImageFormatException: The file is not a ReadyToRun image
   at ILCompiler.Reflection.ReadyToRun.ReadyToRunReader.Initialize(IAssemblyMetadata metadata) in /_/src/coreclr/tools/aot/ILCompiler.Reflection.ReadyToRun/ReadyToRunReader.cs:line 508
   at R2RDump.Program.Run() in /_/src/coreclr/tools/r2rdump/Program.cs:line 449
20:01:04
Crossgen2 failed with exitcode: 137
in ReleaseLock
Test failed. Trying to see if dump file was created in /home/helixbot/dotnetbuild/dumps since 06/29/2025 20:00:30
Test Harness Exitcode is : 1
To run the test:
Set up CORE_ROOT and run.
> /root/helix/work/workitem/e/JIT/Regression/Regression_3/../JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.sh

Stack trace:

   at Xunit.Assert.True(Nullable`1 condition, String userMessage) in /_/src/arcade/src/Microsoft.DotNet.XUnitAssert/src/BooleanAsserts.cs:line 141
   at TestLibrary.OutOfProcessTest.RunOutOfProcessTest(String assemblyPath, String testPathPrefix)
   at Program.<<Main>$>g__TestExecutor322|0_323(StreamWriter tempLogSw, StreamWriter statsCsvSw, <>c__DisplayClass0_0&)

Jun 30 '25 01:06 SakeTao

Failed in: runtime-coreclr outerloop 20250701.3

Failed tests:

R2R-CG2 linux x64 Checked no_tiered_compilation @ (Alpine.322.Amd64.Open)[email protected]/dotnet-buildtools/prereqs:alpine-3.22-helix-amd64
    - JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.cmd

Error message:

DOTNET_DbgEnableMiniDump is set and the createdump binary does not exist: /root/helix/work/correlation/crossgen2/createdump
/root/helix/work/workitem/e/JIT/Regression/Regression_3/../JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.sh: line 270:  7194 Killed                  $__Command

Return code:      1
Raw output file:      /root/helix/work/workitem/uploads/JitBlue/DevDiv_255294/DevDiv_255294/output.txt
Raw output:
BEGIN EXECUTION
in takeLock
/root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/IL-CG2/DevDiv_255294.dll
19:56:16
Response file: /root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll.rsp
/root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/IL-CG2/DevDiv_255294.dll
-o:/root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll
--targetarch:x64
--targetos:linux
--verify-type-and-field-layout
--method-layout:random
-r:/root/helix/work/correlation/System.*.dll
-r:/root/helix/work/correlation/Microsoft.*.dll
-r:/root/helix/work/correlation/xunit.*.dll
-r:/root/helix/work/correlation/mscorlib.dll
-r:/root/helix/work/correlation/netstandard.dll
Running CrossGen2:  /root/helix/work/correlation/crossgen2/crossgen2 @/root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll.rsp   -r:/root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/IL-CG2/*.dll
Running R2RDump:  dotnet /root/helix/work/correlation/R2RDump/R2RDump.dll --header --sc --in /root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll --out /root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll.r2rdump --val
Error: System.BadImageFormatException: The file is not a ReadyToRun image
   at ILCompiler.Reflection.ReadyToRun.ReadyToRunReader.Initialize(IAssemblyMetadata metadata) in /_/src/coreclr/tools/aot/ILCompiler.Reflection.ReadyToRun/ReadyToRunReader.cs:line 508
   at R2RDump.Program.Run() in /_/src/coreclr/tools/r2rdump/Program.cs:line 449
19:56:29
Crossgen2 failed with exitcode: 137
in ReleaseLock
Test failed. Trying to see if dump file was created in /home/helixbot/dotnetbuild/dumps since 07/01/2025 19:56:16
Test Harness Exitcode is : 1
To run the test:
Set up CORE_ROOT and run.
> /root/helix/work/workitem/e/JIT/Regression/Regression_3/../JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.sh

Stack trace:

   at Xunit.Assert.True(Nullable`1 condition, String userMessage) in /_/src/arcade/src/Microsoft.DotNet.XUnitAssert/src/BooleanAsserts.cs:line 141
   at TestLibrary.OutOfProcessTest.RunOutOfProcessTest(String assemblyPath, String testPathPrefix)
   at Program.<<Main>$>g__TestExecutor322|0_323(StreamWriter tempLogSw, StreamWriter statsCsvSw, <>c__DisplayClass0_0&)

Jul 02 '25 01:07 SakeTao

Failed in: runtime-coreclr outerloop 20250708.8

Failed tests:

R2R-CG2 linux x64 Checked no_tiered_compilation @ (Alpine.322.Amd64.Open)[email protected]/dotnet-buildtools/prereqs:alpine-3.22-helix-amd64
    - JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.cmd

Error message:

DOTNET_DbgEnableMiniDump is set and the createdump binary does not exist: /root/helix/work/correlation/crossgen2/createdump
/root/helix/work/workitem/e/JIT/Regression/Regression_3/../JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.sh: line 270:  7196 Killed                  $__Command

Return code:      1
Raw output file:      /root/helix/work/workitem/uploads/JitBlue/DevDiv_255294/DevDiv_255294/output.txt
Raw output:
BEGIN EXECUTION
in takeLock
/root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/IL-CG2/DevDiv_255294.dll
02:43:21
Response file: /root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll.rsp
/root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/IL-CG2/DevDiv_255294.dll
-o:/root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll
--targetarch:x64
--targetos:linux
--verify-type-and-field-layout
--method-layout:random
-r:/root/helix/work/correlation/System.*.dll
-r:/root/helix/work/correlation/Microsoft.*.dll
-r:/root/helix/work/correlation/xunit.*.dll
-r:/root/helix/work/correlation/mscorlib.dll
-r:/root/helix/work/correlation/netstandard.dll
Running CrossGen2:  /root/helix/work/correlation/crossgen2/crossgen2 @/root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll.rsp   -r:/root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/IL-CG2/*.dll
Running R2RDump:  dotnet /root/helix/work/correlation/R2RDump/R2RDump.dll --header --sc --in /root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll --out /root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll.r2rdump --val
Error: System.BadImageFormatException: The file is not a ReadyToRun image
   at ILCompiler.Reflection.ReadyToRun.ReadyToRunReader.Initialize(IAssemblyMetadata metadata) in /_/src/coreclr/tools/aot/ILCompiler.Reflection.ReadyToRun/ReadyToRunReader.cs:line 508
   at R2RDump.Program.Run() in /_/src/coreclr/tools/r2rdump/Program.cs:line 449
02:43:32
Crossgen2 failed with exitcode: 137
in ReleaseLock
Test failed. Trying to see if dump file was created in /home/helixbot/dotnetbuild/dumps since 07/09/2025 02:43:21
Test Harness Exitcode is : 1
To run the test:
Set up CORE_ROOT and run.
> /root/helix/work/workitem/e/JIT/Regression/Regression_3/../JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.sh

Stack trace:

   at Xunit.Assert.True(Nullable`1 condition, String userMessage) in /_/src/arcade/src/Microsoft.DotNet.XUnitAssert/src/BooleanAsserts.cs:line 141
   at TestLibrary.OutOfProcessTest.RunOutOfProcessTest(String assemblyPath, String testPathPrefix)
   at Program.<<Main>$>g__TestExecutor322|0_323(StreamWriter tempLogSw, StreamWriter statsCsvSw, <>c__DisplayClass0_0&)

Jul 09 '25 09:07 SakeTao

Failed in: runtime-coreclr outerloop 20250715.4

Failed tests:

R2R-CG2 linux x64 Checked no_tiered_compilation @ (Alpine.322.Amd64.Open)[email protected]/dotnet-buildtools/prereqs:alpine-3.22-helix-amd64
    - JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.cmd

Error message:

DOTNET_DbgEnableMiniDump is set and the createdump binary does not exist: /root/helix/work/correlation/crossgen2/createdump
/root/helix/work/workitem/e/JIT/Regression/Regression_3/../JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.sh: line 270:  7194 Killed                  $__Command

Return code:      1
Raw output file:      /root/helix/work/workitem/uploads/JitBlue/DevDiv_255294/DevDiv_255294/output.txt
Raw output:
BEGIN EXECUTION
in takeLock
/root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/IL-CG2/DevDiv_255294.dll
20:14:37
Response file: /root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll.rsp
/root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/IL-CG2/DevDiv_255294.dll
-o:/root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll
--targetarch:x64
--targetos:linux
--verify-type-and-field-layout
--method-layout:random
-r:/root/helix/work/correlation/System.*.dll
-r:/root/helix/work/correlation/Microsoft.*.dll
-r:/root/helix/work/correlation/xunit.*.dll
-r:/root/helix/work/correlation/mscorlib.dll
-r:/root/helix/work/correlation/netstandard.dll
Running CrossGen2:  /root/helix/work/correlation/crossgen2/crossgen2 @/root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll.rsp   -r:/root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/IL-CG2/*.dll
Running R2RDump:  dotnet /root/helix/work/correlation/R2RDump/R2RDump.dll --header --sc --in /root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll --out /root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll.r2rdump --val
Error: System.BadImageFormatException: The file is not a ReadyToRun image
   at ILCompiler.Reflection.ReadyToRun.ReadyToRunReader.Initialize(IAssemblyMetadata metadata) in /_/src/coreclr/tools/aot/ILCompiler.Reflection.ReadyToRun/ReadyToRunReader.cs:line 518
   at R2RDump.Program.Run() in /_/src/coreclr/tools/r2rdump/Program.cs:line 449
20:14:55
Crossgen2 failed with exitcode: 137
in ReleaseLock
Test failed. Trying to see if dump file was created in /home/helixbot/dotnetbuild/dumps since 07/15/2025 20:14:37
Test Harness Exitcode is : 1
To run the test:
Set up CORE_ROOT and run.
> /root/helix/work/workitem/e/JIT/Regression/Regression_3/../JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.sh

Stack trace:

   at Xunit.Assert.True(Nullable`1 condition, String userMessage) in /_/src/arcade/src/Microsoft.DotNet.XUnitAssert/src/BooleanAsserts.cs:line 141
   at TestLibrary.OutOfProcessTest.RunOutOfProcessTest(String assemblyPath, String testPathPrefix)
   at Program.<<Main>$>g__TestExecutor322|0_323(StreamWriter tempLogSw, StreamWriter statsCsvSw, <>c__DisplayClass0_0&)

Jul 16 '25 01:07 SakeTao

Failed in: runtime-coreclr outerloop 20250716.2

Failed tests:

R2R-CG2 linux x64 Checked no_tiered_compilation @ (Alpine.322.Amd64.Open)[email protected]/dotnet-buildtools/prereqs:alpine-3.22-helix-amd64
    - JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.cmd

Error message:

DOTNET_DbgEnableMiniDump is set and the createdump binary does not exist: /root/helix/work/correlation/crossgen2/createdump
/root/helix/work/workitem/e/JIT/Regression/Regression_3/../JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.sh: line 270:  7196 Killed                  $__Command

Return code:      1
Raw output file:      /root/helix/work/workitem/uploads/JitBlue/DevDiv_255294/DevDiv_255294/output.txt
Raw output:
BEGIN EXECUTION
in takeLock
/root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/IL-CG2/DevDiv_255294.dll
20:53:06
Response file: /root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll.rsp
/root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/IL-CG2/DevDiv_255294.dll
-o:/root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll
--targetarch:x64
--targetos:linux
--verify-type-and-field-layout
--method-layout:random
-r:/root/helix/work/correlation/System.*.dll
-r:/root/helix/work/correlation/Microsoft.*.dll
-r:/root/helix/work/correlation/xunit.*.dll
-r:/root/helix/work/correlation/mscorlib.dll
-r:/root/helix/work/correlation/netstandard.dll
Running CrossGen2:  /root/helix/work/correlation/crossgen2/crossgen2 @/root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll.rsp   -r:/root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/IL-CG2/*.dll
Running R2RDump:  dotnet /root/helix/work/correlation/R2RDump/R2RDump.dll --header --sc --in /root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll --out /root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll.r2rdump --val
Error: System.BadImageFormatException: The file is not a ReadyToRun image
   at ILCompiler.Reflection.ReadyToRun.ReadyToRunReader.Initialize(IAssemblyMetadata metadata) in /_/src/coreclr/tools/aot/ILCompiler.Reflection.ReadyToRun/ReadyToRunReader.cs:line 518
   at R2RDump.Program.Run() in /_/src/coreclr/tools/r2rdump/Program.cs:line 449
20:53:25
Crossgen2 failed with exitcode: 137
in ReleaseLock
Test failed. Trying to see if dump file was created in /home/helixbot/dotnetbuild/dumps since 07/16/2025 20:53:06
Test Harness Exitcode is : 1
To run the test:
Set up CORE_ROOT and run.
> /root/helix/work/workitem/e/JIT/Regression/Regression_3/../JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.sh

Stack trace:

   at Xunit.Assert.True(Nullable`1 condition, String userMessage) in /_/src/arcade/src/Microsoft.DotNet.XUnitAssert/src/BooleanAsserts.cs:line 141
   at TestLibrary.OutOfProcessTest.RunOutOfProcessTest(String assemblyPath, String testPathPrefix)
   at Program.<<Main>$>g__TestExecutor322|0_323(StreamWriter tempLogSw, StreamWriter statsCsvSw, <>c__DisplayClass0_0&)

Jul 17 '25 01:07 SakeTao

One thing of note here is that crossgen takes around 2 minutes to compile this test case on my PC w/a Checked build like we use on CI. Based on profiling, most of the time is being spent verifying control flow:

It makes sense given the nature of the test case (a huge method with ~62k if statements in it) but I wanted to make a note of this in case anyone ends up investigating this or similar issues later and wants to iterate faster - disabling fgDebugCheckBlockLinks should speed you up.

Jul 25 '25 18:07 kg

Failed in: runtime-coreclr outerloop 20250726.3

Failed tests:

R2R-CG2 linux x64 Checked no_tiered_compilation @ (Alpine.322.Amd64.Open)[email protected]/dotnet-buildtools/prereqs:alpine-3.22-helix-amd64
    - JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.cmd

Error message:

DOTNET_DbgEnableMiniDump is set and the createdump binary does not exist: /root/helix/work/correlation/crossgen2/createdump
/root/helix/work/workitem/e/JIT/Regression/Regression_3/../JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.sh: line 270:  7195 Killed                  $__Command

Return code:      1
Raw output file:      /root/helix/work/workitem/uploads/JitBlue/DevDiv_255294/DevDiv_255294/output.txt
Raw output:
BEGIN EXECUTION
in takeLock
/root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/IL-CG2/DevDiv_255294.dll
02:42:12
Response file: /root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll.rsp
/root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/IL-CG2/DevDiv_255294.dll
-o:/root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll
--targetarch:x64
--targetos:linux
--verify-type-and-field-layout
--method-layout:random
-r:/root/helix/work/correlation/System.*.dll
-r:/root/helix/work/correlation/Microsoft.*.dll
-r:/root/helix/work/correlation/xunit.*.dll
-r:/root/helix/work/correlation/mscorlib.dll
-r:/root/helix/work/correlation/netstandard.dll
Running CrossGen2:  /root/helix/work/correlation/crossgen2/crossgen2 @/root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll.rsp   -r:/root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/IL-CG2/*.dll
Running R2RDump:  dotnet /root/helix/work/correlation/R2RDump/R2RDump.dll --header --sc --in /root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll --out /root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll.r2rdump --val
Error: System.BadImageFormatException: The file is not a ReadyToRun image
   at ILCompiler.Reflection.ReadyToRun.ReadyToRunReader.Initialize(IAssemblyMetadata metadata) in /_/src/coreclr/tools/aot/ILCompiler.Reflection.ReadyToRun/ReadyToRunReader.cs:line 518
   at R2RDump.Program.Run() in /_/src/coreclr/tools/r2rdump/Program.cs:line 449
02:42:23
Crossgen2 failed with exitcode: 137
in ReleaseLock
Test failed. Trying to see if dump file was created in /home/helixbot/dotnetbuild/dumps since 07/27/2025 02:42:12
Test Harness Exitcode is : 1
To run the test:
Set up CORE_ROOT and run.
> /root/helix/work/workitem/e/JIT/Regression/Regression_3/../JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.sh

Stack trace:

   at Xunit.Assert.True(Nullable`1 condition, String userMessage) in /_/src/arcade/src/Microsoft.DotNet.XUnitAssert/src/BooleanAsserts.cs:line 141
   at TestLibrary.OutOfProcessTest.RunOutOfProcessTest(String assemblyPath, String testPathPrefix)
   at Program.<<Main>$>g__TestExecutor322|0_323(StreamWriter tempLogSw, StreamWriter statsCsvSw, <>c__DisplayClass0_0&)

Jul 28 '25 02:07 SakeTao

I left this test running in a loop (delete IL-CG2, run crossgen2, run r2rdump, run test) for 2 days in my debian VM and it didn't repro. I wonder if it has something to do with the CI configuration?

Jul 28 '25 03:07 kg

Failed in: runtime-coreclr outerloop 20250729.4

Failed tests:

R2R-CG2 linux x64 Checked no_tiered_compilation @ (Alpine.322.Amd64.Open)[email protected]/dotnet-buildtools/prereqs:alpine-3.22-helix-amd64
    - JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.cmd

Error message:

DOTNET_DbgEnableMiniDump is set and the createdump binary does not exist: /root/helix/work/correlation/crossgen2/createdump
/root/helix/work/workitem/e/JIT/Regression/Regression_3/../JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.sh: line 270:  7196 Killed                  $__Command

Return code:      1
Raw output file:      /root/helix/work/workitem/uploads/JitBlue/DevDiv_255294/DevDiv_255294/output.txt
Raw output:
BEGIN EXECUTION
in takeLock
/root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/IL-CG2/DevDiv_255294.dll
19:51:50
Response file: /root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll.rsp
/root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/IL-CG2/DevDiv_255294.dll
-o:/root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll
--targetarch:x64
--targetos:linux
--verify-type-and-field-layout
--method-layout:random
-r:/root/helix/work/correlation/System.*.dll
-r:/root/helix/work/correlation/Microsoft.*.dll
-r:/root/helix/work/correlation/xunit.*.dll
-r:/root/helix/work/correlation/mscorlib.dll
-r:/root/helix/work/correlation/netstandard.dll
Running CrossGen2:  /root/helix/work/correlation/crossgen2/crossgen2 @/root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll.rsp   -r:/root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/IL-CG2/*.dll
Running R2RDump:  dotnet /root/helix/work/correlation/R2RDump/R2RDump.dll --header --sc --in /root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll --out /root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll.r2rdump --val
Error: System.BadImageFormatException: The file is not a ReadyToRun image
   at ILCompiler.Reflection.ReadyToRun.ReadyToRunReader.Initialize(IAssemblyMetadata metadata) in /_/src/coreclr/tools/aot/ILCompiler.Reflection.ReadyToRun/ReadyToRunReader.cs:line 518
   at R2RDump.Program.Run() in /_/src/coreclr/tools/r2rdump/Program.cs:line 449
19:52:12
Crossgen2 failed with exitcode: 137
in ReleaseLock
Test failed. Trying to see if dump file was created in /home/helixbot/dotnetbuild/dumps since 07/29/2025 19:51:50
Test Harness Exitcode is : 1
To run the test:
Set up CORE_ROOT and run.
> /root/helix/work/workitem/e/JIT/Regression/Regression_3/../JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.sh

Stack trace:

   at Xunit.Assert.True(Nullable`1 condition, String userMessage) in /_/src/arcade/src/Microsoft.DotNet.XUnitAssert/src/BooleanAsserts.cs:line 141
   at TestLibrary.OutOfProcessTest.RunOutOfProcessTest(String assemblyPath, String testPathPrefix)
   at Program.<<Main>$>g__TestExecutor322|0_323(StreamWriter tempLogSw, StreamWriter statsCsvSw, <>c__DisplayClass0_0&)

Jul 30 '25 01:07 SakeTao

Failed in: runtime-coreclr outerloop 20250730.1

Failed tests:

R2R-CG2 linux x64 Checked no_tiered_compilation @ (Alpine.322.Amd64.Open)[email protected]/dotnet-buildtools/prereqs:alpine-3.22-helix-amd64
    - JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.cmd

Error message:

DOTNET_DbgEnableMiniDump is set and the createdump binary does not exist: /root/helix/work/correlation/crossgen2/createdump
/root/helix/work/workitem/e/JIT/Regression/Regression_3/../JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.sh: line 270:  7197 Killed                  $__Command

Return code:      1
Raw output file:      /root/helix/work/workitem/uploads/JitBlue/DevDiv_255294/DevDiv_255294/output.txt
Raw output:
BEGIN EXECUTION
in takeLock
/root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/IL-CG2/DevDiv_255294.dll
10:38:18
Response file: /root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll.rsp
/root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/IL-CG2/DevDiv_255294.dll
-o:/root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll
--targetarch:x64
--targetos:linux
--verify-type-and-field-layout
--method-layout:random
-r:/root/helix/work/correlation/System.*.dll
-r:/root/helix/work/correlation/Microsoft.*.dll
-r:/root/helix/work/correlation/xunit.*.dll
-r:/root/helix/work/correlation/mscorlib.dll
-r:/root/helix/work/correlation/netstandard.dll
Running CrossGen2:  /root/helix/work/correlation/crossgen2/crossgen2 @/root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll.rsp   -r:/root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/IL-CG2/*.dll
Running R2RDump:  dotnet /root/helix/work/correlation/R2RDump/R2RDump.dll --header --sc --in /root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll --out /root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll.r2rdump --val
Error: System.BadImageFormatException: The file is not a ReadyToRun image
   at ILCompiler.Reflection.ReadyToRun.ReadyToRunReader.Initialize(IAssemblyMetadata metadata) in /_/src/coreclr/tools/aot/ILCompiler.Reflection.ReadyToRun/ReadyToRunReader.cs:line 518
   at R2RDump.Program.Run() in /_/src/coreclr/tools/r2rdump/Program.cs:line 449
10:38:31
Crossgen2 failed with exitcode: 137
in ReleaseLock
Test failed. Trying to see if dump file was created in /home/helixbot/dotnetbuild/dumps since 07/30/2025 10:38:18
Test Harness Exitcode is : 1
To run the test:
Set up CORE_ROOT and run.
> /root/helix/work/workitem/e/JIT/Regression/Regression_3/../JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.sh

Stack trace:

   at Xunit.Assert.True(Nullable`1 condition, String userMessage) in /_/src/arcade/src/Microsoft.DotNet.XUnitAssert/src/BooleanAsserts.cs:line 141
   at TestLibrary.OutOfProcessTest.RunOutOfProcessTest(String assemblyPath, String testPathPrefix)
   at Program.<<Main>$>g__TestExecutor322|0_323(StreamWriter tempLogSw, StreamWriter statsCsvSw, <>c__DisplayClass0_0&)

Jul 31 '25 01:07 SakeTao

Failed in: runtime-coreclr outerloop 20250731.2

Failed tests:

R2R-CG2 linux x64 Checked no_tiered_compilation @ (Alpine.322.Amd64.Open)[email protected]/dotnet-buildtools/prereqs:alpine-3.22-helix-amd64
    - JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.cmd

Error message:

DOTNET_DbgEnableMiniDump is set and the createdump binary does not exist: /root/helix/work/correlation/crossgen2/createdump
/root/helix/work/workitem/e/JIT/Regression/Regression_3/../JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.sh: line 270:  7198 Killed                  $__Command

Return code:      1
Raw output file:      /root/helix/work/workitem/uploads/JitBlue/DevDiv_255294/DevDiv_255294/output.txt
Raw output:
BEGIN EXECUTION
in takeLock
/root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/IL-CG2/DevDiv_255294.dll
19:58:19
Response file: /root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll.rsp
/root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/IL-CG2/DevDiv_255294.dll
-o:/root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll
--targetarch:x64
--targetos:linux
--verify-type-and-field-layout
--method-layout:random
-r:/root/helix/work/correlation/System.*.dll
-r:/root/helix/work/correlation/Microsoft.*.dll
-r:/root/helix/work/correlation/xunit.*.dll
-r:/root/helix/work/correlation/mscorlib.dll
-r:/root/helix/work/correlation/netstandard.dll
Running CrossGen2:  /root/helix/work/correlation/crossgen2/crossgen2 @/root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll.rsp   -r:/root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/IL-CG2/*.dll
Running R2RDump:  dotnet /root/helix/work/correlation/R2RDump/R2RDump.dll --header --sc --in /root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll --out /root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll.r2rdump --val
Error: System.BadImageFormatException: The file is not a ReadyToRun image
   at ILCompiler.Reflection.ReadyToRun.ReadyToRunReader.Initialize(IAssemblyMetadata metadata) in /_/src/coreclr/tools/aot/ILCompiler.Reflection.ReadyToRun/ReadyToRunReader.cs:line 518
   at R2RDump.Program.Run() in /_/src/coreclr/tools/r2rdump/Program.cs:line 449
19:58:31
Crossgen2 failed with exitcode: 137
in ReleaseLock
Test failed. Trying to see if dump file was created in /home/helixbot/dotnetbuild/dumps since 07/31/2025 19:58:19
Test Harness Exitcode is : 1
To run the test:
Set up CORE_ROOT and run.
> /root/helix/work/workitem/e/JIT/Regression/Regression_3/../JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.sh

Stack trace:

   at Xunit.Assert.True(Nullable`1 condition, String userMessage) in /_/src/arcade/src/Microsoft.DotNet.XUnitAssert/src/BooleanAsserts.cs:line 141
   at TestLibrary.OutOfProcessTest.RunOutOfProcessTest(String assemblyPath, String testPathPrefix)
   at Program.<<Main>$>g__TestExecutor322|0_323(StreamWriter tempLogSw, StreamWriter statsCsvSw, <>c__DisplayClass0_0&)

Aug 01 '25 02:08 SakeTao

Failed in: runtime-coreclr outerloop 20250804.2

Failed tests:

R2R-CG2 linux x64 Checked no_tiered_compilation @ (Alpine.322.Amd64.Open)[email protected]/dotnet-buildtools/prereqs:alpine-3.22-helix-amd64
    - JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.cmd

Error message:

DOTNET_DbgEnableMiniDump is set and the createdump binary does not exist: /root/helix/work/correlation/crossgen2/createdump
/root/helix/work/workitem/e/JIT/Regression/Regression_3/../JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.sh: line 270:  7195 Killed                  $__Command

Return code:      1
Raw output file:      /root/helix/work/workitem/uploads/JitBlue/DevDiv_255294/DevDiv_255294/output.txt
Raw output:
BEGIN EXECUTION
in takeLock
/root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/IL-CG2/DevDiv_255294.dll
20:10:53
Response file: /root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll.rsp
/root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/IL-CG2/DevDiv_255294.dll
-o:/root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll
--targetarch:x64
--targetos:linux
--verify-type-and-field-layout
--method-layout:random
-r:/root/helix/work/correlation/System.*.dll
-r:/root/helix/work/correlation/Microsoft.*.dll
-r:/root/helix/work/correlation/xunit.*.dll
-r:/root/helix/work/correlation/mscorlib.dll
-r:/root/helix/work/correlation/netstandard.dll
Running CrossGen2:  /root/helix/work/correlation/crossgen2/crossgen2 @/root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll.rsp   -r:/root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/IL-CG2/*.dll
Running R2RDump:  dotnet /root/helix/work/correlation/R2RDump/R2RDump.dll --header --sc --in /root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll --out /root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll.r2rdump --val
Error: System.BadImageFormatException: The file is not a ReadyToRun image
   at ILCompiler.Reflection.ReadyToRun.ReadyToRunReader.Initialize(IAssemblyMetadata metadata) in /_/src/coreclr/tools/aot/ILCompiler.Reflection.ReadyToRun/ReadyToRunReader.cs:line 518
   at R2RDump.Program.Run() in /_/src/coreclr/tools/r2rdump/Program.cs:line 449
20:11:29
Crossgen2 failed with exitcode: 137
in ReleaseLock
Test failed. Trying to see if dump file was created in /home/helixbot/dotnetbuild/dumps since 08/04/2025 20:10:53
Test Harness Exitcode is : 1
To run the test:
Set up CORE_ROOT and run.
> /root/helix/work/workitem/e/JIT/Regression/Regression_3/../JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.sh

Stack trace:

   at Xunit.Assert.True(Nullable`1 condition, String userMessage) in /_/src/arcade/src/Microsoft.DotNet.XUnitAssert/src/BooleanAsserts.cs:line 141
   at TestLibrary.OutOfProcessTest.RunOutOfProcessTest(String assemblyPath, String testPathPrefix)
   at Program.<<Main>$>g__TestExecutor322|0_323(StreamWriter tempLogSw, StreamWriter statsCsvSw, <>c__DisplayClass0_0&)

Aug 05 '25 01:08 SakeTao

Failed in: runtime-coreclr outerloop 20250807.4

Failed tests:

R2R-CG2 linux x64 Checked no_tiered_compilation @ (Alpine.322.Amd64.Open)[email protected]/dotnet-buildtools/prereqs:alpine-3.22-helix-amd64
    - JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.cmd

Error message:

DOTNET_DbgEnableMiniDump is set and the createdump binary does not exist: /root/helix/work/correlation/crossgen2/createdump
/root/helix/work/workitem/e/JIT/Regression/Regression_3/../JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.sh: line 270:  7198 Killed                  $__Command

Return code:      1
Raw output file:      /root/helix/work/workitem/uploads/JitBlue/DevDiv_255294/DevDiv_255294/output.txt
Raw output:
BEGIN EXECUTION
in takeLock
/root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/IL-CG2/DevDiv_255294.dll
19:40:33
Response file: /root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll.rsp
/root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/IL-CG2/DevDiv_255294.dll
-o:/root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll
--targetarch:x64
--targetos:linux
--verify-type-and-field-layout
--method-layout:random
-r:/root/helix/work/correlation/System.*.dll
-r:/root/helix/work/correlation/Microsoft.*.dll
-r:/root/helix/work/correlation/xunit.*.dll
-r:/root/helix/work/correlation/mscorlib.dll
-r:/root/helix/work/correlation/netstandard.dll
Running CrossGen2:  /root/helix/work/correlation/crossgen2/crossgen2 @/root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll.rsp   -r:/root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/IL-CG2/*.dll
Running R2RDump:  dotnet /root/helix/work/correlation/R2RDump/R2RDump.dll --header --sc --in /root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll --out /root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll.r2rdump --val
Error: System.BadImageFormatException: The file is not a ReadyToRun image
   at ILCompiler.Reflection.ReadyToRun.ReadyToRunReader.Initialize(IAssemblyMetadata metadata) in /_/src/coreclr/tools/aot/ILCompiler.Reflection.ReadyToRun/ReadyToRunReader.cs:line 518
   at R2RDump.Program.Run() in /_/src/coreclr/tools/r2rdump/Program.cs:line 449
19:41:30
Crossgen2 failed with exitcode: 137
in ReleaseLock
Test failed. Trying to see if dump file was created in /home/helixbot/dotnetbuild/dumps since 08/07/2025 19:40:33
Test Harness Exitcode is : 1
To run the test:
Set up CORE_ROOT and run.
> /root/helix/work/workitem/e/JIT/Regression/Regression_3/../JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.sh

Stack trace:

   at Xunit.Assert.True(Nullable`1 condition, String userMessage) in /_/src/arcade/src/Microsoft.DotNet.XUnitAssert/src/BooleanAsserts.cs:line 141
   at TestLibrary.OutOfProcessTest.RunOutOfProcessTest(String assemblyPath, String testPathPrefix)
   at Program.<<Main>$>g__TestExecutor322|0_323(StreamWriter tempLogSw, StreamWriter statsCsvSw, <>c__DisplayClass0_0&)

Aug 08 '25 01:08 SakeTao

Based on the diagnostic output in https://helixr1107v0xdcypoyl9e7f.blob.core.windows.net/dotnet-runtime-refs-heads-main-86de99a8ae434abebd/Regression_3.Attempt.2/1/console.e921e6c1.log?helixlogtype=result&skoid=8eda00af-b5ec-4be9-b69b-0919a2338892&sktid=72f988bf-86f1-41af-91ab-2d7cd011db47&skt=2025-08-08T15%3A27%3A23Z&ske=2025-08-08T16%3A27%3A23Z&sks=b&skv=2024-11-04&sv=2024-11-04&se=2025-08-08T16%3A27%3A23Z&sr=b&sp=rl&sig=PEyKJctrQLgbE3vwfnb2vCy6QcitZofAqZHIZblcDBE%3D the R2R image was truncated, and the export table is missing (it would have one if it were a composite image, so it's not):

Image file '/root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll' information:
Size: 815616 byte(s)
MetadataSize: 1476 byte(s)
SizeOfImage: 843776 byte(s)
ImageBase: 0x400000
FileAlignment: 0x200
SectionAlignment: 0x2000
CorHeader.Flags: ILOnly
Sections:
  .text 8192 - 820764
  .rsrc 827392 - 828652
  .reloc 835584 - 835596
HasExportTable: False
ExportTableHeaderLength: 0
_namedExportRva: 0 item(s)

I'm not sure how this could happen. A valid composite image's metadata looks like this:

Image file 'Z:\runtime\artifacts\tests\coreclr\windows.x64.Checked\JIT\Regression\JitBlue\DevDiv_255294\DevDiv_255294\composite-r2r.dll' information:
Size: 729088 byte(s)
MetadataSize: 284 byte(s)
SizeOfImage: 729088 byte(s)
ImageBase: 0x180000000
FileAlignment: 0x1000
SectionAlignment: 0x1000
CorHeader.Flags: 0
HasExportTable: True
ExportTableHeaderLength: 40
_namedExportRva: 1 item(s)
  'RTR_HEADER': 5424

You can see that Size and SizeOfImage match and it has an export table. (This metadata is missing the section RVAs because it's from an older version of the diagnostics)

EDIT: CopyRestOfFile in RelocationHelper.cs has an explicit check to make sure that the output stream size matches the expected size of the PE file, so this really shouldn't be possible.

EDIT 2: This was a red herring, the file isn't truncated, SizeOfImage doesn't match because of stuff we do on linux.

Aug 08 '25 15:08 kg

Failed in: runtime-coreclr outerloop 20250811.2

Failed tests:

R2R-CG2 linux x64 Checked no_tiered_compilation @ (Alpine.322.Amd64.Open)[email protected]/dotnet-buildtools/prereqs:alpine-3.22-helix-amd64
    - JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.cmd

Error message:

DOTNET_DbgEnableMiniDump is set and the createdump binary does not exist: /root/helix/work/correlation/crossgen2/createdump
/root/helix/work/workitem/e/JIT/Regression/Regression_3/../JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.sh: line 270:  7196 Killed                  $__Command
Image file '/root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll' information:
Size: 815616 byte(s)
MetadataSize: 1476 byte(s)
SizeOfImage: 843776 byte(s)
ImageBase: 0x400000
FileAlignment: 0x200
SectionAlignment: 0x2000
CorHeader.Flags: ILOnly
Sections:
  .text 8192 - 820764
  .rsrc 827392 - 828652
  .reloc 835584 - 835596
HasExportTable: False
ExportTableHeaderLength: 0
_namedExportRva: 0 item(s)
Image file '/root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll' information:
Size: 815616 byte(s)
MetadataSize: 1476 byte(s)
SizeOfImage: 843776 byte(s)
ImageBase: 0x400000
FileAlignment: 0x200
SectionAlignment: 0x2000
CorHeader.Flags: ILOnly
Sections:
  .text 8192 - 820764
  .rsrc 827392 - 828652
  .reloc 835584 - 835596
HasExportTable: False
ExportTableHeaderLength: 0
_namedExportRva: 0 item(s)

Return code:      1
Raw output file:      /root/helix/work/workitem/uploads/JitBlue/DevDiv_255294/DevDiv_255294/output.txt
Raw output:
BEGIN EXECUTION
in takeLock
/root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/IL-CG2/DevDiv_255294.dll
19:51:14
Response file: /root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll.rsp
/root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/IL-CG2/DevDiv_255294.dll
-o:/root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll
--targetarch:x64
--targetos:linux
--verify-type-and-field-layout
--method-layout:random
-r:/root/helix/work/correlation/System.*.dll
-r:/root/helix/work/correlation/Microsoft.*.dll
-r:/root/helix/work/correlation/xunit.*.dll
-r:/root/helix/work/correlation/mscorlib.dll
-r:/root/helix/work/correlation/netstandard.dll
Running CrossGen2:  /root/helix/work/correlation/crossgen2/crossgen2 @/root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll.rsp   -r:/root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/IL-CG2/*.dll
Running R2RDump:  dotnet /root/helix/work/correlation/R2RDump/R2RDump.dll --header --sc --in /root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll --out /root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll.r2rdump --val
Error: System.BadImageFormatException: The file is not a ReadyToRun image
   at ILCompiler.Reflection.ReadyToRun.ReadyToRunReader.Initialize(IAssemblyMetadata metadata) in /_/src/coreclr/tools/aot/ILCompiler.Reflection.ReadyToRun/ReadyToRunReader.cs:line 523
   at R2RDump.Program.Run() in /_/src/coreclr/tools/r2rdump/Program.cs:line 449
19:51:37
Crossgen2 failed with exitcode: 137
in ReleaseLock
Test failed. Trying to see if dump file was created in /home/helixbot/dotnetbuild/dumps since 08/11/2025 19:51:14
Test Harness Exitcode is : 1
To run the test:
Set up CORE_ROOT and run.
> /root/helix/work/workitem/e/JIT/Regression/Regression_3/../JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.sh

Stack trace:

   at Xunit.Assert.True(Nullable`1 condition, String userMessage) in /_/src/arcade/src/Microsoft.DotNet.XUnitAssert/src/BooleanAsserts.cs:line 141
   at TestLibrary.OutOfProcessTest.RunOutOfProcessTest(String assemblyPath, String testPathPrefix)
   at Program.<<Main>$>g__TestExecutor322|0_323(StreamWriter tempLogSw, StreamWriter statsCsvSw, <>c__DisplayClass0_0&)

Aug 12 '25 02:08 SakeTao

I had hoped https://github.com/dotnet/runtime/pull/118594 might fix this but it doesn't appear it did. Same failure happened in the linux musl lane here https://dev.azure.com/dnceng-public/public/_build/results?buildId=1121267&view=logs&j=92e17f34-a5d5-5d2c-e1e5-826eb9786835

Aug 13 '25 15:08 kg

Failed in: runtime-coreclr outerloop 20250813.3

Failed tests:

R2R-CG2 linux x64 Checked no_tiered_compilation @ (Alpine.322.Amd64.Open)[email protected]/dotnet-buildtools/prereqs:alpine-3.22-helix-amd64
    - JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.cmd

Error message:

DOTNET_DbgEnableMiniDump is set and the createdump binary does not exist: /root/helix/work/correlation/crossgen2/createdump
/root/helix/work/workitem/e/JIT/Regression/Regression_3/../JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.sh: line 270:  7195 Killed                  $__Command
Image file '/root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll' information:
Size: 815616 byte(s)
MetadataSize: 1476 byte(s)
SizeOfImage: 843776 byte(s)
ImageBase: 0x400000
FileAlignment: 0x200
SectionAlignment: 0x2000
CorHeader.Flags: ILOnly
Sections:
  .text 8192 - 820764
  .rsrc 827392 - 828652
  .reloc 835584 - 835596
HasExportTable: False
ExportTableHeaderLength: 0
_namedExportRva: 0 item(s)
Image file '/root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll' information:
Size: 815616 byte(s)
MetadataSize: 1476 byte(s)
SizeOfImage: 843776 byte(s)
ImageBase: 0x400000
FileAlignment: 0x200
SectionAlignment: 0x2000
CorHeader.Flags: ILOnly
Sections:
  .text 8192 - 820764
  .rsrc 827392 - 828652
  .reloc 835584 - 835596
HasExportTable: False
ExportTableHeaderLength: 0
_namedExportRva: 0 item(s)

Return code:      1
Raw output file:      /root/helix/work/workitem/uploads/JitBlue/DevDiv_255294/DevDiv_255294/output.txt
Raw output:
BEGIN EXECUTION
in takeLock
/root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/IL-CG2/DevDiv_255294.dll
02:42:37
Response file: /root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll.rsp
/root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/IL-CG2/DevDiv_255294.dll
-o:/root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll
-O
--targetarch:x64
--targetos:linux
--verify-type-and-field-layout
--method-layout:random
-r:/root/helix/work/correlation/System.*.dll
-r:/root/helix/work/correlation/Microsoft.*.dll
-r:/root/helix/work/correlation/xunit.*.dll
-r:/root/helix/work/correlation/mscorlib.dll
-r:/root/helix/work/correlation/netstandard.dll
Running CrossGen2:  /root/helix/work/correlation/crossgen2/crossgen2 @/root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll.rsp   -r:/root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/IL-CG2/*.dll
Running R2RDump:  dotnet /root/helix/work/correlation/R2RDump/R2RDump.dll --header --sc --in /root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll --out /root/helix/work/workitem/e/JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.dll.r2rdump --val
Error: System.BadImageFormatException: The file is not a ReadyToRun image
   at ILCompiler.Reflection.ReadyToRun.ReadyToRunReader.Initialize(IAssemblyMetadata metadata) in /_/src/coreclr/tools/aot/ILCompiler.Reflection.ReadyToRun/ReadyToRunReader.cs:line 523
   at R2RDump.Program.Run() in /_/src/coreclr/tools/r2rdump/Program.cs:line 449
02:42:50
Crossgen2 failed with exitcode: 137
in ReleaseLock
Test failed. Trying to see if dump file was created in /datadisks/disk1/dumps since 08/14/2025 02:42:37
Test Harness Exitcode is : 1
To run the test:
Set up CORE_ROOT and run.
> /root/helix/work/workitem/e/JIT/Regression/Regression_3/../JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.sh

Stack trace:

   at Xunit.Assert.True(Nullable`1 condition, String userMessage) in /_/src/arcade/src/Microsoft.DotNet.XUnitAssert/src/BooleanAsserts.cs:line 141
   at TestLibrary.OutOfProcessTest.RunOutOfProcessTest(String assemblyPath, String testPathPrefix)
   at Program.<<Main>$>g__TestExecutor322|0_323(StreamWriter tempLogSw, StreamWriter statsCsvSw, <>c__DisplayClass0_0&)

Aug 14 '25 06:08 SakeTao

Looking at the CorHeader.Flags in the most recent dump I notice that they are ILOnly. When R2R copies COR headers (according to comments it always does this) it strips that flag and replaces it with ILLibrary. This indicates that the dll being dumped is not R2R output.

From reading the test bash script it looks like they attempt to rewrite the source ILOnly binary with an R2R binary, and this suggests that for some reason crossgen didn't overwrite the input dll with the r2r output.

EDIT: Normally the output should look like this on Windows:

"Running CrossGen2:  "Z:\runtime\artifacts\tests\coreclr\windows.x64.Checked\Tests\Core_Root\crossgen2\crossgen2.exe" @"Z:\runtime\artifacts\tests\coreclr\windows.x64.Checked\JIT\Regression\JitBlue\DevDiv_255294\DevDiv_255294\DevDiv_255294.dll.rsp"   -r:Z:\runtime\artifacts\tests\coreclr\windows.x64.Checked\JIT\Regression\JitBlue\DevDiv_255294\DevDiv_255294\IL-CG2\*.dll"
Emitting R2R PE file: Z:\runtime\artifacts\tests\coreclr\windows.x64.Checked\JIT\Regression\JitBlue\DevDiv_255294\DevDiv_255294\DevDiv_255294.dll

It seems like the 'Emitting R2R PE File' is missing from the log on the failed run.

EDIT 2: If you run R2RDump on DevDiv_255294.dll immediately after building tests without running crossgen2, you get this exact failure. This further supports my theory that crossgen is failing to (or opting not to) overwrite the dll.

EDIT 3: Looking closer, before the R2RDump failure, Crossgen2 failed. We should probably change the test script to not run r2rdump if crossgen fails:

Crossgen2 failed with exitcode: 137

EDIT 4:

Exit code 137 is Linux-specific and means that your process was killed by a signal, namely SIGKILL

EDIT 5: Based on the log the crossgen invocation is taking around 13 seconds before it dies silently. This means it isn't a timeout. The most likely explanation is the OOM killer, I think.

Aug 14 '25 11:08 kg

On Windows the crossgen2 compilation for this test hits a peak memory usage of approx 4.4GB, so this supports the theory that the linux OOM killer is eating crossgen2 before it can write its output, causing the 137 (SIGKILL) exit code.

EDIT: Examining the memory usage in VS diagnostic tools with snapshots indicates that this is native heap usage, not managed heap usage. It's probably somewhere in the JIT or type system. Not sure how to dig into that further yet, will investigate.

The compiled method body's size is 498814 bytes and its debug info is 210443 bytes.

EDIT 2: The memory usage appears to be inside the JIT during compilation, most of it appears to be BitVecs allocated during BlockReachabilitySets::Build. There are roughly ~124k basic blocks.

EDIT 3: This was previously discussed in https://github.com/dotnet/runtime/issues/44341 - The JIT switches to MinOpts for this method because it's so big, but R2R doesn't. I tested setting NoOptimization for the test method and that makes the R2R compilation complete very quickly with reduced memory usage.

Aug 14 '25 17:08 kg

FYI @dotnet/jit-contrib in case somebody wants to take a look at eliminating or streamlining the use of the reachability sets.

Aug 15 '25 00:08 AndyAyersMS

Thanks @kg for the analysis!

Aug 15 '25 00:08 EgorBo

So looks like the problematic invocation is this one:

https://github.com/dotnet/runtime/blob/59ce21aaea616bf0ae49fa6ee0f681830343f765/src/coreclr/jit/ifconversion.cpp#L670-L675

The most obvious fix is to never invoke this logic if a method is known to never have loops which we care about here. Although, I guess we should use this repro to just generally optimize this routine, as we can just wrap the entire thing into an unnatural loop.

Aug 15 '25 01:08 EgorBo

So I presume we can use the reachability sets, but we'll have to compute them. We probably can do it only for methods with a lot of blocks.

Aug 15 '25 13:08 EgorBo

runtime
runtime copied to clipboard

Test failure: JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.cmd

Known Issue Error Message

Known issue validation

Report

Summary

runtime runtime copied to clipboard

Test failure: JIT/Regression/JitBlue/DevDiv_255294/DevDiv_255294/DevDiv_255294.cmd

Known Issue Error Message

Known issue validation

Report

Summary

runtime
runtime copied to clipboard