[wasm] Runtime tests' build gets terminated with `exited with code 137`

[ilonatommy]

Build Information

Build: https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_build/results?buildId=452279 Build error leg or test failing: Build / browser-wasm linux Release AllSubsets_Mono_RuntimeTests monointerpreter / Build Tests Pull request: https://github.com/dotnet/runtime/pull/94064, https://github.com/dotnet/runtime/pull/94056

Error Message

Fill the error message using step by step known issues guidance.

{
  "ErrorMessage": "/InnerManagedTestBuild.3.binlog\" exited with code 137.",
  "ErrorPattern": "",
  "BuildRetry": false,
  "ExcludeConsoleLog": false
}

log:

   Regressions -> /__w/1/s/artifacts/tests/coreclr/browser.wasm.Release/Regressions/Regressions/browser-wasm/publish/
  /__w/1/s/dotnet.sh: line 27: 35452 Killed                  ${dotnetPath} "$@"
/__w/1/s/src/tests/build.proj(610,5): error MSB3073: The command ""/__w/1/s/dotnet.sh" msbuild /__w/1/s/src/tests/build.proj /t:Build "/p:TargetArchitecture=wasm" "/p:Configuration=Release" "/p:LibrariesConfiguration=Release" "/p:TasksConfiguration=Release" "/p:TargetOS=browser" "/p:ToolsOS=" "/p:PackageOS=" "/p:RuntimeFlavor=mono" "/p:RuntimeVariant=monointerpreter" "/p:CLRTestBuildAllTargets=" "/p:UseCodeFlowEnforcement=" "/p:__TestGroupToBuild=3" "/p:__SkipRestorePackages=1" /nodeReuse:false /m:1 /bl:/__w/1/s/artifacts//log/Release/InnerManagedTestBuild.3.binlog" exited with code 137.

Report

Build	Definition	Step Name	Console log	Pull Request
554493	dotnet/runtime	Build Tests	Log	dotnet/runtime#97415

Summary

24-Hour Hit Count	7-Day Hit Count	1-Month Count
0	1	1

Known issue validation

Build: :mag_right: https://dev.azure.com/dnceng-public/public/_build/results?buildId=452279 Error message validated: /InnerManagedTestBuild.3.binlog" exited with code 137. Result validation: :white_check_mark: Known issue matched with the provided build. Validation performed at: 10/27/2023 4:53:12 PM UTC

[lewing]

This time of failure is usually due to hitting container memory limits

[ghost]

Tagging subscribers to this area: @brzvlad, @kotlarmilos See info in area-owners.md if you want to be subscribed.

Issue Details

---

Build Information

Build: https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_build/results?buildId=452279 Build error leg or test failing: Build / browser-wasm linux Release AllSubsets_Mono_RuntimeTests monointerpreter / Build Tests Pull request: https://github.com/dotnet/runtime/pull/94064, https://github.com/dotnet/runtime/pull/94056

Error Message

Fill the error message using step by step known issues guidance.

{
  "ErrorMessage": "/InnerManagedTestBuild.3.binlog\" exited with code 137.",
  "ErrorPattern": "",
  "BuildRetry": false,
  "ExcludeConsoleLog": false
}

log:

   Regressions -> /__w/1/s/artifacts/tests/coreclr/browser.wasm.Release/Regressions/Regressions/browser-wasm/publish/
  /__w/1/s/dotnet.sh: line 27: 35452 Killed                  ${dotnetPath} "$@"
/__w/1/s/src/tests/build.proj(610,5): error MSB3073: The command ""/__w/1/s/dotnet.sh" msbuild /__w/1/s/src/tests/build.proj /t:Build "/p:TargetArchitecture=wasm" "/p:Configuration=Release" "/p:LibrariesConfiguration=Release" "/p:TasksConfiguration=Release" "/p:TargetOS=browser" "/p:ToolsOS=" "/p:PackageOS=" "/p:RuntimeFlavor=mono" "/p:RuntimeVariant=monointerpreter" "/p:CLRTestBuildAllTargets=" "/p:UseCodeFlowEnforcement=" "/p:__TestGroupToBuild=3" "/p:__SkipRestorePackages=1" /nodeReuse:false /m:1 /bl:/__w/1/s/artifacts//log/Release/InnerManagedTestBuild.3.binlog" exited with code 137.

Report

Summary

24-Hour Hit Count	7-Day Hit Count	1-Month Count
0	0	0

Known issue validation

Build: :mag_right: https://dev.azure.com/dnceng-public/public/_build/results?buildId=452279 Error message validated: /InnerManagedTestBuild.3.binlog" exited with code 137. Result validation: :white_check_mark: Known issue matched with the provided build. Validation performed at: 10/27/2023 4:53:12 PM UTC

Author:	ilonatommy
Assignees:	-
Labels:	blocking-clean-ci, area-Codegen-Interpreter-mono, Known Build Error, needs-area-label
Milestone:	9.0.0

[ghost]

Tagging subscribers to 'arch-wasm': @lewing See info in area-owners.md if you want to be subscribed.

Issue Details

---

Build Information

Build: https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_build/results?buildId=452279 Build error leg or test failing: Build / browser-wasm linux Release AllSubsets_Mono_RuntimeTests monointerpreter / Build Tests Pull request: https://github.com/dotnet/runtime/pull/94064, https://github.com/dotnet/runtime/pull/94056

Error Message

Fill the error message using step by step known issues guidance.

{
  "ErrorMessage": "/InnerManagedTestBuild.3.binlog\" exited with code 137.",
  "ErrorPattern": "",
  "BuildRetry": false,
  "ExcludeConsoleLog": false
}

log:

   Regressions -> /__w/1/s/artifacts/tests/coreclr/browser.wasm.Release/Regressions/Regressions/browser-wasm/publish/
  /__w/1/s/dotnet.sh: line 27: 35452 Killed                  ${dotnetPath} "$@"
/__w/1/s/src/tests/build.proj(610,5): error MSB3073: The command ""/__w/1/s/dotnet.sh" msbuild /__w/1/s/src/tests/build.proj /t:Build "/p:TargetArchitecture=wasm" "/p:Configuration=Release" "/p:LibrariesConfiguration=Release" "/p:TasksConfiguration=Release" "/p:TargetOS=browser" "/p:ToolsOS=" "/p:PackageOS=" "/p:RuntimeFlavor=mono" "/p:RuntimeVariant=monointerpreter" "/p:CLRTestBuildAllTargets=" "/p:UseCodeFlowEnforcement=" "/p:__TestGroupToBuild=3" "/p:__SkipRestorePackages=1" /nodeReuse:false /m:1 /bl:/__w/1/s/artifacts//log/Release/InnerManagedTestBuild.3.binlog" exited with code 137.

Report

Build	Definition	Step Name	Console log	Pull Request
453260	dotnet/runtime	Build Tests	Log
453193	dotnet/runtime	Build Tests	Log	dotnet/runtime#94066
453146	dotnet/runtime	Build Tests	Log	dotnet/runtime#93959
452882	dotnet/runtime	Build Tests	Log	dotnet/runtime#94038
452856	dotnet/runtime	Build Tests	Log	dotnet/runtime#94051
452279	dotnet/runtime	Build Tests	Log	dotnet/runtime#94064
452103	dotnet/runtime	Build Tests	Log	dotnet/runtime#94056

Summary

24-Hour Hit Count	7-Day Hit Count	1-Month Count
6	7	7

Known issue validation

Build: :mag_right: https://dev.azure.com/dnceng-public/public/_build/results?buildId=452279 Error message validated: /InnerManagedTestBuild.3.binlog" exited with code 137. Result validation: :white_check_mark: Known issue matched with the provided build. Validation performed at: 10/27/2023 4:53:12 PM UTC

Author:	ilonatommy
Assignees:	-
Labels:	arch-wasm, blocking-clean-ci, area-Codegen-Interpreter-mono, area-Infrastructure-mono, Known Build Error, needs-area-label
Milestone:	9.0.0

[lewing]

Many lanes across coreclr and mono are hitting container limits and getting a 137 exit code. 137 in a container is kill -9 + 128 from the container and is a generic failure, there isn't much value in adding the test name and making it more specific.