runtime icon indicating copy to clipboard operation
runtime copied to clipboard

[outerloop] System.Runtime.Numerics.Tests crash with exit code 137 in linux debug coreclr

Open elinor-fung opened this issue 1 year ago • 2 comments

Perhaps related to https://github.com/dotnet/runtime/issues/98964

  Starting:    System.Runtime.Numerics.Tests (parallel test collections = on, max threads = 2)
./RunTests.sh: line 168:    21 Killed                  "$RUNTIME_PATH/dotnet" exec --runtimeconfig System.Runtime.Numerics.Tests.runtimeconfig.json --depsfile System.Runtime.Numerics.Tests.deps.json xunit.console.dll System.Runtime.Numerics.Tests.dll -xml testResults.xml -nologo -nocolor -trait category=OuterLoop -notrait category=IgnoreForCI -notrait category=failing $RSP_FILE
/root/helix/work/workitem/e
----- end Mon Jul 8 23:40:00 UTC 2024 ----- exit code 137 ----------------------------------------------------------
exit code 137 means SIGKILL Killed eg by kill

Build Information

Build: https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_build/results?buildId=733224 Build error leg or test failing: System.Runtime.Numerics.Tests.WorkItemExecution Pull request: https://github.com/dotnet/runtime/pull/104501

Error Message

Fill the error message using step by step known issues guidance.

{
  "ErrorMessage": "",
  "ErrorPattern": "Killed.+System\\.Runtime\\.Numerics\\.Tests\\.runtimeconfig\\.json.+OuterLoop",
  "BuildRetry": false,
  "ExcludeConsoleLog": false
}

Known issue validation

Build: :mag_right: https://dev.azure.com/dnceng-public/public/_build/results?buildId=733224 Error message validated: [Killed.+System\.Runtime\.Numerics\.Tests\.runtimeconfig\.json.+OuterLoop] Result validation: :white_check_mark: Known issue matched with the provided build. Validation performed at: 7/9/2024 4:39:02 AM UTC

Report

Build Definition Test Pull Request
847286 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
847289 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
847268 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
847260 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
846104 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
846095 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
846105 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
846098 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
844515 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
844516 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
844520 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
844505 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
843018 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
843007 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
843011 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
843012 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
841492 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
841491 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
841488 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
841493 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
841048 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
841044 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
841056 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
841043 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
840711 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
840715 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
840696 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
840714 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
839647 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
839646 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
839645 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
839610 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
837804 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
837814 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
837828 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
837826 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
834979 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
834985 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
834988 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
834971 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
831562 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
831547 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
831525 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
831554 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
828311 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
828312 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
828306 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
828300 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
827197 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
827199 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
827175 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
827174 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
825914 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
825905 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
825904 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
825903 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
823251 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
823266 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
823255 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
823262 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
821952 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
821945 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
821940 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
821930 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
821543 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
821511 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
821538 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
821528 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
821158 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
821187 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
821184 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
821173 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
820229 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
820227 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
820215 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
820191 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
818918 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
818917 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
818898 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
818914 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
817810 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
817807 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
817789 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
817786 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
816754 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
816749 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
816747 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
816755 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
815526 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
815524 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
815528 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
815518 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
815140 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
815143 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
815142 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
815141 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
814780 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
814771 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
814769 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
814768 dotnet/runtime System.Runtime.Numerics.Tests.WorkItemExecution
Displaying 100 of 107 results

Summary

24-Hour Hit Count 7-Day Hit Count 1-Month Count
4 28 107

elinor-fung avatar Jul 09 '24 04:07 elinor-fung

Tagging subscribers to this area: @dotnet/area-system-numerics See info in area-owners.md if you want to be subscribed.

There is no dump and the only hint as to why the SIGKILL might have been raised is

dmesg: read kernel buffer failed: Operation not permitted

This seems like a more general flaky issue and not related to anything in the tests. I've not been able to repro locally so there's not much that can be done without some additional context or a reliable repro

tannergooding avatar Aug 08 '24 19:08 tannergooding

This is the highest-hitting libraries known build issue. Worth a look if you can determine the cause. https://helix.dot.net/BuildAnalysis/KnownIssues @tannergooding @jeffhandley

ericstj avatar Nov 07 '24 21:11 ericstj