Infra timeout causing "Unable to obtain kernel buffer"

[steveharter]

Build

https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_build/results?buildId=879974

The tests succeeded (some long-running), but afterwards there was an errror message:

----- end Tue Nov 26 14:19:02 EST 2024 ----- exit code 0 ----------------------------------------------------------
exit code 0 means Exited Successfully
Unable to obtain kernel buffer: Operation not permitted

Build leg reported

System.Text.Json.Tests.WorkItemExecution

Pull Request

https://github.com/dotnet/runtime/pull/110097

Known issue core information

Fill out the known issue JSON section by following the step by step documentation on how to create a known issue

 {
    "ErrorMessage" : "'System.Text.Json.Tests' END OF WORK ITEM LOG: Command timed out, and was killed",
    "BuildRetry": false,
    "ErrorPattern": "",
    "ExcludeConsoleLog": false
 }

@dotnet/dnceng

log

/private/tmp/helix/working/B2A909DA/w/AA7A0952/e /private/tmp/helix/working/B2A909DA/w/AA7A0952/e
  Discovering: System.Text.Json.Tests (method display = ClassAndMethod, method display options = None)
  Discovered:  System.Text.Json.Tests (found 8725 of 8795 test cases)
  Starting:    System.Text.Json.Tests (parallel test collections = on [4 threads], stop on fail = off)
   System.Text.Json.Tests: [Long Running Test] 'System.Text.Json.Serialization.Tests.JsonElementTests.DeepEquals_TooDeepJsonDocument_ThrowsInsufficientExecutionStackException', Elapsed: 00:04:27
   System.Text.Json.Tests: [Long Running Test] 'System.Text.Json.Serialization.Tests.JsonElementTests.DeepEquals_TooDeepJsonDocument_ThrowsInsufficientExecutionStackException', Elapsed: 00:06:29
  Finished:    System.Text.Json.Tests
=== TEST EXECUTION SUMMARY ===
   System.Text.Json.Tests  Total: 41670, Errors: 0, Failed: 0, Skipped: 0, Time: 868.437s
/private/tmp/helix/working/B2A909DA/w/AA7A0952/e
----- end Tue Nov 26 14:19:02 EST 2024 ----- exit code 0 ----------------------------------------------------------
exit code 0 means Exited Successfully
Unable to obtain kernel buffer: Operation not permitted
usage: sudo dmesg
XUnitLogChecker status: 1
----- start =============== XUnitLogChecker Output =====================================================
No dumps found in /cores.
----- end =============== XUnitLogChecker Output - exit code 0 ===========================
+ export _commandExitCode=0
+ _commandExitCode=0
+ /usr/local/bin/python3 /tmp/helix/working/B2A909DA/p/reporter/run.py https://dev.azure.com/dnceng-public/ public 22986740 eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiIsIng1dCI6IjdSd2F5dmlYRHFoZnN6MTZSNmxPbXNXWWxTQSJ9.eyJuYW1laWQiOiJjNzczZjJjMi01MTIwLTQyMDctYWZlMi1hZmFmMzVhOGJjMGEiLCJzY3AiOiJhcHBfdG9rZW4iLCJhdWkiOiI2ZjViYmE1ZC1lZWU1LTQ4NzQtOWMzMy04YmYzMDM3M2JjOGEiLCJzaWQiOiI2MzFhODBiNy0yM2RlLTRhOTctYTM4NC0xMDFlYTU3MDlkMDMiLCJCdWlsZElkIjoiY2JiMTgyNjEtYzQ4Zi00YWJiLTg2NTEtOGNkY2I1NDc0NjQ5Ozg3OTk3NCIsIkRlZklkIjoiMTI5Iiwiam9icmVmIjoiOWU2ZWRhMDMtOTNmYS00ODQzLWFjZTgtZDA0ZWNiNzI5N2Q1OjY5YjYwYjUzLWE0MTctNTZlOS1kNGUwLTNhNDAzNDRkNWU2NyIsInBwaWQiOiJ2c3RmczovLy9CdWlsZC9CdWlsZC84Nzk5NzQiLCJvcmNoaWQiOiI5ZTZlZGEwMy05M2ZhLTQ4NDMtYWNlOC1kMDRlY2I3Mjk3ZDUuYnVpbGQubGlicmFyaWVzX3Rlc3RfcnVuX2NoZWNrZWRfY29yZWNscl9vc3hfeDY0X2RlYnVnLl9fZGVmYXVsdCIsInJlcG9JZHMiOiIiLCJpc3MiOiJhcHAudnN0b2tlbi52aXN1YWxzdHVkaW8uY29tIiwiYXVkIjoiYXBwLnZzdG9rZW4udmlzdWFsc3R1ZGlvLmNvbXx2c286NmZjYzkyZTUtNzNhNy00Zjg4LThkMTMtZDkwNDViNDVmYjI3IiwibmJmIjoxNzMyNjQ2NjE3LCJleHAiOjE3MzI2NTY4MTd9.cC2SRXCXtsOpTBOQFXJsYZWgT9I8INckKrzLAlwfE9UFPQROpQGXjLn1pC3JbKSq6O9ZTBzqtKzCUL_45mPdNyxrElGg9dWsG9zIPCmN8Rzhs9Jmou17iOtSgWQ0BqpiZuieVhZJkGqVdQLRhNMHuB9oChkunLX-LQzOI7WgSH20jJCHavHBPveDywEdO1_o7fQOxWVdMOhgnScNK6DczXkQMhMqWPeLmisfk_sZJ1tAk5q2HoLyKWMlX4zzMlAMA7bdcfarsm_NC4XQmyxr0yfYiOYChDOzrRFg3Jfm-kCrH5KraJyeQoh14_fB_M9fjk0IPQSGr4DLzr66EcXBsA
2024-11-26T19:19:04.189Z	INFO   	run.py	run(48)	main	Beginning reading of test results.
2024-11-26T19:19:04.194Z	INFO   	run.py	__init__(42)	read_results	Searching '/private/tmp/helix/working/B2A909DA/w/AA7A0952/e' for test results files
2024-11-26T19:19:04.201Z	INFO   	run.py	__init__(48)	read_results	Found results file /private/tmp/helix/working/B2A909DA/w/AA7A0952/e/testResults.xml with format xunit
['System.Text.Json.Tests' END OF WORK ITEM LOG: Command timed out, and was killed]

Release Note Category

• [ ] Feature changes/additions
• [ ] Bug fixes
• [ ] Internal Infrastructure Improvements

Release Note Description

Additional information about the issue reported

No response

Known issue validation

Build: :mag_right: https://dev.azure.com/dnceng-public/public/_build/results?buildId=879974 Error message validated: ['System.Text.Json.Tests' END OF WORK ITEM LOG: Command timed out, and was killed] Result validation: :white_check_mark: Known issue matched with the provided build. Validation performed at: 11/26/2024 8:06:58 PM UTC

Report

Build	Definition	Test	Pull Request
2847237	dotnet-runtime	System.Text.Json.Tests.WorkItemExecution
2845772	dotnet-runtime	System.Text.Json.Tests.WorkItemExecution
2845675	dotnet-runtime	System.Text.Json.Tests.WorkItemExecution
2842850	dotnet-runtime	System.Text.Json.Tests.WorkItemExecution
2838225	dotnet-runtime	System.Text.Json.Tests.WorkItemExecution
2838113	dotnet-runtime	System.Text.Json.Tests.WorkItemExecution	#54001
2832722	dotnet-runtime	System.Text.Json.Tests.WorkItemExecution
2829662	dotnet-runtime	System.Text.Json.Tests.WorkItemExecution

Summary

24-Hour Hit Count	7-Day Hit Count	1-Month Count
1	4	8