dynamorio icon indicating copy to clipboard operation
dynamorio copied to clipboard

multiple tests (api.rseq, api.startstop, burst_threads, synch_attach) failed with "Failed to synchronize" on detach

Open prasun3 opened this issue 2 years ago • 11 comments

Describe the bug

Seen in https://github.com/DynamoRIO/dynamorio/pull/5907

in event_post_attach
in event_pre_detach
<Application /home/pratn/dynamorio-latest/build-x86-32/suite/tests/bin/api.startstop (124291). Failed to synchronize with all threads when detaching.>

To Reproduce Run suite/tests/bin/api.startstop

Expected behavior

Screenshots or Pasted Text

Versions

  • What version of DynamoRIO are you using?
  • Does the latest build from https://github.com/DynamoRIO/dynamorio/releases solve the problem?
  • What operating system version are you running on? ("Windows 10" is not sufficient: give the release number.)
    • Linux
  • Is your application 32-bit or 64-bit?
    • 32-bit

Additional context

prasun3 avatar Mar 13 '23 08:03 prasun3

There are other issues on startstop test failures (#4604, #2093, #2246) so I added the precise failure reason to the title here.

derekbruening avatar Mar 13 '23 20:03 derekbruening

Happened in burst_threads test: https://github.com/DynamoRIO/dynamorio/actions/runs/16353704551/job/46206684643

derekbruening avatar Jul 17 '25 19:07 derekbruening

I merged #6185 here.

derekbruening avatar Jul 17 '25 19:07 derekbruening

code_api|tool.drcacheoff.burst_threads in ci x86-32 failed with:

Failed to synchronize with all threads when detaching.

at 004151938c2a2a8133295a79415aa8268b143616 (in PR #7556) after merging with master. The test passed on the second try.

From the ci log:

2025-07-23T03:17:18.3161649Z       Test #374: code_api|tool.drcacheoff.burst_threads ...........................***Failed   58.64 sec
2025-07-23T03:17:18.3162675Z Running |/opt/hostedtoolcache/cmake/3.19.7/x64/cmake-3.19.7-Linux-x86_64/bin/cmake;-E;remove_directory /home/runner/work/dynamorio/dynamorio/build_debug-internal-32/suite/tests/drmemtrace.tool.drcacheoff.burst_threads.26729.1754.dir|
2025-07-23T03:17:18.3164282Z Running |/opt/hostedtoolcache/cmake/3.19.7/x64/cmake-3.19.7-Linux-x86_64/bin/cmake;-E;remove_directory /home/runner/work/dynamorio/dynamorio/build_debug-internal-32/suite/tests/drmemtrace.tool.drcacheoff.burst_threads.26729.3740.dir|
2025-07-23T03:17:18.3165755Z Running |/opt/hostedtoolcache/cmake/3.19.7/x64/cmake-3.19.7-Linux-x86_64/bin/cmake;-E;remove_directory /home/runner/work/dynamorio/dynamorio/build_debug-internal-32/suite/tests/drmemtrace.tool.drcacheoff.burst_threads.26729.4652.dir|
2025-07-23T03:17:18.3167449Z Running |/opt/hostedtoolcache/cmake/3.19.7/x64/cmake-3.19.7-Linux-x86_64/bin/cmake;-E;remove_directory /home/runner/work/dynamorio/dynamorio/build_debug-internal-32/suite/tests/drmemtrace.tool.drcacheoff.burst_threads.26729.5689.dir|
2025-07-23T03:17:18.3168586Z Running cmd |/home/runner/work/dynamorio/dynamorio/build_debug-internal-32/clients/bin32/tool.drcacheoff.burst_threads|
2025-07-23T03:17:18.3169284Z CMake Error at /home/runner/work/dynamorio/dynamorio/suite/tests/process_cmdline.cmake:109 (message):
2025-07-23T03:17:18.3169720Z   *** cmd failed (40): pre-DR init
2025-07-23T03:17:18.3169866Z 
2025-07-23T03:17:18.3169929Z   pre-DR start
2025-07-23T03:17:18.3170034Z 
2025-07-23T03:17:18.3170095Z   pre-DR detach
2025-07-23T03:17:18.3170192Z 
2025-07-23T03:17:18.3170328Z   pre-DR init
2025-07-23T03:17:18.3170430Z 
2025-07-23T03:17:18.3170490Z   pre-DR start
2025-07-23T03:17:18.3170582Z 
2025-07-23T03:17:18.3170648Z   <Application
2025-07-23T03:17:18.3171043Z   /home/runner/work/dynamorio/dynamorio/build_debug-internal-32/clients/bin32/tool.drcacheoff.burst_threads
2025-07-23T03:17:18.3171567Z   (31477).  Failed to synchronize with all threads when detaching.>
2025-07-23T03:17:18.3171883Z 
2025-07-23T03:17:18.3171939Z   ***
2025-07-23T03:17:18.3172023Z 
2025-07-23T03:17:18.3172100Z Call Stack (most recent call first):
2025-07-23T03:17:18.3172479Z   /home/runner/work/dynamorio/dynamorio/suite/tests/runmulti.cmake:57 (process_cmdline)

edeiana avatar Jul 23 '25 20:07 edeiana

tool.drcacheoff.burst_threads failed on x86-32 again (https://github.com/DynamoRIO/dynamorio/actions/runs/16638503332/attempts/1) in the master merge for 0a9748a

abhinav92003 avatar Jul 31 '25 18:07 abhinav92003

The new synch_attach test, which uses the burst_threads executable, hit this: see https://github.com/DynamoRIO/dynamorio/pull/7621#issuecomment-3283338227

derekbruening avatar Sep 12 '25 19:09 derekbruening

tool.drcacheoff.burst_threads and tool.drcacheoff.synch_attach both failed on x86-32 with "Failed to synchronize with all threads when detaching." in the master merge test suite (https://github.com/DynamoRIO/dynamorio/commit/78998c229ca0a6dceaca06a93a1bf42410850bd7): https://github.com/DynamoRIO/dynamorio/actions/runs/17750919545/attempts/1

abhinav92003 avatar Sep 16 '25 16:09 abhinav92003

tool.drcacheoff.burst_threads failed again on x86-32 with "Failed to synchronize with all threads when detaching" on the master merge for #7650: https://github.com/DynamoRIO/dynamorio/actions/runs/18017345161/attempts/1

abhinav92003 avatar Sep 25 '25 19:09 abhinav92003

x32 burst_threads again on master merge: https://github.com/DynamoRIO/dynamorio/actions/runs/18500365114/job/52715252155

derekbruening avatar Oct 14 '25 15:10 derekbruening

tool.drcacheoff.synch_attach failed on x86-32 in the master merge for #7682: https://github.com/DynamoRIO/dynamorio/actions/runs/18568733950/job/52936829568.

abhinav92003 avatar Oct 16 '25 21:10 abhinav92003

synch_attach failed with this again: https://github.com/DynamoRIO/dynamorio/actions/runs/19440519336/job/55622442717?pr=7715

derekbruening avatar Nov 17 '25 19:11 derekbruening