ucx
ucx copied to clipboard
shm_ib/test_ucp_am_nbx_send_copy_header.all_protos/3 <shm,ib/reply/proto> fails on swx-rdmz-ucx-gpu-01
Describe the bug
https://dev.azure.com/ucfconsort/ucx/_build/results?buildId=50521&view=logs&j=f97d6e39-20b4-5224-cb57-ac6707fa3b18&t=65630ad1-e2d8-5140-3757-25a4f549d6a1
2022-09-10T19:47:14.5269298Z [ RUN ] shm_ib/test_ucp_am_nbx_send_copy_header.all_protos/3 <shm,ib/reply/proto>
2022-09-10T19:47:14.8133395Z [ INFO ] header length 8 data length 8
2022-09-10T19:47:14.8356245Z [ INFO ] header length 8 data length 8 RNDV
2022-09-10T19:47:14.8373897Z [ INFO ] header length 32 data length 32
2022-09-10T19:47:14.8374559Z [ INFO ] header length 32 data length 32 RNDV
2022-09-10T19:47:14.8383474Z [ INFO ] header length 64 data length 64
2022-09-10T19:47:14.8390461Z [ INFO ] header length 64 data length 64 RNDV
2022-09-10T19:47:14.8418378Z [ INFO ] header length 8 data length 4124
2022-09-10T19:47:14.8422923Z /__w/1/s/contrib/../test/gtest/common/mem_buffer.cc:245: Failure
2022-09-10T19:47:14.8439848Z Pattern check failed at 0x4f44aa0 offset 0: Expected: 0x1111111111111111 Actual: 0x8c93540
2022-09-10T19:47:14.8445101Z [swx-rdmz-ucx-gpu-01:11288:0:11288] ucp_worker.c:2806 Assertion `worker->inprogress++ == 0' failed
2022-09-10T19:47:14.8446281Z ==== backtrace (tid: 11288) ====
2022-09-10T19:47:14.8447713Z 0 /__w/1/s/build-test/src/ucs/.libs/libucs.so.0(ucs_handle_error+0x12c) [0x7f316bfab95c]
2022-09-10T19:47:14.8449418Z 1 /__w/1/s/build-test/src/ucs/.libs/libucs.so.0(ucs_fatal_error_message+0x58) [0x7f316bfa8a18]
2022-09-10T19:47:14.8451127Z 2 /__w/1/s/build-test/src/ucs/.libs/libucs.so.0(ucs_fatal_error_format+0xd1) [0x7f316bfa8ba1]
2022-09-10T19:47:14.8452611Z 3 /__w/1/s/build-test/src/ucp/.libs/libucp.so.0(ucp_worker_progress+0x216) [0x7f316b80abd6]
2022-09-10T19:47:14.8453920Z 4 /__w/1/s/build-test/test/gtest/gtest() [0xa6838c]
2022-09-10T19:47:14.8455149Z 5 /__w/1/s/build-test/test/gtest/gtest() [0xa6998f]
2022-09-10T19:47:14.8456386Z 6 /__w/1/s/build-test/test/gtest/gtest() [0xa69e39]
2022-09-10T19:47:14.8457773Z 7 /__w/1/s/build-test/test/gtest/gtest() [0xa6bd94]
2022-09-10T19:47:14.8458926Z 8 /__w/1/s/build-test/test/gtest/gtest() [0xa6be08]
2022-09-10T19:47:14.8460211Z 9 /__w/1/s/build-test/test/gtest/gtest() [0x604868]
2022-09-10T19:47:14.8461427Z 10 /__w/1/s/build-test/test/gtest/gtest() [0xcf5f29]
2022-09-10T19:47:14.8462652Z 11 /__w/1/s/build-test/test/gtest/gtest() [0xcecb00]
2022-09-10T19:47:14.8463895Z 12 /__w/1/s/build-test/test/gtest/gtest() [0xcecc61]
2022-09-10T19:47:14.8465104Z 13 /__w/1/s/build-test/test/gtest/gtest() [0xcecd25]
2022-09-10T19:47:14.8466319Z 14 /__w/1/s/build-test/test/gtest/gtest() [0xced84a]
2022-09-10T19:47:14.8467598Z 15 /__w/1/s/build-test/test/gtest/gtest() [0xceda01]
2022-09-10T19:47:14.8468818Z 16 /__w/1/s/build-test/test/gtest/gtest() [0x589b99]
2022-09-10T19:47:14.8469826Z 17 /usr/lib64/libc.so.6(__libc_start_main+0xf5) [0x7f3166d99555]
2022-09-10T19:47:14.8471043Z 18 /__w/1/s/build-test/test/gtest/gtest() [0x5eb3b4]
2022-09-10T19:47:14.8472004Z =================================
2022-09-10T19:47:25.7708777Z make: *** [test] Aborted (core dumped)
2022-09-10T19:47:25.7719659Z make: Leaving directory `/__w/1/s/build-test/test/gtest'
2022-09-10T19:47:25.7833450Z ##[error]Bash exited with code '2'.
2022-09-10T19:47:25.7988921Z ##[section]Finishing: Run ./contrib/test_jenkins.sh