taosdata
3.0.1 cluster crash
GNU gdb (GDB) Red Hat Enterprise Linux 7.6.1-120.el7 Copyright (C) 2013 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later http://gnu.org/licenses/gpl.html This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-redhat-linux-gnu". For bug reporting instructions, please see: http://www.gnu.org/software/gdb/bugs/... Reading symbols from /usr/local/taos/bin/taosd...done. [New LWP 17363] [New LWP 17379] [New LWP 17366] [New LWP 17368] [New LWP 17364] [New LWP 17374] [New LWP 17367] [New LWP 17369] [New LWP 17365] [New LWP 17310] [New LWP 17371] [New LWP 17316] [New LWP 17349] [New LWP 17376] [New LWP 17322] [New LWP 17334] [New LWP 17339] [New LWP 17318] [New LWP 17345] [New LWP 17357] [New LWP 17373] [New LWP 17375] [New LWP 17347] [New LWP 17372] [New LWP 17380] [New LWP 17317] [New LWP 17315] [New LWP 17341] [New LWP 17346] [New LWP 17359] [New LWP 17361] [New LWP 17324] [New LWP 17343] [New LWP 17350] [New LWP 17377] [New LWP 17370] [New LWP 17327] [New LWP 17351] [New LWP 17325] [New LWP 17333] [New LWP 17355] [New LWP 17326] [New LWP 17328] [New LWP 17344] [New LWP 17354] [New LWP 17362] [New LWP 17323] [New LWP 17319] [New LWP 17329] [New LWP 17348] [New LWP 17378] [New LWP 17314] [New LWP 17381] [New LWP 17311] [New LWP 17312] [New LWP 17340] [New LWP 17335] [New LWP 17342] [New LWP 17358] [New LWP 17321] [New LWP 17360] [New LWP 17332] [New LWP 17352] [New LWP 17353] [New LWP 17313] [New LWP 17336] [New LWP 17356] [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib64/libthread_db.so.1". Core was generated by `/usr/bin/taosd'. Program terminated with signal 11, Segmentation fault. #0 0x000055f566f1aabf in getTableDelIdx (pDelFReader=0x7f02a1993160, suid=8481409855040702563, uid=2968890740801013113, pDelIdx=0x7f032d7e11b0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/dnode/vnode/src/tsdb/tsdbCache.c:404 Copying output to gdb.txt.
Thread 67 (Thread 0x7f0330fe9700 (LWP 17356)): #0 0x00007f035db8eb3b in do_futex_wait.constprop.1 () from /lib64/libpthread.so.0 #1 0x00007f035db8ebcf in __new_sem_wait_slow.constprop.0 () from /lib64/libpthread.so.0 #2 0x00007f035db8ec6b in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0 #3 0x000055f56726becb in tsem_wait (sem=0x55f56a04ae88) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSemaphore.c:513 #4 0x000055f56725810a in taosReadQitemFromQset (qset=0x55f56a04ae50, ppItem=0x7f0330fe8ed0, qinfo=0x7f0330fe8ee0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tqueue.c:414 #5 0x000055f5672618a4 in tQWorkerThreadFp (worker=0x55f56a04b010) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tworker.c:82 #6 0x00007f035db88ea5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f035d4a596d in clone () from /lib64/libc.so.6
Thread 66 (Thread 0x7f0339ffb700 (LWP 17336)): #0 0x00007f035db8eb3b in do_futex_wait.constprop.1 () from /lib64/libpthread.so.0 #1 0x00007f035db8ebcf in __new_sem_wait_slow.constprop.0 () from /lib64/libpthread.so.0 #2 0x00007f035db8ec6b in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0 #3 0x000055f56726becb in tsem_wait (sem=0x7f033c1126e8) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSemaphore.c:513 #4 0x000055f56725bb93 in taosProcessSchedQueue (scheduler=0x7f033c1126c0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tsched.c:116 #5 0x00007f035db88ea5 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f035d4a596d in clone () from /lib64/libc.so.6
Thread 65 (Thread 0x7f035484e700 (LWP 17313)): #0 0x00007f035d4a5f43 in epoll_wait () from /lib64/libc.so.6 #1 0x000055f5671ada07 in uv__io_poll (loop=0x55f56a005bc0, timeout=-1) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/contrib/libuv/src/unix/epoll.c:236 #2 0x000055f567198470 in uv_run (loop=0x55f56a005bc0, mode=UV_RUN_DEFAULT) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/contrib/libuv/src/unix/core.c:406 #3 0x000055f567184665 in transWorkerThread (arg=0x55f56a0058d0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/libs/transport/src/transSvr.c:810 #4 0x00007f035db88ea5 in start_thread () from /lib64/libpthread.so.0 #5 0x00007f035d4a596d in clone () from /lib64/libc.so.6
Thread 64 (Thread 0x7f03327ec700 (LWP 17353)): #0 0x00007f035db8eb3b in do_futex_wait.constprop.1 () from /lib64/libpthread.so.0 #1 0x00007f035db8ebcf in __new_sem_wait_slow.constprop.0 () from /lib64/libpthread.so.0 #2 0x00007f035db8ec6b in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0 #3 0x000055f56726becb in tsem_wait (sem=0x55f56a04ae88) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSemaphore.c:513 #4 0x000055f56725810a in taosReadQitemFromQset (qset=0x55f56a04ae50, ppItem=0x7f03327ebed0, qinfo=0x7f03327ebee0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tqueue.c:414 #5 0x000055f5672618a4 in tQWorkerThreadFp (worker=0x55f56a04afc8) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tworker.c:82 #6 0x00007f035db88ea5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f035d4a596d in clone () from /lib64/libc.so.6
Thread 63 (Thread 0x7f0332fed700 (LWP 17352)): #0 0x00007f035db8eb3b in do_futex_wait.constprop.1 () from /lib64/libpthread.so.0 #1 0x00007f035db8ebcf in __new_sem_wait_slow.constprop.0 () from /lib64/libpthread.so.0 #2 0x00007f035db8ec6b in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0 #3 0x000055f56726becb in tsem_wait (sem=0x55f56a04ae88) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSemaphore.c:513 #4 0x000055f56725810a in taosReadQitemFromQset (qset=0x55f56a04ae50, ppItem=0x7f0332feced0, qinfo=0x7f0332fecee0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tqueue.c:414 #5 0x000055f5672618a4 in tQWorkerThreadFp (worker=0x55f56a04afb0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tworker.c:82 #6 0x00007f035db88ea5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f035d4a596d in clone () from /lib64/libc.so.6
Thread 62 (Thread 0x7f033bfff700 (LWP 17332)): #0 0x00007f035db8eb3b in do_futex_wait.constprop.1 () from /lib64/libpthread.so.0 #1 0x00007f035db8ebcf in __new_sem_wait_slow.constprop.0 () from /lib64/libpthread.so.0 #2 0x00007f035db8ec6b in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0 #3 0x000055f56726becb in tsem_wait (sem=0x7f033c1126e8) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSemaphore.c:513 #4 0x000055f56725bb93 in taosProcessSchedQueue (scheduler=0x7f033c1126c0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tsched.c:116 #5 0x00007f035db88ea5 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f035d4a596d in clone () from /lib64/libc.so.6
Thread 61 (Thread 0x7f032efe5700 (LWP 17360)): #0 0x00007f035db8eb3b in do_futex_wait.constprop.1 () from /lib64/libpthread.so.0 #1 0x00007f035db8ebcf in __new_sem_wait_slow.constprop.0 () from /lib64/libpthread.so.0 #2 0x00007f035db8ec6b in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0 #3 0x000055f56726becb in tsem_wait (sem=0x55f56a04ae88) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSemaphore.c:513 #4 0x000055f56725810a in taosReadQitemFromQset (qset=0x55f56a04ae50, ppItem=0x7f032efe4ed0, qinfo=0x7f032efe4ee0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tqueue.c:414 #5 0x000055f5672618a4 in tQWorkerThreadFp (worker=0x55f56a04b070) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tworker.c:82 #6 0x00007f035db88ea5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f035d4a596d in clone () from /lib64/libc.so.6
Thread 60 (Thread 0x7f0351047700 (LWP 17321)): #0 0x00007f035d46c85d in nanosleep () from /lib64/libc.so.6 #1 0x00007f035d49d134 in usleep () from /lib64/libc.so.6 #2 0x000055f56726c237 in taosMsleep (ms=1000) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSleep.c:37 #3 0x000055f5670f46bb in walUpdateSeq () at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/libs/wal/src/walMgmt.c:225 #4 0x000055f5670f4846 in walThreadFunc (param=0x0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/libs/wal/src/walMgmt.c:248 #5 0x00007f035db88ea5 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f035d4a596d in clone () from /lib64/libc.so.6
Thread 59 (Thread 0x7f032ffe7700 (LWP 17358)): #0 0x00007f035db8eb3b in do_futex_wait.constprop.1 () from /lib64/libpthread.so.0 #1 0x00007f035db8ebcf in __new_sem_wait_slow.constprop.0 () from /lib64/libpthread.so.0 #2 0x00007f035db8ec6b in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0 #3 0x000055f56726becb in tsem_wait (sem=0x55f56a04ae88) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSemaphore.c:513 #4 0x000055f56725810a in taosReadQitemFromQset (qset=0x55f56a04ae50, ppItem=0x7f032ffe6ed0, qinfo=0x7f032ffe6ee0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tqueue.c:414 #5 0x000055f5672618a4 in tQWorkerThreadFp (worker=0x55f56a04b040) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tworker.c:82 #6 0x00007f035db88ea5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f035d4a596d in clone () from /lib64/libc.so.6
Thread 58 (Thread 0x7f0337ff7700 (LWP 17342)): #0 0x00007f035db8eb3b in do_futex_wait.constprop.1 () from /lib64/libpthread.so.0 #1 0x00007f035db8ebcf in __new_sem_wait_slow.constprop.0 () from /lib64/libpthread.so.0 #2 0x00007f035db8ec6b in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0 #3 0x000055f56726becb in tsem_wait (sem=0x55f56a04ae88) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSemaphore.c:513 #4 0x000055f56725810a in taosReadQitemFromQset (qset=0x55f56a04ae50, ppItem=0x7f0337ff6ed0, qinfo=0x7f0337ff6ee0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tqueue.c:414 #5 0x000055f5672618a4 in tQWorkerThreadFp (worker=0x55f56a04aec0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tworker.c:82 #6 0x00007f035db88ea5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f035d4a596d in clone () from /lib64/libc.so.6
Thread 57 (Thread 0x7f033a7fc700 (LWP 17335)): #0 0x00007f035db8eb3b in do_futex_wait.constprop.1 () from /lib64/libpthread.so.0 #1 0x00007f035db8ebcf in __new_sem_wait_slow.constprop.0 () from /lib64/libpthread.so.0 #2 0x00007f035db8ec6b in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0 #3 0x000055f56726becb in tsem_wait (sem=0x7f033c1126e8) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSemaphore.c:513 #4 0x000055f56725bb93 in taosProcessSchedQueue (scheduler=0x7f033c1126c0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tsched.c:116 #5 0x00007f035db88ea5 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f035d4a596d in clone () from /lib64/libc.so.6
Thread 56 (Thread 0x7f0338ff9700 (LWP 17340)): #0 0x00007f035db8eb3b in do_futex_wait.constprop.1 () from /lib64/libpthread.so.0 #1 0x00007f035db8ebcf in __new_sem_wait_slow.constprop.0 () from /lib64/libpthread.so.0 #2 0x00007f035db8ec6b in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0 #3 0x000055f56726becb in tsem_wait (sem=0x7f033c225508) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSemaphore.c:513 #4 0x000055f567258328 in taosReadAllQitemsFromQset (qset=0x7f033c2254d0, qall=0x7f033c121720, qinfo=0x7f0338ff8ee0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tqueue.c:458 #5 0x000055f567262081 in tWWorkerThreadFp (worker=0x55f56a04b880) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tworker.c:208 #6 0x00007f035db88ea5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f035d4a596d in clone () from /lib64/libc.so.6
Thread 55 (Thread 0x7f035504f700 (LWP 17312)): #0 0x00007f035d4a5f43 in epoll_wait () from /lib64/libc.so.6 #1 0x000055f5671ada07 in uv__io_poll (loop=0x55f56a004d70, timeout=-1) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/contrib/libuv/src/unix/epoll.c:236 #2 0x000055f567198470 in uv_run (loop=0x55f56a004d70, mode=UV_RUN_DEFAULT) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/contrib/libuv/src/unix/core.c:406 #3 0x000055f567184665 in transWorkerThread (arg=0x55f56a004a80) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/libs/transport/src/transSvr.c:810 #4 0x00007f035db88ea5 in start_thread () from /lib64/libpthread.so.0 #5 0x00007f035d4a596d in clone () from /lib64/libc.so.6
Thread 54 (Thread 0x7f0355a63700 (LWP 17311)): #0 0x00007f035d46c85d in nanosleep () from /lib64/libc.so.6 #1 0x00007f035d49d134 in usleep () from /lib64/libc.so.6 #2 0x000055f56726c237 in taosMsleep (ms=25) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSleep.c:37 #3 0x000055f56725187c in taosAsyncOutputLog (param=0x55f568fda500) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tlog.c:699 #4 0x00007f035db88ea5 in start_thread () from /lib64/libpthread.so.0 #5 0x00007f035d4a596d in clone () from /lib64/libc.so.6
Thread 53 (Thread 0x7f0324fd1700 (LWP 17381)): #0 0x00007f035d46c85d in nanosleep () from /lib64/libc.so.6 #1 0x00007f035d49d134 in usleep () from /lib64/libc.so.6 #2 0x000055f56726c237 in taosMsleep (ms=200) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSleep.c:37 #3 0x000055f566e508c5 in dmMonitorThreadFp (param=0x55f56a01ee10) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/dnode/mgmt/mgmt_dnode/src/dmWorker.c:45 #4 0x00007f035db88ea5 in start_thread () from /lib64/libpthread.so.0 #5 0x00007f035d4a596d in clone () from /lib64/libc.so.6
Thread 52 (Thread 0x7f035404d700 (LWP 17314)): #0 0x00007f035d4a5f43 in epoll_wait () from /lib64/libc.so.6 #1 0x000055f5671ada07 in uv__io_poll (loop=0x55f56a006a80, timeout=-1) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/contrib/libuv/src/unix/epoll.c:236 #2 0x000055f567198470 in uv_run (loop=0x55f56a006a80, mode=UV_RUN_DEFAULT) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/contrib/libuv/src/unix/core.c:406 #3 0x000055f567184665 in transWorkerThread (arg=0x55f56a006790) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/libs/transport/src/transSvr.c:810 #4 0x00007f035db88ea5 in start_thread () from /lib64/libpthread.so.0 #5 0x00007f035d4a596d in clone () from /lib64/libc.so.6
Thread 51 (Thread 0x7f0325fd3700 (LWP 17378)): #0 0x00007f035db8eb3b in do_futex_wait.constprop.1 () from /lib64/libpthread.so.0 #1 0x00007f035db8ebcf in __new_sem_wait_slow.constprop.0 () from /lib64/libpthread.so.0 #2 0x00007f035db8ec6b in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0 #3 0x000055f56726becb in tsem_wait (sem=0x7f033c22afc8) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSemaphore.c:513 #4 0x000055f567258328 in taosReadAllQitemsFromQset (qset=0x7f033c22af90, qall=0x7f033c1214b0, qinfo=0x7f0325fd2ee0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tqueue.c:458 #5 0x000055f567262081 in tWWorkerThreadFp (worker=0x55f56a04b2b0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tworker.c:208 #6 0x00007f035db88ea5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f035d4a596d in clone () from /lib64/libc.so.6
Thread 50 (Thread 0x7f0334ff1700 (LWP 17348)): #0 0x00007f035db8eb3b in do_futex_wait.constprop.1 () from /lib64/libpthread.so.0 #1 0x00007f035db8ebcf in __new_sem_wait_slow.constprop.0 () from /lib64/libpthread.so.0 #2 0x00007f035db8ec6b in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0 #3 0x000055f56726becb in tsem_wait (sem=0x55f56a04ae88) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSemaphore.c:513 #4 0x000055f56725810a in taosReadQitemFromQset (qset=0x55f56a04ae50, ppItem=0x7f0334ff0ed0, qinfo=0x7f0334ff0ee0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tqueue.c:414 #5 0x000055f5672618a4 in tQWorkerThreadFp (worker=0x55f56a04af50) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tworker.c:82 #6 0x00007f035db88ea5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f035d4a596d in clone () from /lib64/libc.so.6
Thread 49 (Thread 0x7f0348ff9700 (LWP 17329)): #0 0x00007f035db8eb3b in do_futex_wait.constprop.1 () from /lib64/libpthread.so.0 #1 0x00007f035db8ebcf in __new_sem_wait_slow.constprop.0 () from /lib64/libpthread.so.0 #2 0x00007f035db8ec6b in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0 #3 0x000055f56726becb in tsem_wait (sem=0x55f56a04c128) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSemaphore.c:513 #4 0x000055f56725810a in taosReadQitemFromQset (qset=0x55f56a04c0f0, ppItem=0x7f0348ff8ed0, qinfo=0x7f0348ff8ee0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tqueue.c:414 #5 0x000055f5672618a4 in tQWorkerThreadFp (worker=0x55f56a04c160) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tworker.c:82 #6 0x00007f035db88ea5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f035d4a596d in clone () from /lib64/libc.so.6
Thread 48 (Thread 0x7f0351848700 (LWP 17319)): #0 0x00007f035d4a5f43 in epoll_wait () from /lib64/libc.so.6 #1 0x000055f5671ada07 in uv__io_poll (loop=0x55f5675adc08 <udfdGlobal+8>, timeout=-1) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/contrib/libuv/src/unix/epoll.c:236 #2 0x000055f567198470 in uv_run (loop=0x55f5675adc08 <udfdGlobal+8>, mode=UV_RUN_DEFAULT) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/contrib/libuv/src/unix/core.c:406 #3 0x000055f56706beaf in udfWatchUdfd (args=0x55f5675adc00 <udfdGlobal>) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/libs/function/src/tudf.c:172 #4 0x00007f035db88ea5 in start_thread () from /lib64/libpthread.so.0 #5 0x00007f035d4a596d in clone () from /lib64/libc.so.6
Thread 47 (Thread 0x7f034bfff700 (LWP 17323)): #0 0x00007f035db903c1 in sigwait () from /lib64/libpthread.so.0 #1 0x000055f5672712d4 in taosProcessAlarmSignal (tharg=0x55f56725f4a1 <taosTimerLoopFunc>) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osTimer.c:130 #2 0x00007f035db88ea5 in start_thread () from /lib64/libpthread.so.0 #3 0x00007f035d4a596d in clone () from /lib64/libc.so.6
Thread 46 (Thread 0x7f032dfe3700 (LWP 17362)): #0 0x00007f035db8eb3b in do_futex_wait.constprop.1 () from /lib64/libpthread.so.0 #1 0x00007f035db8ebcf in __new_sem_wait_slow.constprop.0 () from /lib64/libpthread.so.0 #2 0x00007f035db8ec6b in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0 #3 0x000055f56726becb in tsem_wait (sem=0x55f56a04ae88) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSemaphore.c:513 #4 0x000055f56725810a in taosReadQitemFromQset (qset=0x55f56a04ae50, ppItem=0x7f032dfe2ed0, qinfo=0x7f032dfe2ee0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tqueue.c:414 #5 0x000055f5672618a4 in tQWorkerThreadFp (worker=0x55f56a04b0a0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tworker.c:82 #6 0x00007f035db88ea5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f035d4a596d in clone () from /lib64/libc.so.6
Thread 45 (Thread 0x7f0331feb700 (LWP 17354)): #0 0x00007f035db8eb3b in do_futex_wait.constprop.1 () from /lib64/libpthread.so.0 #1 0x00007f035db8ebcf in __new_sem_wait_slow.constprop.0 () from /lib64/libpthread.so.0 #2 0x00007f035db8ec6b in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0 #3 0x000055f56726becb in tsem_wait (sem=0x55f56a04ae88) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSemaphore.c:513 #4 0x000055f56725810a in taosReadQitemFromQset (qset=0x55f56a04ae50, ppItem=0x7f0331feaed0, qinfo=0x7f0331feaee0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tqueue.c:414 #5 0x000055f5672618a4 in tQWorkerThreadFp (worker=0x55f56a04afe0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tworker.c:82 #6 0x00007f035db88ea5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f035d4a596d in clone () from /lib64/libc.so.6
Thread 44 (Thread 0x7f0336ff5700 (LWP 17344)): #0 0x00007f035db8eb3b in do_futex_wait.constprop.1 () from /lib64/libpthread.so.0 #1 0x00007f035db8ebcf in __new_sem_wait_slow.constprop.0 () from /lib64/libpthread.so.0 #2 0x00007f035db8ec6b in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0 #3 0x000055f56726becb in tsem_wait (sem=0x55f56a04ae88) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSemaphore.c:513 #4 0x000055f56725810a in taosReadQitemFromQset (qset=0x55f56a04ae50, ppItem=0x7f0336ff4ed0, qinfo=0x7f0336ff4ee0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tqueue.c:414 #5 0x000055f5672618a4 in tQWorkerThreadFp (worker=0x55f56a04aef0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tworker.c:82 #6 0x00007f035db88ea5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f035d4a596d in clone () from /lib64/libc.so.6
Thread 43 (Thread 0x7f03497fa700 (LWP 17328)): #0 0x00007f035db8eb3b in do_futex_wait.constprop.1 () from /lib64/libpthread.so.0 #1 0x00007f035db8ebcf in __new_sem_wait_slow.constprop.0 () from /lib64/libpthread.so.0 #2 0x00007f035db8ec6b in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0 #3 0x000055f56726becb in tsem_wait (sem=0x55f56a04bdc8) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSemaphore.c:513 #4 0x000055f56725810a in taosReadQitemFromQset (qset=0x55f56a04bd90, ppItem=0x7f03497f9ed0, qinfo=0x7f03497f9ee0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tqueue.c:414 #5 0x000055f5672618a4 in tQWorkerThreadFp (worker=0x55f56a04be00) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tworker.c:82 #6 0x00007f035db88ea5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f035d4a596d in clone () from /lib64/libc.so.6
Thread 42 (Thread 0x7f034a7fc700 (LWP 17326)): #0 0x00007f035db8ca35 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x000055f5672709f0 in taosThreadCondWait (cond=0x55f5675b90f8 <vnodeGlobal+56>, mutex=0x55f5675b90d0 <vnodeGlobal+16>) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osThread.c:101 #2 0x000055f566edc4f3 in loop (arg=0x0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/dnode/vnode/src/vnd/vnodeModule.c:148 #3 0x00007f035db88ea5 in start_thread () from /lib64/libpthread.so.0 #4 0x00007f035d4a596d in clone () from /lib64/libc.so.6
Thread 41 (Thread 0x7f03317ea700 (LWP 17355)): #0 0x00007f035db8eb3b in do_futex_wait.constprop.1 () from /lib64/libpthread.so.0 #1 0x00007f035db8ebcf in __new_sem_wait_slow.constprop.0 () from /lib64/libpthread.so.0 #2 0x00007f035db8ec6b in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0 #3 0x000055f56726becb in tsem_wait (sem=0x55f56a04ae88) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSemaphore.c:513 #4 0x000055f56725810a in taosReadQitemFromQset (qset=0x55f56a04ae50, ppItem=0x7f03317e9ed0, qinfo=0x7f03317e9ee0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tqueue.c:414 #5 0x000055f5672618a4 in tQWorkerThreadFp (worker=0x55f56a04aff8) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tworker.c:82 #6 0x00007f035db88ea5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f035d4a596d in clone () from /lib64/libc.so.6
Thread 40 (Thread 0x7f033b7fe700 (LWP 17333)): #0 0x00007f035db8eb3b in do_futex_wait.constprop.1 () from /lib64/libpthread.so.0 #1 0x00007f035db8ebcf in __new_sem_wait_slow.constprop.0 () from /lib64/libpthread.so.0 #2 0x00007f035db8ec6b in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0 #3 0x000055f56726becb in tsem_wait (sem=0x7f033c1126e8) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSemaphore.c:513 #4 0x000055f56725bb93 in taosProcessSchedQueue (scheduler=0x7f033c1126c0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tsched.c:116 #5 0x00007f035db88ea5 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f035d4a596d in clone () from /lib64/libc.so.6
Thread 39 (Thread 0x7f034affd700 (LWP 17325)): #0 0x00007f035db8ca35 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x000055f5672709f0 in taosThreadCondWait (cond=0x55f5675b90f8 <vnodeGlobal+56>, mutex=0x55f5675b90d0 <vnodeGlobal+16>) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osThread.c:101 #2 0x000055f566edc4f3 in loop (arg=0x0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/dnode/vnode/src/vnd/vnodeModule.c:148 #3 0x00007f035db88ea5 in start_thread () from /lib64/libpthread.so.0 #4 0x00007f035d4a596d in clone () from /lib64/libc.so.6
Thread 38 (Thread 0x7f03337ee700 (LWP 17351)): #0 0x00007f035db8eb3b in do_futex_wait.constprop.1 () from /lib64/libpthread.so.0 #1 0x00007f035db8ebcf in __new_sem_wait_slow.constprop.0 () from /lib64/libpthread.so.0 #2 0x00007f035db8ec6b in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0 #3 0x000055f56726becb in tsem_wait (sem=0x55f56a04ae88) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSemaphore.c:513 #4 0x000055f56725810a in taosReadQitemFromQset (qset=0x55f56a04ae50, ppItem=0x7f03337eded0, qinfo=0x7f03337edee0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tqueue.c:414 #5 0x000055f5672618a4 in tQWorkerThreadFp (worker=0x55f56a04af98) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tworker.c:82 #6 0x00007f035db88ea5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f035d4a596d in clone () from /lib64/libc.so.6
Thread 37 (Thread 0x7f0349ffb700 (LWP 17327)): #0 0x00007f035db8ca35 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x000055f5672709f0 in taosThreadCondWait (cond=0x55f5675b90f8 <vnodeGlobal+56>, mutex=0x55f5675b90d0 <vnodeGlobal+16>) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osThread.c:101 #2 0x000055f566edc4f3 in loop (arg=0x0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/dnode/vnode/src/vnd/vnodeModule.c:148 #3 0x00007f035db88ea5 in start_thread () from /lib64/libpthread.so.0 #4 0x00007f035d4a596d in clone () from /lib64/libc.so.6
Thread 36 (Thread 0x7f0329fdb700 (LWP 17370)): #0 0x00007f035db8eb3b in do_futex_wait.constprop.1 () from /lib64/libpthread.so.0 #1 0x00007f035db8ebcf in __new_sem_wait_slow.constprop.0 () from /lib64/libpthread.so.0 #2 0x00007f035db8ec6b in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0 #3 0x000055f56726becb in tsem_wait (sem=0x55f56a04ae88) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSemaphore.c:513 #4 0x000055f56725810a in taosReadQitemFromQset (qset=0x55f56a04ae50, ppItem=0x7f0329fdaed0, qinfo=0x7f0329fdaee0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tqueue.c:414 #5 0x000055f5672618a4 in tQWorkerThreadFp (worker=0x55f56a04b160) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tworker.c:82 #6 0x00007f035db88ea5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f035d4a596d in clone () from /lib64/libc.so.6
Thread 35 (Thread 0x7f03267d4700 (LWP 17377)): #0 0x00007f035db8eb3b in do_futex_wait.constprop.1 () from /lib64/libpthread.so.0 #1 0x00007f035db8ebcf in __new_sem_wait_slow.constprop.0 () from /lib64/libpthread.so.0 #2 0x00007f035db8ec6b in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0 #3 0x000055f56726becb in tsem_wait (sem=0x55f56a04b208) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSemaphore.c:513 #4 0x000055f56725810a in taosReadQitemFromQset (qset=0x55f56a04b1d0, ppItem=0x7f03267d3ed0, qinfo=0x7f03267d3ee0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tqueue.c:414 #5 0x000055f5672618a4 in tQWorkerThreadFp (worker=0x55f56a04b288) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tworker.c:82 #6 0x00007f035db88ea5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f035d4a596d in clone () from /lib64/libc.so.6
Thread 34 (Thread 0x7f0333fef700 (LWP 17350)): #0 0x00007f035db8eb3b in do_futex_wait.constprop.1 () from /lib64/libpthread.so.0 #1 0x00007f035db8ebcf in __new_sem_wait_slow.constprop.0 () from /lib64/libpthread.so.0 #2 0x00007f035db8ec6b in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0 #3 0x000055f56726becb in tsem_wait (sem=0x55f56a04ae88) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSemaphore.c:513 #4 0x000055f56725810a in taosReadQitemFromQset (qset=0x55f56a04ae50, ppItem=0x7f0333feeed0, qinfo=0x7f0333feeee0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tqueue.c:414 #5 0x000055f5672618a4 in tQWorkerThreadFp (worker=0x55f56a04af80) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tworker.c:82 #6 0x00007f035db88ea5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f035d4a596d in clone () from /lib64/libc.so.6
Thread 33 (Thread 0x7f03377f6700 (LWP 17343)): #0 0x00007f035db8eb3b in do_futex_wait.constprop.1 () from /lib64/libpthread.so.0 #1 0x00007f035db8ebcf in __new_sem_wait_slow.constprop.0 () from /lib64/libpthread.so.0 #2 0x00007f035db8ec6b in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0 #3 0x000055f56726becb in tsem_wait (sem=0x55f56a04ae88) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSemaphore.c:513 #4 0x000055f56725810a in taosReadQitemFromQset (qset=0x55f56a04ae50, ppItem=0x7f03377f5ed0, qinfo=0x7f03377f5ee0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tqueue.c:414 #5 0x000055f5672618a4 in tQWorkerThreadFp (worker=0x55f56a04aed8) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tworker.c:82 #6 0x00007f035db88ea5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f035d4a596d in clone () from /lib64/libc.so.6
Thread 32 (Thread 0x7f034b7fe700 (LWP 17324)): #0 0x00007f035db8ca35 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x000055f5672709f0 in taosThreadCondWait (cond=0x55f5675b90f8 <vnodeGlobal+56>, mutex=0x55f5675b90d0 <vnodeGlobal+16>) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osThread.c:101 #2 0x000055f566edc4f3 in loop (arg=0x0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/dnode/vnode/src/vnd/vnodeModule.c:148 #3 0x00007f035db88ea5 in start_thread () from /lib64/libpthread.so.0 #4 0x00007f035d4a596d in clone () from /lib64/libc.so.6
Thread 31 (Thread 0x7f032e7e4700 (LWP 17361)): #0 0x00007f035db8eb3b in do_futex_wait.constprop.1 () from /lib64/libpthread.so.0 #1 0x00007f035db8ebcf in __new_sem_wait_slow.constprop.0 () from /lib64/libpthread.so.0 #2 0x00007f035db8ec6b in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0 #3 0x000055f56726becb in tsem_wait (sem=0x55f56a04ae88) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSemaphore.c:513 #4 0x000055f56725810a in taosReadQitemFromQset (qset=0x55f56a04ae50, ppItem=0x7f032e7e3ed0, qinfo=0x7f032e7e3ee0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tqueue.c:414 #5 0x000055f5672618a4 in tQWorkerThreadFp (worker=0x55f56a04b088) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tworker.c:82 #6 0x00007f035db88ea5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f035d4a596d in clone () from /lib64/libc.so.6
Thread 30 (Thread 0x7f032f7e6700 (LWP 17359)): #0 0x00007f035db8eb3b in do_futex_wait.constprop.1 () from /lib64/libpthread.so.0 #1 0x00007f035db8ebcf in __new_sem_wait_slow.constprop.0 () from /lib64/libpthread.so.0 #2 0x00007f035db8ec6b in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0 #3 0x000055f56726becb in tsem_wait (sem=0x55f56a04ae88) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSemaphore.c:513 #4 0x000055f56725810a in taosReadQitemFromQset (qset=0x55f56a04ae50, ppItem=0x7f032f7e5ed0, qinfo=0x7f032f7e5ee0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tqueue.c:414 #5 0x000055f5672618a4 in tQWorkerThreadFp (worker=0x55f56a04b058) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tworker.c:82 #6 0x00007f035db88ea5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f035d4a596d in clone () from /lib64/libc.so.6
Thread 29 (Thread 0x7f0335ff3700 (LWP 17346)): #0 0x00007f035db8eb3b in do_futex_wait.constprop.1 () from /lib64/libpthread.so.0 #1 0x00007f035db8ebcf in __new_sem_wait_slow.constprop.0 () from /lib64/libpthread.so.0 #2 0x00007f035db8ec6b in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0 #3 0x000055f56726becb in tsem_wait (sem=0x55f56a04ae88) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSemaphore.c:513 #4 0x000055f56725810a in taosReadQitemFromQset (qset=0x55f56a04ae50, ppItem=0x7f0335ff2ed0, qinfo=0x7f0335ff2ee0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tqueue.c:414 #5 0x000055f5672618a4 in tQWorkerThreadFp (worker=0x55f56a04af20) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tworker.c:82 #6 0x00007f035db88ea5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f035d4a596d in clone () from /lib64/libc.so.6
Thread 28 (Thread 0x7f03387f8700 (LWP 17341)): #0 0x00007f035db8eb3b in do_futex_wait.constprop.1 () from /lib64/libpthread.so.0 #1 0x00007f035db8ebcf in __new_sem_wait_slow.constprop.0 () from /lib64/libpthread.so.0 #2 0x00007f035db8ec6b in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0 #3 0x000055f56726becb in tsem_wait (sem=0x7f033c225848) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSemaphore.c:513 #4 0x000055f567258328 in taosReadAllQitemsFromQset (qset=0x7f033c225810, qall=0x7f033c121490, qinfo=0x7f03387f7ee0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tqueue.c:458 #5 0x000055f567262081 in tWWorkerThreadFp (worker=0x55f56a04b5f0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tworker.c:208 #6 0x00007f035db88ea5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f035d4a596d in clone () from /lib64/libc.so.6
Thread 27 (Thread 0x7f035384c700 (LWP 17315)): #0 0x00007f035d4a5f43 in epoll_wait () from /lib64/libc.so.6 #1 0x000055f5671ada07 in uv__io_poll (loop=0x55f56a007a80, timeout=-1) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/contrib/libuv/src/unix/epoll.c:236 #2 0x000055f567198470 in uv_run (loop=0x55f56a007a80, mode=UV_RUN_DEFAULT) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/contrib/libuv/src/unix/core.c:406 #3 0x000055f567184665 in transWorkerThread (arg=0x55f56a006e30) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/libs/transport/src/transSvr.c:810 #4 0x00007f035db88ea5 in start_thread () from /lib64/libpthread.so.0 #5 0x00007f035d4a596d in clone () from /lib64/libc.so.6
Thread 26 (Thread 0x7f035284a700 (LWP 17317)): #0 0x00007f035d4a5f43 in epoll_wait () from /lib64/libc.so.6 #1 0x000055f5671ada07 in uv__io_poll (loop=0x55f56a008e70, timeout=-1) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/contrib/libuv/src/unix/epoll.c:236 #2 0x000055f567198470 in uv_run (loop=0x55f56a008e70, mode=UV_RUN_DEFAULT) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/contrib/libuv/src/unix/core.c:406 #3 0x000055f56717b75a in cliWorkThread (arg=0x55f56a008cc0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/libs/transport/src/transCli.c:1100 #4 0x00007f035db88ea5 in start_thread () from /lib64/libpthread.so.0 #5 0x00007f035d4a596d in clone () from /lib64/libc.so.6
Thread 25 (Thread 0x7f03257d2700 (LWP 17380)): #0 0x00007f035d46c85d in nanosleep () from /lib64/libc.so.6 #1 0x00007f035d49d134 in usleep () from /lib64/libc.so.6 #2 0x000055f56726c237 in taosMsleep (ms=200) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSleep.c:37 #3 0x000055f566e5076d in dmStatusThreadFp (param=0x55f56a01ee10) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/dnode/mgmt/mgmt_dnode/src/dmWorker.c:25 #4 0x00007f035db88ea5 in start_thread () from /lib64/libpthread.so.0 #5 0x00007f035d4a596d in clone () from /lib64/libc.so.6
Thread 24 (Thread 0x7f0328fd9700 (LWP 17372)): #0 0x00007f035db8eb3b in do_futex_wait.constprop.1 () from /lib64/libpthread.so.0 #1 0x00007f035db8ebcf in __new_sem_wait_slow.constprop.0 () from /lib64/libpthread.so.0 #2 0x00007f035db8ec6b in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0 #3 0x000055f56726becb in tsem_wait (sem=0x55f56a04ae88) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSemaphore.c:513 #4 0x000055f56725810a in taosReadQitemFromQset (qset=0x55f56a04ae50, ppItem=0x7f0328fd8ed0, qinfo=0x7f0328fd8ee0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tqueue.c:414 #5 0x000055f5672618a4 in tQWorkerThreadFp (worker=0x55f56a04b190) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tworker.c:82 #6 0x00007f035db88ea5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f035d4a596d in clone () from /lib64/libc.so.6
Thread 23 (Thread 0x7f03357f2700 (LWP 17347)): #0 0x00007f035db8eb3b in do_futex_wait.constprop.1 () from /lib64/libpthread.so.0 #1 0x00007f035db8ebcf in __new_sem_wait_slow.constprop.0 () from /lib64/libpthread.so.0 #2 0x00007f035db8ec6b in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0 #3 0x000055f56726becb in tsem_wait (sem=0x55f56a04ae88) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSemaphore.c:513 #4 0x000055f56725810a in taosReadQitemFromQset (qset=0x55f56a04ae50, ppItem=0x7f03357f1ed0, qinfo=0x7f03357f1ee0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tqueue.c:414 #5 0x000055f5672618a4 in tQWorkerThreadFp (worker=0x55f56a04af38) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tworker.c:82 #6 0x00007f035db88ea5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f035d4a596d in clone () from /lib64/libc.so.6
Thread 22 (Thread 0x7f03277d6700 (LWP 17375)): #0 0x00007f035db8eb3b in do_futex_wait.constprop.1 () from /lib64/libpthread.so.0 #1 0x00007f035db8ebcf in __new_sem_wait_slow.constprop.0 () from /lib64/libpthread.so.0 #2 0x00007f035db8ec6b in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0 #3 0x000055f56726becb in tsem_wait (sem=0x55f56a04b208) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSemaphore.c:513 #4 0x000055f56725810a in taosReadQitemFromQset (qset=0x55f56a04b1d0, ppItem=0x7f03277d5ed0, qinfo=0x7f03277d5ee0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tqueue.c:414 #5 0x000055f5672618a4 in tQWorkerThreadFp (worker=0x55f56a04b258) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tworker.c:82 #6 0x00007f035db88ea5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f035d4a596d in clone () from /lib64/libc.so.6
Thread 21 (Thread 0x7f03287d8700 (LWP 17373)): #0 0x00007f035db8eb3b in do_futex_wait.constprop.1 () from /lib64/libpthread.so.0 #1 0x00007f035db8ebcf in __new_sem_wait_slow.constprop.0 () from /lib64/libpthread.so.0 #2 0x00007f035db8ec6b in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0 #3 0x000055f56726becb in tsem_wait (sem=0x55f56a04ae88) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSemaphore.c:513 #4 0x000055f56725810a in taosReadQitemFromQset (qset=0x55f56a04ae50, ppItem=0x7f03287d7ed0, qinfo=0x7f03287d7ee0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tqueue.c:414 #5 0x000055f5672618a4 in tQWorkerThreadFp (worker=0x55f56a04b1a8) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tworker.c:82 #6 0x00007f035db88ea5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f035d4a596d in clone () from /lib64/libc.so.6
Thread 20 (Thread 0x7f03307e8700 (LWP 17357)): #0 0x00007f035db8eb3b in do_futex_wait.constprop.1 () from /lib64/libpthread.so.0 #1 0x00007f035db8ebcf in __new_sem_wait_slow.constprop.0 () from /lib64/libpthread.so.0 #2 0x00007f035db8ec6b in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0 #3 0x000055f56726becb in tsem_wait (sem=0x55f56a04ae88) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSemaphore.c:513 #4 0x000055f56725810a in taosReadQitemFromQset (qset=0x55f56a04ae50, ppItem=0x7f03307e7ed0, qinfo=0x7f03307e7ee0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tqueue.c:414 #5 0x000055f5672618a4 in tQWorkerThreadFp (worker=0x55f56a04b028) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tworker.c:82 #6 0x00007f035db88ea5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f035d4a596d in clone () from /lib64/libc.so.6
Thread 19 (Thread 0x7f03367f4700 (LWP 17345)): #0 0x00007f035db8eb3b in do_futex_wait.constprop.1 () from /lib64/libpthread.so.0 #1 0x00007f035db8ebcf in __new_sem_wait_slow.constprop.0 () from /lib64/libpthread.so.0 #2 0x00007f035db8ec6b in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0 #3 0x000055f56726becb in tsem_wait (sem=0x55f56a04ae88) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSemaphore.c:513 #4 0x000055f56725810a in taosReadQitemFromQset (qset=0x55f56a04ae50, ppItem=0x7f03367f3ed0, qinfo=0x7f03367f3ee0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tqueue.c:414 #5 0x000055f5672618a4 in tQWorkerThreadFp (worker=0x55f56a04af08) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tworker.c:82 #6 0x00007f035db88ea5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f035d4a596d in clone () from /lib64/libc.so.6
Thread 18 (Thread 0x7f0352049700 (LWP 17318)): #0 0x00007f035db8eb3b in do_futex_wait.constprop.1 () from /lib64/libpthread.so.0 #1 0x00007f035db8ebcf in __new_sem_wait_slow.constprop.0 () from /lib64/libpthread.so.0 #2 0x00007f035db8ec6b in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0 #3 0x000055f56726becb in tsem_wait (sem=0x55f56a01ef58) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSemaphore.c:513 #4 0x000055f56725810a in taosReadQitemFromQset (qset=0x55f56a01ef20, ppItem=0x7f0352048ed0, qinfo=0x7f0352048ee0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tqueue.c:414 #5 0x000055f5672618a4 in tQWorkerThreadFp (worker=0x55f56a01ef90) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tworker.c:82 #6 0x00007f035db88ea5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f035d4a596d in clone () from /lib64/libc.so.6
Thread 17 (Thread 0x7f03397fa700 (LWP 17339)): #0 0x00007f035db8eb3b in do_futex_wait.constprop.1 () from /lib64/libpthread.so.0 #1 0x00007f035db8ebcf in __new_sem_wait_slow.constprop.0 () from /lib64/libpthread.so.0 #2 0x00007f035db8ec6b in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0 #3 0x000055f56726becb in tsem_wait (sem=0x7f033c121458) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSemaphore.c:513 #4 0x000055f567258328 in taosReadAllQitemsFromQset (qset=0x7f033c121420, qall=0x7f033c121700, qinfo=0x7f03397f9ee0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tqueue.c:458 #5 0x000055f567262081 in tWWorkerThreadFp (worker=0x55f56a04b360) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tworker.c:208 #6 0x00007f035db88ea5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f035d4a596d in clone () from /lib64/libc.so.6
Thread 16 (Thread 0x7f033affd700 (LWP 17334)): #0 0x00007f035db8eb3b in do_futex_wait.constprop.1 () from /lib64/libpthread.so.0 #1 0x00007f035db8ebcf in __new_sem_wait_slow.constprop.0 () from /lib64/libpthread.so.0 #2 0x00007f035db8ec6b in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0 #3 0x000055f56726becb in tsem_wait (sem=0x7f033c1126e8) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSemaphore.c:513 #4 0x000055f56725bb93 in taosProcessSchedQueue (scheduler=0x7f033c1126c0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tsched.c:116 #5 0x00007f035db88ea5 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f035d4a596d in clone () from /lib64/libc.so.6
Thread 15 (Thread 0x7f0350846700 (LWP 17322)): #0 0x00007f035db8eb3b in do_futex_wait.constprop.1 () from /lib64/libpthread.so.0 #1 0x00007f035db8ebcf in __new_sem_wait_slow.constprop.0 () from /lib64/libpthread.so.0 #2 0x00007f035db8ec6b in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0 #3 0x000055f56726becb in tsem_wait (sem=0x55f56a049f98) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSemaphore.c:513 #4 0x000055f56725bb93 in taosProcessSchedQueue (scheduler=0x55f56a049f70) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tsched.c:116 #5 0x00007f035db88ea5 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f035d4a596d in clone () from /lib64/libc.so.6
Thread 14 (Thread 0x7f0326fd5700 (LWP 17376)): #0 0x00007f035db8eb3b in do_futex_wait.constprop.1 () from /lib64/libpthread.so.0 #1 0x00007f035db8ebcf in __new_sem_wait_slow.constprop.0 () from /lib64/libpthread.so.0 #2 0x00007f035db8ec6b in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0 #3 0x000055f56726becb in tsem_wait (sem=0x55f56a04b208) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSemaphore.c:513 #4 0x000055f56725810a in taosReadQitemFromQset (qset=0x55f56a04b1d0, ppItem=0x7f0326fd4ed0, qinfo=0x7f0326fd4ee0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tqueue.c:414 #5 0x000055f5672618a4 in tQWorkerThreadFp (worker=0x55f56a04b270) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tworker.c:82 #6 0x00007f035db88ea5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f035d4a596d in clone () from /lib64/libc.so.6
Thread 13 (Thread 0x7f03347f0700 (LWP 17349)): #0 0x00007f035db8eb3b in do_futex_wait.constprop.1 () from /lib64/libpthread.so.0 #1 0x00007f035db8ebcf in __new_sem_wait_slow.constprop.0 () from /lib64/libpthread.so.0 #2 0x00007f035db8ec6b in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0 #3 0x000055f56726becb in tsem_wait (sem=0x55f56a04ae88) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSemaphore.c:513 #4 0x000055f56725810a in taosReadQitemFromQset (qset=0x55f56a04ae50, ppItem=0x7f03347efed0, qinfo=0x7f03347efee0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tqueue.c:414 #5 0x000055f5672618a4 in tQWorkerThreadFp (worker=0x55f56a04af68) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tworker.c:82 #6 0x00007f035db88ea5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f035d4a596d in clone () from /lib64/libc.so.6
Thread 12 (Thread 0x7f035304b700 (LWP 17316)): #0 0x00007f035d4a5f43 in epoll_wait () from /lib64/libc.so.6 #1 0x000055f5671ada07 in uv__io_poll (loop=0x55f56a0046f0, timeout=-1) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/contrib/libuv/src/unix/epoll.c:236 #2 0x000055f567198470 in uv_run (loop=0x55f56a0046f0, mode=UV_RUN_DEFAULT) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/contrib/libuv/src/unix/core.c:406 #3 0x000055f567184219 in transAcceptThread (arg=0x55f56a0040f0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/libs/transport/src/transSvr.c:742 #4 0x00007f035db88ea5 in start_thread () from /lib64/libpthread.so.0 #5 0x00007f035d4a596d in clone () from /lib64/libc.so.6
Thread 11 (Thread 0x7f03297da700 (LWP 17371)): #0 0x00007f035db8eb3b in do_futex_wait.constprop.1 () from /lib64/libpthread.so.0 #1 0x00007f035db8ebcf in __new_sem_wait_slow.constprop.0 () from /lib64/libpthread.so.0 #2 0x00007f035db8ec6b in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0 #3 0x000055f56726becb in tsem_wait (sem=0x55f56a04ae88) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSemaphore.c:513 #4 0x000055f56725810a in taosReadQitemFromQset (qset=0x55f56a04ae50, ppItem=0x7f03297d9ed0, qinfo=0x7f03297d9ee0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tqueue.c:414 #5 0x000055f5672618a4 in tQWorkerThreadFp (worker=0x55f56a04b178) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tworker.c:82 #6 0x00007f035db88ea5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f035d4a596d in clone () from /lib64/libc.so.6
Thread 10 (Thread 0x7f035e2a4740 (LWP 17310)):
#0 0x00007f035d46c85d in nanosleep () from /lib64/libc.so.6
#1 0x00007f035d49d134 in usleep () from /lib64/libc.so.6
#2 0x000055f56726c237 in taosMsleep (ms=100) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSleep.c:37
#3 0x000055f566e37db5 in dmRunDnode (pDnode=0x55f5675a7420
Thread 9 (Thread 0x7f032c7e0700 (LWP 17365)): #0 0x00007f035db8eb3b in do_futex_wait.constprop.1 () from /lib64/libpthread.so.0 #1 0x00007f035db8ebcf in __new_sem_wait_slow.constprop.0 () from /lib64/libpthread.so.0 #2 0x00007f035db8ec6b in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0 #3 0x000055f56726becb in tsem_wait (sem=0x55f56a04ae88) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSemaphore.c:513 #4 0x000055f56725810a in taosReadQitemFromQset (qset=0x55f56a04ae50, ppItem=0x7f032c7dfed0, qinfo=0x7f032c7dfee0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tqueue.c:414 #5 0x000055f5672618a4 in tQWorkerThreadFp (worker=0x55f56a04b0e8) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tworker.c:82 #6 0x00007f035db88ea5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f035d4a596d in clone () from /lib64/libc.so.6
Thread 8 (Thread 0x7f032a7dc700 (LWP 17369)): #0 0x00007f035db8eb3b in do_futex_wait.constprop.1 () from /lib64/libpthread.so.0 #1 0x00007f035db8ebcf in __new_sem_wait_slow.constprop.0 () from /lib64/libpthread.so.0 #2 0x00007f035db8ec6b in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0 #3 0x000055f56726becb in tsem_wait (sem=0x55f56a04ae88) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSemaphore.c:513 #4 0x000055f56725810a in taosReadQitemFromQset (qset=0x55f56a04ae50, ppItem=0x7f032a7dbed0, qinfo=0x7f032a7dbee0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tqueue.c:414 #5 0x000055f5672618a4 in tQWorkerThreadFp (worker=0x55f56a04b148) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tworker.c:82 #6 0x00007f035db88ea5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f035d4a596d in clone () from /lib64/libc.so.6
Thread 7 (Thread 0x7f032b7de700 (LWP 17367)): #0 0x00007f035db8eb3b in do_futex_wait.constprop.1 () from /lib64/libpthread.so.0 #1 0x00007f035db8ebcf in __new_sem_wait_slow.constprop.0 () from /lib64/libpthread.so.0 #2 0x00007f035db8ec6b in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0 #3 0x000055f56726becb in tsem_wait (sem=0x55f56a04ae88) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSemaphore.c:513 #4 0x000055f56725810a in taosReadQitemFromQset (qset=0x55f56a04ae50, ppItem=0x7f032b7dded0, qinfo=0x7f032b7ddee0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tqueue.c:414 #5 0x000055f5672618a4 in tQWorkerThreadFp (worker=0x55f56a04b118) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tworker.c:82 #6 0x00007f035db88ea5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f035d4a596d in clone () from /lib64/libc.so.6
Thread 6 (Thread 0x7f0327fd7700 (LWP 17374)): #0 0x00007f035db8eb3b in do_futex_wait.constprop.1 () from /lib64/libpthread.so.0 #1 0x00007f035db8ebcf in __new_sem_wait_slow.constprop.0 () from /lib64/libpthread.so.0 #2 0x00007f035db8ec6b in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0 #3 0x000055f56726becb in tsem_wait (sem=0x55f56a04b208) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSemaphore.c:513 #4 0x000055f56725810a in taosReadQitemFromQset (qset=0x55f56a04b1d0, ppItem=0x7f0327fd6ed0, qinfo=0x7f0327fd6ee0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tqueue.c:414 #5 0x000055f5672618a4 in tQWorkerThreadFp (worker=0x55f56a04b240) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tworker.c:82 #6 0x00007f035db88ea5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f035d4a596d in clone () from /lib64/libc.so.6
Thread 5 (Thread 0x7f032cfe1700 (LWP 17364)): #0 0x00007f035db8eb3b in do_futex_wait.constprop.1 () from /lib64/libpthread.so.0 #1 0x00007f035db8ebcf in __new_sem_wait_slow.constprop.0 () from /lib64/libpthread.so.0 #2 0x00007f035db8ec6b in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0 #3 0x000055f56726becb in tsem_wait (sem=0x55f56a04ae88) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSemaphore.c:513 #4 0x000055f56725810a in taosReadQitemFromQset (qset=0x55f56a04ae50, ppItem=0x7f032cfe0ed0, qinfo=0x7f032cfe0ee0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tqueue.c:414 #5 0x000055f5672618a4 in tQWorkerThreadFp (worker=0x55f56a04b0d0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tworker.c:82 #6 0x00007f035db88ea5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f035d4a596d in clone () from /lib64/libc.so.6
Thread 4 (Thread 0x7f032afdd700 (LWP 17368)): #0 0x00007f035db8eb3b in do_futex_wait.constprop.1 () from /lib64/libpthread.so.0 #1 0x00007f035db8ebcf in __new_sem_wait_slow.constprop.0 () from /lib64/libpthread.so.0 #2 0x00007f035db8ec6b in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0 #3 0x000055f56726becb in tsem_wait (sem=0x55f56a04ae88) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSemaphore.c:513 #4 0x000055f56725810a in taosReadQitemFromQset (qset=0x55f56a04ae50, ppItem=0x7f032afdced0, qinfo=0x7f032afdcee0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tqueue.c:414 #5 0x000055f5672618a4 in tQWorkerThreadFp (worker=0x55f56a04b130) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tworker.c:82 #6 0x00007f035db88ea5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f035d4a596d in clone () from /lib64/libc.so.6
Thread 3 (Thread 0x7f032bfdf700 (LWP 17366)): #0 0x00007f035db8eb3b in do_futex_wait.constprop.1 () from /lib64/libpthread.so.0 #1 0x00007f035db8ebcf in __new_sem_wait_slow.constprop.0 () from /lib64/libpthread.so.0 #2 0x00007f035db8ec6b in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0 #3 0x000055f56726becb in tsem_wait (sem=0x55f56a04ae88) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSemaphore.c:513 #4 0x000055f56725810a in taosReadQitemFromQset (qset=0x55f56a04ae50, ppItem=0x7f032bfdeed0, qinfo=0x7f032bfdeee0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tqueue.c:414 #5 0x000055f5672618a4 in tQWorkerThreadFp (worker=0x55f56a04b100) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tworker.c:82 #6 0x00007f035db88ea5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f035d4a596d in clone () from /lib64/libc.so.6
Thread 2 (Thread 0x7f0343fff700 (LWP 17379)): #0 0x00007f035d4a5f43 in epoll_wait () from /lib64/libc.so.6 #1 0x000055f5671ada07 in uv__io_poll (loop=0x55f5675af208 <gUdfdProxy+4168>, timeout=-1) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/contrib/libuv/src/unix/epoll.c:236 #2 0x000055f567198470 in uv_run (loop=0x55f5675af208 <gUdfdProxy+4168>, mode=UV_RUN_DEFAULT) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/contrib/libuv/src/unix/core.c:406 #3 0x000055f567071917 in constructUdfService (argsThread=0x55f5675ae1c0 <gUdfdProxy>) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/libs/function/src/tudf.c:1575 #4 0x00007f035db88ea5 in start_thread () from /lib64/libpthread.so.0 #5 0x00007f035d4a596d in clone () from /lib64/libc.so.6
Thread 1 (Thread 0x7f032d7e2700 (LWP 17363)): #0 0x000055f566f1aabf in getTableDelIdx (pDelFReader=0x7f02a1993160, suid=8481409855040702563, uid=2968890740801013113, pDelIdx=0x7f032d7e11b0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/dnode/vnode/src/tsdb/tsdbCache.c:404 #1 0x000055f566f1b90e in nextRowIterOpen (pIter=0x7f032d7e12a0, uid=2968890740801013113, pTsdb=0x7f033c11ce10, pTSchema=0x7f02a1a41450) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/dnode/vnode/src/tsdb/tsdbCache.c:875 #2 0x000055f566f1c65e in mergeLastRow (uid=2968890740801013113, pTsdb=0x7f033c11ce10, dup=0x7f032d7e172b, ppRow=0x7f032d7e1738) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/dnode/vnode/src/tsdb/tsdbCache.c:1037 #3 0x000055f566f1d258 in tsdbCacheGetLastrowH (pCache=0x7f033c139e20, uid=2968890740801013113, pTsdb=0x7f033c11ce10, handle=0x7f032d7e1818) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/dnode/vnode/src/tsdb/tsdbCache.c:1226 #4 0x000055f5670bc10f in doExtractCacheRow (pr=0x7f02a1a40e90, lruCache=0x7f033c139e20, uid=2968890740801013113, pRow=0x7f032d7e1820, h=0x7f032d7e1818) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/dnode/vnode/src/tsdb/tsdbCacheRead.c:123 #5 0x000055f5670bc41b in tsdbRetrieveCacheRows (pReader=0x7f02a1a40e90, pResBlock=0x7f02a1ab3ad0, slotIds=0x7f02a1a9c9c0, pTableUidList=0x7f02a1aa0380) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/dnode/vnode/src/tsdb/tsdbCacheRead.c:196 #6 0x000055f566fa9514 in doScanCache (pOperator=0x7f02a1a9d5b0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/libs/executor/src/cachescanoperator.c:124 #7 0x000055f566f69667 in doOpenAggregateOptr (pOperator=0x7f02a193c480) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/libs/executor/src/executorimpl.c:2659 #8 0x000055f566f698e9 in getAggregateResult (pOperator=0x7f02a193c480) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/libs/executor/src/executorimpl.c:2703 #9 0x000055f566f5fa35 in qExecTaskOpt (tinfo=0x7f02a1990ab0, pResList=0x7f02a1ab39c0, useconds=0x7f032d7e1b58) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/libs/executor/src/executor.c:496 #10 0x000055f566fbce6f in qwExecTask (mgmt=0x7f033c11f770, sId=18638118865551668, qId=3696492561274445034, tId=925, rId=926, eId=0, ctx=0x7f0304006948, queryStop=0x0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/libs/qworker/src/qworker.c:91 #11 0x000055f566fc0849 in qwProcessQuery (mgmt=0x7f033c11f770, sId=18638118865551668, qId=3696492561274445034, tId=925, rId=926, eId=0, qwMsg=0x7f032d7e1cd0, sql=0x0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/libs/qworker/src/qworker.c:592 #12 0x000055f566fb5adc in qWorkerProcessQueryMsg (node=0x7f032d7e1da0, qWorkerMgmt=0x7f033c11f770, pMsg=0x7f0304012bc0, ts=0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/libs/qworker/src/qwMsg.c:393 #13 0x000055f566ede549 in vnodeProcessQueryMsg (pVnode=0x7f033c0008c0, pMsg=0x7f0304012bc0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/dnode/vnode/src/vnd/vnodeSvr.c:301 #14 0x000055f566e4c431 in vmProcessQueryQueue (pInfo=0x7f032d7e1ee0, pMsg=0x7f0304012bc0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/dnode/mgmt/mgmt_vnode/src/vmWorker.c:72 #15 0x000055f56726193e in tQWorkerThreadFp (worker=0x55f56a04b0b8) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tworker.c:90 #16 0x00007f035db88ea5 in start_thread () from /lib64/libpthread.so.0 #17 0x00007f035d4a596d in clone () from /lib64/libc.so.6 No core file now.
程序是启动了几个进程连接后，往数据库表插入行情数据， 单节点，程序运行没问题，3个节点组成的集群，集群会崩溃 CREATE DATABASE bh_stock_data KEEP 3650 DURATION 10 BUFFER 48 VGROUPS 2 CACHEMODEL 'both' REPLICA 1;
单节点也挂了 GNU gdb (GDB) Red Hat Enterprise Linux 7.6.1-120.el7 Copyright (C) 2013 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later http://gnu.org/licenses/gpl.html This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-redhat-linux-gnu". For bug reporting instructions, please see: http://www.gnu.org/software/gdb/bugs/... Reading symbols from /usr/local/taos/bin/taosd...done. [New LWP 17169] [New LWP 17174] [New LWP 17175] [New LWP 17183] [New LWP 17182] [New LWP 17177] [New LWP 17208] [New LWP 17173] [New LWP 17201] [New LWP 17176] [New LWP 17215] [New LWP 17184] [New LWP 17179] [New LWP 17185] [New LWP 17178] [New LWP 17189] [New LWP 17180] [New LWP 17187] [New LWP 17213] [New LWP 17190] [New LWP 17214] [New LWP 17188] [New LWP 17219] [New LWP 17192] [New LWP 17193] [New LWP 17172] [New LWP 17191] [New LWP 17198] [New LWP 17195] [New LWP 17203] [New LWP 17209] [New LWP 17239] [New LWP 17229] [New LWP 17210] [New LWP 17241] [New LWP 17224] [New LWP 17231] [New LWP 17240] [New LWP 17207] [New LWP 17196] [New LWP 17232] [New LWP 17243] [New LWP 17226] [New LWP 17199] [New LWP 17222] [New LWP 17227] [New LWP 17233] [New LWP 17220] [New LWP 17242] [New LWP 17225] [New LWP 17221] [New LWP 17211] [New LWP 17204] [New LWP 17234] [New LWP 17245] [New LWP 17228] [New LWP 17217] [New LWP 17194] [New LWP 17230] [New LWP 17235] [New LWP 17244] [New LWP 17200] [New LWP 17223] [New LWP 17212] [New LWP 17236] [New LWP 17247] [New LWP 17237] [New LWP 17238] [New LWP 17246] [New LWP 17216] [New LWP 17249] [New LWP 17251] [New LWP 17218] [New LWP 17248] [New LWP 17250] [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib64/libthread_db.so.1". Core was generated by `/usr/bin/taosd'. Program terminated with signal 6, Aborted. #0 0x00007f16b3d04387 in raise () from /lib64/libc.so.6 Copying output to gdb.txt.
Thread 75 (Thread 0x7f166ffd7700 (LWP 17250)): #0 0x00007f16b44b5b3b in do_futex_wait.constprop.1 () from /lib64/libpthread.so.0 #1 0x00007f16b44b5bcf in __new_sem_wait_slow.constprop.0 () from /lib64/libpthread.so.0 #2 0x00007f16b44b5c6b in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0 #3 0x000055a00d2d1ecb in tsem_wait (sem=0x55a00ff24dd8) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSemaphore.c:513 #4 0x000055a00d2be10a in taosReadQitemFromQset (qset=0x55a00ff24da0, ppItem=0x7f166ffd6ed0, qinfo=0x7f166ffd6ee0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tqueue.c:414 #5 0x000055a00d2c78a4 in tQWorkerThreadFp (worker=0x55a00ff24e58) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tworker.c:82 #6 0x00007f16b44afea5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f16b3dccb0d in clone () from /lib64/libc.so.6
Thread 74 (Thread 0x7f1670fd9700 (LWP 17248)): #0 0x00007f16b44b5b3b in do_futex_wait.constprop.1 () from /lib64/libpthread.so.0 #1 0x00007f16b44b5bcf in __new_sem_wait_slow.constprop.0 () from /lib64/libpthread.so.0 #2 0x00007f16b44b5c6b in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0 #3 0x000055a00d2d1ecb in tsem_wait (sem=0x55a00ff24dd8) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSemaphore.c:513 #4 0x000055a00d2be10a in taosReadQitemFromQset (qset=0x55a00ff24da0, ppItem=0x7f1670fd8ed0, qinfo=0x7f1670fd8ee0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tqueue.c:414 #5 0x000055a00d2c78a4 in tQWorkerThreadFp (worker=0x55a00ff24e28) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tworker.c:82 #6 0x00007f16b44afea5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f16b3dccb0d in clone () from /lib64/libc.so.6
Thread 73 (Thread 0x7f167fff7700 (LWP 17218)): #0 0x00007f16b44b5b3b in do_futex_wait.constprop.1 () from /lib64/libpthread.so.0 #1 0x00007f16b44b5bcf in __new_sem_wait_slow.constprop.0 () from /lib64/libpthread.so.0 #2 0x00007f16b44b5c6b in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0 #3 0x000055a00d2d1ecb in tsem_wait (sem=0x55a00ff24a58) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSemaphore.c:513 #4 0x000055a00d2be10a in taosReadQitemFromQset (qset=0x55a00ff24a20, ppItem=0x7f167fff6ed0, qinfo=0x7f167fff6ee0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tqueue.c:414 #5 0x000055a00d2c78a4 in tQWorkerThreadFp (worker=0x55a00ff24ad8) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tworker.c:82 #6 0x00007f16b44afea5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f16b3dccb0d in clone () from /lib64/libc.so.6
Thread 72 (Thread 0x7f166f7d6700 (LWP 17251)): #0 0x00007f16b44b5b3b in do_futex_wait.constprop.1 () from /lib64/libpthread.so.0 #1 0x00007f16b44b5bcf in __new_sem_wait_slow.constprop.0 () from /lib64/libpthread.so.0 #2 0x00007f16b44b5c6b in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0 #3 0x000055a00d2d1ecb in tsem_wait (sem=0x7f16842c9ba8) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSemaphore.c:513 #4 0x000055a00d2be328 in taosReadAllQitemsFromQset (qset=0x7f16842c9b70, qall=0x7f16842c9be0, qinfo=0x7f166f7d5ee0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tqueue.c:458 #5 0x000055a00d2c8081 in tWWorkerThreadFp (worker=0x55a00ff24e80) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tworker.c:208 #6 0x00007f16b44afea5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f16b3dccb0d in clone () from /lib64/libc.so.6
Thread 71 (Thread 0x7f16707d8700 (LWP 17249)): #0 0x00007f16b44b5b3b in do_futex_wait.constprop.1 () from /lib64/libpthread.so.0 #1 0x00007f16b44b5bcf in __new_sem_wait_slow.constprop.0 () from /lib64/libpthread.so.0 #2 0x00007f16b44b5c6b in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0 #3 0x000055a00d2d1ecb in tsem_wait (sem=0x55a00ff24dd8) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSemaphore.c:513 #4 0x000055a00d2be10a in taosReadQitemFromQset (qset=0x55a00ff24da0, ppItem=0x7f16707d7ed0, qinfo=0x7f16707d7ee0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tqueue.c:414 #5 0x000055a00d2c78a4 in tQWorkerThreadFp (worker=0x55a00ff24e40) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tworker.c:82 #6 0x00007f16b44afea5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f16b3dccb0d in clone () from /lib64/libc.so.6
Thread 70 (Thread 0x7f1680ff9700 (LWP 17216)): #0 0x00007f16b44b5b3b in do_futex_wait.constprop.1 () from /lib64/libpthread.so.0 #1 0x00007f16b44b5bcf in __new_sem_wait_slow.constprop.0 () from /lib64/libpthread.so.0 #2 0x00007f16b44b5c6b in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0 #3 0x000055a00d2d1ecb in tsem_wait (sem=0x55a00ff24a58) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSemaphore.c:513 #4 0x000055a00d2be10a in taosReadQitemFromQset (qset=0x55a00ff24a20, ppItem=0x7f1680ff8ed0, qinfo=0x7f1680ff8ee0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tqueue.c:414 #5 0x000055a00d2c78a4 in tQWorkerThreadFp (worker=0x55a00ff24aa8) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tworker.c:82 #6 0x00007f16b44afea5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f16b3dccb0d in clone () from /lib64/libc.so.6
Thread 69 (Thread 0x7f1671fdb700 (LWP 17246)): #0 0x00007f16b44b5b3b in do_futex_wait.constprop.1 () from /lib64/libpthread.so.0 #1 0x00007f16b44b5bcf in __new_sem_wait_slow.constprop.0 () from /lib64/libpthread.so.0 #2 0x00007f16b44b5c6b in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0 #3 0x000055a00d2d1ecb in tsem_wait (sem=0x55a00ff24a58) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSemaphore.c:513 #4 0x000055a00d2be10a in taosReadQitemFromQset (qset=0x55a00ff24a20, ppItem=0x7f1671fdaed0, qinfo=0x7f1671fdaee0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tqueue.c:414 #5 0x000055a00d2c78a4 in tQWorkerThreadFp (worker=0x55a00ff24d78) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tworker.c:82 #6 0x00007f16b44afea5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f16b3dccb0d in clone () from /lib64/libc.so.6
Thread 68 (Thread 0x7f1675fe3700 (LWP 17238)): #0 0x00007f16b44b5b3b in do_futex_wait.constprop.1 () from /lib64/libpthread.so.0 #1 0x00007f16b44b5bcf in __new_sem_wait_slow.constprop.0 () from /lib64/libpthread.so.0 #2 0x00007f16b44b5c6b in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0 #3 0x000055a00d2d1ecb in tsem_wait (sem=0x55a00ff24a58) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSemaphore.c:513 #4 0x000055a00d2be10a in taosReadQitemFromQset (qset=0x55a00ff24a20, ppItem=0x7f1675fe2ed0, qinfo=0x7f1675fe2ee0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tqueue.c:414 #5 0x000055a00d2c78a4 in tQWorkerThreadFp (worker=0x55a00ff24cb8) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tworker.c:82 #6 0x00007f16b44afea5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f16b3dccb0d in clone () from /lib64/libc.so.6
Thread 67 (Thread 0x7f16767e4700 (LWP 17237)): #0 0x00007f16b44b5b3b in do_futex_wait.constprop.1 () from /lib64/libpthread.so.0 #1 0x00007f16b44b5bcf in __new_sem_wait_slow.constprop.0 () from /lib64/libpthread.so.0 #2 0x00007f16b44b5c6b in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0 #3 0x000055a00d2d1ecb in tsem_wait (sem=0x55a00ff24a58) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSemaphore.c:513 #4 0x000055a00d2be10a in taosReadQitemFromQset (qset=0x55a00ff24a20, ppItem=0x7f16767e3ed0, qinfo=0x7f16767e3ee0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tqueue.c:414 #5 0x000055a00d2c78a4 in tQWorkerThreadFp (worker=0x55a00ff24ca0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tworker.c:82 #6 0x00007f16b44afea5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f16b3dccb0d in clone () from /lib64/libc.so.6
Thread 66 (Thread 0x7f16717da700 (LWP 17247)): #0 0x00007f16b44b5b3b in do_futex_wait.constprop.1 () from /lib64/libpthread.so.0 #1 0x00007f16b44b5bcf in __new_sem_wait_slow.constprop.0 () from /lib64/libpthread.so.0 #2 0x00007f16b44b5c6b in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0 #3 0x000055a00d2d1ecb in tsem_wait (sem=0x55a00ff24dd8) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSemaphore.c:513 #4 0x000055a00d2be10a in taosReadQitemFromQset (qset=0x55a00ff24da0, ppItem=0x7f16717d9ed0, qinfo=0x7f16717d9ee0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tqueue.c:414 #5 0x000055a00d2c78a4 in tQWorkerThreadFp (worker=0x55a00ff24e10) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tworker.c:82 #6 0x00007f16b44afea5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f16b3dccb0d in clone () from /lib64/libc.so.6
Thread 65 (Thread 0x7f1676fe5700 (LWP 17236)): #0 0x00007f16b44b5b3b in do_futex_wait.constprop.1 () from /lib64/libpthread.so.0 #1 0x00007f16b44b5bcf in __new_sem_wait_slow.constprop.0 () from /lib64/libpthread.so.0 #2 0x00007f16b44b5c6b in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0 #3 0x000055a00d2d1ecb in tsem_wait (sem=0x55a00ff24a58) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSemaphore.c:513 #4 0x000055a00d2be10a in taosReadQitemFromQset (qset=0x55a00ff24a20, ppItem=0x7f1676fe4ed0, qinfo=0x7f1676fe4ee0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tqueue.c:414 #5 0x000055a00d2c78a4 in tQWorkerThreadFp (worker=0x55a00ff24c88) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tworker.c:82 #6 0x00007f16b44afea5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f16b3dccb0d in clone () from /lib64/libc.so.6
Thread 64 (Thread 0x7f1694ff9700 (LWP 17212)): #0 0x00007f16b44b5b3b in do_futex_wait.constprop.1 () from /lib64/libpthread.so.0 #1 0x00007f16b44b5bcf in __new_sem_wait_slow.constprop.0 () from /lib64/libpthread.so.0 #2 0x00007f16b44b5c6b in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0 #3 0x000055a00d2d1ecb in tsem_wait (sem=0x7f16842c3fd8) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSemaphore.c:513 #4 0x000055a00d2be328 in taosReadAllQitemsFromQset (qset=0x7f16842c3fa0, qall=0x7f16841fa060, qinfo=0x7f1694ff8ee0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tqueue.c:458 #5 0x000055a00d2c8081 in tWWorkerThreadFp (worker=0x55a00ff24f30) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tworker.c:208 #6 0x00007f16b44afea5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f16b3dccb0d in clone () from /lib64/libc.so.6
Thread 63 (Thread 0x7f167d7f2700 (LWP 17223)): #0 0x00007f16b44b5b3b in do_futex_wait.constprop.1 () from /lib64/libpthread.so.0 #1 0x00007f16b44b5bcf in __new_sem_wait_slow.constprop.0 () from /lib64/libpthread.so.0 #2 0x00007f16b44b5c6b in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0 #3 0x000055a00d2d1ecb in tsem_wait (sem=0x55a00ff24a58) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSemaphore.c:513 #4 0x000055a00d2be10a in taosReadQitemFromQset (qset=0x55a00ff24a20, ppItem=0x7f167d7f1ed0, qinfo=0x7f167d7f1ee0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tqueue.c:414 #5 0x000055a00d2c78a4 in tQWorkerThreadFp (worker=0x55a00ff24b50) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tworker.c:82 #6 0x00007f16b44afea5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f16b3dccb0d in clone () from /lib64/libc.so.6
Thread 62 (Thread 0x7f1696ffd700 (LWP 17200)): #0 0x00007f16b44b3a35 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x000055a00d2d69f0 in taosThreadCondWait (cond=0x55a00d61f0f8 <vnodeGlobal+56>, mutex=0x55a00d61f0d0 <vnodeGlobal+16>) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osThread.c:101 #2 0x000055a00cf424f3 in loop (arg=0x0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/dnode/vnode/src/vnd/vnodeModule.c:148 #3 0x00007f16b44afea5 in start_thread () from /lib64/libpthread.so.0 #4 0x00007f16b3dccb0d in clone () from /lib64/libc.so.6
Thread 61 (Thread 0x7f1672fdd700 (LWP 17244)): #0 0x00007f16b44b5b3b in do_futex_wait.constprop.1 () from /lib64/libpthread.so.0 #1 0x00007f16b44b5bcf in __new_sem_wait_slow.constprop.0 () from /lib64/libpthread.so.0 #2 0x00007f16b44b5c6b in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0 #3 0x000055a00d2d1ecb in tsem_wait (sem=0x55a00ff24a58) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSemaphore.c:513 #4 0x000055a00d2be10a in taosReadQitemFromQset (qset=0x55a00ff24a20, ppItem=0x7f1672fdced0, qinfo=0x7f1672fdcee0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tqueue.c:414 #5 0x000055a00d2c78a4 in tQWorkerThreadFp (worker=0x55a00ff24d48) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tworker.c:82 #6 0x00007f16b44afea5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f16b3dccb0d in clone () from /lib64/libc.so.6
Thread 60 (Thread 0x7f16777e6700 (LWP 17235)): #0 0x00007f16b44b5b3b in do_futex_wait.constprop.1 () from /lib64/libpthread.so.0 #1 0x00007f16b44b5bcf in __new_sem_wait_slow.constprop.0 () from /lib64/libpthread.so.0 #2 0x00007f16b44b5c6b in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0 #3 0x000055a00d2d1ecb in tsem_wait (sem=0x55a00ff24a58) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSemaphore.c:513 #4 0x000055a00d2be10a in taosReadQitemFromQset (qset=0x55a00ff24a20, ppItem=0x7f16777e5ed0, qinfo=0x7f16777e5ee0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tqueue.c:414 #5 0x000055a00d2c78a4 in tQWorkerThreadFp (worker=0x55a00ff24c70) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tworker.c:82 #6 0x00007f16b44afea5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f16b3dccb0d in clone () from /lib64/libc.so.6
Thread 59 (Thread 0x7f1679feb700 (LWP 17230)): #0 0x00007f16b44b5b3b in do_futex_wait.constprop.1 () from /lib64/libpthread.so.0 #1 0x00007f16b44b5bcf in __new_sem_wait_slow.constprop.0 () from /lib64/libpthread.so.0 #2 0x00007f16b44b5c6b in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0 #3 0x000055a00d2d1ecb in tsem_wait (sem=0x55a00ff24a58) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSemaphore.c:513 #4 0x000055a00d2be10a in taosReadQitemFromQset (qset=0x55a00ff24a20, ppItem=0x7f1679feaed0, qinfo=0x7f1679feaee0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tqueue.c:414 #5 0x000055a00d2c78a4 in tQWorkerThreadFp (worker=0x55a00ff24bf8) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tworker.c:82 #6 0x00007f16b44afea5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f16b3dccb0d in clone () from /lib64/libc.so.6
Thread 58 (Thread 0x7f169dffb700 (LWP 17194)): #0 0x00007f16b44b5b3b in do_futex_wait.constprop.1 () from /lib64/libpthread.so.0 #1 0x00007f16b44b5bcf in __new_sem_wait_slow.constprop.0 () from /lib64/libpthread.so.0 #2 0x00007f16b44b5c6b in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0 #3 0x000055a00d2d1ecb in tsem_wait (sem=0x55a01009e0f8) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSemaphore.c:513 #4 0x000055a00d2be10a in taosReadQitemFromQset (qset=0x55a01009e0c0, ppItem=0x7f169dffaed0, qinfo=0x7f169dffaee0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tqueue.c:414 #5 0x000055a00d2c78a4 in tQWorkerThreadFp (worker=0x55a01009e130) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tworker.c:82 #6 0x00007f16b44afea5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f16b3dccb0d in clone () from /lib64/libc.so.6
Thread 57 (Thread 0x7f16807f8700 (LWP 17217)): #0 0x00007f16b44b5b3b in do_futex_wait.constprop.1 () from /lib64/libpthread.so.0 #1 0x00007f16b44b5bcf in __new_sem_wait_slow.constprop.0 () from /lib64/libpthread.so.0 #2 0x00007f16b44b5c6b in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0 #3 0x000055a00d2d1ecb in tsem_wait (sem=0x55a00ff24a58) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSemaphore.c:513 #4 0x000055a00d2be10a in taosReadQitemFromQset (qset=0x55a00ff24a20, ppItem=0x7f16807f7ed0, qinfo=0x7f16807f7ee0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tqueue.c:414 #5 0x000055a00d2c78a4 in tQWorkerThreadFp (worker=0x55a00ff24ac0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tworker.c:82 #6 0x00007f16b44afea5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f16b3dccb0d in clone () from /lib64/libc.so.6
Thread 56 (Thread 0x7f167afed700 (LWP 17228)): #0 0x00007f16b44b5b3b in do_futex_wait.constprop.1 () from /lib64/libpthread.so.0 #1 0x00007f16b44b5bcf in __new_sem_wait_slow.constprop.0 () from /lib64/libpthread.so.0 #2 0x00007f16b44b5c6b in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0 #3 0x000055a00d2d1ecb in tsem_wait (sem=0x55a00ff24a58) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSemaphore.c:513 #4 0x000055a00d2be10a in taosReadQitemFromQset (qset=0x55a00ff24a20, ppItem=0x7f167afeced0, qinfo=0x7f167afecee0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tqueue.c:414 #5 0x000055a00d2c78a4 in tQWorkerThreadFp (worker=0x55a00ff24bc8) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tworker.c:82 #6 0x00007f16b44afea5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f16b3dccb0d in clone () from /lib64/libc.so.6
Thread 55 (Thread 0x7f16727dc700 (LWP 17245)): #0 0x00007f16b44b5b3b in do_futex_wait.constprop.1 () from /lib64/libpthread.so.0 #1 0x00007f16b44b5bcf in __new_sem_wait_slow.constprop.0 () from /lib64/libpthread.so.0 #2 0x00007f16b44b5c6b in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0 #3 0x000055a00d2d1ecb in tsem_wait (sem=0x55a00ff24a58) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSemaphore.c:513 #4 0x000055a00d2be10a in taosReadQitemFromQset (qset=0x55a00ff24a20, ppItem=0x7f16727dbed0, qinfo=0x7f16727dbee0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tqueue.c:414 #5 0x000055a00d2c78a4 in tQWorkerThreadFp (worker=0x55a00ff24d60) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tworker.c:82 #6 0x00007f16b44afea5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f16b3dccb0d in clone () from /lib64/libc.so.6
Thread 54 (Thread 0x7f1677fe7700 (LWP 17234)): #0 0x00007f16b44b5b3b in do_futex_wait.constprop.1 () from /lib64/libpthread.so.0 #1 0x00007f16b44b5bcf in __new_sem_wait_slow.constprop.0 () from /lib64/libpthread.so.0 #2 0x00007f16b44b5c6b in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0 #3 0x000055a00d2d1ecb in tsem_wait (sem=0x55a00ff24a58) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSemaphore.c:513 #4 0x000055a00d2be10a in taosReadQitemFromQset (qset=0x55a00ff24a20, ppItem=0x7f1677fe6ed0, qinfo=0x7f1677fe6ee0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tqueue.c:414 #5 0x000055a00d2c78a4 in tQWorkerThreadFp (worker=0x55a00ff24c58) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tworker.c:82 #6 0x00007f16b44afea5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f16b3dccb0d in clone () from /lib64/libc.so.6
Thread 53 (Thread 0x7f16957fa700 (LWP 17204)): #0 0x00007f16b44b5b3b in do_futex_wait.constprop.1 () from /lib64/libpthread.so.0 #1 0x00007f16b44b5bcf in __new_sem_wait_slow.constprop.0 () from /lib64/libpthread.so.0 #2 0x00007f16b44b5c6b in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0 #3 0x000055a00d2d1ecb in tsem_wait (sem=0x55a00ff25cf8) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSemaphore.c:513 #4 0x000055a00d2be10a in taosReadQitemFromQset (qset=0x55a00ff25cc0, ppItem=0x7f16957f9ed0, qinfo=0x7f16957f9ee0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tqueue.c:414 #5 0x000055a00d2c78a4 in tQWorkerThreadFp (worker=0x55a00ff25d30) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tworker.c:82 #6 0x00007f16b44afea5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f16b3dccb0d in clone () from /lib64/libc.so.6
Thread 52 (Thread 0x7f1682ffd700 (LWP 17211)): #0 0x00007f16b44b5b3b in do_futex_wait.constprop.1 () from /lib64/libpthread.so.0 #1 0x00007f16b44b5bcf in __new_sem_wait_slow.constprop.0 () from /lib64/libpthread.so.0 #2 0x00007f16b44b5c6b in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0 #3 0x000055a00d2d1ecb in tsem_wait (sem=0x7f168c1126e8) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSemaphore.c:513 #4 0x000055a00d2c1b93 in taosProcessSchedQueue (scheduler=0x7f168c1126c0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tsched.c:116 #5 0x00007f16b44afea5 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f16b3dccb0d in clone () from /lib64/libc.so.6
Thread 51 (Thread 0x7f167e7f4700 (LWP 17221)): #0 0x00007f16b44b5b3b in do_futex_wait.constprop.1 () from /lib64/libpthread.so.0 #1 0x00007f16b44b5bcf in __new_sem_wait_slow.constprop.0 () from /lib64/libpthread.so.0 #2 0x00007f16b44b5c6b in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0 #3 0x000055a00d2d1ecb in tsem_wait (sem=0x55a00ff24a58) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSemaphore.c:513 #4 0x000055a00d2be10a in taosReadQitemFromQset (qset=0x55a00ff24a20, ppItem=0x7f167e7f3ed0, qinfo=0x7f167e7f3ee0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tqueue.c:414 #5 0x000055a00d2c78a4 in tQWorkerThreadFp (worker=0x55a00ff24b20) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tworker.c:82 #6 0x00007f16b44afea5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f16b3dccb0d in clone () from /lib64/libc.so.6
Thread 50 (Thread 0x7f167c7f0700 (LWP 17225)): #0 0x00007f16b44b5b3b in do_futex_wait.constprop.1 () from /lib64/libpthread.so.0 #1 0x00007f16b44b5bcf in __new_sem_wait_slow.constprop.0 () from /lib64/libpthread.so.0 #2 0x00007f16b44b5c6b in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0 #3 0x000055a00d2d1ecb in tsem_wait (sem=0x55a00ff24a58) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSemaphore.c:513 #4 0x000055a00d2be10a in taosReadQitemFromQset (qset=0x55a00ff24a20, ppItem=0x7f167c7efed0, qinfo=0x7f167c7efee0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tqueue.c:414 #5 0x000055a00d2c78a4 in tQWorkerThreadFp (worker=0x55a00ff24b80) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tworker.c:82 #6 0x00007f16b44afea5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f16b3dccb0d in clone () from /lib64/libc.so.6
Thread 49 (Thread 0x7f1673fdf700 (LWP 17242)): #0 0x00007f16b44b5b3b in do_futex_wait.constprop.1 () from /lib64/libpthread.so.0 #1 0x00007f16b44b5bcf in __new_sem_wait_slow.constprop.0 () from /lib64/libpthread.so.0 #2 0x00007f16b44b5c6b in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0 #3 0x000055a00d2d1ecb in tsem_wait (sem=0x55a00ff24a58) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSemaphore.c:513 #4 0x000055a00d2be10a in taosReadQitemFromQset (qset=0x55a00ff24a20, ppItem=0x7f1673fdeed0, qinfo=0x7f1673fdeee0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tqueue.c:414 #5 0x000055a00d2c78a4 in tQWorkerThreadFp (worker=0x55a00ff24d18) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tworker.c:82 #6 0x00007f16b44afea5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f16b3dccb0d in clone () from /lib64/libc.so.6
Thread 48 (Thread 0x7f167eff5700 (LWP 17220)): #0 0x00007f16b44b5b3b in do_futex_wait.constprop.1 () from /lib64/libpthread.so.0 #1 0x00007f16b44b5bcf in __new_sem_wait_slow.constprop.0 () from /lib64/libpthread.so.0 #2 0x00007f16b44b5c6b in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0 #3 0x000055a00d2d1ecb in tsem_wait (sem=0x55a00ff24a58) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSemaphore.c:513 #4 0x000055a00d2be10a in taosReadQitemFromQset (qset=0x55a00ff24a20, ppItem=0x7f167eff4ed0, qinfo=0x7f167eff4ee0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tqueue.c:414 #5 0x000055a00d2c78a4 in tQWorkerThreadFp (worker=0x55a00ff24b08) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tworker.c:82 #6 0x00007f16b44afea5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f16b3dccb0d in clone () from /lib64/libc.so.6
Thread 47 (Thread 0x7f16787e8700 (LWP 17233)): #0 0x00007f16b44b5b3b in do_futex_wait.constprop.1 () from /lib64/libpthread.so.0 #1 0x00007f16b44b5bcf in __new_sem_wait_slow.constprop.0 () from /lib64/libpthread.so.0 #2 0x00007f16b44b5c6b in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0 #3 0x000055a00d2d1ecb in tsem_wait (sem=0x55a00ff24a58) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSemaphore.c:513 #4 0x000055a00d2be10a in taosReadQitemFromQset (qset=0x55a00ff24a20, ppItem=0x7f16787e7ed0, qinfo=0x7f16787e7ee0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tqueue.c:414 #5 0x000055a00d2c78a4 in tQWorkerThreadFp (worker=0x55a00ff24c40) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tworker.c:82 #6 0x00007f16b44afea5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f16b3dccb0d in clone () from /lib64/libc.so.6
Thread 46 (Thread 0x7f167b7ee700 (LWP 17227)): #0 0x00007f16b44b5b3b in do_futex_wait.constprop.1 () from /lib64/libpthread.so.0 #1 0x00007f16b44b5bcf in __new_sem_wait_slow.constprop.0 () from /lib64/libpthread.so.0 #2 0x00007f16b44b5c6b in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0 #3 0x000055a00d2d1ecb in tsem_wait (sem=0x55a00ff24a58) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSemaphore.c:513 #4 0x000055a00d2be10a in taosReadQitemFromQset (qset=0x55a00ff24a20, ppItem=0x7f167b7eded0, qinfo=0x7f167b7edee0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tqueue.c:414 #5 0x000055a00d2c78a4 in tQWorkerThreadFp (worker=0x55a00ff24bb0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tworker.c:82 #6 0x00007f16b44afea5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f16b3dccb0d in clone () from /lib64/libc.so.6
Thread 45 (Thread 0x7f167dff3700 (LWP 17222)): #0 0x00007f16b44b5b3b in do_futex_wait.constprop.1 () from /lib64/libpthread.so.0 #1 0x00007f16b44b5bcf in __new_sem_wait_slow.constprop.0 () from /lib64/libpthread.so.0 #2 0x00007f16b44b5c6b in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0 #3 0x000055a00d2d1ecb in tsem_wait (sem=0x55a00ff24a58) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSemaphore.c:513 #4 0x000055a00d2be10a in taosReadQitemFromQset (qset=0x55a00ff24a20, ppItem=0x7f167dff2ed0, qinfo=0x7f167dff2ee0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tqueue.c:414 #5 0x000055a00d2c78a4 in tQWorkerThreadFp (worker=0x55a00ff24b38) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tworker.c:82 #6 0x00007f16b44afea5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f16b3dccb0d in clone () from /lib64/libc.so.6
Thread 44 (Thread 0x7f16977fe700 (LWP 17199)): #0 0x00007f16b44b3a35 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x000055a00d2d69f0 in taosThreadCondWait (cond=0x55a00d61f0f8 <vnodeGlobal+56>, mutex=0x55a00d61f0d0 <vnodeGlobal+16>) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osThread.c:101 #2 0x000055a00cf424f3 in loop (arg=0x0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/dnode/vnode/src/vnd/vnodeModule.c:148 #3 0x00007f16b44afea5 in start_thread () from /lib64/libpthread.so.0 #4 0x00007f16b3dccb0d in clone () from /lib64/libc.so.6
Thread 43 (Thread 0x7f167bfef700 (LWP 17226)): #0 0x00007f16b44b5b3b in do_futex_wait.constprop.1 () from /lib64/libpthread.so.0 #1 0x00007f16b44b5bcf in __new_sem_wait_slow.constprop.0 () from /lib64/libpthread.so.0 #2 0x00007f16b44b5c6b in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0 #3 0x000055a00d2d1ecb in tsem_wait (sem=0x55a00ff24a58) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSemaphore.c:513 #4 0x000055a00d2be10a in taosReadQitemFromQset (qset=0x55a00ff24a20, ppItem=0x7f167bfeeed0, qinfo=0x7f167bfeeee0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tqueue.c:414 #5 0x000055a00d2c78a4 in tQWorkerThreadFp (worker=0x55a00ff24b98) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tworker.c:82 #6 0x00007f16b44afea5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f16b3dccb0d in clone () from /lib64/libc.so.6
Thread 42 (Thread 0x7f16737de700 (LWP 17243)): #0 0x00007f16b44b5b3b in do_futex_wait.constprop.1 () from /lib64/libpthread.so.0 #1 0x00007f16b44b5bcf in __new_sem_wait_slow.constprop.0 () from /lib64/libpthread.so.0 #2 0x00007f16b44b5c6b in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0 #3 0x000055a00d2d1ecb in tsem_wait (sem=0x55a00ff24a58) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSemaphore.c:513 #4 0x000055a00d2be10a in taosReadQitemFromQset (qset=0x55a00ff24a20, ppItem=0x7f16737dded0, qinfo=0x7f16737ddee0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tqueue.c:414 #5 0x000055a00d2c78a4 in tQWorkerThreadFp (worker=0x55a00ff24d30) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tworker.c:82 #6 0x00007f16b44afea5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f16b3dccb0d in clone () from /lib64/libc.so.6
Thread 41 (Thread 0x7f1678fe9700 (LWP 17232)): #0 0x00007f16b44b5b3b in do_futex_wait.constprop.1 () from /lib64/libpthread.so.0 #1 0x00007f16b44b5bcf in __new_sem_wait_slow.constprop.0 () from /lib64/libpthread.so.0 #2 0x00007f16b44b5c6b in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0 #3 0x000055a00d2d1ecb in tsem_wait (sem=0x55a00ff24a58) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSemaphore.c:513 #4 0x000055a00d2be10a in taosReadQitemFromQset (qset=0x55a00ff24a20, ppItem=0x7f1678fe8ed0, qinfo=0x7f1678fe8ee0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tqueue.c:414 #5 0x000055a00d2c78a4 in tQWorkerThreadFp (worker=0x55a00ff24c28) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tworker.c:82 #6 0x00007f16b44afea5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f16b3dccb0d in clone () from /lib64/libc.so.6
Thread 40 (Thread 0x7f169cff9700 (LWP 17196)): #0 0x00007f16b44b5b3b in do_futex_wait.constprop.1 () from /lib64/libpthread.so.0 #1 0x00007f16b44b5bcf in __new_sem_wait_slow.constprop.0 () from /lib64/libpthread.so.0 #2 0x00007f16b44b5c6b in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0 #3 0x000055a00d2d1ecb in tsem_wait (sem=0x55a00ff22a38) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSemaphore.c:513 #4 0x000055a00d2be10a in taosReadQitemFromQset (qset=0x55a00ff22a00, ppItem=0x7f169cff8ed0, qinfo=0x7f169cff8ee0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tqueue.c:414 #5 0x000055a00d2c78a4 in tQWorkerThreadFp (worker=0x55a00ff22a70) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tworker.c:82 #6 0x00007f16b44afea5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f16b3dccb0d in clone () from /lib64/libc.so.6
Thread 39 (Thread 0x7f1690ff4700 (LWP 17207)): #0 0x00007f16b44b5b3b in do_futex_wait.constprop.1 () from /lib64/libpthread.so.0 #1 0x00007f16b44b5bcf in __new_sem_wait_slow.constprop.0 () from /lib64/libpthread.so.0 #2 0x00007f16b44b5c6b in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0 #3 0x000055a00d2d1ecb in tsem_wait (sem=0x7f168c1126e8) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSemaphore.c:513 #4 0x000055a00d2c1b93 in taosProcessSchedQueue (scheduler=0x7f168c1126c0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tsched.c:116 #5 0x00007f16b44afea5 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f16b3dccb0d in clone () from /lib64/libc.so.6
Thread 38 (Thread 0x7f1674fe1700 (LWP 17240)): #0 0x00007f16b44b5b3b in do_futex_wait.constprop.1 () from /lib64/libpthread.so.0 #1 0x00007f16b44b5bcf in __new_sem_wait_slow.constprop.0 () from /lib64/libpthread.so.0 #2 0x00007f16b44b5c6b in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0 #3 0x000055a00d2d1ecb in tsem_wait (sem=0x55a00ff24a58) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSemaphore.c:513 #4 0x000055a00d2be10a in taosReadQitemFromQset (qset=0x55a00ff24a20, ppItem=0x7f1674fe0ed0, qinfo=0x7f1674fe0ee0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tqueue.c:414 #5 0x000055a00d2c78a4 in tQWorkerThreadFp (worker=0x55a00ff24ce8) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tworker.c:82 #6 0x00007f16b44afea5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f16b3dccb0d in clone () from /lib64/libc.so.6
Thread 37 (Thread 0x7f16797ea700 (LWP 17231)): #0 0x00007f16b44b5b3b in do_futex_wait.constprop.1 () from /lib64/libpthread.so.0 #1 0x00007f16b44b5bcf in __new_sem_wait_slow.constprop.0 () from /lib64/libpthread.so.0 #2 0x00007f16b44b5c6b in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0 #3 0x000055a00d2d1ecb in tsem_wait (sem=0x55a00ff24a58) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSemaphore.c:513 #4 0x000055a00d2be10a in taosReadQitemFromQset (qset=0x55a00ff24a20, ppItem=0x7f16797e9ed0, qinfo=0x7f16797e9ee0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tqueue.c:414 #5 0x000055a00d2c78a4 in tQWorkerThreadFp (worker=0x55a00ff24c10) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tworker.c:82 #6 0x00007f16b44afea5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f16b3dccb0d in clone () from /lib64/libc.so.6
Thread 36 (Thread 0x7f167cff1700 (LWP 17224)): #0 0x00007f16b44b5b3b in do_futex_wait.constprop.1 () from /lib64/libpthread.so.0 #1 0x00007f16b44b5bcf in __new_sem_wait_slow.constprop.0 () from /lib64/libpthread.so.0 #2 0x00007f16b44b5c6b in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0 #3 0x000055a00d2d1ecb in tsem_wait (sem=0x55a00ff24a58) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSemaphore.c:513 #4 0x000055a00d2be10a in taosReadQitemFromQset (qset=0x55a00ff24a20, ppItem=0x7f167cff0ed0, qinfo=0x7f167cff0ee0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tqueue.c:414 #5 0x000055a00d2c78a4 in tQWorkerThreadFp (worker=0x55a00ff24b68) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tworker.c:82 #6 0x00007f16b44afea5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f16b3dccb0d in clone () from /lib64/libc.so.6
Thread 35 (Thread 0x7f16747e0700 (LWP 17241)): #0 0x00007f16b44b5b3b in do_futex_wait.constprop.1 () from /lib64/libpthread.so.0 #1 0x00007f16b44b5bcf in __new_sem_wait_slow.constprop.0 () from /lib64/libpthread.so.0 #2 0x00007f16b44b5c6b in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0 #3 0x000055a00d2d1ecb in tsem_wait (sem=0x55a00ff24a58) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSemaphore.c:513 #4 0x000055a00d2be10a in taosReadQitemFromQset (qset=0x55a00ff24a20, ppItem=0x7f16747dfed0, qinfo=0x7f16747dfee0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tqueue.c:414 #5 0x000055a00d2c78a4 in tQWorkerThreadFp (worker=0x55a00ff24d00) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tworker.c:82 #6 0x00007f16b44afea5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f16b3dccb0d in clone () from /lib64/libc.so.6
Thread 34 (Thread 0x7f16837fe700 (LWP 17210)): #0 0x00007f16b44b5b3b in do_futex_wait.constprop.1 () from /lib64/libpthread.so.0 #1 0x00007f16b44b5bcf in __new_sem_wait_slow.constprop.0 () from /lib64/libpthread.so.0 #2 0x00007f16b44b5c6b in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0 #3 0x000055a00d2d1ecb in tsem_wait (sem=0x7f168c1126e8) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSemaphore.c:513 #4 0x000055a00d2c1b93 in taosProcessSchedQueue (scheduler=0x7f168c1126c0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tsched.c:116 #5 0x00007f16b44afea5 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f16b3dccb0d in clone () from /lib64/libc.so.6
Thread 33 (Thread 0x7f167a7ec700 (LWP 17229)): #0 0x00007f16b44b5b3b in do_futex_wait.constprop.1 () from /lib64/libpthread.so.0 #1 0x00007f16b44b5bcf in __new_sem_wait_slow.constprop.0 () from /lib64/libpthread.so.0 #2 0x00007f16b44b5c6b in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0 #3 0x000055a00d2d1ecb in tsem_wait (sem=0x55a00ff24a58) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSemaphore.c:513 #4 0x000055a00d2be10a in taosReadQitemFromQset (qset=0x55a00ff24a20, ppItem=0x7f167a7ebed0, qinfo=0x7f167a7ebee0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tqueue.c:414 #5 0x000055a00d2c78a4 in tQWorkerThreadFp (worker=0x55a00ff24be0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tworker.c:82 #6 0x00007f16b44afea5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f16b3dccb0d in clone () from /lib64/libc.so.6
Thread 32 (Thread 0x7f16757e2700 (LWP 17239)): #0 0x00007f16b44b5b3b in do_futex_wait.constprop.1 () from /lib64/libpthread.so.0 #1 0x00007f16b44b5bcf in __new_sem_wait_slow.constprop.0 () from /lib64/libpthread.so.0 #2 0x00007f16b44b5c6b in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0 #3 0x000055a00d2d1ecb in tsem_wait (sem=0x55a00ff24a58) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSemaphore.c:513 #4 0x000055a00d2be10a in taosReadQitemFromQset (qset=0x55a00ff24a20, ppItem=0x7f16757e1ed0, qinfo=0x7f16757e1ee0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tqueue.c:414 #5 0x000055a00d2c78a4 in tQWorkerThreadFp (worker=0x55a00ff24cd0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tworker.c:82 #6 0x00007f16b44afea5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f16b3dccb0d in clone () from /lib64/libc.so.6
Thread 31 (Thread 0x7f1683fff700 (LWP 17209)): #0 0x00007f16b44b5b3b in do_futex_wait.constprop.1 () from /lib64/libpthread.so.0 #1 0x00007f16b44b5bcf in __new_sem_wait_slow.constprop.0 () from /lib64/libpthread.so.0 #2 0x00007f16b44b5c6b in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0 #3 0x000055a00d2d1ecb in tsem_wait (sem=0x7f168c1126e8) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSemaphore.c:513 #4 0x000055a00d2c1b93 in taosProcessSchedQueue (scheduler=0x7f168c1126c0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tsched.c:116 #5 0x00007f16b44afea5 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f16b3dccb0d in clone () from /lib64/libc.so.6
Thread 30 (Thread 0x7f1695ffb700 (LWP 17203)): #0 0x00007f16b44b5b3b in do_futex_wait.constprop.1 () from /lib64/libpthread.so.0 #1 0x00007f16b44b5bcf in __new_sem_wait_slow.constprop.0 () from /lib64/libpthread.so.0 #2 0x00007f16b44b5c6b in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0 #3 0x000055a00d2d1ecb in tsem_wait (sem=0x55a00ff25998) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSemaphore.c:513 #4 0x000055a00d2be10a in taosReadQitemFromQset (qset=0x55a00ff25960, ppItem=0x7f1695ffaed0, qinfo=0x7f1695ffaee0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tqueue.c:414 #5 0x000055a00d2c78a4 in tQWorkerThreadFp (worker=0x55a00ff259d0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tworker.c:82 #6 0x00007f16b44afea5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f16b3dccb0d in clone () from /lib64/libc.so.6
Thread 29 (Thread 0x7f169d7fa700 (LWP 17195)): #0 0x00007f16b44b5b3b in do_futex_wait.constprop.1 () from /lib64/libpthread.so.0 #1 0x00007f16b44b5bcf in __new_sem_wait_slow.constprop.0 () from /lib64/libpthread.so.0 #2 0x00007f16b44b5c6b in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0 #3 0x000055a00d2d1ecb in tsem_wait (sem=0x55a00ff226d8) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSemaphore.c:513 #4 0x000055a00d2be10a in taosReadQitemFromQset (qset=0x55a00ff226a0, ppItem=0x7f169d7f9ed0, qinfo=0x7f169d7f9ee0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tqueue.c:414 #5 0x000055a00d2c78a4 in tQWorkerThreadFp (worker=0x55a00ff22710) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tworker.c:82 #6 0x00007f16b44afea5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f16b3dccb0d in clone () from /lib64/libc.so.6
Thread 28 (Thread 0x7f1697fff700 (LWP 17198)): #0 0x00007f16b44b3a35 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x000055a00d2d69f0 in taosThreadCondWait (cond=0x55a00d61f0f8 <vnodeGlobal+56>, mutex=0x55a00d61f0d0 <vnodeGlobal+16>) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osThread.c:101 #2 0x000055a00cf424f3 in loop (arg=0x0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/dnode/vnode/src/vnd/vnodeModule.c:148 #3 0x00007f16b44afea5 in start_thread () from /lib64/libpthread.so.0 #4 0x00007f16b3dccb0d in clone () from /lib64/libc.so.6
Thread 27 (Thread 0x7f169f7fe700 (LWP 17191)): #0 0x00007f16b44b5b3b in do_futex_wait.constprop.1 () from /lib64/libpthread.so.0 #1 0x00007f16b44b5bcf in __new_sem_wait_slow.constprop.0 () from /lib64/libpthread.so.0 #2 0x00007f16b44b5c6b in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0 #3 0x000055a00d2d1ecb in tsem_wait (sem=0x55a01009d7c8) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSemaphore.c:513 #4 0x000055a00d2be10a in taosReadQitemFromQset (qset=0x55a01009d790, ppItem=0x7f169f7fded0, qinfo=0x7f169f7fdee0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tqueue.c:414 #5 0x000055a00d2c78a4 in tQWorkerThreadFp (worker=0x55a01009d800) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tworker.c:82 #6 0x00007f16b44afea5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f16b3dccb0d in clone () from /lib64/libc.so.6
Thread 26 (Thread 0x7f16ac38a700 (LWP 17172)): #0 0x00007f16b3d939fd in nanosleep () from /lib64/libc.so.6 #1 0x00007f16b3dc42d4 in usleep () from /lib64/libc.so.6 #2 0x000055a00d2d2237 in taosMsleep (ms=25) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSleep.c:37 #3 0x000055a00d2b787c in taosAsyncOutputLog (param=0x55a00eefcdb0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tlog.c:699 #4 0x00007f16b44afea5 in start_thread () from /lib64/libpthread.so.0 #5 0x00007f16b3dccb0d in clone () from /lib64/libc.so.6
Thread 25 (Thread 0x7f169e7fc700 (LWP 17193)): #0 0x00007f16b44b5b3b in do_futex_wait.constprop.1 () from /lib64/libpthread.so.0 #1 0x00007f16b44b5bcf in __new_sem_wait_slow.constprop.0 () from /lib64/libpthread.so.0 #2 0x00007f16b44b5c6b in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0 #3 0x000055a00d2d1ecb in tsem_wait (sem=0x55a01009db28) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSemaphore.c:513 #4 0x000055a00d2be10a in taosReadQitemFromQset (qset=0x55a01009daf0, ppItem=0x7f169e7fbed0, qinfo=0x7f169e7fbee0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tqueue.c:414 #5 0x000055a00d2c78a4 in tQWorkerThreadFp (worker=0x55a01009db78) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tworker.c:82 #6 0x00007f16b44afea5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f16b3dccb0d in clone () from /lib64/libc.so.6
Thread 24 (Thread 0x7f169effd700 (LWP 17192)): #0 0x00007f16b44b5b3b in do_futex_wait.constprop.1 () from /lib64/libpthread.so.0 #1 0x00007f16b44b5bcf in __new_sem_wait_slow.constprop.0 () from /lib64/libpthread.so.0 #2 0x00007f16b44b5c6b in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0 #3 0x000055a00d2d1ecb in tsem_wait (sem=0x55a01009db28) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSemaphore.c:513 #4 0x000055a00d2be10a in taosReadQitemFromQset (qset=0x55a01009daf0, ppItem=0x7f169effced0, qinfo=0x7f169effcee0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tqueue.c:414 #5 0x000055a00d2c78a4 in tQWorkerThreadFp (worker=0x55a01009db60) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tworker.c:82 #6 0x00007f16b44afea5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f16b3dccb0d in clone () from /lib64/libc.so.6
Thread 23 (Thread 0x7f167f7f6700 (LWP 17219)): #0 0x00007f16b44b5b3b in do_futex_wait.constprop.1 () from /lib64/libpthread.so.0 #1 0x00007f16b44b5bcf in __new_sem_wait_slow.constprop.0 () from /lib64/libpthread.so.0 #2 0x00007f16b44b5c6b in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0 #3 0x000055a00d2d1ecb in tsem_wait (sem=0x55a00ff24a58) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSemaphore.c:513 #4 0x000055a00d2be10a in taosReadQitemFromQset (qset=0x55a00ff24a20, ppItem=0x7f167f7f5ed0, qinfo=0x7f167f7f5ee0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tqueue.c:414 #5 0x000055a00d2c78a4 in tQWorkerThreadFp (worker=0x55a00ff24af0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tworker.c:82 #6 0x00007f16b44afea5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f16b3dccb0d in clone () from /lib64/libc.so.6
Thread 22 (Thread 0x7f16a5169700 (LWP 17188)): #0 0x00007f16b44b5b3b in do_futex_wait.constprop.1 () from /lib64/libpthread.so.0 #1 0x00007f16b44b5bcf in __new_sem_wait_slow.constprop.0 () from /lib64/libpthread.so.0 #2 0x00007f16b44b5c6b in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0 #3 0x000055a00d2d1ecb in tsem_wait (sem=0x55a01009cd28) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSemaphore.c:513 #4 0x000055a00d2be10a in taosReadQitemFromQset (qset=0x55a01009ccf0, ppItem=0x7f16a5168ed0, qinfo=0x7f16a5168ee0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tqueue.c:414 #5 0x000055a00d2c78a4 in tQWorkerThreadFp (worker=0x55a01009cd78) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tworker.c:82 #6 0x00007f16b44afea5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f16b3dccb0d in clone () from /lib64/libc.so.6
Thread 21 (Thread 0x7f1681ffb700 (LWP 17214)): #0 0x00007f16b44b5b3b in do_futex_wait.constprop.1 () from /lib64/libpthread.so.0 #1 0x00007f16b44b5bcf in __new_sem_wait_slow.constprop.0 () from /lib64/libpthread.so.0 #2 0x00007f16b44b5c6b in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0 #3 0x000055a00d2d1ecb in tsem_wait (sem=0x7f16842c4408) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSemaphore.c:513 #4 0x000055a00d2be328 in taosReadAllQitemsFromQset (qset=0x7f16842c43d0, qall=0x7f16842c4440, qinfo=0x7f1681ffaee0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tqueue.c:458 #5 0x000055a00d2c8081 in tWWorkerThreadFp (worker=0x55a00ff251c0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tworker.c:208 #6 0x00007f16b44afea5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f16b3dccb0d in clone () from /lib64/libc.so.6
Thread 20 (Thread 0x7f169ffff700 (LWP 17190)): #0 0x00007f16b44b5b3b in do_futex_wait.constprop.1 () from /lib64/libpthread.so.0 #1 0x00007f16b44b5bcf in __new_sem_wait_slow.constprop.0 () from /lib64/libpthread.so.0 #2 0x00007f16b44b5c6b in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0 #3 0x000055a00d2d1ecb in tsem_wait (sem=0x55a01009cd28) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSemaphore.c:513 #4 0x000055a00d2be10a in taosReadQitemFromQset (qset=0x55a01009ccf0, ppItem=0x7f169fffeed0, qinfo=0x7f169fffeee0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tqueue.c:414 #5 0x000055a00d2c78a4 in tQWorkerThreadFp (worker=0x55a01009cda8) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tworker.c:82 #6 0x00007f16b44afea5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f16b3dccb0d in clone () from /lib64/libc.so.6
Thread 19 (Thread 0x7f16827fc700 (LWP 17213)): #0 0x00007f16b44b5b3b in do_futex_wait.constprop.1 () from /lib64/libpthread.so.0 #1 0x00007f16b44b5bcf in __new_sem_wait_slow.constprop.0 () from /lib64/libpthread.so.0 #2 0x00007f16b44b5c6b in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0 #3 0x000055a00d2d1ecb in tsem_wait (sem=0x7f16842c40c8) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSemaphore.c:513 #4 0x000055a00d2be328 in taosReadAllQitemsFromQset (qset=0x7f16842c4090, qall=0x7f16842c2aa0, qinfo=0x7f16827fbee0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tqueue.c:458 #5 0x000055a00d2c8081 in tWWorkerThreadFp (worker=0x55a00ff25450) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tworker.c:208 #6 0x00007f16b44afea5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f16b3dccb0d in clone () from /lib64/libc.so.6
Thread 18 (Thread 0x7f16a596a700 (LWP 17187)): #0 0x00007f16b44b5b3b in do_futex_wait.constprop.1 () from /lib64/libpthread.so.0 #1 0x00007f16b44b5bcf in __new_sem_wait_slow.constprop.0 () from /lib64/libpthread.so.0 #2 0x00007f16b44b5c6b in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0 #3 0x000055a00d2d1ecb in tsem_wait (sem=0x55a01009cd28) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSemaphore.c:513 #4 0x000055a00d2be10a in taosReadQitemFromQset (qset=0x55a01009ccf0, ppItem=0x7f16a5969ed0, qinfo=0x7f16a5969ee0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tqueue.c:414 #5 0x000055a00d2c78a4 in tQWorkerThreadFp (worker=0x55a01009cd60) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tworker.c:82 #6 0x00007f16b44afea5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f16b3dccb0d in clone () from /lib64/libc.so.6
Thread 17 (Thread 0x7f16a816f700 (LWP 17180)): #0 0x00007f16b3dcd0e3 in epoll_wait () from /lib64/libc.so.6 #1 0x000055a00d213a07 in uv__io_poll (loop=0x55a00d613c08 <udfdGlobal+8>, timeout=-1) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/contrib/libuv/src/unix/epoll.c:236 #2 0x000055a00d1fe470 in uv_run (loop=0x55a00d613c08 <udfdGlobal+8>, mode=UV_RUN_DEFAULT) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/contrib/libuv/src/unix/core.c:406 #3 0x000055a00d0d1eaf in udfWatchUdfd (args=0x55a00d613c00 <udfdGlobal>) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/libs/function/src/tudf.c:172 #4 0x00007f16b44afea5 in start_thread () from /lib64/libpthread.so.0 #5 0x00007f16b3dccb0d in clone () from /lib64/libc.so.6
Thread 16 (Thread 0x7f16a4968700 (LWP 17189)): #0 0x00007f16b44b5b3b in do_futex_wait.constprop.1 () from /lib64/libpthread.so.0 #1 0x00007f16b44b5bcf in __new_sem_wait_slow.constprop.0 () from /lib64/libpthread.so.0 #2 0x00007f16b44b5c6b in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0 #3 0x000055a00d2d1ecb in tsem_wait (sem=0x55a01009cd28) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSemaphore.c:513 #4 0x000055a00d2be10a in taosReadQitemFromQset (qset=0x55a01009ccf0, ppItem=0x7f16a4967ed0, qinfo=0x7f16a4967ee0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tqueue.c:414 #5 0x000055a00d2c78a4 in tQWorkerThreadFp (worker=0x55a01009cd90) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tworker.c:82 #6 0x00007f16b44afea5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f16b3dccb0d in clone () from /lib64/libc.so.6
Thread 15 (Thread 0x7f16a9171700 (LWP 17178)): #0 0x00007f16b3dcd0e3 in epoll_wait () from /lib64/libc.so.6 #1 0x000055a00d213a07 in uv__io_poll (loop=0x55a00ff2bbc0, timeout=-1) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/contrib/libuv/src/unix/epoll.c:236 #2 0x000055a00d1fe470 in uv_run (loop=0x55a00ff2bbc0, mode=UV_RUN_DEFAULT) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/contrib/libuv/src/unix/core.c:406 #3 0x000055a00d1e175a in cliWorkThread (arg=0x55a00ff2ba10) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/libs/transport/src/transCli.c:1100 #4 0x00007f16b44afea5 in start_thread () from /lib64/libpthread.so.0 #5 0x00007f16b3dccb0d in clone () from /lib64/libc.so.6
Thread 14 (Thread 0x7f16a616b700 (LWP 17185)): #0 0x00007f16b3d939fd in nanosleep () from /lib64/libc.so.6 #1 0x00007f16b3dc42d4 in usleep () from /lib64/libc.so.6 #2 0x000055a00d2d2237 in taosMsleep (ms=500) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSleep.c:37 #3 0x000055a00d2a3ac9 in taosCacheTimedRefresh (handle=0x0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tcache.c:844 #4 0x00007f16b44afea5 in start_thread () from /lib64/libpthread.so.0 #5 0x00007f16b3dccb0d in clone () from /lib64/libc.so.6
Thread 13 (Thread 0x7f16a8970700 (LWP 17179)): #0 0x00007f16b44b5b3b in do_futex_wait.constprop.1 () from /lib64/libpthread.so.0 #1 0x00007f16b44b5bcf in __new_sem_wait_slow.constprop.0 () from /lib64/libpthread.so.0 #2 0x00007f16b44b5c6b in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0 #3 0x000055a00d2d1ecb in tsem_wait (sem=0x55a00ff41d08) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSemaphore.c:513 #4 0x000055a00d2be10a in taosReadQitemFromQset (qset=0x55a00ff41cd0, ppItem=0x7f16a896fed0, qinfo=0x7f16a896fee0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tqueue.c:414 #5 0x000055a00d2c78a4 in tQWorkerThreadFp (worker=0x55a00ff41d40) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tworker.c:82 #6 0x00007f16b44afea5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f16b3dccb0d in clone () from /lib64/libc.so.6
Thread 12 (Thread 0x7f16a696c700 (LWP 17184)): #0 0x00007f16b44b73c1 in sigwait () from /lib64/libpthread.so.0 #1 0x000055a00d2d72d4 in taosProcessAlarmSignal (tharg=0x55a00d2c54a1 <taosTimerLoopFunc>) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osTimer.c:130 #2 0x00007f16b44afea5 in start_thread () from /lib64/libpthread.so.0 #3 0x00007f16b3dccb0d in clone () from /lib64/libc.so.6
Thread 11 (Thread 0x7f16817fa700 (LWP 17215)): #0 0x00007f16b44b5b3b in do_futex_wait.constprop.1 () from /lib64/libpthread.so.0 #1 0x00007f16b44b5bcf in __new_sem_wait_slow.constprop.0 () from /lib64/libpthread.so.0 #2 0x00007f16b44b5c6b in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0 #3 0x000055a00d2d1ecb in tsem_wait (sem=0x55a00ff24a58) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSemaphore.c:513 #4 0x000055a00d2be10a in taosReadQitemFromQset (qset=0x55a00ff24a20, ppItem=0x7f16817f9ed0, qinfo=0x7f16817f9ee0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tqueue.c:414 #5 0x000055a00d2c78a4 in tQWorkerThreadFp (worker=0x55a00ff24a90) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tworker.c:82 #6 0x00007f16b44afea5 in start_thread () from /lib64/libpthread.so.0 #7 0x00007f16b3dccb0d in clone () from /lib64/libc.so.6
Thread 10 (Thread 0x7f16aa173700 (LWP 17176)): #0 0x00007f16b3dcd0e3 in epoll_wait () from /lib64/libc.so.6 #1 0x000055a00d213a07 in uv__io_poll (loop=0x55a00ff2a7d0, timeout=-1) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/contrib/libuv/src/unix/epoll.c:236 #2 0x000055a00d1fe470 in uv_run (loop=0x55a00ff2a7d0, mode=UV_RUN_DEFAULT) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/contrib/libuv/src/unix/core.c:406 #3 0x000055a00d1ea665 in transWorkerThread (arg=0x55a00ff29b80) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/libs/transport/src/transSvr.c:810 #4 0x00007f16b44afea5 in start_thread () from /lib64/libpthread.so.0 #5 0x00007f16b3dccb0d in clone () from /lib64/libc.so.6
Thread 9 (Thread 0x7f16967fc700 (LWP 17201)): #0 0x00007f16b44b3a35 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 #1 0x000055a00d2d69f0 in taosThreadCondWait (cond=0x55a00d61f0f8 <vnodeGlobal+56>, mutex=0x55a00d61f0d0 <vnodeGlobal+16>) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osThread.c:101 #2 0x000055a00cf424f3 in loop (arg=0x0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/dnode/vnode/src/vnd/vnodeModule.c:148 #3 0x00007f16b44afea5 in start_thread () from /lib64/libpthread.so.0 #4 0x00007f16b3dccb0d in clone () from /lib64/libc.so.6
Thread 8 (Thread 0x7f16ab976700 (LWP 17173)): #0 0x00007f16b3dcd0e3 in epoll_wait () from /lib64/libc.so.6 #1 0x000055a00d213a07 in uv__io_poll (loop=0x55a00ff27ac0, timeout=-1) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/contrib/libuv/src/unix/epoll.c:236 #2 0x000055a00d1fe470 in uv_run (loop=0x55a00ff27ac0, mode=UV_RUN_DEFAULT) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/contrib/libuv/src/unix/core.c:406 #3 0x000055a00d1ea665 in transWorkerThread (arg=0x55a00ff277d0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/libs/transport/src/transSvr.c:810 #4 0x00007f16b44afea5 in start_thread () from /lib64/libpthread.so.0 #5 0x00007f16b3dccb0d in clone () from /lib64/libc.so.6
Thread 7 (Thread 0x7f1688ffc700 (LWP 17208)): #0 0x00007f16b44b5b3b in do_futex_wait.constprop.1 () from /lib64/libpthread.so.0 #1 0x00007f16b44b5bcf in __new_sem_wait_slow.constprop.0 () from /lib64/libpthread.so.0 #2 0x00007f16b44b5c6b in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0 #3 0x000055a00d2d1ecb in tsem_wait (sem=0x7f168c1126e8) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSemaphore.c:513 #4 0x000055a00d2c1b93 in taosProcessSchedQueue (scheduler=0x7f168c1126c0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tsched.c:116 #5 0x00007f16b44afea5 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f16b3dccb0d in clone () from /lib64/libc.so.6
Thread 6 (Thread 0x7f16a9972700 (LWP 17177)): #0 0x00007f16b3dcd0e3 in epoll_wait () from /lib64/libc.so.6 #1 0x000055a00d213a07 in uv__io_poll (loop=0x55a00ff27420, timeout=-1) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/contrib/libuv/src/unix/epoll.c:236 #2 0x000055a00d1fe470 in uv_run (loop=0x55a00ff27420, mode=UV_RUN_DEFAULT) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/contrib/libuv/src/unix/core.c:406 #3 0x000055a00d1ea219 in transAcceptThread (arg=0x55a00ff271d0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/libs/transport/src/transSvr.c:742 #4 0x00007f16b44afea5 in start_thread () from /lib64/libpthread.so.0 #5 0x00007f16b3dccb0d in clone () from /lib64/libc.so.6
Thread 5 (Thread 0x7f16a796e700 (LWP 17182)): #0 0x00007f16b3d939fd in nanosleep () from /lib64/libc.so.6 #1 0x00007f16b3dc42d4 in usleep () from /lib64/libc.so.6 #2 0x000055a00d2d2237 in taosMsleep (ms=1000) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSleep.c:37 #3 0x000055a00d15a6bb in walUpdateSeq () at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/libs/wal/src/walMgmt.c:225 #4 0x000055a00d15a846 in walThreadFunc (param=0x0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/libs/wal/src/walMgmt.c:248 #5 0x00007f16b44afea5 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f16b3dccb0d in clone () from /lib64/libc.so.6
Thread 4 (Thread 0x7f16a716d700 (LWP 17183)): #0 0x00007f16b44b5b3b in do_futex_wait.constprop.1 () from /lib64/libpthread.so.0 #1 0x00007f16b44b5bcf in __new_sem_wait_slow.constprop.0 () from /lib64/libpthread.so.0 #2 0x00007f16b44b5c6b in sem_wait@@GLIBC_2.2.5 () from /lib64/libpthread.so.0 #3 0x000055a00d2d1ecb in tsem_wait (sem=0x55a00ff6b9f8) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/os/src/osSemaphore.c:513 #4 0x000055a00d2c1b93 in taosProcessSchedQueue (scheduler=0x55a00ff6b9d0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/util/src/tsched.c:116 #5 0x00007f16b44afea5 in start_thread () from /lib64/libpthread.so.0 #6 0x00007f16b3dccb0d in clone () from /lib64/libc.so.6
Thread 3 (Thread 0x7f16aa974700 (LWP 17175)): #0 0x00007f16b3dcd0e3 in epoll_wait () from /lib64/libc.so.6 #1 0x000055a00d213a07 in uv__io_poll (loop=0x55a00ff297d0, timeout=-1) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/contrib/libuv/src/unix/epoll.c:236 #2 0x000055a00d1fe470 in uv_run (loop=0x55a00ff297d0, mode=UV_RUN_DEFAULT) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/contrib/libuv/src/unix/core.c:406 #3 0x000055a00d1ea665 in transWorkerThread (arg=0x55a00ff294e0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/libs/transport/src/transSvr.c:810 #4 0x00007f16b44afea5 in start_thread () from /lib64/libpthread.so.0 #5 0x00007f16b3dccb0d in clone () from /lib64/libc.so.6
Thread 2 (Thread 0x7f16ab175700 (LWP 17174)): #0 0x00007f16b3dcd0e3 in epoll_wait () from /lib64/libc.so.6 #1 0x000055a00d213a07 in uv__io_poll (loop=0x55a00ff28910, timeout=-1) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/contrib/libuv/src/unix/epoll.c:236 #2 0x000055a00d1fe470 in uv_run (loop=0x55a00ff28910, mode=UV_RUN_DEFAULT) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/contrib/libuv/src/unix/core.c:406 #3 0x000055a00d1ea665 in transWorkerThread (arg=0x55a00ff28620) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/libs/transport/src/transSvr.c:810 #4 0x00007f16b44afea5 in start_thread () from /lib64/libpthread.so.0 #5 0x00007f16b3dccb0d in clone () from /lib64/libc.so.6
Thread 1 (Thread 0x7f16b4bc5740 (LWP 17169)):
#0 0x00007f16b3d04387 in raise () from /lib64/libc.so.6
#1 0x00007f16b3d05bb8 in abort () from /lib64/libc.so.6
#2 0x00007f16b3cfd1a6 in __assert_fail_base () from /lib64/libc.so.6
#3 0x00007f16b3cfd252 in __assert_fail () from /lib64/libc.so.6
#4 0x000055a00cf7a2e0 in tsdbFSClose (pTsdb=0x7f16841163b0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/dnode/vnode/src/tsdb/tsdbFS.c:511
#5 0x000055a00cf7d3b2 in tsdbClose (pTsdb=0x7f1684000dc0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/dnode/vnode/src/tsdb/tsdbOpen.c:88
#6 0x000055a00cf3b9c7 in vnodeClose (pVnode=0x7f16840008c0) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/dnode/vnode/src/vnd/vnodeOpen.c:194
#7 0x000055a00ceb052b in vmCloseVnode (pMgmt=0x55a00ff22d60, pVnode=0x7f16842c3e90)
at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/dnode/mgmt/mgmt_vnode/src/vmInt.c:99
#8 0x000055a00ceb10b9 in vmCloseVnodes (pMgmt=0x55a00ff22d60) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/dnode/mgmt/mgmt_vnode/src/vmInt.c:224
#9 0x000055a00ceb1171 in vmCleanup (pMgmt=0x55a00ff22d60) at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/dnode/mgmt/mgmt_vnode/src/vmInt.c:240
#10 0x000055a00ceb170d in vmInit (pInput=0x7ffcafaea370, pOutput=0x7ffcafaea360)
at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/dnode/mgmt/mgmt_vnode/src/vmInt.c:323
#11 0x000055a00ce9cf3c in dmOpenNode (pWrapper=0x55a00d6104d8 <global+12472>)
at /home/ubuntu/workroom/jenkins/3.0/TDinternal/community/source/dnode/mgmt/node_mgmt/src/dmNodes.c:86
#12 0x000055a00ce9d8b5 in dmOpenNodes (pDnode=0x55a00d60d420
The bugs in earlier versions of 3.0 have been fixed, but 3.0.2.5 May not be compatible with the current version (3.3.0.0), so it is not possible to upgrade directly. Therefore, it is recommended to redeploy the latest 3.3.0.0, the subsequent upgrade is very convenient, directly install the latest version of the software.
Range of open source version of the operating system support: https://docs.taosdata.com/reference/support-platform/ The bugs from earlier versions of 3.0 have been fixed, but 3.0.2.5 May not be compatible with the current version (3.3.0.0), so it is not possible to upgrade directly. Therefore, it is recommended to redeploy the latest 3.3.0.0, the subsequent upgrade is very convenient, directly install the latest version of the software.
Range of open source version of the operating system support: https://docs.taosdata.com/reference/support-platform/