velox icon indicating copy to clipboard operation
velox copied to clipboard

Fix deadlocking parallel join build issue

Open tanjialiang opened this issue 7 months ago • 2 comments

Parallel hash table build will stuck if an off-thread (not on driver thread) allocations trigger arbitration. This is because off-thread arbitration does not have thread-local driver context to suspend the current driver thread. When arbitration goes along, it waits for the task to be fully suspended. This will never happen because of the above mentioned. And the query will go into a stuck state without resolving.

tanjialiang avatar Jul 06 '24 03:07 tanjialiang