matrixone icon indicating copy to clipboard operation
matrixone copied to clipboard

[Bug]: Excessive Memory Allocation in sysbench Delete Test [DupJmAuxData]

Open sukki37 opened this issue 1 year ago • 6 comments

Is there an existing issue for the same bug?

  • [X] I have checked the existing issues.

Branch Name

1.2-dev

Commit ID

1ef0439f92f5feaa2a3882a12f1bfa8cd9b54860

Other Environment Information

- Hardware parameters:
- OS type:
- Others:

Actual Behavior

Related to #16617

During the sysbench delete test, the DupJmAuxData component allocated an excessive amount of memory, reaching 670GB within two minutes. This level of memory consumption is highly unusual and indicates inefficient memory usage in the system.

heap.zip

企业微信截图_06ed85eb-b428-4f22-8aa9-e3333a648d1e

Expected Behavior

No response

Steps to Reproduce

run sysbench delete test 100 threads

Additional information

No response

sukki37 avatar Jun 05 '24 03:06 sukki37

#16617 case 1

fengttt avatar Jun 05 '24 03:06 fengttt

not working on it today

aunjgr avatar Jun 11 '24 11:06 aunjgr

investigating

aunjgr avatar Jun 17 '24 12:06 aunjgr

working on a PR

aunjgr avatar Jun 21 '24 11:06 aunjgr

not working on it today

aunjgr avatar Jun 26 '24 11:06 aunjgr

on leave

aunjgr avatar Jul 03 '24 15:07 aunjgr

not working on it today

aunjgr avatar Jul 09 '24 13:07 aunjgr

not working on it today

aunjgr avatar Jul 15 '24 12:07 aunjgr

working

badboynt1 avatar Jul 18 '24 10:07 badboynt1

fixed

badboynt1 avatar Jul 24 '24 02:07 badboynt1

经测试,现在没有dup hash表的内存分配开销了

alloc_sysbench.zip

badboynt1 avatar Oct 24 '24 07:10 badboynt1

confirm,closed

heni02 avatar Oct 24 '24 09:10 heni02