matrixone icon indicating copy to clipboard operation
matrixone copied to clipboard

[Bug]: CDC only return around 100K rows with data size 1 million rows

Open cpegeric opened this issue 7 months ago • 1 comments

Is there an existing issue for the same bug?

  • [x] I have checked the existing issues.

Branch Name

main

Commit ID

27590cfa44907284d982037350faf20aa7577ef4

Other Environment Information

- Hardware parameters:
- OS type:
- Others:

Actual Behavior

Image

only around 100K rows from CDC. Image

Expected Behavior

No response

Steps to Reproduce

use the repo

https://github.com/cpegeric/matrixone/tree/cdc_sqlexecutor_cleanup

with branch cdc_sqlexecutor_cleanup

download the tool from 

git clone [email protected]:cpegeric/wiki-benchmark.git

In MO,

> create database eric;

From command line,

% cd wiki-benchmark/python
% python indextest.py buildcdc 127.0.0.1 eric src hnswidx vector_l2_ops 128 1000000 hnsw


IN MO,

select count(*) from src;

LOG,

check the logs/stderr-xxx to see the logs.

Additional information

No response

cpegeric avatar Jun 06 '25 14:06 cpegeric

fixed

XuPeng-SH avatar Jun 09 '25 08:06 XuPeng-SH

现在回归没有这个问题了,closed

heni02 avatar Aug 01 '25 02:08 heni02