matrixone icon indicating copy to clipboard operation
matrixone copied to clipboard

[Bug]: mo_cdc: show cdc task checkpoint is null when state is running

Open heni02 opened this issue 1 year ago • 3 comments

Is there an existing issue for the same bug?

  • [X] I have checked the existing issues.

Branch Name

main

Commit ID

dbced459d

Other Environment Information

- Hardware parameters:
- OS type:
- Others:

Actual Behavior

测试场景:上游mo单表并发1000 insert,运行15min,等测试结束后,全量数据同步完成后show任务 企业微信截图_3b230832-9863-4d5c-bffa-2131a8cefaf5 没有暂停过服务但是日志显示cdc任务已经结束 企业微信截图_07108159-1f82-4a50-bacd-ff0a808e0be2

mo log: http://10.222.6.1/explore?panes=%7B%22VCp%22:%7B%22datasource%22:%22loki%22,%22queries%22:%5B%7B%22refId%22:%22A%22,%22expr%22:%22%7Bnamespace%3D%5C%22mo-cdc-test%5C%22%7D%20%7C%3D%20%60tableReader%60%22,%22queryType%22:%22range%22,%22datasource%22:%7B%22type%22:%22loki%22,%22uid%22:%22loki%22%7D,%22editorMode%22:%22builder%22%7D%5D,%22range%22:%7B%22from%22:%221728718520000%22,%22to%22:%221728719720000%22%7D%7D%7D&schemaVersion=1&orgId=1

Expected Behavior

No response

Steps to Reproduce

使用mo-load工具并发insert1000运行10分钟
ddl:create table test01(a int auto_increment primary key,b int);
1.mo-load工具修改run.yml
./start.sh -h 10.222.6.6 -b sysbench_db -c cases/ddl/
2../mo_cdc task create --task-name "cdc_insert" --source-uri="mysql://dump:[email protected]:6001" --sink-type="mysql" --sink-uri="mysql://dump:[email protected]:3306"    --tables='sysbench_db.test01:test_cdc_db.test01' --level="account"  --account="sys"
3.全量数据结束后show
./mo_cdc task show --task-name "cdc_insert" --source-uri="mysql://dump:[email protected]:6001"

Additional information

No response

heni02 avatar Oct 12 '24 08:10 heni02

查看日志,应该是暂停前truncate了上游表,cdc结束,show相关状态running没有更新状态 企业微信截图_8d726d4b-5d5a-4e65-999f-ef71c96bd3d6

heni02 avatar Oct 12 '24 08:10 heni02

查看日志,应该是暂停前truncate了上游表,cdc结束,show相关状态running没有更新状态 企业微信截图_8d726d4b-5d5a-4e65-999f-ef71c96bd3d6

状态更新的问题同#19184,产品表示先保持现状

ck89119 avatar Oct 12 '24 08:10 ck89119

先挪到下一个版本

heni02 avatar Oct 23 '24 06:10 heni02

和产品沟通,同一个cdc任务中包含多个表时,其中有个别表失败无法定位cdc status状态,因此目前不会更改状态为failed,维持产品现状,关闭该issue

heni02 avatar Nov 14 '24 07:11 heni02