[Bug]: mo_cdc: mo cdc to mo reported error no such table which table exists

[heni02]

Is there an existing issue for the same bug?

• [X] I have checked the existing issues.

Branch Name

main

Commit ID

b4ea38bcd

Other Environment Information

- Hardware parameters:
- OS type:
- Others:

Actual Behavior

下游mo表是存在的，日志里报错表不存在，同步数据失败

下游mo执行日志中的sql报语法错误： 去掉前面的hint可以执行：

mo log： http://10.222.6.1/explore?panes=%7B%22VCp%22:%7B%22datasource%22:%22loki%22,%22queries%22:%5B%7B%22refId%22:%22A%22,%22expr%22:%22%7Bnamespace%3D%5C%22mo-cdc-test%5C%22%7D%20%7C%3D%20%60%60%22,%22queryType%22:%22range%22,%22datasource%22:%7B%22type%22:%22loki%22,%22uid%22:%22loki%22%7D,%22editorMode%22:%22builder%22%7D%5D,%22range%22:%7B%22from%22:%221728975792593%22,%22to%22:%221728979392593%22%7D%7D%7D&schemaVersion=1&orgId=1

Expected Behavior

No response

Steps to Reproduce

./mo_cdc task create --task-name "cdc_15k_new" --source-uri="mysql://dump:[email protected]:6001" --sink-type="matrixone" --sink-uri="mysql://dump:[email protected]:3306"    --tables='test_db.orders_15k:mo_db.orders_15k' --level="account"  --account="sys"

Additional information

No response

[ck89119]

replace算子的问题

mysql> /* adfa */ replace into t0 values (3);
ERROR 1105 (HY000): You have an error in your SQL syntax; check the manual that corresponds to your MatrixOne server version for the right syntax to use. syntax error at line 1 column 9 near "  */ replace into t0 values (3)";

[heni02]

还是报表不存在 commit:f9b8368 mo log: http://10.222.6.1/explore?panes=%7B%22VCp%22:%7B%22datasource%22:%22loki%22,%22queries%22:%5B%7B%22refId%22:%22A%22,%22expr%22:%22%7Bnamespace%3D%5C%22mo-cdc-test%5C%22%7D%20%7C%3D%20%60tpch_100g.orders%60%22,%22queryType%22:%22range%22,%22datasource%22:%7B%22type%22:%22loki%22,%22uid%22:%22loki%22%7D,%22editorMode%22:%22builder%22%7D%5D,%22range%22:%7B%22from%22:%221729246141963%22,%22to%22:%221729249741963%22%7D%7D%7D&schemaVersion=1&orgId=1

[heni02]

下游mo链接信息用户密码错误测试了下，日志也是报no such table，参考下

http://10.222.6.1/explore?panes=%7B%22JhH%22:%7B%22datasource%22:%22loki%22,%22queries%22:%5B%7B%22refId%22:%22A%22,%22expr%22:%22%7Bnamespace%3D%5C%22mo-cdc-test%5C%22%7D%20%7C%3D%20%60orders%60%22,%22queryType%22:%22range%22,%22datasource%22:%7B%22type%22:%22loki%22,%22uid%22:%22loki%22%7D,%22editorMode%22:%22builder%22%7D%5D,%22range%22:%7B%22from%22:%221729493222399%22,%22to%22:%221729496822399%22%7D%7D%7D&schemaVersion=1&orgId=1

[ck89119]

还是replace的问题，复现步骤：

create database test_db;
use test_db;
create table t0 (a int primary key);

create database test;
use test;
replace into test_db.t0 values (1);   #[42S02][1146] no such table test.t0

[heni02]

回归验证创建同步任务到mo，下游mo报panic错误，服务挂掉 commit:967435ecc

mo log: https://shanghai.idc.matrixorigin.cn:30001/explore?panes=%7B%22GYP%22:%7B%22datasource%22:%22loki%22,%22queries%22:%5B%7B%22refId%22:%22A%22,%22expr%22:%22%7Bhost%3D%5C%2210-222-1-128%5C%22,%20filename%3D%5C%22%2Fdata1%2Frunners%2Faction-runner%2F_work%2Fmo-nightly-regression%2Fmo-nightly-regression%2Fhead%2Fmo-service-967435ec-20241028-070417.log%5C%22%7D%20%7C%3D%20%60panic%60%22,%22queryType%22:%22range%22,%22datasource%22:%7B%22type%22:%22loki%22,%22uid%22:%22loki%22%7D,%22editorMode%22:%22builder%22%7D%5D,%22range%22:%7B%22from%22:%221730082841000%22,%22to%22:%221730082842000%22%7D%7D%7D&schemaVersion=1&orgId=1

[ck89119]

复现问题，mo执行一条超长的replace into会stack overflow

sql片段， 需要全部sql私聊我

/* [0-0, 1730089025713908000-1) */REPLACE INTO `tpch_10g`.`orders` VALUES (1,369001,'O','186600.18','1996-01-02','5-LOW','Clerk#000009506',0,'nstructions sleep furiously among '),(2,780017,'O','66219.63','1996-12-01','1-URGENT','Clerk#000008792',0,' foxes. pending accounts at the pending, silent asymptot'),(3,1233140,'F','270741.97','1993-10-14','5-LOW','Clerk#000009543',0,'sly final accounts boost. carefully regular ideas cajole carefully. depos'),(4,1367761,'O','41714.38','1995-10-11','5-LOW','Clerk#000001234',0,'sits. slyly regular warthogs cajole. regular, regular theodolites acro'),(5,444848,'F','122444.33','1994-07-30','5-LOW','Clerk#000009248',0,'quickly. bold deposits sleep slyly. packages use slyly'),(6,556222,'F','50883.96','1992-02-21','4-NOT SPECIFIED','Clerk#000000580',0,'ggle. special, final requests are against the furiously specia'),(7,391343,'O','287534.80','1996-01-10','2-HIGH','Clerk#000004697',0,'ly special requests '),(32,1300570,'O','129634.85','1995-07-16','2-HIGH','Clerk#000006157',0,'ise blithely bold, regular requests. quickly unusual dep'),(33,669580,'F','126998.88','1993-10-27','3-MEDIUM','Clerk#000004086',0,'uriously. furiously final request'),(34,610001,'O','55314.82','1998-07-21','3-MEDIUM','Clerk#000002228',0,'ly final packages. fluffily final deposits wake blithely ideas. spe'),(35,1275877,'O','219853.63','1995-10-23','4-NOT SPECIFIED','Clerk#000002584',0,'zzle. carefully enticing deposits nag furio'),(36,1152518,'O','67366.95','1995-11-03','1-URGENT','Clerk#000003571',0,' quick packages are blithely. slyly silent accounts wake qu'),(37,861145,'F','159656.83','1992-06-03','3-MEDIUM','Clerk#000004556',0,'kly regular pinto beans. carefully unusual waters cajole never'),(38,1248280,'O','62356.62','1996-08-21','4-NOT SPECIFIED','Clerk#000006037',0,'haggle blithely. furiously express ideas haggle blithely furiously regular re'),(39,817625,'O','328710.77','1996-09-20','3-MEDIUM','Clerk#000006586',0,'ole express, ironic requests: ir'),(64,321127,'F','29881.68','1994-07-16','3-MEDIUM','Clerk#000006603',0,'wake fluffily. sometimes ironic pinto beans about the dolphin'),(65,162511,'P','116796.77','1995-03-18','1-URGENT','Clerk#000006320',0,'ular requests are blithely pending orbits-- even requests against the deposit'),(66,1291996,'F','121760.68','1994-01-20','5-LOW','Clerk#000007423',0,'y pending requests integrate'),(67,566122,'O','142088.50','1996-12-19','4-NOT SPECIFIED','Clerk#000005465',0,'symptotes haggle slyly around the furiously iron'),(68,285469,'O','352983.62','1998-04-18','3-MEDIUM','Clerk#000004394',0,' pinto beans sleep carefully. blithely ironic deposits haggle furiously acro'),(69,844865,'F','236134.16','1994-06-04','4-NOT SPECIFIED','Clerk#000003299',0,' depths atop the slyly thin deposits detect among the furiously silent accou'),(70,643396,'F','124745.92','1993-12-18','5-LOW','Clerk#000003217',0,' carefully ironic request'),(71,33712,'O','251370.01','1998-01-24','4-NOT SPECIFIED','Clerk#000002702',0,' express deposits along the blithely regul'),(96,1077778,'F','98522.68','1994-04-17','2-HIGH','Clerk#000003946',0,'oost furiously. pinto'),(97,210601,'F','128769.34','1993-01-29','3-MEDIUM','Clerk#000005469',0,'hang blithely along the regular accounts. furiously even ideas after the'),(98,1044797,'F','62608.62','1994-09-25','1-URGENT','Clerk#000004478',0,'c asymptotes. quickly regular packages should have to nag re'),(99,889093,'F','142581.04','1994-03-13','4-NOT SPECIFIED','Clerk#000009723',0,'e carefully ironic packages. pending'),(100,1470031,'O','212771.20','1998-02-28','4-NOT SPECIFIED','Clerk#000005761',0,'heodolites detect slyly alongside of the ent'),(101,279974,'O','144299.54','1996-03-17','3-MEDIUM','Clerk#000004182',0,'ding accounts above the slyly final asymptote'),(102,7159,'O','138498.28','1997-05-09','2-HIGH','Clerk#000005952',0,' slyly according to the asymptotes. carefully final packages integrate furious'),(103,290995,'O','130367.08','1996-06-20','4-NOT SPECIFIED','Clerk#000000897',0,'ges. carefully unusual instructions haggle quickly regular f'),(128,739556,'F','44851.88','1992-06-15','1-URGENT','Clerk#000003842',0,'ns integrate fluffily. ironic asymptotes after the regular excuses nag around '),(129,711334,'F','300188.45','1992-11-19','5-LOW','Clerk#000008587',0,'ing tithes. carefully pending deposits boost about the silently express '),(130,369634,'F','163405.51','1992-05-08','2-HIGH','Clerk#000000353',0,'le slyly unusual, regular packages? express deposits det'),(131,927487,'F','122731.75','1994-06-08','3-MEDIUM','Clerk#000006249',0,'after the fluffily special foxes integrate s'),(132,263935,'F','177783.84','1993-06-11','3-MEDIUM','Clerk#000004871',0,'sits are daringly accounts. carefully regular foxes sleep slyly about the'),(133,439999,'O','118343.96','1997-11-29','1-URGENT','Clerk#000007373',0,'usly final asymptotes '),(134,61975,'F','191042.32','1992-05-01','4-NOT SPECIFIED','Clerk#000007110',0,'lar theodolites boos'),(135,604798,'O','213625.91','1995-10-21','4-NOT SPECIFIED','Clerk#000008034',0,'l platelets use according t'),(160,824935,'O','164832.69','1996-12-19','4-NOT SPECIFIED','Clerk#000003414',0,'thely special sauternes wake slyly of t'),(161,166190,'F','19397.81','1994-08-31','2-HIGH','Clerk#000003213',0,'carefully! special instructions sin'),(162,141155,'O','3705.36','1995-05-08','3-MEDIUM','Clerk#000003779',0,'nts hinder fluffily ironic instructions. express, express excuses '),(163,877582,'O','161689.56','1997-09-05','3-MEDIUM','Clerk#000003784',0,'y final packages. final foxes since the quickly even'),(164,7781,'F','274276.61','1992-10-21','5-LOW','Clerk#000002087',0,'cajole ironic courts. slyly final ideas are slyly. blithely final Tiresias sub'),(165,272362,'F','223355.65','1993-01-30','4-NOT SPECIFIED','Clerk#000002919',0,'across the blithely regular accounts. bold'),(166,1078105,'O','156191.39','1995-09-12','2-HIGH','Clerk#000004391',0,'lets. ironic, bold asymptotes kindle'),(167,1194016,'F','81414.50','1993-01-04','4-NOT SPECIFIED','Clerk#000007307',0,'s nag furiously bold excuses. fluffily iron'),(192,825686,'O','154349.95','1997-11-25','5-LOW','Clerk#000004828',0,'y unusual platelets among the final instructions integrate rut'),(193,790601,'F','78448.35','1993-08-08','1-URGENT','Clerk#000000246',0,'the furiously final pin'),(194,617236,'F','178340.62','1992-04-05','3-MEDIUM','Clerk#000003513',0,'egular requests haggle slyly regular, regular pinto beans. asymptote'),(195,1354207,'F','176122.64','1993-12-28','3-MEDIUM','Clerk#000002160',0,'old forges are furiously sheaves. slyly fi'),(196,648232,'F','52391.22','1993-03-17','2-HIGH','Clerk#000009872',0,'beans boost at the foxes. silent foxes'),(197,325109,'P','166996.97','1995-04-07','2-HIGH','Clerk#000009684',0,'solve quickly about the even braids. carefully express deposits affix care'),(198,1102162,'O','204109.73','1998-01-02','4-NOT SPECIFIED','Clerk#000003309',0,'its. carefully ironic requests sleep. furiously express fox'),(199,529693,'O','143655.44','1996-03-07','2-HIGH','Clerk#000004888',0,'g theodolites. special packag'),(224,24742,'F','217429.39','1994-06-18','4-NOT SPECIFIED','Clerk#000006415',0,'r the quickly thin courts. carefully'),(225,330296,'P','230931.68','1995-05-25','1-URGENT','Clerk#000001763',0,'s. blithely ironic accounts wake quickly fluffily special acc'),(226,1274654,'F','227212.14','1993-03-10','2-HIGH','Clerk#000007560',0,'s are carefully at the blithely ironic acc'),(227,98825,'O','50134.13','1995-11

[ouyuanning]

短时间无法处理。目前replace的处理方式是改写成2条sql， 得等龙冉的DML重构分支合并后处理

[heni02]

和产品沟通，2.0 cdc暂不支持mo cdc to mo，挪到下一版本

[ouyuanning]

短时间无法处理。目前replace的处理方式是改写成2条sql， 得等龙冉的DML重构分支合并后处理

[ouyuanning]

等龙冉的DML重构分支合并后处理

[ouyuanning]

下周跟龙冉确认下replace的分工

[ouyuanning]

待跟龙冉确认是否转龙冉

[aunjgr]

等下一个版本重构

[aunjgr]

等重构

[ck89119]

复现问题，mo执行一条超长的replace into会stack overflow

sql片段， 需要全部sql私聊我

/* [0-0, 1730089025713908000-1) */REPLACE INTO `tpch_10g`.`orders` VALUES (1,369001,'O','186600.18','1996-01-02','5-LOW','Clerk#000009506',0,'nstructions sleep furiously among '),(2,780017,'O','66219.63','1996-12-01','1-URGENT','Clerk#000008792',0,' foxes. pending accounts at the pending, silent asymptot'),(3,1233140,'F','270741.97','1993-10-14','5-LOW','Clerk#000009543',0,'sly final accounts boost. carefully regular ideas cajole carefully. depos'),(4,1367761,'O','41714.38','1995-10-11','5-LOW','Clerk#000001234',0,'sits. slyly regular warthogs cajole. regular, regular theodolites acro'),(5,444848,'F','122444.33','1994-07-30','5-LOW','Clerk#000009248',0,'quickly. bold deposits sleep slyly. packages use slyly'),(6,556222,'F','50883.96','1992-02-21','4-NOT SPECIFIED','Clerk#000000580',0,'ggle. special, final requests are against the furiously specia'),(7,391343,'O','287534.80','1996-01-10','2-HIGH','Clerk#000004697',0,'ly special requests '),(32,1300570,'O','129634.85','1995-07-16','2-HIGH','Clerk#000006157',0,'ise blithely bold, regular requests. quickly unusual dep'),(33,669580,'F','126998.88','1993-10-27','3-MEDIUM','Clerk#000004086',0,'uriously. furiously final request'),(34,610001,'O','55314.82','1998-07-21','3-MEDIUM','Clerk#000002228',0,'ly final packages. fluffily final deposits wake blithely ideas. spe'),(35,1275877,'O','219853.63','1995-10-23','4-NOT SPECIFIED','Clerk#000002584',0,'zzle. carefully enticing deposits nag furio'),(36,1152518,'O','67366.95','1995-11-03','1-URGENT','Clerk#000003571',0,' quick packages are blithely. slyly silent accounts wake qu'),(37,861145,'F','159656.83','1992-06-03','3-MEDIUM','Clerk#000004556',0,'kly regular pinto beans. carefully unusual waters cajole never'),(38,1248280,'O','62356.62','1996-08-21','4-NOT SPECIFIED','Clerk#000006037',0,'haggle blithely. furiously express ideas haggle blithely furiously regular re'),(39,817625,'O','328710.77','1996-09-20','3-MEDIUM','Clerk#000006586',0,'ole express, ironic requests: ir'),(64,321127,'F','29881.68','1994-07-16','3-MEDIUM','Clerk#000006603',0,'wake fluffily. sometimes ironic pinto beans about the dolphin'),(65,162511,'P','116796.77','1995-03-18','1-URGENT','Clerk#000006320',0,'ular requests are blithely pending orbits-- even requests against the deposit'),(66,1291996,'F','121760.68','1994-01-20','5-LOW','Clerk#000007423',0,'y pending requests integrate'),(67,566122,'O','142088.50','1996-12-19','4-NOT SPECIFIED','Clerk#000005465',0,'symptotes haggle slyly around the furiously iron'),(68,285469,'O','352983.62','1998-04-18','3-MEDIUM','Clerk#000004394',0,' pinto beans sleep carefully. blithely ironic deposits haggle furiously acro'),(69,844865,'F','236134.16','1994-06-04','4-NOT SPECIFIED','Clerk#000003299',0,' depths atop the slyly thin deposits detect among the furiously silent accou'),(70,643396,'F','124745.92','1993-12-18','5-LOW','Clerk#000003217',0,' carefully ironic request'),(71,33712,'O','251370.01','1998-01-24','4-NOT SPECIFIED','Clerk#000002702',0,' express deposits along the blithely regul'),(96,1077778,'F','98522.68','1994-04-17','2-HIGH','Clerk#000003946',0,'oost furiously. pinto'),(97,210601,'F','128769.34','1993-01-29','3-MEDIUM','Clerk#000005469',0,'hang blithely along the regular accounts. furiously even ideas after the'),(98,1044797,'F','62608.62','1994-09-25','1-URGENT','Clerk#000004478',0,'c asymptotes. quickly regular packages should have to nag re'),(99,889093,'F','142581.04','1994-03-13','4-NOT SPECIFIED','Clerk#000009723',0,'e carefully ironic packages. pending'),(100,1470031,'O','212771.20','1998-02-28','4-NOT SPECIFIED','Clerk#000005761',0,'heodolites detect slyly alongside of the ent'),(101,279974,'O','144299.54','1996-03-17','3-MEDIUM','Clerk#000004182',0,'ding accounts above the slyly final asymptote'),(102,7159,'O','138498.28','1997-05-09','2-HIGH','Clerk#000005952',0,' slyly according to the asymptotes. carefully final packages integrate furious'),(103,290995,'O','130367.08','1996-06-20','4-NOT SPECIFIED','Clerk#000000897',0,'ges. carefully unusual instructions haggle quickly regular f'),(128,739556,'F','44851.88','1992-06-15','1-URGENT','Clerk#000003842',0,'ns integrate fluffily. ironic asymptotes after the regular excuses nag around '),(129,711334,'F','300188.45','1992-11-19','5-LOW','Clerk#000008587',0,'ing tithes. carefully pending deposits boost about the silently express '),(130,369634,'F','163405.51','1992-05-08','2-HIGH','Clerk#000000353',0,'le slyly unusual, regular packages? express deposits det'),(131,927487,'F','122731.75','1994-06-08','3-MEDIUM','Clerk#000006249',0,'after the fluffily special foxes integrate s'),(132,263935,'F','177783.84','1993-06-11','3-MEDIUM','Clerk#000004871',0,'sits are daringly accounts. carefully regular foxes sleep slyly about the'),(133,439999,'O','118343.96','1997-11-29','1-URGENT','Clerk#000007373',0,'usly final asymptotes '),(134,61975,'F','191042.32','1992-05-01','4-NOT SPECIFIED','Clerk#000007110',0,'lar theodolites boos'),(135,604798,'O','213625.91','1995-10-21','4-NOT SPECIFIED','Clerk#000008034',0,'l platelets use according t'),(160,824935,'O','164832.69','1996-12-19','4-NOT SPECIFIED','Clerk#000003414',0,'thely special sauternes wake slyly of t'),(161,166190,'F','19397.81','1994-08-31','2-HIGH','Clerk#000003213',0,'carefully! special instructions sin'),(162,141155,'O','3705.36','1995-05-08','3-MEDIUM','Clerk#000003779',0,'nts hinder fluffily ironic instructions. express, express excuses '),(163,877582,'O','161689.56','1997-09-05','3-MEDIUM','Clerk#000003784',0,'y final packages. final foxes since the quickly even'),(164,7781,'F','274276.61','1992-10-21','5-LOW','Clerk#000002087',0,'cajole ironic courts. slyly final ideas are slyly. blithely final Tiresias sub'),(165,272362,'F','223355.65','1993-01-30','4-NOT SPECIFIED','Clerk#000002919',0,'across the blithely regular accounts. bold'),(166,1078105,'O','156191.39','1995-09-12','2-HIGH','Clerk#000004391',0,'lets. ironic, bold asymptotes kindle'),(167,1194016,'F','81414.50','1993-01-04','4-NOT SPECIFIED','Clerk#000007307',0,'s nag furiously bold excuses. fluffily iron'),(192,825686,'O','154349.95','1997-11-25','5-LOW','Clerk#000004828',0,'y unusual platelets among the final instructions integrate rut'),(193,790601,'F','78448.35','1993-08-08','1-URGENT','Clerk#000000246',0,'the furiously final pin'),(194,617236,'F','178340.62','1992-04-05','3-MEDIUM','Clerk#000003513',0,'egular requests haggle slyly regular, regular pinto beans. asymptote'),(195,1354207,'F','176122.64','1993-12-28','3-MEDIUM','Clerk#000002160',0,'old forges are furiously sheaves. slyly fi'),(196,648232,'F','52391.22','1993-03-17','2-HIGH','Clerk#000009872',0,'beans boost at the foxes. silent foxes'),(197,325109,'P','166996.97','1995-04-07','2-HIGH','Clerk#000009684',0,'solve quickly about the even braids. carefully express deposits affix care'),(198,1102162,'O','204109.73','1998-01-02','4-NOT SPECIFIED','Clerk#000003309',0,'its. carefully ironic requests sleep. furiously express fox'),(199,529693,'O','143655.44','1996-03-07','2-HIGH','Clerk#000004888',0,'g theodolites. special packag'),(224,24742,'F','217429.39','1994-06-18','4-NOT SPECIFIED','Clerk#000006415',0,'r the quickly thin courts. carefully'),(225,330296,'P','230931.68','1995-05-25','1-URGENT','Clerk#000001763',0,'s. blithely ironic accounts wake quickly fluffily special acc'),(226,1274654,'F','227212.14','1993-03-10','2-HIGH','Clerk#000007560',0,'s are carefully at the blithely ironic acc'),(227,98825,'O','50134.13','1995-11

现在执行不再会报错，但是执行时间非常长（同样的sql语句mysql秒执行），还需优化

[aunjgr]

replace重構PR已經合併，待節後確認是否修復

[aunjgr]

麻烦 @heni02 帮验证一下，replace重构是否已经解决这个问题？

[heni02]

目前2.1和main都已支持mo cdc mo，closed