dinky icon indicating copy to clipboard operation
dinky copied to clipboard

cdc 整库到 多 Sink,报错 Could not find any factory for identifier 'datastream-kafka'

Open kaiwangleo opened this issue 7 months ago • 3 comments

Search before asking

  • [x] I had searched in the issues and found no similar issues.

What happened

cdc 整库到 多 Sink,报错 Could not find any factory for identifier 'datastream-kafka'

What you expected to happen

使用下述sql 实现cdc 整库到 多 Sink,报错 Could not find any factory for identifier 'datastream-kafka' EXECUTE CDCSOURCE jobname WITH ( 'connector' = 'mysql-cdc', 'hostname' = '127.0.0.1', 'port' = '3306', 'username' = 'root', 'password' = '123456', 'checkpoint' = '3000', 'scan.startup.mode' = 'initial', 'parallelism' = '1', 'table-name' = 'test.student,test.score', 'sink[0].connector' = 'doris', 'sink[0].fenodes' = '127.0.0.1:8030', 'sink[0].username' = 'root', 'sink[0].password' = 'dw123456', 'sink[0].sink.batch.size' = '1', 'sink[0].sink.max-retries' = '1', 'sink[0].sink.batch.interval' = '60000', 'sink[0].sink.db' = 'test', 'sink[0].table.prefix' = 'ODS_', 'sink[0].table.upper' = 'true', 'sink[0].table.identifier' = '#{schemaName}.#{tableName}', 'sink[0].sink.label-prefix' = '#{schemaName}_#{tableName}_1', 'sink[0].sink.enable-delete' = 'true', 'sink[1].connector'='datastream-kafka', 'sink[1].topic'='cdc', 'sink[1].brokers'='127.0.0.1:9092' )

How to reproduce

使用下述sql 实现cdc 整库到 多 Sink,报错 Could not find any factory for identifier 'datastream-kafka' EXECUTE CDCSOURCE jobname WITH ( 'connector' = 'mysql-cdc', 'hostname' = '127.0.0.1', 'port' = '3306', 'username' = 'root', 'password' = '123456', 'checkpoint' = '3000', 'scan.startup.mode' = 'initial', 'parallelism' = '1', 'table-name' = 'test.student,test.score', 'sink[0].connector' = 'doris', 'sink[0].fenodes' = '127.0.0.1:8030', 'sink[0].username' = 'root', 'sink[0].password' = 'dw123456', 'sink[0].sink.batch.size' = '1', 'sink[0].sink.max-retries' = '1', 'sink[0].sink.batch.interval' = '60000', 'sink[0].sink.db' = 'test', 'sink[0].table.prefix' = 'ODS_', 'sink[0].table.upper' = 'true', 'sink[0].table.identifier' = '#{schemaName}.#{tableName}', 'sink[0].sink.label-prefix' = '#{schemaName}_#{tableName}_1', 'sink[0].sink.enable-delete' = 'true', 'sink[1].connector'='datastream-kafka', 'sink[1].topic'='cdc', 'sink[1].brokers'='127.0.0.1:9092' )

Anything else

No response

Version

1.2.3

Are you willing to submit PR?

  • [ ] Yes I am willing to submit a PR!

Code of Conduct

kaiwangleo avatar May 15 '25 12:05 kaiwangleo

你同步单个Sink 可以成功吗 请问下 你用的 flink和cdc 的版本是多少

Selegant avatar Jun 06 '25 03:06 Selegant

add dinky-cdc-plus.jar

aiwenmo avatar Jul 09 '25 10:07 aiwenmo

Hello @, this issue has not been active for more than 30 days. This issue will be closed in 7 days if there is no response. If you have any questions, you can comment and reply.

你好 @, 这个 issue 30 天内没有活跃,7 天后将关闭,如需回复,可以评论回复。

github-actions[bot] avatar Sep 01 '25 00:09 github-actions[bot]