paimon icon indicating copy to clipboard operation
paimon copied to clipboard

[Flink]Supports SQLServer cdc

Open sunxiaojian opened this issue 1 year ago • 9 comments

Purpose

Linked issue: close (https://github.com/apache/incubator-paimon/issues/2399) Add SQLServer cdc connector

sunxiaojian avatar Nov 27 '23 12:11 sunxiaojian

Thanks @sunxiaojian

But I hardly ever hear of anyone wanting to use sqlserver cdc.

JingsongLi avatar Dec 13 '23 06:12 JingsongLi

Thanks @sunxiaojian

But I hardly ever hear of anyone wanting to use sqlserver cdc.

@JingsongLi In fact, many government and enterprise users still use SQL Server and Oracle to store data, and the companies that provide them with data services require this feature

sunxiaojian avatar Dec 30 '23 15:12 sunxiaojian

Many ERP systems use sqlserver,

melin avatar Dec 30 '23 15:12 melin

@JingsongLi Currently, there are still some requirements for SqlServer cdc. I have re adapted the new API and look forward to a review

sunxiaojian avatar Feb 20 '24 10:02 sunxiaojian

So, Where can I find the relevant code? I also developed SqlServer CDC Action and want to contribute to paimon.

renxiaoyao avatar Feb 27 '24 09:02 renxiaoyao

So, Where can I find the relevant code? I also developed SqlServer CDC Action and want to contribute to paimon.

@renxiaoyao Waiting for review @JingsongLi @yuzelin @zhuangchong PTAL

sunxiaojian avatar Feb 27 '24 09:02 sunxiaojian

not support schema changes?

cs3163077 avatar Mar 01 '24 08:03 cs3163077

not support schema changes?

Yes, the current version of sqlserver cdc is not supported yet, and data parsing errors will occur. I will continue to follow up, or contribute code to cdc to support this feature.

sunxiaojian avatar Mar 01 '24 09:03 sunxiaojian

@JingsongLi @yuzelin If you have time, could you please help review it

sunxiaojian avatar Mar 15 '24 12:03 sunxiaojian