seatunnel
seatunnel copied to clipboard
[Bug] sqlservercdc 不支持增量同步
Search before asking
- [X] I had searched in the issues and found no similar issues.
What happened
sqlservercdc 只支持快照同步,后续快照同步完成,在对源库增删改不会同步
SeaTunnel Version
2.3.2
SeaTunnel Config
env {
"job.mode"=STREAMING
"job.name"="SeaTunnel_Job"
"checkpoint.interval"="10000"
}
source {
SqlServer-CDC {
"startup.mode"=INITIAL
"parallelism"="2"
"format"=DEFAULT
"exactly_once"="true"
"incremental.parallelism"=1
"snapshot.split.size"=8096
"stop.mode"=NEVER
"result_table_name"=cdc_test
catalog {
factory=SqlServer
}
database-names=[
ocean
]
table-names=[
"ocean.mdm.test2_sqlserver_cdc",
]
password="******"
username="sa"
base-url="jdbc:sqlserver://172.16.11.123:1433;databaseName=ocean"
}
}
sink {
jdbc {
url = "jdbc:mysql://172.16.11.131:3306/test1mysql"
driver = "com.mysql.cj.jdbc.Driver"
user = "mysql"
source_table_name = "cdc_test"
password = "******"
generate_sink_sql = true
# You need to configure both database and table
database = test1mysql
table = cdc_test
primary_keys = ["INTEGER"]
}
}
Running Command
seatunnel.sh --confg job/sqlservercdc.conf
Error Exception
没有任何异常
Flink or Spark Version
No response
Java or Scala Version
1.8
Screenshots
No response
Are you willing to submit PR?
- [ ] Yes I am willing to submit a PR!
Code of Conduct
- [X] I agree to follow this project's Code of Conduct