seatunnel icon indicating copy to clipboard operation
seatunnel copied to clipboard

[Bug] sqlservercdc 不支持增量同步

Open Xuzhengz opened this issue 2 years ago • 0 comments

Search before asking

  • [X] I had searched in the issues and found no similar issues.

What happened

sqlservercdc 只支持快照同步,后续快照同步完成,在对源库增删改不会同步

SeaTunnel Version

2.3.2

SeaTunnel Config

env {
"job.mode"=STREAMING
"job.name"="SeaTunnel_Job"
"checkpoint.interval"="10000"
}
source {
SqlServer-CDC {
    "startup.mode"=INITIAL
    "parallelism"="2"
    "format"=DEFAULT
    "exactly_once"="true"
    "incremental.parallelism"=1
    "snapshot.split.size"=8096
    "stop.mode"=NEVER
    "result_table_name"=cdc_test
    catalog {
        factory=SqlServer
    }
    database-names=[
        ocean
    ]
    table-names=[
        "ocean.mdm.test2_sqlserver_cdc",
    ]
    password="******"
    username="sa"
    base-url="jdbc:sqlserver://172.16.11.123:1433;databaseName=ocean"
}
}
sink {
    jdbc {
        url = "jdbc:mysql://172.16.11.131:3306/test1mysql"
        driver = "com.mysql.cj.jdbc.Driver"
        user = "mysql"
        source_table_name = "cdc_test"
        password = "******"
        generate_sink_sql = true
        # You need to configure both database and table
        database = test1mysql
        table = cdc_test
        primary_keys = ["INTEGER"]
    }
}

Running Command

seatunnel.sh --confg job/sqlservercdc.conf

Error Exception

没有任何异常

Flink or Spark Version

No response

Java or Scala Version

1.8

Screenshots

No response

Are you willing to submit PR?

  • [ ] Yes I am willing to submit a PR!

Code of Conduct

Xuzhengz avatar Jul 15 '23 01:07 Xuzhengz