flink-cdc
flink-cdc copied to clipboard
apache
Flink CDC is a streaming data integration tool
As shown in https://issues.apache.org/jira/browse/FLINK-34688 : In Mysql CDC, MysqlSnapshotSplitAssigner splits snapshot chunks asynchronously(https://github.com/apache/flink-cdc/pull/931). But CDC framework lacks it. If table is too big to split, the enumerator will be stuck,...
Cherry-picked from #3583.
We should applySchemaChange (where the route rule works) first and lenientize its result then, or we may not be able to get evolved schema since tableId isn't routed: ``` Caused...
If the SQL Server source connector is restarted while handling updates from a transaction with multiple updates, upon restart, it will skip the non-processed changes and proceed from the next...
paimon cdc schema evolution failure when restart job Minimal reproduce step： 1. stop flink-cdc-mysql-to-paimon pipeline job 2. alter mysql table schema, such as add column 2. start pipeline job 3....
This closes FLINK-36151 by adding missing schema evolution related concepts into Flink CDC docs.
This pull request reuses the contribution under https://github.com/apache/flink-cdc/pull/3445 and fixes the outstanding issues in the underlying code to get it fully operational.
Improve the stability of pipeline e2e tests by setting a larger checkpoint interval
Fix elasticsearch dependency version by use `${project.version}`. When executing `mvn versions:set -DnewVersion=xxx`, compilation fails.
# ISSUE Hi, when I was using Flink CDC Postgre, I chose 'debezium.snapshot.mode' = 'never' to skip the snapshot phase, but the code still entered the snapshot branch, and this...
