flink-cdc

flink-cdc copied to clipboard

[FLINK-36165][source-connector/mysql] Support capturing snapshot data with conditions

12

Hey, this is an implementation designed to capture snapshot data with filtering conditions. For example, by specifying `scan.snapshot.filters: db.user_table:id > 200;`, we can synchronize only the user data where the...

uicosp

[FLINK-37676][cdc-common] Add caching mechanism to Selectors for improved performance

4

Refer to https://issues.apache.org/jira/browse/FLINK-37676 Adding a cache for better performance.

joyCurry30

[hotfix][postgres] PostgresSourceFetchTaskContext log do not output P…

2

log output format and text

hql0312

[hotfix][postgres] Flink CDC Postgres Connector subsribe regular expression

4

copy from https://github.com/apache/flink-cdc/pull/3808

hql0312

[FLINK-37065]: MySQL cdc fix method 'fixRestoredGtidSet' to support gt…

3

This PR closes: [FLINK-37065](https://issues.apache.org/jira/browse/FLINK-37065) ticket. The new `fixRestoredGtidSet` implementation preserves GTID gaps by merging the server and restored GTID sets interval-by-interval, ensuring no unprocessed transactions are skipped or flattened.

mielientiev

[improve] Remove repeated dependency.

1

Remove repeated dependency of maxcompute, and change the phase of "download-flink-release" in pipeline-e2e-test.

joyCurry30

[Docs] Update mysql-to-doris.md, add scan.startup.mode config to make demo run more smoothly

3

When not set scan.startup.mode to earliest-offset, will use intial mode，the next part about incrementing data will not work. That's not very friendly to new starters.

maixiaohai

current local mode lacks loading additionalJars and flinkConf Local mode is convenient for development and debug 

MOBIN-F

[FLINK-37585] [cdc-connector][mysql] Fixed the data of the newly added table cannot be read

2

Fixed the data of the newly added table cannot be read

jeff-zou

[postgres] fix when backfill will scan all table schame which match config

3

copy pr https://github.com/apache/flink-cdc/pull/3979

hql0312