flink-cdc

flink-cdc copied to clipboard

[FLINK-35323][runtime] Fix transform failure when one rule matches multiple tables with incompatible schema

1

This closes [FLINK-35323](https://issues.apache.org/jira/browse/FLINK-35323). Currently, Transform module doesn’t support handling multiple tables with different schema within one projection / filtering rule. A minimum reproducible example is: ```yaml transform: - source-table: DB.TABLE\.*...

yuxiqian

This pull request fixes license and NOTICE files and add CI check in Flink CDC.

PatrickRen

[FLINK-35243][cdc] Supports more schema change event types & backfill pre-schema payload for sink

3

This PR closes [FLINK-35243](https://issues.apache.org/jira/browse/FLINK-35243): * Supports `AlterColumnCommentEvent`, `AlterTableCommentEvent`, `DropTableEvent`, `RenameTableEvent`, and `TruncateTableEvent` in pipeline framework * Adds `SchemaChangeEventWithPreSchema` interface, allowing SchemaRegistry backfilling schema before change payload * Fixed MySQL pipeline...

yuxiqian

[FLINK-35317][cli] Supports submitting multiple pipeline jobs at once

2

This closes [FLINK-35317](https://issues.apache.org/jira/browse/FLINK-35317). Currently, Flink CDC CLI only allows submitting one YAML pipeline job each time. This PR allows submitting multiple .yml files at once like this: `./bin/flink-cdc.sh job1.yml job2.yml...

yuxiqian

This closes [FLINK-35314](https://issues.apache.org/jira/browse/FLINK-35314).

aiwenmo

This closes [FLINK-35316](https://issues.apache.org/jira/browse/FLINK-35316). Since Flink 1.19 has been generally available, Flink CDC should keep the compatibility with it. This PR changes E2e test cases, updates minor version number to ensure...

yuxiqian

[FLINK-35281][hotfix][cdc-common] FlinkEnvironmentUtils#addJar add each jar only once

1

Current org.apache.flink.cdc.composer.flink.FlinkEnvironmentUtils#addJar will be invoked for each source and sink. ```java public static void addJar(StreamExecutionEnvironment env, URL jarUrl) { try { Class envClass = StreamExecutionEnvironment.class; Field field = envClass.getDeclaredField("configuration"); field.setAccessible(true);...

loserwang1024

[FLINK-35291] Improve the ROW data deserialization performance of DebeziumEventDeserializationScheme

5

#flink-35291

lzshlzsh

In JDK 8 and earlier version, if multiple threads invoke `Class.forName("com.xx.Driver")` simultaneously, it may cause jdbc driver deadlock. [FLINK-19435](https://issues.apache.org/jira/browse/FLINK-19435)  analyzes this problem.

Shawn-Hx

Improve MySqlStreamingChangeEventSource to skip null events in event deserializer.

Shawn-Hx