flink-cdc
flink-cdc copied to clipboard
apache
Flink CDC is a streaming data integration tool
This PR added the omitted Iceberg connector into the CI test matrix. Also split the pipeline connector UT into individual stages as the number of connectors has increased a lot.
close FLINK-37275. FLINK-36315 supported the flink-cdc-base module source metric statistics, and FLINK-37231 added the metrics documentation. However, the MySQL source currently does not support source metric statistics.
This closes FLINK-37963. Occasionally, test cases related to triggering JM failover might fail, with an NPE thrown when manipulating jobManagerLeaderServices (like https://github.com/apache/flink-cdc/actions/runs/15509047609/job/43667549280). It is likely to be caused by uninitialised...
## Description In the [documentation](https://nightlies.apache.org/flink/flink-cdc-docs-release-3.1/docs/connectors/flink-sources/postgres-cdc/#data-type-mapping) doesn't mention a way to map between postgres type arrays and flink datatype. ### Details This PR add a way to process arrays. For primitive...
As a user of the FlinkPipelineComposer API, I would like to run jobs with a pre-configured StreamExecutionEnvironment of my choosing, for commonality with executing non-Flink-CDC jobs. However, the API only...
[FLINK-37331][tests] Add comprehensive data type coverage tests for new MysqlSource implementation
The new implementation of `MysqlSource` lacks the full type test cases. We should add them to verify it can work well in the new implementation. I add the following test...
This closes [FLINK-37293](https://issues.apache.org/jira/browse/FLINK-37293)
When users need to ignore some privacy fields or large fields from the collection end, column.include.list/column.exclude.list may be used. At this time, the pipeline may fail due to schema inconsistency....
https://issues.apache.org/jira/browse/FLINK-35713
