flink-connector-kafka
flink-connector-kafka copied to clipboard
Apache flink
## What is the purpose of the change Allows writing to different Kafka topics based on the `topic` metadata column value in SQL, and updates the Table API's `KafkaDynamicSink` to...
Update Flink version 1.20.0 to prepare support Lineage integration
change `DEFAULT_KAFKA_TRANSACTION_TIMEOUT` in `KafkaSinkBuilder` class. The default value is 15 minutes, as shown in the official Kakfa documentation. So I changed it from 1 hour to 15 minutes and added...
### What is the purpose of the change - [JUnit5 Migration] Module: [flink-connector-kafka](https://github.com/apache/flink-connector-kafka), [FLINK-25538](https://issues.apache.org/jira/browse/FLINK-25538). ### Brief change log - Updated Junit4 test packages to Junit5 test packages. - This pull...
[FLINK-35632] Fix the example provided in the kafkaSource documentation for topic regex subscription
Fix the example provided in the kafkaSource documentation for topic regex subscription see the issue: https://issues.apache.org/jira/browse/FLINK-35632
In this subtask of FLIP-288, FLINK-32020, it can be seen that automatic partition discovery is supposed to be enabled by default, but it actually isn't. For details, see issue: FLINK-35631.
Also - adds the migration support tests up to 1.20. - bumps Kafka-client to 3.6.2 - various test cases that become flaky with the bumps
To use the Rack-aware Partition Assignment for Kafka Consumers ([KIP-881](https://cwiki.apache.org/confluence/display/KAFKA/KIP-881%3A+Rack-aware+Partition+Assignment+for+Kafka+Consumers)) introduced in [confluent blog](https://www.confluent.io/blog/introducing-apache-kafka-3-5/), upgrade the kafka client version used by flink-connector-kafka to version 3.5.2.
https://issues.apache.org/jira/browse/FLINK-28842 fix `javax.management.InstanceAlreadyExistsException` for kafka sink similar to https://github.com/apache/flink-connector-kafka/pull/118 and address the producer pool comments