flink-connector-kafka
flink-connector-kafka copied to clipboard
apache
Apache flink
## Problem When using the flink kafka connector in batch scenarios, consuming transactional messages can cause indefinite hanging. This issue can be easily reproduced with following steps. 1. Produce transactional...
…ing nested unit tests The root cause of the duplicate nested test execution is noted in this github issue: https://github.com/junit-team/junit5/issues/3782. TLDR, the outer test runs once (running all its nested...
So that when connector-kafka installed into Flink Libs, it can work with a Customer Deserializer class defines in User Code. This is useful with work with Spring Kafka JsonDeserializer. JsonDeserializer...
when partition leader invalid(leader=-1), the flink streaming job using KafkaSource can't restart or start a new instance with a new groupid, it will stuck and got following exception: "org.apache.kafka.common.errors.TimeoutException: Timeout...
## What is the purpose of the change To address the current flow of KafkaProducer having exact same behavior for `DeliveryGuarantee.NONE` and `DeliveryGuarantee.AT_LEAST_ONCE` It is based on the understanding that...
## What is the purpose of the change Add deserialize version check for kafka simple versioned serializers like other SimpleVersionedSerializer implementations in case of incompatible or corrupt state when restoring...
This fix snapshots the noMoreNewPartitionSplits variable. This is done to make sure that the signalNoMoreSplits signal is sent after restoring from a snapshot. At the current state, a bounded kafka...
Add RecordEvaluator to dynamically stop source based on de-serialized records.
