kop
kop copied to clipboard
streamnative
Kafka-on-Pulsar - A protocol handler that brings native Kafka protocol to Apache Pulsar
Table of Contents ================= * [Motivation](#motivation) * [Approach](#approach) * [API Design](#api-design) * [Schema Registry Client](#schema-registry-client) * [Schema Version Header](#schema-version-header) * [Serializer](#serializer) * [Deserializer](#deserializer) * [Interaction with Pulsar clients](#interaction-with-pulsar-clients) * [Kafka...
Reproduce step: 1. Consumer a topic using kafka clients. 2. delete topic using `bin/pulsar-admin topics delete-partitioned-topic` 3. Get consumer group using `bin/kafka-consumer-groups.sh --list`
**Describe the bug** I have a long-running test that has three consumers in a consumer group, every 40 minutes it stops one consumer, then 20 minutes later adds a new...
Edit: The OOM issue is better described in streamnative/kop#1278. This issue is now only about the LockBusyException. This may be low priority. ---- **Describe the bug** I have a pulsar...
ERROR LOG 2021-12-04 04:15:34.634 [pulsar-io-4-4] ERROR i.s.pulsar.handlers.kop.KafkaRequestHandler - Caught error in handler, closing channel java.lang.NoClassDefFoundError: io/streamnative/pulsar/handlers/kop/utils/delayed/DelayedOperationKey$GroupKey at io.streamnative.pulsar.handlers.kop.coordinator.group.GroupCoordinator.unsafeJoinGroup(GroupCoordinator.java:431) at io.streamnative.pulsar.handlers.kop.coordinator.group.GroupCoordinator.lambda$doJoinGroup$2(GroupCoordinator.java:283) at io.streamnative.pulsar.handlers.kop.utils.CoreUtils.inLock(CoreUtils.java:35) at io.streamnative.pulsar.handlers.kop.coordinator.group.GroupMetadata.inLock(GroupMetadata.java:214) at io.streamnative.pulsar.handlers.kop.coordinator.group.GroupCoordinator.doJoinGroup(GroupCoordinator.java:283) at io.streamnative.pulsar.handlers.kop.coordinator.group.GroupCoordinator.lambda$handleJoinGroup$0(GroupCoordinator.java:241) at java.util.Optional.map(Optional.java:215)...
**Describe the bug** https://github.com/streamnative/kop/blob/60ec259d354d4bb61f82133338b72d2ea46fa6d5/kafka-impl/src/main/java/io/streamnative/pulsar/handlers/kop/stats/ThreadLocalAccessor.java#L24-L36 or older code: https://github.com/streamnative/kop/blob/82211b9ba2553a68b06c1b2f3479459e5b75f846/kafka-impl/src/main/java/io/streamnative/pulsar/handlers/kop/stats/DataSketchesOpStatsLogger.java#L183-L197 The `onRemoval` method is responsible to remove the thread local `LocalData` from the map when the thread stops. However, this method can...
**Describe the bug** If a transaction is aborted/rolled back, I think its messages should not be visible to consumers with setting read_committed. However, if there is some processing delay before...
**Describe the bug** Following screenshots all represent the publish rate to the offset topic (`__consumer_offsets`), which represents the frequency to commit the offsets. We can see there was a wave...
UpgradeTest is flaky. The testConsumeLatest test method fails sporadically. [example failure](https://github.com/streamnative/kop/runs/5858286648?check_suite_focus=true#step:5:254) ``` Error: testConsumeLatest(io.streamnative.pulsar.handlers.kop.UpgradeTest) Time elapsed: 4.365 s
Metadata
Owner
Metadata
Kafka-on-Pulsar - A protocol handler that brings native Kafka protocol to Apache Pulsar