kop
kop copied to clipboard
Kafka-on-Pulsar - A protocol handler that brings native Kafka protocol to Apache Pulsar
When the Kafka client issues a Fetch and sets a maxWait time we are already scheduling a DelayedFetch, but there is no way to trigger that Fetch and it is...
**Describe the bug** The broker keeps sending `307` error messages to ``` PUT /admin/v2/persistent/public/__kafka_producerid/__transaction_producerid_generator?authoritative=true HTTP/1.1 ``` when pulsar standalone is *restarted* as a systemd service. This seems to be caused...
**Describe the bug** **To Reproduce** - Kafka Client: 3.1.0 - Pulsar: 2.10.0 - KoP: 2.10.1.1 KoP configs: ```properties messagingProtocols=kafka protocolHandlerDirectory=./protocols allowAutoTopicCreationType=partitioned kafkaListeners=PLAINTEXT://127.0.0.1:9092 brokerEntryMetadataInterceptors=org.apache.pulsar.common.intercept.AppendIndexMetadataInterceptor brokerDeleteInactiveTopicsEnabled=false brokerDeleteInactivePartitionedTopicMetadataEnabled=true brokerDeduplicationEnabled=true kafkaTransactionCoordinatorEnabled=true brokerDeleteInactiveTopicsMode=delete_when_subscriptions_caught_up ``` First,...
TODO: We still need to test to find out the best `explicitFlushAfterFlushes` config value. The better option is migration the [`org.apache.cassandra.transport.Flusher`](https://github.com/apache/cassandra/blob/trunk/src/java/org/apache/cassandra/transport/Flusher.java). It can reduce the flush count and reduce the...
**Describe the bug** When i use KoP and use kafka command "kafka-consumer-groups.sh" to view the consumption,it shows the message "Consumer group '****' has no active members."。In addition, I can still...
**Describe the bug** When I enabled the Kafka consumer client locally, it took 5 minutes from 17:17 to 17:21 to start and then consume data **To Reproduce** 17:17:02.479 [main] INFO...
Hey, im using Pulsar version 2.10 With kop 2.10 nar I am using node - kafkajs I want to use kop on a different tenant and namespace then the default...
**Describe the bug** Due to all Kop metrics not exposed cluster label, promtheus coundn't be recognized different pulsar clusters from kop metrics. However, pulsar provides. Hope to provide this feature,...
**Describe the bug** Pulsar 2.9.2 + KoP 2.9.2 the broker's log shows some exceptions as follow: ``` 2022-06-28T11:14:19,719+0800 [globalEventExecutor-5-1211] ERROR io.streamnative.pulsar.handlers.kop.KafkaRequestHandler - [[id: 0x19aa8f59, L:/10.187.128.67:9092 - R:/10.189.111.220:58966]] Failed to get...
Describe the bug One Broker shutdown with the following logs : ``` 2022-06-17T13:27:16,824+0800 [main-SendThread(10.187.128.229:2181)] WARN org.apache.pulsar.broker.service.persistent.PersistentTopic - [persistent://gmtp_cffex/SF_test/bar] Failed to persist msg in store: Error while using ZooKeeper 2022-06-17T13:27:16,824+0800 [main-SendThread(10.187.128.229:2181)]...