librdkafka
librdkafka copied to clipboard
confluentinc
The Apache Kafka C/C++ library
Description =========== We have a consumer group (call it `CG1`) that consumes from a set of topics and produces to a single output topic. Historically this has worked well, however...
Please add support for pluggable partition assignment algorithms for the consumers. I was in a design review today where we will need this for a handful of upcoming services. This...
Read the FAQ first: https://github.com/edenhill/librdkafka/wiki/FAQ Do NOT create issues for questions, use the discussion forum: https://github.com/edenhill/librdkafka/discussions Description =========== My program crash with following stack: ``` *** Aborted at 1632307784 (unix...
I'd like to add a kafka consumer lag input plugin to `telegraf`, and for that I need a Golang client that supports the [`ListConsumerGroupOffsets`](https://kafka.apache.org/20/javadoc/org/apache/kafka/clients/admin/AdminClient.html#listConsumerGroupOffsets-java.lang.String-org.apache.kafka.clients.admin.ListConsumerGroupOffsetsOptions-) call. But as best I can...
Read the FAQ first: https://github.com/edenhill/librdkafka/wiki/FAQ Do NOT create issues for questions, use the discussion forum: https://github.com/edenhill/librdkafka/discussions Description =========== Kafka producer produces the messages every 30ms, but the consumer needs the...
Description =========== Hi! I have misunderstandings about assignment to the end of a topic when using `KafkaConsumer#assign`. Note that we are using the `RdKafka::KafkaConsumer` which requires a `group.id` even if...
Description =========== Re-opening old issue #2046. As mentioned in that issue, we send millions of small messages per second and use a key to partition them. The partitioning being consistent...
In clickhouse CI, we do checks if there is some usage of glibc function which are considered [harmful](https://github.com/ClickHouse/ClickHouse/blob/9f5cd35a6963cc556a51218b46b0754dcac7306a/base/harmful/harmful.c). Recently it caught `system` function call done by librdkafka (firing `kinit`). It...
Hi, i would like to know if there is any plan to support [KIP-568](https://cwiki.apache.org/confluence/display/KAFKA/KIP-568%3A+Explicit+rebalance+triggering+on+the+Consumer) Enforce Rebalance. Thanks!
Description ========= I am using node-rdkafka which is a wrapper around librdkafka. I have set it up so that i use static group membership. The following error was observed: ```...
