librdkafka
librdkafka copied to clipboard
The Apache Kafka C/C++ library
This is a very rough implementation of [KIP-396](https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=97551484). I tried to follow [the Java implementation](https://github.com/apache/kafka/pull/7296) and have the `alterConsumerGroupOffsets()` API call just send an [OffsetCommitRequest](https://kafka.apache.org/protocol#The_Messages_OffsetCommit) and the `listConsumerGroupOffsets()` API call...
Description =========== /tmp/pip-install-3zn71rtb/confluent-kafka_1577fda28d2f4a1fbbfe78cceec3959f/src/confluent_kafka/src/confluent_kafka.c: In function ‘oauth_cb’: /tmp/pip-install-3zn71rtb/confluent-kafka_1577fda28d2f4a1fbbfe78cceec3959f/src/confluent_kafka/src/confluent_kafka.c:1633:17: error: ‘for’ loop initial declarations are only allowed in C99 mode for(int i = 0; i < rd_extensions_size; i++) { ^ /tmp/pip-install-3zn71rtb/confluent-kafka_1577fda28d2f4a1fbbfe78cceec3959f/src/confluent_kafka/src/confluent_kafka.c:1633:17: note:...
Add an additional parameter (`timeout_ms`) for `rd_kafka_commit`/`rd_kafka_commit_message`. To avoid stuck there forever while a consumer is trying to sync-commit but no response from brokers (e.g. brokers unexpected down)
Hello, I recently had some issues with librdkafka based consumer (from go) and zstd compressed messages. When a java producer sends batch of messages it only estimates the compressed size...
Problem ----------------- `rd_kafka_cert_new(encoding=RD_KAFKA_CERT_ENC_PEM, type=RD_KAFKA_CERT_CA, …)` leaks allocated X509 buffer (result of `PEM_read_bio_X509`). This is the problematic code: https://github.com/edenhill/librdkafka/blob/9b72ca3aa6c49f8f57eea02f70aadb1453d3ba1f/src/rdkafka_cert.c#L264 ```{.c} while ((x509 = PEM_read_bio_X509( bio, NULL, rd_kafka_conf_ssl_passwd_cb, (void *)conf))) { if...
Read the FAQ first: https://github.com/edenhill/librdkafka/wiki/FAQ Do NOT create issues for questions, use the discussion forum: https://github.com/edenhill/librdkafka/discussions Description =========== On a test setup we noticed only a single broker (running 3...
Read the FAQ first: https://github.com/edenhill/librdkafka/wiki/FAQ Description =========== This has been discussed in the past (#2795), but the output of `rand()` is predictable. This predictability is usually alleviated with the use...
Read the FAQ first: https://github.com/edenhill/librdkafka/wiki/FAQ Do NOT create issues for questions, use the discussion forum: https://github.com/edenhill/librdkafka/discussions Description =========== We wrote an application which deploys a transactional client (transactional consumer +....
Where can I find PDBs for the librdkafka.redist 1.3.0 Nuget package? I can see there's a librdkafka.symbols package in Nuget, but it seems to be abandoned (last version was published...
Read the FAQ first: https://github.com/edenhill/librdkafka/wiki/FAQ Description =========== Consumer cannot consume messages when auto.reset.offset=latest How to reproduce ================ I'm using the consumer.c from https://github.com/edenhill/librdkafka/blob/master/examples/consumer.c, and I change auto.reset.offset=latest and set auto.commit.offset=false...