rust-rdkafka icon indicating copy to clipboard operation
rust-rdkafka copied to clipboard

A fully asynchronous, futures-based Kafka client library for Rust based on librdkafka

Results 135 rust-rdkafka issues
Sort by recently updated
recently updated
newest added

Bumps [lz4-sys](https://github.com/10xGenomics/lz4-rs) from 1.8.3 to 1.9.4. Changelog Sourced from lz4-sys's changelog. 1.24.0: Update to lz4 1.9.4 (lz4-sys 1.9.4) - this fixes CVE-2021-3520, which was a security vulnerability in the core...

dependencies

👋 A small change that adds in the README a new project that is using rust-rdkafka. Thanks for all the work on this.

Build is failing with following message when we run rdkafka with ssl feature enabled on mac m1. ``` Undefined symbols for architecture arm64: "_SSL_get1_peer_certificate", referenced from: _rd_kafka_transport_ssl_handshake in librdkafka_sys-66bfa0eb454c4b25.rlib(rdkafka_ssl.c.o) ld:...

I would like to use [recv()](https://docs.rs/rdkafka/latest/rdkafka/consumer/stream_consumer/struct.StreamConsumer.html#method.recv) with [tokio::select!](https://docs.rs/tokio/latest/tokio/macro.select.html) but I couldn't find (maybe missed it) whether recv is cancellation safe so I don't loose any kafka messages.

It seems like rdkafka-sys exposes methods like https://docs.rs/rdkafka-sys/latest/rdkafka_sys/bindings/fn.rd_kafka_conf_set_ssl_cert.html but rdkafka does not expose any way for the user to setup TLS.

I want to save the currently consumed offset when the program is closed so that it can be seamless and the data is consistent the next time the program is...

Transition from callbacks to events changed log handling for librdkafka's internal threads - logs are sent to stderr (default in librdkafka). This PR fixes it and restores previous forwarding behavior.

As the title says, after upgrade from `0.34.0` to `0.36.0` we started getting Kafka consumers that would stop consuming messages, start leaking memory and do not leave the consumer group....

While investigating something else, I noticed [this](https://github.com/confluentinc/librdkafka/blob/master/src/rdkafka.h#L3251-L3273): ``` /** * @brief Pause producing or consumption for the provided list of partitions. * * Success or error is returned per-partition \p...

bug
help wanted

Hey, I can't seem to get this to link on windows with a vendored ssl. I.e, using: ``` rdkafka = { version = "0.29.0", features = ["ssl-vendored", "cmake-build"] } ```...