rust-rdkafka
rust-rdkafka copied to clipboard
fede1024
A fully asynchronous, futures-based Kafka client library for Rust based on librdkafka
Currently, it is possible to dynamically link against `librdkafka` at runtime. However, if there are symbols in the new lib that aren't present in `rdkafka-sys::bindings` things are left in an...
I'm used [`ThreadedProducer`] to send kafka messages. I also hope to get the error information of send when the server does not exist, but I don't know how to catch...
Hi, I have subscribed to a topic. I would like to receive a message within the next 2 sec or else I want to timeout. I am unable to find...
The following commit: https://github.com/fede1024/rust-rdkafka/commit/24a28bbad94a385929cd3a1b7761c7e11f83f70a introduced polling two queues instead of one on message polling calls: https://github.com/fede1024/rust-rdkafka/blob/35177be201eef182a66b2bdc3af695354bcc1e8b/src/consumer/base_consumer.rs#L125-L132 As it turns out, this has a very significant perf. impact, as polling a...
Hi, I am new to kafka on rust. I used `kafka-consumer-groups.sh` command and discovered for the group id `gp` the offsets for all partitions are above `100`. Now, using `rdkafka`...
I'm writing an Actix web application and want to instantiate a consumer that I can reuse in each route rath than instantiating one for each request. The common approach to...
I use simple_consumer.rs to cosume data from kafka (kafka_2.13-3.2.0). Rebalance happens every 6 seconds (which is the value of "session.timeout.ms"). What is wrong? Pre rebalance Assign(TPL {aligw/0: offset=Invalid metadata=""; aligw/1:...
Hi, I have a minimal reproducible code on https://github.com/RedKinda/rust-musl-segfault To reproduce, run the dockerfile included. It compiles for target `x86_64-unknown-linux-musl` on release, and upon running segfaults. After using gdb i...
I am considering this crate for a project, but it seems the project is not maintained anymore.
