aiokafka
aiokafka copied to clipboard
aio-libs
asyncio client for kafka
We have followed the transactional consume-process-produce paradigm laid out at: [https://aiokafka.readthedocs.io/en/stable/examples/transaction_example.html](https://aiokafka.readthedocs.io/en/stable/examples/transaction_example.html) We seem to be seeing issues when a node is restarted (or becomes unreachable) while a transaction is in...
What is the preferred way of using AIOKafkaProducer.start() and stop() with long-running application and with environment when you have to periodically renew kerberos ticket for accessing brocker? If I use...
[consumer.stop](https://aiokafka.readthedocs.io/en/stable/api.html#aiokafka.AIOKafkaConsumer.stop) will > Commit last consumed message if autocommit enabled For a consumer with `enable.auto.commit=True`, I'd like to be able to shutdown without committing in order maintain better control over...
I have a topic named my_topic, I want to exit process that no data is put into the topic within ten seconds when consuming my_topic using kafka-python package, I can...
It seems by default aiokafka tries to load C extensions for core/cpu intensive operations. I have seen various blocks initializing it like ```py try: from ._crecords import ( DefaultRecordBatchBuilder as...
**Describe the solution you'd like** Serializers and deserializers should receive more context about the record they are working on : * the headers * the topic It is especially useful...
This problem always occurs after a few days that microservices communicate with kafka, I have 3 nodes, and for each microservice I use a group id on a specific topic....
I just tried the sample code for AIOKafkaConsumer from your github page on a topic with 1 partition. At each iteration I output msg.offset, and the offsets appear in order....
**Describe the bug** Consumer throws an error when started ```sh Heartbeat failed for group my-group because it is rebalancing Unexpected error while fetching data: UnknownError ``` **Expected behaviour** Consumer authenticates...
Hello, Is there a published list of which KIPs and/or kafka versions this library supports? For example, if I wanted to check support for [KIP-429](https://cwiki.apache.org/confluence/display/KAFKA/KIP-429%3A+Kafka+Consumer+Incremental+Rebalance+Protocol) is there something I can...
