aiokafka
aiokafka copied to clipboard
asyncio client for kafka
**Describe the bug** When a topic is configured with `compression.type=zstd`, `aiokafka` consumers crash on the first fetch with: `Unexpected error while fetching data: UnknownError` Debug logging reveals that the broker...
### Changes Fixes #1080 Fixes #1015 I recently discovered that `aiokafka` does not implement `KIP-368`, which is essential for the `OAUTHBEARER` authorization, for example, when using `AWS MSK`. This was...
### Changes Remove typing_extensions from run time requirements = less dependencies to install for users of aiokafka. ### Checklist - [x] I think the code is well written - [x]...
**Describe the solution you'd like** Add support for Kafka 4.0 [Share Groups](https://www.confluent.io/blog/queues-on-kafka/) **Additional context** Kafka 4.0 is currently in preview on Confluent Platform and will be released in early 2025...
### Changes - Introduce a new `rack_id` parameter on AIOKafkaConsumer and store it on the instance. - Propagate `rack_id` (alongside new session metadata fields `session_id`, `session_epoch` and `forgotten_topics_data`) into the...
### Changes Fixes #712 task update metadata never ended after problem with network ### Checklist - [x] I think the code is well written - [x] Unit tests for the...
Hi, Apache Kafka 4.0 is removing a number of very old protocol api versions via [KIP-896](https://cwiki.apache.org/confluence/display/KAFKA/KIP-896%3A+Remove+old+client+protocol+API+versions+in+Kafka+4.0). When I was looking at the code, I noticed that we seem to use...
**Describe the bug** If the Kafka server is down, `send()`ing a message and awaiting the results has two effects: 1) A log is sent every `retry_backoff_ms` * This is pretty...
### Changes Adds type stubs to classes that clients will interact with, and `py.typed` so that type checkers know type information is available. Fixes https://github.com/aio-libs/aiokafka/issues/980 (kind of) Per [providing type...
### Changes Fixes #1102, but not limited to the `getmany()` method. Added a `started` flag to check whether the consumer has started; if not, the following message is displayed: `"The...