aiokafka
aiokafka copied to clipboard
aio-libs
asyncio client for kafka
Kafka supports SASL/OAuthBearer as an authentication method [KIP-255](https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=75968876). We would really like to have this feature in this library to avoid a separate auth flow for Kafka from other pieces...
I would like to expose the consumer metrics to Prometheus, to check if the consumer is alive or not. I couldn't find anything on the documentation, the only exporter i...
Hi, We're facing an issue where we send and receive messages using aiokafka. When restarting kafka docker container the connection is established, but kafka seems not to be ready yet,...
`Consumer.getmany` already has a `max_records` parameter to to limit the number of messages returned, but nothing to limit the number of records by partition. I've implemented a `max_records_per_partition` to provide...
Sometimes AIOKafkaProducer writes messages without headers. Environment: - python version `3.7.4` - aiokafka version `0.5.2` - kafka-python version `1.4.6` - docker image `confluentinc/cp-kafka:5.2.1` In new environment I created a new...
Using `offsets_for_times`, I'd like to be able to query all message between a certain time range, as fast as I can. Using the `confluent-kafka-python` client, I was able to do...
Currently, the SubscriptionState will reset assignment on subscription changes. This can have a strange effect, resulting in an undefined assignment during processing (if callbacks are not used by the user).
During processing I sometimes get UnknownError. Broker throws error like such: ``` [2019-08-16 11:47:51,481] ERROR [KafkaApi-1] Error when handling request: clientId=aiokafka-producer-1, correlationId=4641, api=ADD_PARTITIONS_TO_TXN, body={transactional_id=LOCAL-platform-event-preprocessor-tid-0,producer_id=0,producer_epoch=0,topics=[{topic=LOCAL-platform-event-clean,partitions=[2]}]} (kafka.server.KafkaApis) java.lang.IllegalStateException: TransactionalId LOCAL-platform-event-preprocessor-tid-0 failed transition...
The current implementation is a bunch of hacks made to make sure aiokafka works with the same input parameters as Java's client while remaining asynchronous as much as possible. This...
As #335 issue and some related threads (https://github.com/ManageIQ/aiops-incoming-listener/pull/11) point out, current logging levels are not exactly the best and cause some confusion. Will need to go over Java's log levels...