aiokafka

aiokafka copied to clipboard

Hello folks, I am not sure what would be the best way to contact the maintainers of the package, but I want to let you know that I am creating...

italomg

Document how to handle long message processing with max_poll_interval_ms

3

**Describe the solution you'd like** I think it'd be good to give a clear warning in the docs about processing long messages and focus people's attention on max_poll_interval_ms. Maybe another...

butla

[QUESTION] Rebalance during transaction breaks exactly-once semantics?

3

I try to understand how to implement exactly-once guarantees with the [transactional consume-process-produce example](https://aiokafka.readthedocs.io/en/stable/examples/transaction_example.html). I use the example almost verbatim. I've added a few print statements and added a sleep...

sauerburger

Admin client not included in PIP package

2

**Describe the bug** The admin client is not being included in the pip package. **Expected behaviour** The admin client should be available in the pip package **Environment (please complete the...

TrevorPace

Hi, Thanks for the work that you are doing!! According to the code, the only way to use the `ConsumerRebalanceListener` is using the `subscribe` method, I was wondering: Why is...

marcosschroh

"'NoneType' object is not callable" if lz4 compression enabled on server but lib not installed

2

The library errors with a cryptic message if lz4 compression is enabled on the Kafka cluster but the corresponding Python library is not installed on the consumer/broker. It took a...

mstump

[Producer] Performance drop when 'send' is called from multiple Futures

10

The following pattern (also used in `benchmark/simple_produce_bench.py`) is well performant: ```py for i in range(n): await producer.send(topic, message, partition=partition) ``` The same goes for send_and_wait, while the throughput is slightly...

panagiks

[QUESTION] bootstrap_servers="kafka:9092" doesn't work in my docker-compose, why?

1

I can connect with kafka-python to the kafka service, but aiokafka doesn't give me that solution. My docker-compose.yml ```yml version: '3.5' services: data_base: image: postgres:10.5 container_name: postgres ports: - '5432:5432'...

Buronn

[QUESTION] How to avoid missing messages between calls to AIOKafkaConsumer.subscribe

3

If we're subscribed to channels "a" and "b" and we want to drop "a" and keep "b", the [docs](https://aiokafka.readthedocs.io/en/stable/api.html#aiokafka.AIOKafkaConsumer.subscribe) for `AIOKafkaConsumer.subscribe` say "Topic subscriptions are not incremental: this list will...

andrew222651

[QUESTION] add schema registry url

2

Hi everyone, I can't find option to set schema registry url, can some one help me to point the right way to add Avro Schema based on Schema Registry? thanks

hamroune