Vincent Maurin

How do you serialize with avro ? Avro is a format where a schema is required for the producer to serialize and the consumer to deserialize, otherwise is just gibberish...

Maybe try to dump the message you serialized before passing it to `aiokafka` ? Otherwise, as far as I can see, the size is checked per message https://github.com/aio-libs/aiokafka/blob/master/aiokafka/producer/producer.py#L411 (even if...

You mean [max.message.bytes](https://kafka.apache.org/documentation/#topicconfigs_max.message.bytes) on broker/topic ? It might be then it seems to be applied after compression, but then it is also applied to a batch of message, while the...

Kafka protocol are a two steps thing : * connecting to "bootstrap servers" to discover a cluster (brokers, topics, partitions, ...) * connecting to the actual brokers to put/get data...

Could it be related to the fact of doing manual commit ? i.e no "real" message are consumed, so the consumer loop doesn't trigger and it is not committing offsets...

@sauerburger As I understood, the zombie fencing is managed by the "transactional id" settings that is not really explained in the aiokafka example. On my implementation of an exactly-once semantics...

@ods I have taken a look to the test setup, and an approach would be : * drop the supervisord approach in docker * create a docker-compose file that starts...

@ods About running the test inside a service part of the docker-compose.yml, it is the way we are working in my company so we have quite an experience with it,...

@ods I tried https://github.com/aio-libs/aiokafka/pull/973 but for sure, I cannot reproduce the issue. I start wondering if a kafka broker version didn't solved this issue (i.e you can send the command...

@kbhatiya999 @y4n9squared Any tips to reproduce the issue ? What the version of brokers used in your clusters ?