confluent-kafka-python
confluent-kafka-python copied to clipboard
confluentinc
Confluent's Kafka Python Client
data_files is intended to be used to place manual files in the output. the intended mechanism for including the license in the distribution is the `license_file` or `license_files` options --...
Description =========== We're using a multi-threaded Flask server with the asynchronous producer (`confluent_kafka.avro.AvroProducer`) to send events to Kafka. After we asynchronously `produce` the events, we use `flush` to ensure that...
here is my producer config： kafka_producer = SerializingProducer({ 'bootstrap.servers': 'master:9092,slave1:9092,slave2:9092', 'key.serializer': StringSerializer('utf_8'), 'value.serializer': StringSerializer('utf_8'), 'queue.buffering.max.kbytes': 2000000, 'queue.buffering.max.messages': 1000000, 'acks': -1, 'enable.idempotence': 'true' }) confluent kafka version is 1.9.0， but it...
Description =========== I am running a Kafka server on my computer with [this docker-compose file](https://www.baeldung.com/ops/kafka-docker-setup). I have created basic consumer and producer applications which I run simultaneously, and I can...
Description =========== I might be doing something wrong, but it appears that the `log_cb` and `stats_cb` on the `SerializingProducer` and `DeserializingConsumer` don't seem to add any additional output. How to...
PEP517
Could you move the buildsystem to [PEP517](https://peps.python.org/pep-0517/)?
Description =========== I have a microservice that consumes messages from Kafka, do some work with it, and publish the result back to Kafka. However it quickly get OOMKilled after started....
No module named 'confluent_kafka.cimpl' =========== How to reproduce: Deploy AWS Lambda function with Python 3.9 runtime and try to import: `from confluent_kafka import Producer` When confluent_kafka version 1.8.2 is used...
