confluent-kafka-python
confluent-kafka-python copied to clipboard
Confluent's Kafka Python Client
Data files are installed in the wrong directory when packaging this, and it is very uncommon to do so. data files should be files needed for the runtime only.
How can I close producer's broker connection manually? It seems to leave zombie processes in cases of asyncio loop in threads. Thanks in advance
we should look at adding automated style checking using `autopep8` or similar.
How can I add and remove topic from consumption with different group id?
Does Consumer.pause(partitions) cause other group members will poll messages? Will group rebalance be there? Thanks in advance
Description =========== run for a while,consumer not pulll message , consumer idling process exist error: %6|1642580757.330|FAIL|rdkafka#consumer-1| [thrd:GroupCoordinator]: GroupCoordinator:: Disconnected (after 1137914ms in state UP, 1 identical error(s) suppressed) %6|1642580757.348|FAIL|rdkafka#consumer-1| [thrd:GroupCoordinator]:...
Description =========== the errors was that, we have not install or run kafka in localhost, while I write a example to test the producer and consumer, it still will block...
https://github.com/confluentinc/confluent-kafka-python/blob/80ea78c8e46823b68372448e49153723dfffdbf8/examples/json_consumer.py#L109 I play with 2 files: json_consumer, json_producer. But json_consumer always return None And then I try play with json_producer and consumer. I can't convert data to dict type with...
Description =========== `confluent_kafka` versions:  In bootstrapping our application, we create a `SerializingProducer` and dump it into our applications registry (registry not relevant) ```python schema_registry_client = SchemaRegistryClient({ "url": "https://fake.cc.schema.registry.com", "basic.auth.user.info":...
Description =========== Observed a pathological behavior which is missing in other clients (java's `kafka-clients` & `franz-go`). With disabled transactions when any client (including `confluent_kafka`) is about to send `init_producer_id` it...