confluent-kafka-python
confluent-kafka-python copied to clipboard
Confluent's Kafka Python Client
Is there a demo of multithreading consumption in Kafka? The order requirements are not high, just need to improve consumption efficiency on the line。 thanks
Description =========== The group responsible for the Kafka Broker got a problem and it generated a KafkaError within my application. ``` Exception in thread Thread-2: Traceback (most recent call last):...
It has been reported that: ``` AdminClient({...}).delete_topics( topics=topics, operation_timeout=30.0 ) ``` gives the exception: ``` cimpl.KafkaException: KafkaError{code=_DESTROY,val=-197,str="Handle is terminating: Success"} ``` whereas: ``` client: AdminClient = AdminClient({...}) client.delete_topics( topics=topics, operation_timeout=30.0...
Description =========== I found that whenever I set the timeout for the Consumer.poll method > 2047.4... it will start behaving incorrectly. It looks like there is a overflow in the...
Description =========== When passing in a logger to the Consumer / Producer constructors, PyCharm complains that `logger` is an unexpected argument, even though it is not. I think happens because...
we have deploy 3 node kafka broker using the confluent-for-kubernetes helm chart, Just want to confirm the license model for the confluent kafka in kubernetes, is it opensource or all...
Description =========== How to pass an offset/message to the next member of a consumer group? i.e. if the current consumer process has been failed. consumer.pause() instead of consumer.commit(msg) does not...
Description =========== I need to retrive last N messages of a topic using confluent-kafka-python. I've been reading https://docs.confluent.io/platform/current/clients/confluent-kafka-python/html/index.html# for a day, but no finding any appropriate method for getting the...
Description =========== When i remove futures returned by methods of the AdminClient from the dict they are originally contained in, any calls to the result and exception method hang indefinitely....
Question =========== As mentioned in #885, there is always a producer callback registered, allowing to execute `on_delivery` when provided. I doesn't know Kafka very well, but I've understand that we...