pykafka
pykafka copied to clipboard
Parsely
Apache Kafka client for Python; high-level & low-level consumer/producer, with great performance.
**PyKafka version**: 2.8.0 **Kafka version**: 2.2.0 When producing to an auto-created topic a divide by zero exception can occur. ``` Traceback (most recent call last): File "/opt/system/project/usr/share/signal_generator.py", line 464, in...
Today, if `JoinGroup` sees a socket disconnection, it will retry again without reconnecting the connection which results in subsequent retries all to fail. This change will ensure that we attempt...
For **consumer.commit_offsets(partition_offsets)**, the documentation clearly mentions "partition_offsets (Sequence of tuples of the form (pykafka.partition.Partition, int)) – (partition, offset) pairs to commit where partition is the partition for which to commit...
consumer Heartbeat worker exit because of SocketDisconnectedError Then it cause the error committing offsets(errors: { Result: consumer is still consume, but offset not be committed pykafka==2.8.0 broker version=0.10.0 Python 2.7.5...
Is there any way that more support for creating/deleting topics can be added to PyKafka? I am aware that calling KafkaClient.topics['a new topic name'] will create a new topic but...
Limit queued.max.messages.kbytes according to librdkafka https://github.com/edenhill/librdkafka/commit/cc43f451b46e41fc3ce00e3b4e5c9bafd11f7b0e. This will fix rdkafka tests on librdkafka 0.11.3+. ``` E RdKafkaException: Configuration property "queued.max.messages.kbytes" value 102400000 is outside allowed range 1..2097151 ```
I am getting the `RdKafkaException: (-170, 'Local: Not implemented')` error while trying to consume a message from the consumer. Following is the stack trace: ```--------------------------------------------------------------------------- RdKafkaException Traceback (most recent call...
Hello, my PyKafka version is 2.8.0. I am working on embedding PyKafka in [Zato](https://zato.io/docs/) and I have a question about exposing the **_connection** attribute of Broker objects directly as **connection**....
The docs mention that a [`Message`](https://pykafka.readthedocs.io/en/latest/api/common.html#pykafka.common.Message) contains a response_code, topic, payload, key (optional) and offset. However, it seems that in practice, response_code, topic and payload are not present. In addition,...