kafka-python
kafka-python copied to clipboard
dpkp
Python client for Apache Kafka
This pull request addresses issue #2232 by adding an `AWS_MSK_IAM` authentication mechanism. A detailed description of the authentication scheme is available here: * https://github.com/aws/aws-msk-iam-auth#uriencode > I understand that `kafka-python` may...
It solves situations where some protocol is not supported, and some variables would be referred before the assignment Also, it's possible to be necessary to use the zstandard with legacy...
Hi All Is there a way to get the size of a partition with this library? I know its possible via commandline with the kafka-log-dirs command.
Hello, I have a MSK cluster, and connected my EC2 instance with it. I would like to create a python script on that EC2, which will produce to, and consume...
We are running some docker services that connect to a single kafka (and zookeeper) service. After some time, one of the services stops working and inspecting the logs we see...
Python version: 3.8 Kafka-python version: 2.0.2 Kafka broker version: strimzi/kafka:0.19.0-kafka-2.5.0 (docker image provided by strimzi) In my application, I am providing a regex pattern to kafka consumer's subscribe() method at...
There are small typos in: - kafka/codec.py - kafka/coordinator/base.py - kafka/record/abc.py - kafka/record/legacy_records.py Fixes: - Should read `timestamp` rather than `typestamp`. - Should read `minimum` rather than `miniumum`. - Should...
Hello, I am using kafka-python>=2.0.1 (with Python 3.7.6 on MacOsx, build from the python website) it generally works fine, but when I tried to access our broker, that has SSL...
When setting `compression.type=zstd` on the broker, the consumer fails to read any messages, reporting `WARNING:kafka.consumer.fetcher:Unknown error fetching data for topic-partition TopicPartition(topic='test', partition=0)`. Switching to `compression.type=gzip` or to producer-side compression (even...
I have too many topics(maybe 2000). I want to verify compress type of all topic. I know kafka self's command `kafka-dump-log.sh` can show the compress type of message. But it...
