kafka-python
kafka-python copied to clipboard
dpkp
Python client for Apache Kafka
When listing or describing groups via a `ListGroups` or `DescribeGroups` request, Kafka also returns non-consumer groups, e.g. Kafka Connect groups. Those should be omitted when listing or describing consumer groups,...
How to set the parameter sasl.jaas.config? The authentication is SASL and PLAIN mechanism
# Description Using the highlevel KafkaConsumer or KafkaProducer with Kafka 2.6.0 configured with an SSL listener ends with multiple client disconnection. The messages are produced/consumed eventually. It looks like the...
Nomatter what I set the ssl_cafile to it give this error, the pem files are checked elsewhere and work. The filepat verifies fine with os.path.isfile(ssl_cafile) >>> kafka.__version__ '2.0.2' >>> sys.version...
When using Python 3.10, kafka-python 2.0.2, in `python -Wd`: ``` >>> from kafka import KafkaConsumer :914: ImportWarning: _SixMetaPathImporter.find_spec() not found; falling back to find_module() :671: ImportWarning: _SixMetaPathImporter.exec_module() not found; falling...
I have been struggling with this issue of **No Brokers available** while using kafka consumer with below mentioned configuration (kafka-python version 2.0.2). consumer = KafkaConsumer( 'my-topic', group_id='my-group', bootstrap_servers=['host1:port1','host2:port2','host3:port3','host4:port4'], auto_offset_reset='earliest', enable_auto_commit=False,...
Running Kafka 2.6.2 on AWS MSK, and getting an UnrecognizedBrokerVersion error ``` Traceback (most recent call last): File "/home/ubuntu/repos/confluent-relay/confluent_relay.py", line 3, in consumer = kafka.KafkaConsumer( File "/home/ubuntu/.local/lib/python3.8/site-packages/kafka/consumer/group.py", line 358, in...
The documentation doesn't make it clear whether the parameter controls number of messages or total bytes: ``` batch_size (int): Requests sent to brokers will contain multiple batches, one for each...
I implemented API KEY 35 from the official Apache Kafka documentation. This functionality is requested in issue # 2163 and this is an implementation proposal. --- This change is [](https://reviewable.io/reviews/dpkp/kafka-python/2278)
Kafka-Python claims to be "async" but this seems to just mean "uses lots of threads to put your I/O into the background" and not actually "event-driven". It would be nice...
