confluent-kafka-python
confluent-kafka-python copied to clipboard
confluentinc
Confluent's Kafka Python Client
Steps to reproduce: 1. Deploy Amazon MSK instance 3.8.1 version. 2. Configure SASL_SSL security protocol. 3. Check the broker's certificate. 4. Download CA certificate that issued the broker's certificate. 5....
We're using the schema registry client in confluent_kafka 2.8.0 and encountering an issue when talking to a schema registry with self-signed certificates. In previous releases, the `ssl.ca.location` parameter worked as...
While running attempting to build the Dockerfile running `docker build -f examples/docker/Dockerfile.alpine .` I receive the following error: ``` 1.019 Creating program kcat 1.019 gcc -g -O2 -Wall -Wsign-compare -Wfloat-equal...
Below is the sample program, we have everything working with Java and tested the principal and keytab able to produce the message but through kafka with below pattern noticing the...
Hi, we are trying to implement what is suggested in https://medium.com/@ravisharma911993/kafka-broadcasting-messages-without-consumer-groups-5a374fcfb7bc - a standalone consumer. The use case: we have dynamic pods coming alive consuming from latest, die and not...
Running version 2.6.1 of the library, this is approximately my code: ``` class FooSerializer: def __init__(self, topic: str, schema_registry: ConfluentSchemaRegistryClient): self._topic = topic self._protobuf_serializer = ProtobufSerializer( Foo, schema_registry, conf={ "auto.register.schemas":...
## Description : There seems to be a bug in how the SchemaRegistryClient caches the subject entries ( with **[confluent_kafka v2.8.0](https://docs.confluent.io/platform/current/clients/confluent-kafka-python/html/_modules/confluent_kafka/schema_registry/schema_registry_client.html#SchemaRegistryClient.get_schema)** ) in the `SchemaRegistryClient.get_schema()` method. It can add a...
Now, `list_consumer_group_offsets` only supports a single consumer group, and the efficiency of looping is too low. ```python from confluent_kafka import (Consumer, ConsumerGroupTopicPartitions, KafkaException, TopicPartition) from confluent_kafka.admin import AdminClient def get_kafka_lag_consumer_groups():...
Attempting to call list_topics() on a closed Kafka Consumer object results in a segmentation fault.
**Description:** When calling the list_topics() method on a Kafka Consumer object after the close() method has already been invoked, a segmentation fault occurs, causing the Python interpreter to crash and...
We are using AWS MSK with mTLS enabled. Any connection from producer or consumer to kafka cluster will have to authenticate via certificates In my case, I am setting up...
