confluent-kafka-python
confluent-kafka-python copied to clipboard
confluentinc
Confluent's Kafka Python Client
Description =========== We are running trying to write to kafka from a spark job. We are using `confluent-kafka` to write the data. We get data as RDD and when we...
A typo fix. From 'propogation' to 'propagation'
What ---- Implement metadata based authentication with Azure IMDS returning an OAuth/OIDC token. Implementation is for both the synchronous and asynchronous client. Before implementing the feature did a refactor to...
What ---- Adding producer example which is using oauth callback function with azure managed identity Checklist ------------------ None References ---------- JIRA: None Test & Review ------------ Tested on Azure AKS...
I looked at the source code of the Deserializer and was not able to find a way to get the schema being used to deserialize the last record. Which I...
We have an internal Python API that fetches all ACLs from a Kafka cluster. Previously, we used a ZooKeeper-based API for this purpose. As ZooKeeper is being deprecated in favor...
I was trying to lookup information from the documentation about the SchemaRegistryClient, Schema Class itself and I noticed they were missing. I am using the official documentation as seen below....
Description =========== I am using 2 process to read from kafka and write to destination (design of ELT tool) hence, I would like to maintain checkpoint/offset manually and read it...
Description =========== Hi, This is a question concerning `DeserializingConsumer` (and to some extent `SerializingProducer`, i.e. should we be using these classes at all?), and generally a question about how to...
Description =========== We are using a single confluent_kafka.Consumer for a partition group that is always unique (via generating a fresh uuid4 in the group) We use on_assign and on_revoke callbacks...
