azure-functions-kafka-extension
azure-functions-kafka-extension copied to clipboard
Azure
Kafka extension for Azure Functions
The Azure documentation recommends to set `connections.max.idle.ms` to `180000`: https://learn.microsoft.com/en-us/azure/event-hubs/apache-kafka-configurations#producer-and-consumer-configurations That option is exposed in the `Confluent.Kafka.ClientConfig` class via the `ConnectionsMaxIdleMs` property, but it seems like it is not possible...
Hello, I am experiencing an issue with the autoscaling of the Kafka function. In this line: https://github.com/Azure/azure-functions-kafka-extension/blob/dev/src/Microsoft.Azure.WebJobs.Extensions.Kafka/Listeners/KafkaTopicScaler.cs#L101 You call the kafka server to get the latest offset of each partition....
I have not found any way to validate the health and readiness of the Kafka Listeners. Did I miss something? Specifically we are planning to deploy the .NET application, which...
The `KafkaTriggerAttributeBindingProvider` checks the `SslCaLocation` to be a valid file path, but according to the Confluent `ClientConfig` class the value `probe` is also a valid configuration, which allows the library...
Headers cannot be specified without also specifying Offset, Partition, Topic, Value (Python binding)
I spent quite a long time debugging why my Python function was unable to set Kafka message headers using the Kafka output binding (the headers were showing up as a...
When any part of the output message cannot be successfully parsed as JSON, the output binding will silently place the entire output as the value of the kafka message as...
It seems like the ClientId property for Kafka Clients is not configurable. It would be nice to have this configurable so that a proper client id can be used in...
I am using Java based Azure Function App to write to Confluent Kafka with topic having schema validation enabled. I am using the latest update and providing the schema details...
Due to unresolved Kafka issue described here https://github.com/confluentinc/confluent-kafka-dotnet/issues/1861 there are a lot of errors can be produced in log collection storage when the services run because of this error logging:...
