azure-functions-kafka-extension

azure-functions-kafka-extension copied to clipboard

kafka triggers repeating messages

1

Hi, We've been using the kafka extension (Java SDK) for more than a year without any issue. A few days ago one of our triggers started to repeat message processing,...

nachoge

How to Zstandard compress and microbatch events with output binding?

7

**Setup** - Using confluent cloud, their schema registry and Avro for the serialization - Confluent Cloud sets all topics to compression.type=producer (producers must compress prior to sending, kafka cluster does...

smitty-codes

#310 Support for ssl certificate auth with cert and key in pem string…

1

… format Setting up ConsumerConfig and ProducerConfig (confluent.kafka classes) "SslCertificatePem" and "SslKeyPem" properties based on same name trigger attributes. This will get mapped to librdkafka "ssl.certificate.pem" and "ssl.key.pem" properties.

vkhose

For the KafkaTrigger, how can I configure the protocol to be Ssl if I have certs but NotSet if I don't?

2

I have an isolated function with a `[KafkaTrigger]`, how can I set the Protocol dynamically? ```cs [Function("hello_kafka")] public async Task HelloKafka( [KafkaTrigger( "%KafkaBootstrapServers%", "%KafkaTopicsHelloName%", ConsumerGroup = "%KafkaTopicsHelloConsumerGroup%", Protocol = BrokerProtocol.NotSet,...

justinmchase

Can you include a sample for dotnet-isolated, which works for both localhost via docker and also eventHubs?

2

In the current samples: https://github.com/Azure/azure-functions-kafka-extension/tree/dev/samples/dotnet-isolated You have a lot of settings hard coded right into the various trigger attributes. But I need to support multiple environments, local and running in...

justinmchase

Output binding example for Python

6

Hi there, thank you so much for providing Azure bindings for Kafka. Our scenario is that we use Python to consume events from Azure Event Hubs using its trigger binding...

amotl

KafkaTrigger fails to load SslCertificateLocation and SslKeyLocation

13

- On initialization of `KafkaTrigger` in Azure Premium Function, client public certificate and client secret will fail to load unless reference by absolute path within the trigger configuration. - I...

Irate-Walrus

Offset updates even when the function cannot process the messages after receiving

2

Scenario- If I receive 100 messages in a batch using the trigger, and if there is an error that happened after I receive the message (e.g.: one of the external...

shanavt

jainharsh98

Since the function extension already supports Avro and Protobuf (de)serialization, it would be helpful to expose the following as optional configs for the `KafkaTrigger` and `Kafka` attributes. - `schema.registry.basic.auth.credentials.source` -...

bbejeck