azure-functions-kafka-extension icon indicating copy to clipboard operation
azure-functions-kafka-extension copied to clipboard

need control in setting the commit offset value (i.e manual commit) with Kafka extension instead of auto commit

Open thilakbe opened this issue 2 years ago • 2 comments

At high load, we see duplicate events consumption issue when we use Function app with Kafka trigger. Hence, we are looking for a feature where we could set the offset commit value manually instead of auto commit which is managed by Azure functions platform.

thilakbe avatar Apr 14 '23 10:04 thilakbe

We need to set commit offset manually for a different reason as we have a use case where we need to cache events for a specific time and flush the events if a duration or memory threshold is reached. We want to commit after flushing and not when the events where received.

PSanetra avatar Jul 14 '23 09:07 PSanetra