pinot icon indicating copy to clipboard operation
pinot copied to clipboard

Adding kafka consumer group for reporting offset back to Kafka

Open xiangfu0 opened this issue 1 year ago • 1 comments

Requirements: have a way to track/compare the physical Kafka ingestion lag.

This can be an optional stream config to report the consumer lag periodically to Kafka for tracking purpose.

It's not for any data flow management like offset reset kind of usage.

xiangfu0 avatar Sep 29 '24 08:09 xiangfu0

Hello, I would like to take this task. How can I get started? Can you please direct me to the relevant files and directories?

Thanks for the help

vivekkoya avatar Oct 14 '24 23:10 vivekkoya