numaflow
numaflow copied to clipboard
watermark updates gets linearly slow with increase in partition count
Describe the bug
watermark updates get linearly slow with an increase in partition count, causing forward-a-chunk
to block. we noticed this issue when reading from Kafka with partition counts ~ 500.
Work Around Disabling the watermark can be done only for non-reduced pipelines.