numaflow Seeing duplicate messages in user defined source

Seeing duplicate messages in user defined source

Open yhl25 opened this issue 10 months ago • 2 comments

Duplicate message -  AAAAAJexQqI=-52-input-0  -  419895504

we occasionally see around 10 per second.

Apr 03 '24 03:04 yhl25

Hey @yhl25 , how do we reproduce this issue?

May 02 '24 18:05 KeranYang

I think this was fixed in - https://github.com/numaproj/numaflow/pull/1613

May 03 '24 11:05 yhl25

Have we observed this again? Or are we good for 1.3 on this to close

Jul 16 '24 23:07 kohlisid

@kohlisid No we haven't. It should be good to close. cc: @yhl25

Jul 17 '24 01:07 KeranYang

@yhl25 why was this reopened?

Jul 17 '24 12:07 vigith

We do not see this anymore except when there is ack failures due to topic rebalancing.

Jul 21 '24 00:07 vigith