tiflow icon indicating copy to clipboard operation
tiflow copied to clipboard

Enhance Kafka consumer performance

Open wk989898 opened this issue 10 months ago • 1 comments

The following points need to be considered.

  • When the consumer crashes, some messages which haven't write to the downstream may be lost.
  • The code needs to be easy to maintain.
  • Reduce memory usage

wk989898 avatar Apr 26 '24 09:04 wk989898

Can we addresss the issue with multiple consumer running together as well? @3AceShowHand @wk989898

fubinzh avatar Apr 28 '24 01:04 fubinzh