seatunnel icon indicating copy to clipboard operation
seatunnel copied to clipboard

[Metrics] [Kafka Source] the source recived count maybe not correct when MessageFormatErrorHandleWay = true

Open liunaijie opened this issue 1 year ago • 1 comments

Search before asking

  • [X] I had searched in the issues and found no similar issues.

What happened

When use kafka source, it has an MessageFormatErrorHandleWay option, when enable this, we can skip the deserialize exception and continue the process. But when we read an dirty data, due to deserialize failed, it won't send to the Collector. so this record is not counted in sourceRecivedCount.

SeaTunnel Version

dev

SeaTunnel Config

na

Running Command

na

Error Exception

na

Zeta or Flink or Spark Version

all

Java or Scala Version

No response

Screenshots

No response

Are you willing to submit PR?

  • [ ] Yes I am willing to submit a PR!

Code of Conduct

liunaijie avatar Mar 18 '24 06:03 liunaijie

This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.

github-actions[bot] avatar Apr 18 '24 00:04 github-actions[bot]