seatunnel
seatunnel copied to clipboard
[Metrics] [Kafka Source] the source recived count maybe not correct when MessageFormatErrorHandleWay = true
Search before asking
- [X] I had searched in the issues and found no similar issues.
What happened
When use kafka source, it has an MessageFormatErrorHandleWay option, when enable this, we can skip the deserialize exception and continue the process.
But when we read an dirty data, due to deserialize failed, it won't send to the Collector. so this record is not counted in sourceRecivedCount.
SeaTunnel Version
dev
SeaTunnel Config
na
Running Command
na
Error Exception
na
Zeta or Flink or Spark Version
all
Java or Scala Version
No response
Screenshots
No response
Are you willing to submit PR?
- [ ] Yes I am willing to submit a PR!
Code of Conduct
- [X] I agree to follow this project's Code of Conduct
This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.