paimon
paimon copied to clipboard
[Bug] When the paimon-flink-cdc module processes Kafka messages formatted in maxwell-json, if it encounters events lacking the "data" field, such as "table-alter", the program immediately throws an error and enters an unrecoverable state.
Search before asking
- [x] I searched in the issues and found nothing similar.
Paimon version
9d2a4605dffc39ddb0e5d0b8733c02bf9ea42c68
Compute Engine
flink 1.17
Minimal reproduce step
1.Establish a connection with the MySQL database, Maxwell collector, Kafka, and the paimon-flink-cdc program. 2.Initiate table-level modifications on MySQL tables, specifically table-alter events, such as ALTER TABLE xxx AUTO_INCREMENT = 2300. 3.The paimon-flink-cdc will throw an error message: "invalid maxwell-json format: missing 'data' field."
What doesn't meet your expectations?
The program encountered an error and cannot be recovered. It is expected to prevent such errors.
Anything else?
No response
Are you willing to submit a PR?
- [x] I'm willing to submit a PR!