seatunnel
seatunnel copied to clipboard
[Feature][MySQL-CDC] Partition by event time
Search before asking
- [X] I had searched in the feature and found no similar feature requirement.
Description
It is common to convert ts_ms to dt and use it as the partition key. It seems that it is not possible as of now. I get this error:
ErrorCode:[COMMON-06], ErrorDescription:[Illegal argument] - partition fields must in sink columns
Usage Scenario
We have many tables, not all of them have update_time a column, and not all of the update_time columns are named consistently. We need to use the ts_ms to do partitioning.
Related issues
No response
Are you willing to submit a PR?
- [ ] Yes I am willing to submit a PR!
Code of Conduct
- [X] I agree to follow this project's Code of Conduct