seatunnel icon indicating copy to clipboard operation
seatunnel copied to clipboard

[Feature][MySQL-CDC] Partition by event time

Open dz902 opened this issue 1 year ago • 0 comments

Search before asking

  • [X] I had searched in the feature and found no similar feature requirement.

Description

It is common to convert ts_ms to dt and use it as the partition key. It seems that it is not possible as of now. I get this error:

ErrorCode:[COMMON-06], ErrorDescription:[Illegal argument] - partition fields must in sink columns

Usage Scenario

We have many tables, not all of them have update_time a column, and not all of the update_time columns are named consistently. We need to use the ts_ms to do partitioning.

Related issues

No response

Are you willing to submit a PR?

  • [ ] Yes I am willing to submit a PR!

Code of Conduct

dz902 avatar Jun 26 '24 09:06 dz902