seatunnel icon indicating copy to clipboard operation
seatunnel copied to clipboard

[Improve][Connector-V2] Support schema evolution for mysql-cdc and mysql-jdbc

Open dailai opened this issue 1 year ago • 6 comments

Purpose of this pull request

  1. Support schema evolution for mysql-cdc
  • Support add column
  • Support drop column
  • Support modify data type of column
  • Support rename name of column
  1. Support schema evolution for mysql jdbc sink
  • Support add column
  • Support drop column
  • Support modify data type of column
  • Support rename name of column

Does this PR introduce any user-facing change?

How was this patch tested?

Check list

  • [ ] If any new Jar binary package adding in your PR, please add License Notice according New License Guide
  • [ ] If necessary, please update the documentation to describe the new feature. https://github.com/apache/seatunnel/tree/dev/docs
  • [ ] If you are contributing the connector code, please check that the following files are updated:
    1. Update change log that in connector document. For more details you can refer to connector-v2
    2. Update plugin-mapping.properties and add new connector information in it
    3. Update the pom file of seatunnel-dist
  • [ ] Update the release-note.

dailai avatar May 31 '24 08:05 dailai

subtask of https://github.com/apache/seatunnel/issues/4672

hailin0 avatar May 31 '24 10:05 hailin0

中文: 这块是否有方案文档,对这块有兴趣,想了解一下是如何实现点的,想看看能不能实现动态加表的特性,如果可以,想看看我能不能实现 English: Is there a solution document for this? I am interested in this and would like to understand how it is implemented. I want to see if it is possible to achieve the feature of dynamically adding tables. If so, I would like to see if I can implement it.

steveGuRen avatar Jun 03 '24 02:06 steveGuRen

Has it already been completed?

Carl-Zhou-CN avatar Jun 20 '24 06:06 Carl-Zhou-CN

Has it already been completed?

Yes, I have tested both locally and using e2e several times.

dailai avatar Jun 20 '24 06:06 dailai

cc @EricJoy2048 @Hisoka-X

hailin0 avatar Jun 25 '24 15:06 hailin0

Has it already been completed?

Yes, I have tested both locally and using e2e several times.

ok

Carl-Zhou-CN avatar Jun 26 '24 10:06 Carl-Zhou-CN

Hi @dailai , could you add some doc? I found users even not know this feature so that can not use it at now.

Hisoka-X avatar Sep 10 '24 01:09 Hisoka-X

OK

dailai avatar Sep 10 '24 02:09 dailai