paimon icon indicating copy to clipboard operation
paimon copied to clipboard

[Flink]supported schemaEvolution when restarting the paimon cdc job

Open MOBIN-F opened this issue 1 year ago • 4 comments

Purpose

Restarting the flink-paimon-mysql-cdc job schemaCompatible failed when the data type length was modified between the stop and restart of the flink-paimon-mysql-cdc job

Tests

API and Format

Documentation

MOBIN-F avatar May 09 '24 12:05 MOBIN-F

I added some test cases, can you help review this pr? @JingsongLi

MOBIN-F avatar May 11 '24 07:05 MOBIN-F

Test Triggerred.

JingsongLi avatar May 13 '24 05:05 JingsongLi

The pr will add the following jobs: When restarting the paimon job, if the field length changes, the schemaCompatible check is successful and schemaEvolution is performed at the same time.

MOBIN-F avatar May 14 '24 07:05 MOBIN-F

@JingsongLi @yuzelin @zhongyujiang I updated the code and test cases, can you help review them?

MOBIN-F avatar May 17 '24 17:05 MOBIN-F

Found some problems, I will close the PR and create a new PR for better review of the code

MOBIN-F avatar May 21 '24 01:05 MOBIN-F

move to #3362

MOBIN-F avatar May 27 '24 07:05 MOBIN-F