paimon icon indicating copy to clipboard operation
paimon copied to clipboard

[cdc] fix paimon cdc job restart failed when schema changed

Open MOBIN-F opened this issue 1 year ago • 4 comments

Purpose

Restarting the flink-paimon-cdc job schemaCompatible failed when the column change/add between the stop and restart of the flink-paimon-cdc job

  1. In cdc-postgresql, for the newly added fields, because debezium-postgresql has no DDL events, the newly added fields can only be parsed from the records, and char and varchar fields are both STRING types in debezium-postgresql, so both char and varchar are converted to STRING in cdc-postgresql.

Tests

API and Format

Documentation

MOBIN-F avatar May 21 '24 10:05 MOBIN-F

can you help review this pr? tks @JingsongLi

MOBIN-F avatar May 30 '24 01:05 MOBIN-F

CC @yuzelin

JingsongLi avatar Jun 24 '24 10:06 JingsongLi

Hello, can you solve the conflicts ?

yuzelin avatar Jun 24 '24 10:06 yuzelin

Hello, can you solve the conflicts ?

done,please help to review this PR, thanks. @yuzelin

MOBIN-F avatar Jun 25 '24 01:06 MOBIN-F