flink-cdc icon indicating copy to clipboard operation
flink-cdc copied to clipboard
verified publisher icon apache

[FLINK-35441][tests] Add migration test cases

Open yuxiqian opened this issue 1 year ago • 1 comments

This closes FLINK-35441.

Adding backwards compatible test with 3.0.0 and 3.1.0 version by serializing objects on lower versions and deserializing them on snapshot version.

  • SchemaManager test runs on 3.1.0 only since commit https://github.com/apache/flink-cdc/commit/bcad5d9d11b9c37182510a43292e3019356173d1 and #3129 changes SchemaRegistry serialization fields and breaks backwards compatibility.
  • SchemaRegistry test runs on 3.1.0 only, since it stores SchemaManager in its state.
  • ChangeTableInfo test runs on 3.1.0 only since Transform feature does not exist in 3.0.x.

Also noticed that there's no much classes using versioned serialization protocol, which couldn't guarantee backwards compatibility. Needs more discussion on how to refactor them.

yuxiqian avatar May 27 '24 08:05 yuxiqian

I'm not sure if it's OK to perform migration tests like so, could @leonardBang @PatrickRen please provide some advices on this? Thanks!

yuxiqian avatar May 27 '24 09:05 yuxiqian

Looks like we can close this PR as we've finish the tests in https://github.com/apache/flink-cdc/pull/3370 @yuxiqian

leonardBang avatar Jun 07 '24 08:06 leonardBang