scaleph icon indicating copy to clipboard operation
scaleph copied to clipboard

[Feature][scaleph-engine-flink] flink multi-version cluster support

Open kalencaya opened this issue 3 years ago • 2 comments

Already searched before asking?

  • [X] I had searched in the feature and found no similar feature requirement.

Usage Scenario

Scaleph supports flink 1.13.x, 1.14.x, 1.15.x, ...

Description

Flink api evolves between different version and flinkful keeps up with flink through 1.13.6.xxx version or 1.14.4.xxx version. Scaleph delegates flink cluster and job operate to flinkful and only supports specific flink version. We need to add support multiple flink version feature to Scaleph.

Are you willing to submit a PR?

  • [X] Yes, I am willing to submit a PR!

Code of Conduct

kalencaya avatar Jul 03 '22 23:07 kalencaya

There are two solutions for this problem:

  • seperate run environment. we can provide seperate environment by image and container
  • classloader. JVM identifies different class if the same class name loaded by different classloader

kalencaya avatar Jul 03 '22 23:07 kalencaya

https://www.sofastack.tech/projects/sofa-boot/sofa-ark-migration-guide/

kalencaya avatar Jul 06 '22 07:07 kalencaya