scaleph
scaleph copied to clipboard
[Feature][scaleph-engine-flink] flink multi-version cluster support
Already searched before asking?
- [X] I had searched in the feature and found no similar feature requirement.
Usage Scenario
Scaleph supports flink 1.13.x, 1.14.x, 1.15.x, ...
Description
Flink api evolves between different version and flinkful keeps up with flink through 1.13.6.xxx version or 1.14.4.xxx version. Scaleph delegates flink cluster and job operate to flinkful and only supports specific flink version. We need to add support multiple flink version feature to Scaleph.
Are you willing to submit a PR?
- [X] Yes, I am willing to submit a PR!
Code of Conduct
- [X] I agree to follow this project's Code of Conduct
There are two solutions for this problem:
- seperate run environment. we can provide seperate environment by image and container
- classloader. JVM identifies different class if the same class name loaded by different classloader
https://www.sofastack.tech/projects/sofa-boot/sofa-ark-migration-guide/