seatunnel icon indicating copy to clipboard operation
seatunnel copied to clipboard

[Feature][Core] Supprot add thirdparty jar in env

Open Hisoka-X opened this issue 2 years ago • 1 comments

Search before asking

  • [X] I had searched in the feature and found no similar feature requirement.

Description

Support Add thirdpatry jar like mysql driver in env config for each job. Both should support spark/flink/engine.

  1. Spark parse env config then add it in spark-submit shell in SparkStarter::buildCommands.
  2. Flink parse env config then add it use FlinkExecution::registerPlugin
  3. ST-Engine parse env config then add it use JobExecutionEnvironment.commonPluginJars
  4. The Env config key should be jars, like jars="file://local/jar1.jar,file://local/jar2.jar"

This feature should be done before next version release, so we should support it faster.

Usage Scenario

No response

Related issues

No response

Are you willing to submit a PR?

  • [ ] Yes I am willing to submit a PR!

Code of Conduct

Hisoka-X avatar Nov 25 '22 04:11 Hisoka-X

assign to me

liugddx avatar Nov 25 '22 05:11 liugddx