[ST-Engine][JobSubmit] Design of Job Submit

[EricJoy2048]

Search before asking

• [X] I had searched in the feature and found no similar feature requirement.

Description

From https://github.com/apache/incubator-seatunnel/issues/2272 we know we will create LogicalDag in SeaTunnel Client and then submit it to SeaTunnel Server.

JobImmutableInformation

JobImmutableInformation is the Object that Client submit to Server .

public class JobImmutableInformation implements IdentifiedDataSerializable {
    private long jobId;

    private long createTime;

    private Data logicalDag;

    private JobConfig jobConfig;

    private List<URL> pluginJarsUrls;
}

Why logicalDag's type is Data

Because the deserialization of LogicalDag depends on the connector plugin jar be loaded into the classpath. So we add pluginJarsUrls to JobImmutableInformation. When SeaTunnel Server received the submitJob request,It will deserialization JobImmutableInformation first and then get the pluginJarsUrls from JobImmutableInformation. Then use a URLClassLoader load the jars so the logicalDag can be deserialized.

Usage Scenario

No response

Related issues

No response

Are you willing to submit a PR?

• [X] Yes I am willing to submit a PR!

Code of Conduct

• [X] I agree to follow this project's Code of Conduct