seatunnel icon indicating copy to clipboard operation
seatunnel copied to clipboard

[Design][Zeta] Add Zeta Http Client

Open zhibinF opened this issue 2 years ago • 2 comments

Search before asking

  • [X] I had searched in the feature and found no similar feature requirement.

Description

From https://github.com/apache/seatunnel/issues/4955 , we design Seatunnel Http Client instead of Seatnnel CLI. At present, seatunnel has been implemented to query status and statistics of running jobs, as well as recent completed jobs through rest command. Now we try to design Zeta job submission via rest api.

Job Parameter Passing Pass parameters as a POST request All the parameters in the config file are passed in json format in the body of the broken post. Other CLI job parameters are passed in parameter: clusterName, masterType, jobName, restoreJobId, async

URL entry "/hazelcast/rest/maps/submit-job"

Implementation ideas

  1. Under the rest folder to create RestHttpPostCommandProcessor. Java
  2. In NodeExtension. Register RestHttpPostCommandProcessor in Java
  3. Registered in RestConstant * SUBMIT_JOB_URL * for "/ hazelcast/rest/maps/submit-job",
  4. Registered in the handle RestHttpPostCommandProcessor handleSubmitJob function is used to submit the task
  5. Implement the submit task in the handleSubmitJob function

Usage Scenario

No response

Related issues

No response

Are you willing to submit a PR?

  • [ ] Yes I am willing to submit a PR!

Code of Conduct

zhibinF avatar Jul 08 '23 06:07 zhibinF

#2272 #2333

liugddx avatar Jul 08 '23 14:07 liugddx

Since the request is sent directly to the master node, We can directly call CoordinatorService.submitJob to complete the task submission.

liugddx avatar Jul 08 '23 14:07 liugddx

This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.

github-actions[bot] avatar Aug 08 '23 00:08 github-actions[bot]

This issue has been closed because it has not received response for too long time. You could reopen it if you encountered similar problems in the future.

github-actions[bot] avatar Aug 16 '23 00:08 github-actions[bot]