seatunnel
seatunnel copied to clipboard
[Design][Zeta] Add Zeta Http Client
Search before asking
- [X] I had searched in the feature and found no similar feature requirement.
Description
From https://github.com/apache/seatunnel/issues/4955 , we design Seatunnel Http Client instead of Seatnnel CLI. At present, seatunnel has been implemented to query status and statistics of running jobs, as well as recent completed jobs through rest command. Now we try to design Zeta job submission via rest api.
Job Parameter Passing Pass parameters as a POST request All the parameters in the config file are passed in json format in the body of the broken post. Other CLI job parameters are passed in parameter: clusterName, masterType, jobName, restoreJobId, async
URL entry "/hazelcast/rest/maps/submit-job"
Implementation ideas
- Under the rest folder to create RestHttpPostCommandProcessor. Java
- In NodeExtension. Register RestHttpPostCommandProcessor in Java
- Registered in RestConstant * SUBMIT_JOB_URL * for "/ hazelcast/rest/maps/submit-job",
- Registered in the handle RestHttpPostCommandProcessor handleSubmitJob function is used to submit the task
- Implement the submit task in the handleSubmitJob function
Usage Scenario
No response
Related issues
No response
Are you willing to submit a PR?
- [ ] Yes I am willing to submit a PR!
Code of Conduct
- [X] I agree to follow this project's Code of Conduct
#2272 #2333
Since the request is sent directly to the master node, We can directly call CoordinatorService.submitJob to complete the task submission.
This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.
This issue has been closed because it has not received response for too long time. You could reopen it if you encountered similar problems in the future.