seatunnel
seatunnel copied to clipboard
[Feature][SeaTunnel Engine] Add test to test stream job recover when all cluster node done and restart
Search before asking
- [X] I had searched in the feature and found no similar feature requirement.
Description
Add a test to do this:
- 3 node cluster start and then submit a stream job (Fake Source -> LocalFile Sink, and Fake Source will write 6000 rows. You can reference https://github.com/apache/incubator-seatunnel/blob/dev/seatunnel-e2e/seatunnel-engine-e2e/connector-seatunnel-e2e-base/src/test/java/org/apache/seatunnel/engine/e2e/ClusterFaultToleranceIT.java)
- Stop all nodes when there are some rows write into the local files.
- Start all nodes.
- Check the job status will recover to
Running
. - Wait and check the local files will have all the row write from Fake Source and the number of the rows are
6000
. - Cannel the job and wait the job's status turn to
CANCELED
. - Stop the cluster client.
- Stop all cluster nodes.
Usage Scenario
No response
Related issues
No response
Are you willing to submit a PR?
- [ ] Yes I am willing to submit a PR!
Code of Conduct
- [X] I agree to follow this project's Code of Conduct
I want to try this task, it will help me understand engine better. Please assign it to me,thanks.