seatunnel
seatunnel copied to clipboard
[Improve] [Engine] Move Completed Checkpoint trigger to CheckpointCoordinator
Purpose of this pull request
Move Completed Checkpoint trigger to CheckpointCoordinator to avoid normal Checkpoint and completed checkpoint both trigger at same time.
Check list
- [ ] Code changed are covered with tests, or it does not need tests for reason:
- [ ] If any new Jar binary package adding in your PR, please add License Notice according New License Guide
- [ ] If necessary, please update the documentation to describe the new feature. https://github.com/apache/incubator-seatunnel/tree/dev/docs
- [ ] If you are contributing the connector code, please check that the following files are updated:
- Update change log that in connector document. For more details you can refer to connector-v2
- Update plugin-mapping.properties and add new connector information in it
- Update the pom file of seatunnel-dist
Is there a case where we have multiple sources in the single pipeline? This causes the COMPLETED_POINT_TYPE to be triggered when a single source completes
good point, I will fix this.
@ashulin Temporary solution to ensure that the task can run normally, and the fine-grained part of the task completed logic will be resolved in the future.