seatunnel icon indicating copy to clipboard operation
seatunnel copied to clipboard

[Bug] [CheckPoint] Checkpoints were not deleted

Open W-dragan opened this issue 1 year ago • 2 comments

Search before asking

  • [X] I had searched in the issues and found no similar issues.

What happened

When I ran the seatunnel task, I found that the checkpoints file continued to grow, and even after the task was completed, it was not deleted image

SeaTunnel Version

dev

SeaTunnel Config

any config

Running Command

./seatunnel-cluster.sh -d

Error Exception

org.apache.seatunnel.engine.server.checkpoint.CheckpointManager#shutdown is only used in unitTest. 
In the previous version 2.3.1, this interface was called to delete checkpoints, but currently there is no call. It is uncertain whether the refactoring was missed or a new strategy was used. However, the current phenomenon is that checkpoints were not deleted, resulting in continuous file growth

Zeta or Flink or Spark Version

No response

Java or Scala Version

No response

Screenshots

No response

Are you willing to submit PR?

  • [ ] Yes I am willing to submit a PR!

Code of Conduct

W-dragan avatar Jan 17 '24 15:01 W-dragan

cc @EricJoy2048

Hisoka-X avatar Jan 19 '24 09:01 Hisoka-X

This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.

github-actions[bot] avatar Feb 19 '24 00:02 github-actions[bot]

This issue has been closed because it has not received response for too long time. You could reopen it if you encountered similar problems in the future.

github-actions[bot] avatar Feb 26 '24 00:02 github-actions[bot]