[Feature]: Support executing expiring processes in the Optimizer

[zhoujinsong]

Description

The expiring processes(including snapshot expiration, orphan file cleaning, and data file expiration, etc) on tables, should be executed in the Optimizer instead of in the AMS.

Use case/motivation

Currently, the AMS periodically performs expiring processes(including snapshot expiration, orphan file cleaning, and data file expiration, etc) on tables, These processes may consume significant AMS resources, especially memory resources, posing a significant risk to AMS stability. We should support executing these expiring processes in the Optimizer to improve AMS stability.

Describe the solution

No response

Subtasks

No response

Related issues

No response

Are you willing to submit a PR?

• [ ] Yes I am willing to submit a PR!

Code of Conduct

• [X] I agree to follow this project's Code of Conduct