[Feature][Spark]: support run optimize by spark command

[baiyangtx]

Description

trigger optimize by spark command.

Use case/motivation

optimize job is scheduled by AMS, but in some case user wants to trigger optimize under job or by terminal.

Describe the solution

there are 2 way to implement this feature.

1. spark command report to AMS and retrurn immediately， AMS start a optimize job async.
2. spark command do real optimize job and return after job is down.

Related issues

No response

Are you willing to submit a PR?

• [ ] Yes I am willing to submit a PR!

Code of Conduct

• [X] I agree to follow this project's Code of Conduct