[Feature]: Support spark optimizer container for AMS

[tcodehuber]

Description

Although the implementation of Spark Optimizer is currently supported, users need to run it in an external container, which is triggered by an external scheduling platform usually. Encapsulating the deployment method of optimizers such as flink container(out of box) is user-friendly and very necessary.

Use case/motivation

No response

Describe the solution

No response

Subtasks

No response

Related issues

No response

Are you willing to submit a PR?

• [x] Yes I am willing to submit a PR!

Code of Conduct

• [X] I agree to follow this project's Code of Conduct