[Feature]: Integration with Kubernetes

[baiyangtx]

Description

K8S is an important computing engine and a crucial orchestration method in cloud-native scenarios. One of Amoro's positioning is to provide an integrated solution for data lake and data warehouse in cloud-native scenarios, so it is necessary to consider the integration with K8S.

The following tasks need to be improved to support integration with K8S:

• Support deploying AMS on Kubernetes.
• Support scaling, resizing, and managing Optimizer on Kubernetes clusters through AMS.
• Supplement "Deploy with Kubernetes" in the deployment section of the documentation.

In addition, there are some details that need to be optimized in the Kubernetes scenario.

Use case/motivation

No response

Describe the solution

No response

Subtasks

• https://github.com/NetEase/amoro/issues/1335
• https://github.com/NetEase/amoro/issues/508
• https://github.com/NetEase/amoro/issues/1918
• https://github.com/NetEase/amoro/issues/2054
• https://github.com/NetEase/amoro/pull/2020

Related issues

• https://github.com/NetEase/amoro/issues/1922
• https://github.com/NetEase/amoro/issues/1945
• https://github.com/NetEase/amoro/issues/1957
• https://github.com/NetEase/amoro/issues/1962
• https://github.com/NetEase/amoro/issues/2033
• https://github.com/NetEase/amoro/issues/1958
• https://github.com/NetEase/amoro/issues/2306

Are you willing to submit a PR?

• [ ] Yes I am willing to submit a PR!

Code of Conduct

• [X] I agree to follow this project's Code of Conduct