[Feature][Task] Submit Flink task directly on Kubernetes

[kezhenxu94]

Search before asking

• [X] I had searched in the issues and found no similar feature requirement.

Description

We will support two methods to submit Flink jobs to Kubernetes

• Flink JobManager/TaskManager deployed on Kubernetes

./bin/flink run -m <jobmanager.address>:<jobmanager.port> ./examples/streaming/TopSpeedWindowing.jar

• Native Kubernetes

We will only support Application Mode as that's recommended in production.

kubectl create serviceaccount flink-service-account
kubectl create clusterrolebinding flink-role-binding-flink --clusterrole=edit --serviceaccount=default:flink-service-account  

./bin/flink run-application \
    --target kubernetes-application \
    -Dkubernetes.cluster-id=wordcount \
    -Dkubernetes.service-account=flink-service-account \
    local:///opt/flink/examples/batch/WordCount.jar

Use case

No response

Related issues

Similar to #13511 /cc @Radeity

Are you willing to submit a PR?

• [ ] Yes I am willing to submit a PR!

Code of Conduct

• [X] I agree to follow this project's Code of Conduct

[github-actions[bot]]

Thank you for your feedback, we have received your issue, Please wait patiently for a reply.

• In order for us to understand your request as soon as possible, please provide detailed information, version or pictures.
• If you haven't received a reply for a long time, you can join our slack and send your question to channel #troubleshooting

[Radeity]

Hi, @kezhenxu94, it's similar with Spark, and maybe they can share some component, like k8s application manager, you can assign me, i'll try my best.

[kezhenxu94]

Hi, @kezhenxu94, it's similar with Spark, and maybe they can share some component, like k8s application manager, you can assign me, i'll try my best.

Hi @Radeity thanks for the interest, assigned

[github-actions[bot]]

This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.

[github-actions[bot]]

This issue has been closed because it has not received response for too long time. You could reopen it if you encountered similar problems in the future.