kyuubi icon indicating copy to clipboard operation
kyuubi copied to clipboard

Published 20 hours ago • verified publisher icon apache

[SUB-TASK][KPIP-2] Support YARN application-mode

Open yanghua opened this issue 3 years ago • 1 comments

Code of Conduct

Search before asking

  • [X] I have searched in the issues and found no similar issues.

Describe the feature

This is a subtask of #1322

Motivation

No response

Describe the solution

No response

Additional context

No response

Are you willing to submit PR?

  • [ ] Yes I am willing to submit a PR!

yanghua avatar Dec 29 '21 14:12 yanghua

Interested on it. Could u please assign this ticket to me? @yanghua

zuston avatar Apr 19 '22 15:04 zuston

This is a feature nice to have, not a blocker of 1.7

pan3793 avatar Feb 07 '23 05:02 pan3793

@yanghua @pan3793 I've created a POC https://github.com/link3280/incubator-kyuubi/commit/a0c3dae2eb4de224bba605be186d3280a40908e1 and verified myself, PTAL. Codes related to the session mode are removed temporarily to simplify testing.

It needs some hacking to submit jobs from Kyuubi currently, but at the same time I'm preparing a FLIP to allow job graph submitted from outside the cluster in Flink application mode. If implemented, we should not need hacking anymore.

link3280 avatar Mar 12 '23 08:03 link3280

Thank @link3280 for your excellent work.

pan3793 avatar Mar 13 '23 02:03 pan3793

👍

yaooqinn avatar Mar 13 '23 02:03 yaooqinn

Can this get the job application id?

waywtdcc avatar Mar 24 '23 08:03 waywtdcc

Can this get the job application id?

@waywtdcc The application id would be handled on the Flink side, thus we don't have to explicitly set an application id.

link3280 avatar Mar 25 '23 08:03 link3280