zeppelin icon indicating copy to clipboard operation
zeppelin copied to clipboard

[ZEPPELIN-4050] Zeppelin on YARN

Open xunliu opened this issue 6 years ago • 3 comments

What is this PR for?

Let Zeppelin all interpreter process running on YARN.

  • Run Zeppelin server on local host.
  • Run Standard interpreters as YARN (Docker) container.
  • Spark on Yarn only support local mode, yarn-client and yarn-cluster mode unchanged.

What type of PR is it?

[Feature]

Todos

  • [ ] - Task

What is the Jira issue?

https://issues.apache.org/jira/browse/ZEPPELIN-4050

How should this be tested?

https://travis-ci.org/liuxunorg/zeppelin/builds/523999069

Screenshots (if appropriate)

python, shell, ... on yarn

ZeppelinOnYarn

Spark on Yarn (only local mode)

sparkIntpOnYarn

Questions:

  • Does the licenses files need update?
  • Is there breaking changes for older versions?
  • Does this needs documentation? YES

xunliu avatar Apr 25 '19 02:04 xunliu

@zjffdu , CI pass, Please help me review code, thanks!

xunliu avatar Apr 25 '19 02:04 xunliu

@liuxunorg I just go through this PR, and see several code related with submarine. Could you explain that ? And this is a big PR, could you write a simple doc to explain how this feature is implemented ?

zjffdu avatar Apr 25 '19 02:04 zjffdu

@zjffdu , I attach a Zeppelin On Yarn Design Document to the ZEPPELIN-4050.

xunliu avatar Apr 25 '19 04:04 xunliu