zeppelin
zeppelin copied to clipboard
[ZEPPELIN-4050] Zeppelin on YARN
What is this PR for?
Let Zeppelin all interpreter process running on YARN.
- Run Zeppelin server on local host.
- Run Standard interpreters as YARN (Docker) container.
- Spark on Yarn only support local mode, yarn-client and yarn-cluster mode unchanged.
What type of PR is it?
[Feature]
Todos
- [ ] - Task
What is the Jira issue?
https://issues.apache.org/jira/browse/ZEPPELIN-4050
How should this be tested?
https://travis-ci.org/liuxunorg/zeppelin/builds/523999069
Screenshots (if appropriate)
python, shell, ... on yarn

Spark on Yarn (only local mode)

Questions:
- Does the licenses files need update?
- Is there breaking changes for older versions?
- Does this needs documentation? YES
@zjffdu , CI pass, Please help me review code, thanks!
@liuxunorg I just go through this PR, and see several code related with submarine. Could you explain that ? And this is a big PR, could you write a simple doc to explain how this feature is implemented ?
@zjffdu , I attach a Zeppelin On Yarn Design Document to the ZEPPELIN-4050.