zeppelin icon indicating copy to clipboard operation
zeppelin copied to clipboard

[ZEPPELIN-3540] Show Spark inline UI in Non-Secure mode

Open shahsank3t opened this issue 7 years ago • 17 comments

What is this PR for?

After running a paragraph via Spark interpreter, we will be showing a "Spark UI" link. On clicking it, we show the Spark UI with the respective running job running.

What type of PR is it?

[Improvement]

What is the Jira issue?

[ZEPPELIN-3540]

How should this be tested?

Using Spark interpreter, run a paragraph. On successful execution, we will see a Spark UI link(as shown in screenshot below) Click on the link and the pop up modal opens up showing the Spark job in the Zeppelin context.

Screenshots (if appropriate)

spark-ui-link

webui-modal

shahsank3t avatar Jun 14 '18 05:06 shahsank3t

@prabhjyotsingh @r-kamath - Just a reminder to review this.

shahsank3t avatar Jun 18 '18 08:06 shahsank3t

@shahsank3t I didn't try this PR, but I didn't see backend pass spark.ui.allowFramingFrom to frontend, so how does frontend know whether it should show spark ui inline or in another windows of the old method ?

zjffdu avatar Jun 20 '18 06:06 zjffdu

ping @shahsank3t Any updates ?

zjffdu avatar Jun 26 '18 02:06 zjffdu

@zjffdu Apologies missed out the earlier notification.

I didn't try this PR, but I didn't see backend pass spark.ui.allowFramingFrom to frontend, so how does frontend know whether it should show spark ui inline or in another windows of the old method ?

Yes, you are right. Frontend is not checking the property spark.ui.allowFramingFrom and always explicitly showing spark ui inline(within a modal). If we want to provide the support to fallback, we can check the specified property for any value and show ui inline and if no value is set, show in another windows. Sounds good?

shahsank3t avatar Jun 26 '18 04:06 shahsank3t

One drawback of inline UI is that user can not switch from spark ui and notebook, this may make user annoyed .

zjffdu avatar Jun 26 '18 04:06 zjffdu

can we open a pop up with options, like clicking on a url link in google doc? possible options: open, open in new tab

felixcheung avatar Jun 26 '18 06:06 felixcheung

can we open a pop up with options, like clicking on a url link in google doc? possible options: open, open in new tab

@zjffdu Above suggestion makes sense right? User can click which ever desired option. @felixcheung Thanks for the suggestion, I'll look into it.

shahsank3t avatar Jun 27 '18 04:06 shahsank3t

Make sense for me to provide options to allow user to chose.

zjffdu avatar Jun 28 '18 08:06 zjffdu

@zjffdu @felixcheung Integrated your suggestions.

Below screenshot when single job is running: screen shot 2018-07-02 at 2 38 55 pm

Below screenshot with multiple job is running: screen shot 2018-07-02 at 2 39 35 pm

Please have a look.

shahsank3t avatar Jul 02 '18 09:07 shahsank3t

I just have concern that is it possible to implement it via less code change. Because it seems to be a very simple function to pop an iframe window. Not sure why it would involve so many code change. But I am not frontend expert, I may be wrong on this. Wait for other frontend expert for more comments. \cc @prabhjyotsingh

zjffdu avatar Jul 02 '18 09:07 zjffdu

I agree with @zjffdu. AFAIK, we already have a modal for some other reasons. Can we reuse them for this issue?

jongyoul avatar Jul 05 '18 07:07 jongyoul

@jongyoul @zjffdu @prabhjyotsingh Updated the code by reusing modal and other available methods. Please review it.

shahsank3t avatar Jul 11 '18 07:07 shahsank3t

@shahsank3t can you enable CI, looks like Travis builds are not enabled https://zeppelin.apache.org/contribution/contributions.html#continuous-integration

prabhjyotsingh avatar Jul 17 '18 07:07 prabhjyotsingh

@prabhjyotsingh Done enabling CI

shahsank3t avatar Jul 17 '18 09:07 shahsank3t

@zjffdu @prabhjyotsingh Updated the PR with all the changes and documentation. Please review and let me know if I should rebase and squash the commits.

shahsank3t avatar Aug 07 '18 11:08 shahsank3t

@zjffdu Thanks for the review. I wasn't aware of Zeppelin context as another thing. Have addressed your comments and fixed the wording.

shahsank3t avatar Aug 08 '18 04:08 shahsank3t

@r-kamath - addressed your review comments. Please have a look again. Thanks in advance.

shahsank3t avatar Aug 29 '18 09:08 shahsank3t