Ruslan Dautkhanov

@bartdag can you please have a look at this? I also opened https://issues.apache.org/jira/browse/SPARK-23842 as didn't know if this has to be tackled from Spark or from py4j side. Thanks!

thanks @bartdag . cc @HyukjinKwon - would be great to have your input here. thanks both!

@HyukjinKwon I just published this code that can give you an idea what we're trying to do (as an example) - https://github.com/Tagar/ML/blob/master/mojo_pyspark_scorer.py (it's not a complete code as it has...

That's certainly an option, although would be so complicated that I am sure my colleagues wouldn't want to go into .. We can score records in Spark using the above...

@HyukjinKwon do you mean with https://github.com/apache/spark/pull/20151 we could pass py4j as a module to `spark.python.worker.module` and then it would give automatic connectivity to jvm on executors? Please elaborate how that...

```python # Use case 1 try: gw.entry_point.doSomething() except gw.jvm.java.io.IOError.as_type(): print("Hello World") # Alternative try: gw.entry_point.doSomething() except gw.jvm.java.io.IOError: print("Hello World") ``` This would be super cool - any plans to add...

> While this is a really nice feature to have, it does introduce some risk of information leakage in an organization. Take for example `select * from tableofsecrets where secretcolumn...

Another option is to set Spark `JobGroup Id` to paragraph's title ..

I think it's a great idea to add something like this to also show status if an interpreter is running. So show a green icon - if interpreter is running/...

Was thinking of another solution.. is it possible to *move* grid-ui's - Export all/visible data as csv/xls four options to that old Download menu? So grid-ui would only have more...