Luciano Resende
Luciano Resende
The classic Jupyter + IPython kernel approach with PySpark would allow each user to run their own Spark driver instance, giving them full control over configuration, context, and resource usage...
@ojarjur, I believe that adopting this approach will eventually lead to the deprecation of the current gateway client. To minimize the impact on the Jupyter Server's architecture, we should explore...
> @lresende you mean kernel _provisioners_ instead of "providers", correct? Sorry, @Zsailer is correct.