Jerry Shao

@namanmishra91 thanks for your work, did you finish all your works? @yiheng @runzhiwang would you please help to review, thanks.

Also have you tested multiple scala/python/R interpreters in one context?

@pmsgd would you please give an example of how to use this new feature?

Thanks for the info. The API usage seems not so straightforward from my point. Let me think a bit on this thing.

I was thinking if we can: 1. associate file uploading with session creation post request, so that we can handle this in one request, not sure if Http protocol support...

For the memory issue, I think we can stream the file input into disk, that will handle memory issue. Can you explain more about this "if file is uploaded before...

> After some time hdfs will be filled with these "orphan" files. I think periodic maintenace task for deleting old unused files is worse than one rest call. This should...

Can you please check how other Spark service handle such file upload issue? like Toree, Spark JobServer, or maybe others.

@zjffdu @ajbozarth can you please comment on this feature, especially on the API design side. Thanks!

How about we design new APIs for such such usage scenario? 1. request a new session/batch id from Livy server. 2. Start preparing new resources(jars, py files, archieves). 3. submit...