feature request: jupyter app for jupyter running directly on worker node

[ltalirz]

In what area(s)?

/area administration /area ansible /area autoscaling /area configuration /area cyclecloud /area documentation /area image /area job-scheduling /area monitoring /area ood /area remote-visualization /area user-management

Describe the feature

The current jupyter app is useful when the software environment users need is fully encapsulated in the container (potentially mixed with conda environments installed on the shared file system that will, however, only be usable from the container).

In practice, the operating system on the VMs and of the container (Ubuntu for scipy/notebook) will differ. The container does not come with lmod, and users likely won't be able to run applications that have been compiled e.g. via spack for the VMs in question, even if one mounts the ANF inside the container.

There is thus a use case for a more "lightweight" jupyter app that basically does

srun /path/to/jupyter lab

Here, the jupyter installation lives on ANF and is managed either by the user or by the cluster admin.

The app makes it easy to run jupyter natively on the node, so the user does not have to worry about forwarding ports to their local machine etc.

The app is obviously rather straightforward and I already have a prototype of this in case in case anyone is interested