Docker container

[FlorianMF]

I think it would be great for users and for developers to be able to easily share their dashboard or run it in production without deploying via Streamlit. I could add a simple Dockerfile wrapping everything up into a container.

Torchserve-Dashbord would be to Torchserve what MongoExpress is to MongoDB. Thoughts?

[cceyda]

I can't give any production ready guarantees 😅 but a basic setup probably do something easily building on top of official containers https://hub.docker.com/r/pytorch/torchserve like this; pseudo dockerfile:

FROM pytorch/torchserve:latest-gpu #pick a base image
RUN pip install torchserve-dashboard
#COPY config file
#COPY model files

EXPOSE 8080,8501 #expose prediction and/or dashboard

ENTRYPOINT ["/usr/local/bin/entrypoint.sh"] #entrypoint would start dashboard

One thing I would like to clarify is Management Dashboard is for an Admin user only and exposed ports should be secured with such privileges.

[FlorianMF]

I'll give this a shot in the next days. We can easily have a cpu and a gpu version.

I think for the beginning user rights might be a bit complicated to set up. But that definitely is an interesting feature.