torchserve-dashboard
torchserve-dashboard copied to clipboard
Docker container
I think it would be great for users and for developers to be able to easily share their dashboard or run it in production without deploying via Streamlit. I could add a simple Dockerfile wrapping everything up into a container.
Torchserve-Dashbord would be to Torchserve what MongoExpress is to MongoDB. Thoughts?
I can't give any production ready guarantees 😅 but a basic setup probably do something easily building on top of official containers https://hub.docker.com/r/pytorch/torchserve like this; pseudo dockerfile:
FROM pytorch/torchserve:latest-gpu #pick a base image
RUN pip install torchserve-dashboard
#COPY config file
#COPY model files
EXPOSE 8080,8501 #expose prediction and/or dashboard
ENTRYPOINT ["/usr/local/bin/entrypoint.sh"] #entrypoint would start dashboard
One thing I would like to clarify is Management Dashboard is for an Admin user only and exposed ports should be secured with such privileges.
I'll give this a shot in the next days. We can easily have a cpu and a gpu version.
I think for the beginning user rights might be a bit complicated to set up. But that definitely is an interesting feature.
any updates on this?