kserve
Local deployment (Docker, not Kubernetes/MiniKube)
I am new with modelmesh but so interested in this project. Could we deploy modelmesh using Docker only without k8s cluster? Thanks
Hi @Phelan164, the short answer is in theory yes (Model-mesh actually started out independently of Kubernetes), but it would require a fair amount of custom setup/configuration, especially if you want to use the built-in model server integration that we have as part of the wider modelmesh-serving framework.
I would strongly recommend using it on Kube via the controller (following quickstart here). You can install local/lightweight Kubernetes clusters using something like minikube or kind.
@njhill thanks for your suggestion. Yes, I could work with modelmesh via controller and deploy into kubenetes cluster. But just want to make very simple development env, so I want to setup modelmesh run in docker and directly interact with that via gRPC. Related to "custom setup/configuration", could you share some basic guidelines ? Thanks so much for your support