ray-llm icon indicating copy to clipboard operation
ray-llm copied to clipboard
verified publisher icon ray-project

Serve a new model without restarting RayLLM

Open k6l3 opened this issue 1 year ago • 1 comments

Is it possible to start serving a new model when an event happens?

k6l3 avatar Feb 02 '24 07:02 k6l3

Bumping this.

samarth-contextual avatar Feb 09 '24 20:02 samarth-contextual