worker-vllm icon indicating copy to clipboard operation
worker-vllm copied to clipboard

add changes for lora adapter support and /v1/models endpoint

Open sven-knoblauch opened this issue 1 year ago • 0 comments

small changes to add the lora modules ENV variable (supporting 1 lora adapter) as solution for #119 with the format: {"name": "xxx", "path": "xxx/xxxxx", "base_model_name": "xxx/xxxx"}

also change of the v1/models endpoint to return all models

sven-knoblauch avatar Oct 09 '24 10:10 sven-knoblauch