worker-vllm
worker-vllm copied to clipboard
add changes for lora adapter support and /v1/models endpoint
small changes to add the lora modules ENV variable (supporting 1 lora adapter) as solution for #119
with the format: {"name": "xxx", "path": "xxx/xxxxx", "base_model_name": "xxx/xxxx"}
also change of the v1/models endpoint to return all models