Sven Knoblauch
Results
3
comments of
Sven Knoblauch
yeah, for the "standard" vllm docker image you can load it with --lora-modules, but how do you do so in the runpod serverless vllm worker image. There you can't add...
Thanks @pandyamarut for merging the last lora adapter Pull Request. Just added a small update to include also multi lora support.
should be working now with the new version