worker-vllm icon indicating copy to clipboard operation
worker-vllm copied to clipboard
verified publisher icon runpod-workers

[mc] add Env and modelpath util

Open pandyamarut opened this issue 10 months ago • 1 comments

Note: You can only load one model at a time, Hence in quick deploy only single model is assigned.

pandyamarut avatar Feb 07 '25 20:02 pandyamarut

see https://github.com/runpod-workers/worker-sglang/pull/18#issuecomment-2646023036

ef0xa avatar Feb 09 '25 01:02 ef0xa