worker-vllm icon indicating copy to clipboard operation
worker-vllm copied to clipboard

Published 20 hours ago • verified publisher icon runpod-workers

ImputError prepare_hf_model_weights method

Open ArtyoMKos opened this issue 9 months ago • 0 comments

Since vLLM 0.4.1 added model_loader and did not added <prepare_hf_model_weights> function. During docker building process model downloader module failed to import this function.

ArtyoMKos avatar May 24 '24 12:05 ArtyoMKos