worker-vllm icon indicating copy to clipboard operation
worker-vllm copied to clipboard

Published 20 hours ago • verified publisher icon runpod-workers

Randomly the machine get stuck on loading model

Open Sapessii opened this issue 5 months ago • 1 comments

Hi,

as the title suggests completely random, the machine gets stuck on

Using model weights format ['*.safetensors']

and I have to manually terminate the worker and restart it.

Do you have any suggestions?

Sapessii avatar Sep 19 '24 12:09 Sapessii