nim-anywhere icon indicating copy to clipboard operation
nim-anywhere copied to clipboard

Published 20 hours ago • verified publisher icon NVIDIA

LLM NIM startup timout is too short.

Open rmkraus opened this issue 5 months ago • 0 comments

We probably should have the timeout for NIM startup to be as long as it takes for the 8b model to start from an empty NIM cache and without the docker image preteched.

rmkraus avatar Aug 30 '24 15:08 rmkraus