Eric Curtin
Eric Curtin
@slp I intended Linux... I think that would be a good start... We could potentially do macOS as a follow on I guess if we thought it was worth it......
> Sure, I thought you wanted to compete against container. > > What is the value of Linux, where I can just use traditional containers? Currently can krun leak random...
ROCm would require `--device /dev/kfd --device /dev/dri` but I understand it may not be desired to look into ROCm at this point in time. Could be too much effort. ROCm...
And vLLM (because vLLM only uses cuda/ROCm).
I see, it looks like the structure of the OCI artifact is different, we should try and consolidate on that
> > I see, it looks like the structure of the OCI artifact is different, we should try and consolidate on that > > I would love to! we also...
Yeah I agree, I am especially interested in what we do for .safetensors as it's multi-file and I haven't figured out all the files that may be required there to...
Here ya go! https://github.com/inotify-tools/inotify-tools/releases/tag/4.25.9.0
You probably should install nvidia container toolkit, it's the recommended way...
Does this file exist on your system? /usr/bin/nvidia-container-runtime