Open-Assistant icon indicating copy to clipboard operation
Open-Assistant copied to clipboard

fail to docker pull oasst-inference-worker-llama:latest

Open Asmedeus998 opened this issue 1 year ago • 1 comments

Digest: sha256:af3ff8ebdc5a98b03731ede2655edbf7a43cbed07c267acbd41513cf518c832a
Status: Image is up to date for ghcr.io/laion-ai/open-assistant/oasst-inference-worker-llama:latest
ghcr.io/laion-ai/open-assistant/oasst-inference-worker-llama:latest
docker: Error response from daemon: unknown or invalid runtime name: nvidia.
See 'docker run --help'.

can you include the inference of llama package in docker folder?

Asmedeus998 avatar Jun 27 '23 20:06 Asmedeus998

Did you install nvidia-docker ? Here are the instructions

And can you run nvidia-smi on your host system without error?

wirthual avatar Jul 03 '23 15:07 wirthual