k8s-device-plugin icon indicating copy to clipboard operation
k8s-device-plugin copied to clipboard

Question: How to set LD_LIBRARY_PATH on the nvidia-device-plugin pod

Open joedborg opened this issue 5 years ago • 2 comments

1. Issue or feature description

Question: I'm wondering, for the nvidia-device-plugin pod, is it possible to pass through the LD_LIBRARY_PATH to tell the pod where to find libnvidia* etc? There are certain circumstances where these are not found in the usual directory, which puts the pod into CrashLoopBackOff.

2. Steps to reproduce the issue

Deploy k8s-device-plugin to a node which has an nvidia card but does not have the drivers installed to the usual location.

3. Information to attach (optional if deemed irrelevant)

N/A

joedborg avatar Nov 05 '20 16:11 joedborg

This is not a property of the k8s-decive-plugin, but rather of the underlying nvidia-container-toolkit (which does the job of injecting libnvidia* into all containers for you -- including the k8s-device-plugin container).

You can configure where it looks for the driver under /etc/nvidia-container-runtime/config.toml with the following option:

#root = "/run/nvidia/driver"

klueska avatar Nov 06 '20 12:11 klueska

Awesome, thanks for sharing that @klueska, I'll try it out.

joedborg avatar Nov 10 '20 20:11 joedborg

This issue is stale because it has been open 90 days with no activity. This issue will be closed in 30 days unless new comments are made or the stale label is removed.

github-actions[bot] avatar Feb 29 '24 04:02 github-actions[bot]

This issue was automatically closed due to inactivity.

github-actions[bot] avatar Mar 31 '24 04:03 github-actions[bot]