The installation of GPU Operator version v24.6.1 fails to install the /usr/local/nvidia/toolkit

[coderRenxy]

1. Quick Debug Information

• Ubuntu20.04
• Kernel Version: 5.4.0-192-generic
• Container Runtime Type/Version:Containerd/1.7.12
• K8s Flavor/Version:k8s/v1.28.2
• GPU Operator Version: v24.6.1
• GPU version: A40
• local GPU driver: 560.28.03

2. Issue or feature description

1. When installing the GPU Operator version v24.6.1, the nvidia-toolkit fails to install. However, installing version v24.3.0 successfully installs the toolkit.
2. Customization options are not producing the desired effects.

3. Steps to reproduce the issue

helm install --wait --generate-name \
    -n gpu-operator --create-namespace \
    nvidia/gpu-operator

helm install --wait --generate-name -n gpu-operator --create-namespace nvidia/gpu-operator --set operator.defaultRuntime=containerd --set driver.enabled=false --set driver.nvidiaDriverCRD.enabled=true --version v24.3.0 

[cdesiniotis]

@coderRenxy please provide relevant logs and more details on the issue you are encountering.

[github-actions[bot]]

This issue is stale because it has been open 90 days with no activity. This issue will be closed in 30 days unless new comments are made or the stale label is removed. To skip these checks, apply the "lifecycle/frozen" label.

[rahulait]

This issue has been open for over 90 days without recent updates, and the context may now be outdated. Given there were no details provided when more details were requested in comment https://github.com/NVIDIA/gpu-operator/issues/925#issuecomment-2302722585, we cannot evaluate this further.

Given that gpu-operator v24.6.1 is EOL now, we would encourage you to try latest version and see if you still see this issue.

If this issue is still relevant with the latest version of the NVIDIA GPU Operator, please feel free to reopen it or open a new one with updated details.