gpu-operator

gpu-operator copied to clipboard

Failed to initialize NVML: Unknown Error

28

_The template below is mostly useful for bug reports and support questions. Feel free to remove anything which doesn't apply to you and add more information where it makes sense._...

hoangtnm

PowerEdge XE9680 H100 Support

2

Hi, we're maintaining an OpenShift v4.10 cluster, and recently provisioned Dell PowerEdge XE9680 servers as GPU nodes. We are working with NVIDIA GPU Operator v22.9.1 as for now (aware of...

doronkg

Failed to get sandbox runtime: no runtime for nvidia is configured

39

_The template below is mostly useful for bug reports and support questions. Feel free to remove anything which doesn't apply to you and add more information where it makes sense._...

Bec-k

repoConfig is not mounted into GDS container

9

### 1. Quick Debug Information * OS/Version(e.g. RHEL8.6, Ubuntu22.04): Ubuntu20.04 * Kernel Version: 5.15.x * Container Runtime Type/Version(e.g. Containerd, CRI-O, Docker): CRI-O * K8s Flavor/Version(e.g. K8s, OCP, Rancher, GKE, EKS):...

age9990

containerd getting restarted on gpu node reboots

5

### 1. Quick Debug Information * OS/Version: RHEL8.8 * Kernel Version:4.18.0-477.27.1.el8_8.x86_64 * Container Runtime Type/Versio: Containerd * K8s Flavor/Version: v1.26.2 * GPU Operator Version: 23.6.1 ### 2. Issue or feature...

anoopsinghnegi

Daemonset pods fail with: "nvidia-container-cli.real: initialization error: load library failed: libnvidia-ml.so.1: cannot open shared object file: no such file or directory: unknown

3

_The template below is mostly useful for bug reports and support questions. Feel free to remove anything which doesn't apply to you and add more information where it makes sense._...

lokanthak

Nodes stuck in upgrade

7

In a Rancher-provisioned bare metal cluster I have two GPU nodes that cannot finish upgrade, their status is _validation-required_ and _pod-restart-required_. ### 1. Quick Debug Information * OS/Version - Ubuntu22.04:...

LarsAC

Failed to create pod sandbox: rpc error: code = Unknown desc = failed to get sandbox runtime: no runtime for "nvidia" is configure

12

_The template below is mostly useful for bug reports and support questions. Feel free to remove anything which doesn't apply to you and add more information where it makes sense._...

BartoszZawadzki

Cannot install gpu-operator due to kubelet error: Failed to create pod sandbox: rpc error: code = Unknown desc = failed to get sandbox runtime: no runtime for "nvidia" is configured

1

_The template below is mostly useful for bug reports and support questions. Feel free to remove anything which doesn't apply to you and add more information where it makes sense._...

yuzs2

GPU Operator with RHEL8/SElinux: Driver Container failed to deploy if SELinux Enforcing mode is activated. Error message: modprobe: ERROR: could not insert 'nvidia': Permission denied

6

Steps to reproduce the issue: 1/ Set the RHEL 8 server in SELinux ENFORCING mode: ``` [nvidia@ipp1-0686 ~]$ sestatus SELinux status: enabled SELinuxfs mount: /sys/fs/selinux SELinux root directory: /etc/selinux Loaded...

francisguillier