csi-driver-smb icon indicating copy to clipboard operation
csi-driver-smb copied to clipboard

Failed Mount Error (exit status 32) When Creating Pod with PVC using the csi-driver-smb

Open hajedkh opened this issue 1 year ago • 12 comments

What happened: Pod Creation Error with event: Warning FailedMount 28s (x8 over 92s) kubelet MountVolume.MountDevice failed for volume "pvc-f03018a6-a450-41a9-b4f7-0609a57120e7" : rpc error: code = Internal desc = volume(viaps012-int.lia.int/archives#pvc-f03018a6-a450-41a9-b4f7-0609a57120e7##) mount "//<HOST>/archives" on "/var/lib/kubelet/plugins/kubernetes.io/csi/smb.csi.k8s.io/0a24123840085c6b252ac47fff4245d291dfda1381a23183f0c8b394e4183af5/globalmount" failed with mount failed: exit status 32 Mounting command: mount Mounting arguments: -t cifs -o dir_mode=0777,file_mode=0777,uid=1001,gid=1001,<masked> //viaps012-int.lia.int/archives /var/lib/kubelet/plugins/kubernetes.io/csi/smb.csi.k8s.io/0a24123840085c6b252ac47fff4245d291dfda1381a23183f0c8b394e4183af5/globalmount Output: mount error(13): Permission denied Refer to the mount.cifs(8) manual page (e.g. man mount.cifs) and kernel log messages (dmesg)

What you expected to happen: Volume provisionned and pod created

How to reproduce it: Random after multiple volume mounts it fails for some and the pod stay blocked in ContainerCreationError.

Anything else we need to know?: When we reschedule the pod in another node in the cluster it works fine (it happens with all worker nodes). Environment:

  • CSI Driver version: v1.16.0
  • Kubernetes version (use kubectl version): v1.27.13+e709aa5
  • OS (e.g. from /etc/os-release): CoreOS
  • Install tools: Helm
  • Others: Openshift cluster 4.14.26

hajedkh avatar Sep 24 '24 09:09 hajedkh