ceph-csi
ceph-csi copied to clipboard
CephFS RWO PVC is getting attached to different pods on different nodes
RWO is meant to be used only on multiple pods on a single node, but I can start multiple pods in different nodes which use the RWO PVC. This is happening with Rook master and cephcsi canary.
[🎩︎]mrajanna@fedora cephfs $]kubectl get nodes
NAME STATUS ROLES AGE VERSION
minikube Ready control-plane 14m v1.24.3
minikube-m02 Ready <none> 11m v1.24.3
[🎩︎]mrajanna@fedora cephfs $]kubectl get csidriver
NAME ATTACHREQUIRED PODINFOONMOUNT STORAGECAPACITY TOKENREQUESTS REQUIRESREPUBLISH MODES AGE
rook-ceph.cephfs.csi.ceph.com false false false <unset> false Persistent 7m55s
rook-ceph.rbd.csi.ceph.com true false false <unset> false Persistent 7m55s
[🎩︎]mrajanna@fedora cephfs $]kubectl get po -oyaml |grep pvc
name: mypvc
- name: mypvc
claimName: cephfs-pvc
name: mypvc
- name: mypvc
claimName: cephfs-pvc
[🎩︎]mrajanna@fedora cephfs $]kubectl get po -owide
NAME READY STATUS RESTARTS AGE IP NODE NOMINATED NODE READINESS GATES
csicephfs-demo-pod-1 1/1 Running 0 85s 10.244.1.17 minikube-m02 <none> <none>
csicephfs-demo-pod-2 1/1 Running 0 85s 10.244.0.12 minikube <none> <none>
[🎩︎]mrajanna@fedora cephfs $]kubectl get po -oyaml |grep pvc
name: mypvc
- name: mypvc
claimName: cephfs-pvc
name: mypvc
- name: mypvc
claimName: cephfs-pvc
[🎩︎]mrajanna@fedora cephfs $]kubectl get pvc
NAME STATUS VOLUME CAPACITY ACCESS MODES STORAGECLASS AGE
cephfs-pvc Bound pvc-f446fc4f-edcd-4450-a5a4-b372ad5d1a8c 1Gi RWO rook-cephfs 9m10s
[🎩︎]mrajanna@fedora cephfs $]kubectl get cstl get csidriver rook-ceph.cephfs.csi.ceph.com -oyaml
apiVersion: storage.k8s.io/v1
kind: CSIDriver
metadata:
creationTimestamp: "2022-08-10T04:45:50Z"
name: rook-ceph.cephfs.csi.ceph.com
resourceVersion: "935"
uid: dd78c9a2-327f-4f4d-88fb-8bf5889eec3d
spec:
attachRequired: false
fsGroupPolicy: ReadWriteOnceWithFSType
podInfoOnMount: false
requiresRepublish: false
storageCapacity: false
volumeLifecycleModes:
- Persistent