ceph-csi icon indicating copy to clipboard operation
ceph-csi copied to clipboard

CephFS RWO PVC is getting attached to different pods on different nodes

Open Madhu-1 opened this issue 2 years ago • 0 comments

RWO is meant to be used only on multiple pods on a single node, but I can start multiple pods in different nodes which use the RWO PVC. This is happening with Rook master and cephcsi canary.

[🎩︎]mrajanna@fedora cephfs $]kubectl get nodes
NAME           STATUS   ROLES           AGE   VERSION
minikube       Ready    control-plane   14m   v1.24.3
minikube-m02   Ready    <none>          11m   v1.24.3
[🎩︎]mrajanna@fedora cephfs $]kubectl get csidriver
NAME                            ATTACHREQUIRED   PODINFOONMOUNT   STORAGECAPACITY   TOKENREQUESTS   REQUIRESREPUBLISH   MODES        AGE
rook-ceph.cephfs.csi.ceph.com   false            false            false             <unset>         false               Persistent   7m55s
rook-ceph.rbd.csi.ceph.com      true             false            false             <unset>         false               Persistent   7m55s

[🎩︎]mrajanna@fedora cephfs $]kubectl get po -oyaml  |grep pvc
        name: mypvc
    - name: mypvc
        claimName: cephfs-pvc
        name: mypvc
    - name: mypvc
        claimName: cephfs-pvc
[🎩︎]mrajanna@fedora cephfs $]kubectl get po -owide
NAME                   READY   STATUS    RESTARTS   AGE   IP            NODE           NOMINATED NODE   READINESS GATES
csicephfs-demo-pod-1   1/1     Running   0          85s   10.244.1.17   minikube-m02   <none>           <none>
csicephfs-demo-pod-2   1/1     Running   0          85s   10.244.0.12   minikube       <none>           <none>
[🎩︎]mrajanna@fedora cephfs $]kubectl get po -oyaml  |grep pvc
        name: mypvc
    - name: mypvc
        claimName: cephfs-pvc
        name: mypvc
    - name: mypvc
        claimName: cephfs-pvc
[🎩︎]mrajanna@fedora cephfs $]kubectl get pvc
NAME         STATUS   VOLUME                                     CAPACITY   ACCESS MODES   STORAGECLASS   AGE
cephfs-pvc   Bound    pvc-f446fc4f-edcd-4450-a5a4-b372ad5d1a8c   1Gi        RWO            rook-cephfs    9m10s
[🎩︎]mrajanna@fedora cephfs $]kubectl get cstl get csidriver rook-ceph.cephfs.csi.ceph.com -oyaml
apiVersion: storage.k8s.io/v1
kind: CSIDriver
metadata:
  creationTimestamp: "2022-08-10T04:45:50Z"
  name: rook-ceph.cephfs.csi.ceph.com
  resourceVersion: "935"
  uid: dd78c9a2-327f-4f4d-88fb-8bf5889eec3d
spec:
  attachRequired: false
  fsGroupPolicy: ReadWriteOnceWithFSType
  podInfoOnMount: false
  requiresRepublish: false
  storageCapacity: false
  volumeLifecycleModes:
  - Persistent

Madhu-1 avatar Aug 10 '22 07:08 Madhu-1