lvm-localpv
lvm-localpv copied to clipboard
Published
20 hours ago •
openebs
openebs
pvc is pending
Description
root@storage-b-01:~# kubectl get pvc -n velero
NAME STATUS VOLUME CAPACITY ACCESS MODES STORAGECLASS AGE
rook-ceph-backup-pv-pvc-4-27klg Pending openebs-lvmpv 2m24s
rook-ceph-backup-pv-pvc-4-5kbzv Pending openebs-lvmpv 117s
rook-ceph-backup-pv-pvc-4-7b5gr Pending openebs-lvmpv 2m52s
rook-ceph-backup-pv-pvc-4-7lz9x Pending openebs-lvmpv 2m34s
rook-ceph-backup-pv-pvc-4-87248 Pending openebs-lvmpv 2m29s
rook-ceph-backup-pv-pvc-4-hlfnk Pending openebs-lvmpv 2m11s
rook-ceph-backup-pv-pvc-4-htlh7 Pending openebs-lvmpv 2m47s
rook-ceph-backup-pv-pvc-4-mc7sz Pending openebs-lvmpv 2m18s
rook-ceph-backup-pv-pvc-4-zvl7v Pending openebs-lvmpv 2m
rook-ceph-backup-pv-pvc-4-zzmpn Pending openebs-lvmpv 2m41s
Warning ProvisioningFailed 38s local.csi.openebs.io_openebs-lvm-controller-0_24a6e4e0-6bde-4212-b01f-8cabaf937638 failed to provision volume with StorageClass "openebs-lvmpv": error getting handle for DataSource Type VolumeSnapshot by Name rook-ceph-backup-pv-pvc-4-mc7sz: snapshot rook-ceph-backup-pv-pvc-4-mc7sz is not Ready
Normal ExternalProvisioning 6s (x5 over 38s) persistentvolume-controller Waiting for a volume to be created either by the external provisioner 'local.csi.openebs.io' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered.
Normal Provisioning 4s (x6 over 38s) local.csi.openebs.io_openebs-lvm-controller-0_24a6e4e0-6bde-4212-b01f-8cabaf937638 External provisioner is provisioning volume for claim "velero/rook-ceph-backup-pv-pvc-4-mc7sz"
Warning ProvisioningFailed 4s (x5 over 36s) local.csi.openebs.io_openebs-lvm-controller-0_24a6e4e0-6bde-4212-b01f-8cabaf937638 failed to provision volume with StorageClass "openebs-lvmpv": rpc error: code = Unimplemented desc =
root@storage-b-01:~# kubectl get sc openebs-lvmpv -o yaml
allowVolumeExpansion: true
allowedTopologies:
- matchLabelExpressions:
- key: kubernetes.io/hostname
values:
- master-01
- worker-01
- worker-02
- worker-03
apiVersion: storage.k8s.io/v1
kind: StorageClass
metadata:
annotations:
kubectl.kubernetes.io/last-applied-configuration: |
{"allowVolumeExpansion":true,"allowedTopologies":[{"matchLabelExpressions":[{"key":"kubernetes.io/hostname","values":["master-01","worker-01","worker-02","worker-03"]}]}],"apiVersion":"storage.k8s.io/v1","kind":"StorageClass","metadata":{"annotations":{},"name":"openebs-lvmpv"},"parameters":{"storage":"lvm","volgroup":"openebs-lvm"},"provisioner":"local.csi.openebs.io"}
creationTimestamp: "2024-02-10T09:22:16Z"
name: openebs-lvmpv
resourceVersion: "345934"
uid: 21fc542b-cfe6-4fe2-96d4-c46f99c768fe
parameters:
storage: lvm
volgroup: openebs-lvm
provisioner: local.csi.openebs.io
reclaimPolicy: Delete
volumeBindingMode: Immediate
kubectl logs -n kube-system openebs-lvm-controller-0 -c csi-provisioner
I0211 02:42:40.794135 1 capacity.go:518] Capacity Controller: enqueuing {segment:0xc000011c38 storageClassName:openebs-lvmpv} for periodic update
I0211 02:42:40.794303 1 capacity.go:518] Capacity Controller: enqueuing {segment:0xc000011c68 storageClassName:openebs-lvmpv} for periodic update
I0211 02:42:40.794323 1 capacity.go:518] Capacity Controller: enqueuing {segment:0xc000011c98 storageClassName:openebs-lvmpv} for periodic update
I0211 02:42:40.794337 1 capacity.go:518] Capacity Controller: enqueuing {segment:0xc000011cc8 storageClassName:openebs-lvmpv} for periodic update
I0211 02:42:40.794378 1 capacity.go:574] Capacity Controller: refreshing {segment:0xc000011c38 storageClassName:openebs-lvmpv}
I0211 02:42:40.794411 1 connection.go:193] GRPC call: /csi.v1.Controller/GetCapacity
I0211 02:42:40.794425 1 connection.go:194] GRPC request: {"accessible_topology":{"segments":{"kubernetes.io/hostname":"master-01","openebs.io/nodename":"master-01"}},"parameters":{"storage":"lvm","volgroup":"openebs-lvm"},"volume_capabilities":[{"AccessType":{"Mount":null},"access_mode":{}}]}
I0211 02:42:40.795209 1 connection.go:200] GRPC response: {"available_capacity":433774919680}
I0211 02:42:40.795259 1 connection.go:201] GRPC error: <nil>
I0211 02:42:40.795281 1 capacity.go:656] Capacity Controller: no need to update csisc-fhh8t for {segment:0xc000011c38 storageClassName:openebs-lvmpv}, same capacity 413680Mi, same maximumVolumeSize <nil> and correct owner
I0211 02:42:40.795315 1 capacity.go:574] Capacity Controller: refreshing {segment:0xc000011c68 storageClassName:openebs-lvmpv}
I0211 02:42:40.795335 1 connection.go:193] GRPC call: /csi.v1.Controller/GetCapacity
I0211 02:42:40.795348 1 connection.go:194] GRPC request: {"accessible_topology":{"segments":{"kubernetes.io/hostname":"worker-01","openebs.io/nodename":"worker-01"}},"parameters":{"storage":"lvm","volgroup":"openebs-lvm"},"volume_capabilities":[{"AccessType":{"Mount":null},"access_mode":{}}]}
I0211 02:42:40.795661 1 connection.go:200] GRPC response: {"available_capacity":471355883520}
I0211 02:42:40.795683 1 connection.go:201] GRPC error: <nil>
I0211 02:42:40.795698 1 capacity.go:656] Capacity Controller: no need to update csisc-g2xj9 for {segment:0xc000011c68 storageClassName:openebs-lvmpv}, same capacity 449520Mi, same maximumVolumeSize <nil> and correct owner
I0211 02:42:40.795718 1 capacity.go:574] Capacity Controller: refreshing {segment:0xc000011c98 storageClassName:openebs-lvmpv}
I0211 02:42:40.795735 1 connection.go:193] GRPC call: /csi.v1.Controller/GetCapacity
I0211 02:42:40.795747 1 connection.go:194] GRPC request: {"accessible_topology":{"segments":{"kubernetes.io/hostname":"worker-02","openebs.io/nodename":"worker-02"}},"parameters":{"storage":"lvm","volgroup":"openebs-lvm"},"volume_capabilities":[{"AccessType":{"Mount":null},"access_mode":{}}]}
I0211 02:42:40.795970 1 connection.go:200] GRPC response: {"available_capacity":471355883520}
I0211 02:42:40.795990 1 connection.go:201] GRPC error: <nil>
I0211 02:42:40.796006 1 capacity.go:656] Capacity Controller: no need to update csisc-96j89 for {segment:0xc000011c98 storageClassName:openebs-lvmpv}, same capacity 449520Mi, same maximumVolumeSize <nil> and correct owner
I0211 02:42:40.796024 1 capacity.go:574] Capacity Controller: refreshing {segment:0xc000011cc8 storageClassName:openebs-lvmpv}
I0211 02:42:40.796040 1 connection.go:193] GRPC call: /csi.v1.Controller/GetCapacity
I0211 02:42:40.796052 1 connection.go:194] GRPC request: {"accessible_topology":{"segments":{"kubernetes.io/hostname":"worker-03","openebs.io/nodename":"worker-03"}},"parameters":{"storage":"lvm","volgroup":"openebs-lvm"},"volume_capabilities":[{"AccessType":{"Mount":null},"access_mode":{}}]}
I0211 02:42:40.796279 1 connection.go:200] GRPC response: {"available_capacity":472429625344}
I0211 02:42:40.796299 1 connection.go:201] GRPC error: <nil>
I0211 02:42:40.796314 1 capacity.go:656] Capacity Controller: no need to update csisc-95wnt for {segment:0xc000011cc8 storageClassName:openebs-lvmpv}, same capacity 450544Mi, same maximumVolumeSize <nil> and correct owner```
I0210 09:49:00.543945 1 grpc.go:81] GRPC response: {"available_capacity":472429625344}
I0210 09:49:00.754768 1 grpc.go:72] GRPC call: /csi.v1.Controller/CreateVolume requests {"accessibility_requirements":{"preferred":[{"segments":{"kubernetes.io/hostname":"master-01","openebs.io/nodename":"master-01"}}],"requisite":[{"segments":{"kubernetes.io/hostname":"master-01","openebs.io/nodename":"master-01"}}]},"capacity_range":{"required_bytes":5368709120},"name":"pvc-b3ea61be-e2a4-4d32-a898-6e61695f70b9","parameters":{"csi.storage.k8s.io/pv/name":"pvc-b3ea61be-e2a4-4d32-a898-6e61695f70b9","csi.storage.k8s.io/pvc/name":"rook-ceph-backup-pv-pvc-4-mc7sz","csi.storage.k8s.io/pvc/namespace":"velero","storage":"lvm","volgroup":"openebs-lvm"},"volume_capabilities":[{"AccessType":{"Block":{}},"access_mode":{"mode":1}}],"volume_content_source":{"Type":{"Snapshot":{"snapshot_id":"pvc-d13922aa-be6f-4393-b6df-90db88f3d6c4@snapshot-6e89095a-00ea-44ff-b285-d81271e5af02"}}}}
E0210 09:49:00.754945 1 grpc.go:79] GRPC error: rpc error: code = Unimplemented desc =
I0210 09:49:00.771281 1 grpc.go:72] GRPC call: /csi.v1.Controller/GetCapacity requests {"accessible_topology":{"segments":{"kubernetes.io/hostname":"master-01","openebs.io/nodename":"master-01"}},"parameters":{"storage":"lvm","volgroup":"openebs-lvm"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{}}]}
I0210 09:49:00.771414 1 grpc.go:81] GRPC response: {"available_capacity":395120214016}
I0210 09:49:00.776258 1 grpc.go:72] GRPC call: /csi.v1.Controller/GetCapacity requests {"accessible_topology":{"segments":{"kubernetes.io/hostname":"worker-01","openebs.io/nodename":"worker-01"}},"parameters":{"storage":"lvm","volgroup":"openebs-lvm"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{}}]}
--
I0210 09:49:00.802516 1 grpc.go:72] GRPC call: /csi.v1.Controller/GetCapacity requests {"accessible_topology":{"segments":{"kubernetes.io/hostname":"worker-03","openebs.io/nodename":"worker-03"}},"parameters":{"storage":"lvm","volgroup":"openebs-lvm"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{}}]}
I0210 09:49:00.802770 1 grpc.go:81] GRPC response: {"available_capacity":472429625344}
I0210 09:49:01.051397 1 grpc.go:72] GRPC call: /csi.v1.Controller/CreateVolume requests {"accessibility_requirements":{"preferred":[{"segments":{"kubernetes.io/hostname":"master-01","openebs.io/nodename":"master-01"}}],"requisite":[{"segments":{"kubernetes.io/hostname":"master-01","openebs.io/nodename":"master-01"}}]},"capacity_range":{"required_bytes":1073741824},"name":"pvc-702f30d5-165d-4b67-bc22-169ad58c0737","parameters":{"csi.storage.k8s.io/pv/name":"pvc-702f30d5-165d-4b67-bc22-169ad58c0737","csi.storage.k8s.io/pvc/name":"rook-ceph-backup-pv-pvc-4-htlh7","csi.storage.k8s.io/pvc/namespace":"velero","storage":"lvm","volgroup":"openebs-lvm"},"volume_capabilities":[{"AccessType":{"Mount":{"fs_type":"ext4"}},"access_mode":{"mode":1}}],"volume_content_source":{"Type":{"Snapshot":{"snapshot_id":"pvc-fa467e09-dd15-4e94-a0e6-7be9392fc2cb@snapshot-c3558f96-de64-4533-9b17-8f755b829064"}}}}
E0210 09:49:01.063905 1 grpc.go:79] GRPC error: rpc error: code = Unimplemented desc =
I0210 09:49:01.070750 1 grpc.go:72] GRPC call: /csi.v1.Controller/GetCapacity requests {"accessible_topology":{"segments":{"kubernetes.io/hostname":"master-01","openebs.io/nodename":"master-01"}},"parameters":{"storage":"lvm","volgroup":"openebs-lvm"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{}}]}
I0210 09:49:01.070879 1 grpc.go:81] GRPC response: {"available_capacity":395120214016}
I0210 09:49:01.144397 1 grpc.go:72] GRPC call: /csi.v1.Controller/GetCapacity requests {"accessible_topology":{"segments":{"kubernetes.io/hostname":"worker-01","openebs.io/nodename":"worker-01"}},"parameters":{"storage":"lvm","volgroup":"openebs-lvm"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{}}]}
--
I0210 11:14:48.806578 1 grpc.go:72] GRPC call: /csi.v1.Controller/ControllerGetCapabilities requests {}
I0210 11:14:48.806632 1 grpc.go:81] GRPC response: {"capabilities":[{"Type":{"Rpc":{"type":1}}},{"Type":{"Rpc":{"type":9}}},{"Type":{"Rpc":{"type":5}}},{"Type":{"Rpc":{"type":4}}}]}
I0210 11:14:50.358995 1 grpc.go:72] GRPC call: /csi.v1.Controller/CreateVolume requests {"accessibility_requirements":{"preferred":[{"segments":{"kubernetes.io/hostname":"master-01","openebs.io/nodename":"master-01"}}],"requisite":[{"segments":{"kubernetes.io/hostname":"master-01","openebs.io/nodename":"master-01"}}]},"capacity_range":{"required_bytes":1073741824},"name":"pvc-38ed4cf5-7c1b-4c31-9e19-b98e8dab89e1","parameters":{"csi.storage.k8s.io/pv/name":"pvc-38ed4cf5-7c1b-4c31-9e19-b98e8dab89e1","csi.storage.k8s.io/pvc/name":"rook-ceph-backup-pv-pvc-4-7b5gr","csi.storage.k8s.io/pvc/namespace":"velero","storage":"lvm","volgroup":"openebs-lvm"},"volume_capabilities":[{"AccessType":{"Mount":{"fs_type":"ext4"}},"access_mode":{"mode":1}}],"volume_content_source":{"Type":{"Snapshot":{"snapshot_id":"pvc-de77d60a-d446-4486-8b08-a57af771f677@snapshot-1717e107-f7dd-49eb-80cb-73411577ac80"}}}}
E0210 11:14:50.362528 1 grpc.go:79] GRPC error: rpc error: code = Unimplemented desc =
I0210 11:14:50.491318 1 grpc.go:72] GRPC call: /csi.v1.Controller/GetCapacity requests {"accessible_topology":{"segments":{"kubernetes.io/hostname":"master-01","openebs.io/nodename":"master-01"}},"parameters":{"storage":"lvm","volgroup":"openebs-lvm"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{}}]}
I0210 11:14:50.491469 1 grpc.go:81] GRPC response: {"available_capacity":395120214016}
I0210 11:14:50.680091 1 grpc.go:72] GRPC call: /csi.v1.Controller/GetCapacity requests {"accessible_topology":{"segments":{"kubernetes.io/hostname":"worker-01","openebs.io/nodename":"worker-01"}},"parameters":{"storage":"lvm","volgroup":"openebs-lvm"},"volume_capabilities":[{"AccessType":{"Mount":{}},"access_mode":{}}]}
I0211 03:05:04.030231 1 controller.go:1359] provision "default/www-web-2" class "openebs-lvmpv": started
I0211 03:05:04.030327 1 connection.go:193] GRPC call: /csi.v1.Controller/CreateVolume
I0211 03:05:04.030335 1 connection.go:194] GRPC request: {"accessibility_requirements":{"preferred":[{"segments":{"kubernetes.io/hostname":"master-01","openebs.io/nodename":"master-01"}}],"requisite":[{"segments":{"kubernetes.io/hostname":"master-01","openebs.io/nodename":"master-01"}}]},"capacity_range":{"required_bytes":10485760},"name":"pvc-fc01f1b4-3b46-4809-8fd9-aaf0ff61b874","parameters":{"csi.storage.k8s.io/pv/name":"pvc-fc01f1b4-3b46-4809-8fd9-aaf0ff61b874","csi.storage.k8s.io/pvc/name":"www-web-2","csi.storage.k8s.io/pvc/namespace":"default","storage":"lvm","volgroup":"openebs-lvm"},"volume_capabilities":[{"AccessType":{"Mount":{"fs_type":"ext4"}},"access_mode":{"mode":1}}]}
I0211 03:05:04.030849 1 event.go:298] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"default", Name:"www-web-2", UID:"fc01f1b4-3b46-4809-8fd9-aaf0ff61b874", APIVersion:"v1", ResourceVersion:"440906", FieldPath:""}): type: 'Normal' reason: 'Provisioning' External provisioner is provisioning volume for claim "default/www-web-2"
I0211 03:05:05.816034 1 connection.go:200] GRPC response: {"volume":{"accessible_topology":[{"segments":{"openebs.io/nodename":"master-01"}}],"capacity_bytes":10485760,"volume_context":{"openebs.io/cas-type":"localpv-lvm","openebs.io/volgroup":"openebs-lvm"},"volume_id":"pvc-fc01f1b4-3b46-4809-8fd9-aaf0ff61b874"}}
## Expected Behavior
<!-- Tell us what should happen -->
## Current Behavior
<!-- Tell us what happens instead -->
## Possible Solution
<!-- Suggest a fix or reason for this bug -->
## Steps to Reproduce
<!-- Provide a link to a live example or steps to reproduce this bug -->
## Screenshots
<!-- Add screenshots of this bug -->
## Your Environment
<!-- Include as many relevant details about the environment you experienced the bug in -->
* `kubectl get nodes`:
* `kubectl get pods --all-namespaces`:
* `kubectl get services`:
* `kubectl get sc`:
* `kubectl get pv`:
* `kubectl get pvc`:
* OS (from `/etc/os-release`):
* Kernel (from `uname -a`):
* Install tools:
* Others:
moving this issue to LocalPV-LVM repo, which will be picked by my the new Mayastor structure when its activated (soon)... becasue LocalPV-LVM is being unified into Mayastor.
Experiencing exactly the same problem.
Can you please share any one of the node-agent logs from lvm-node daemonset pods?
I0501 14:36:22.077234 1 lvm_util.go:522] created snapshot lvmvg/bce4ca07-0b26-42d0-bf61-fed6cb467db6 from pvc-337110de-ed58-4f6b-b484-51370aaec61a
I0501 14:36:22.088215 1 snapshot.go:267] Successfully synced 'openebs-system/snapshot-bce4ca07-0b26-42d0-bf61-fed6cb467db6'
I0501 14:36:35.644706 1 lvmnode.go:110] lvm node controller: node volume groups updated current=[{Name:lvmvg UUID:B76M19-s03N-1vcL-mQA6-0YB7-QVeA-bkYDLF Size:{i:{value:1000203091968 scale:0} d:{Dec:<nil>} s:953868Mi Format:BinarySI} Free:{i:{value:677006802944 scale:0} d:{Dec:<nil>} s:645644Mi Format:BinarySI} LVCount:4 PVCount:1 MaxLV:0 MaxPV:0 SnapCount:0 MissingPVCount:0 MetadataCount:1 MetadataUsedCount:1 MetadataFree:{i:{value:519168 scale:0} d:{Dec:<nil>} s:507Ki Format:BinarySI} MetadataSize:{i:{value:1044480 scale:0} d:{Dec:<nil>} s:1020Ki Format:BinarySI} Permission:0 AllocationPolicy:0}], required=[{Name:lvmvg UUID:B76M19-s03N-1vcL-mQA6-0YB7-QVeA-bkYDLF Size:{i:{value:1000203091968 scale:0} d:{Dec:<nil>} s: Format:BinarySI} Free:{i:{value:569632620544 scale:0} d:{Dec:<nil>} s: Format:BinarySI} LVCount:5 PVCount:1 MaxLV:0 MaxPV:0 SnapCount:1 MissingPVCount:0 MetadataCount:1 MetadataUsedCount:1 MetadataFree:{i:{value:518144 scale:0} d:{Dec:<nil>} s: Format:BinarySI} MetadataSize:{i:{value:1044480 scale:0} d:{Dec:<nil>} s: Format:BinarySI} Permission:0 AllocationPolicy:0}]
I0501 14:36:35.644778 1 lvmnode.go:120] lvm node controller: updating node object with &{TypeMeta:{Kind:LVMNode APIVersion:local.openebs.io/v1alpha1} ObjectMeta:{Name:ktmb1-g-srv-005.iot.home.alexeym.net GenerateName: Namespace:openebs-system SelfLink: UID:2e007c23-88cf-487d-9431-452892030a60 ResourceVersion:1700015 Generation:5 CreationTimestamp:2024-04-29 05:09:33 +0000 UTC DeletionTimestamp:<nil> DeletionGracePeriodSeconds:<nil> Labels:map[] Annotations:map[] OwnerReferences:[{APIVersion:v1 Kind:Node Name:ktmb1-g-srv-005.iot.home.alexeym.net UID:1bcfbcc3-ad06-4bb2-9679-5f5d2bdda0be Controller:0xc00017a810 BlockOwnerDeletion:<nil>}] Finalizers:[] ManagedFields:[{Manager:lvm-driver Operation:Update APIVersion:local.openebs.io/v1alpha1 Time:2024-05-01 13:30:35 +0000 UTC FieldsType:FieldsV1 FieldsV1:{"f:metadata":{"f:ownerReferences":{".":{},"k:{\"uid\":\"1bcfbcc3-ad06-4bb2-9679-5f5d2bdda0be\"}":{}}},"f:volumeGroups":{}} Subresource:}]} VolumeGroups:[{Name:lvmvg UUID:B76M19-s03N-1vcL-mQA6-0YB7-QVeA-bkYDLF Size:{i:{value:1000203091968 scale:0} d:{Dec:<nil>} s: Format:BinarySI} Free:{i:{value:569632620544 scale:0} d:{Dec:<nil>} s: Format:BinarySI} LVCount:5 PVCount:1 MaxLV:0 MaxPV:0 SnapCount:1 MissingPVCount:0 MetadataCount:1 MetadataUsedCount:1 MetadataFree:{i:{value:518144 scale:0} d:{Dec:<nil>} s: Format:BinarySI} MetadataSize:{i:{value:1044480 scale:0} d:{Dec:<nil>} s: Format:BinarySI} Permission:0 AllocationPolicy:0}]}
I0501 14:36:35.656589 1 lvmnode.go:124] lvm node controller: updated node object openebs-system/ktmb1-g-srv-005.iot.home.alexeym.net
I0501 14:36:35.656624 1 lvmnode.go:306] Successfully synced 'openebs-system/ktmb1-g-srv-005.iot.home.alexeym.net'
I0501 14:36:35.656822 1 lvmnode.go:165] Got update event for lvm node openebs-system/ktmb1-g-srv-005.iot.home.alexeym.net
I0501 14:36:35.784698 1 lvmnode.go:306] Successfully synced 'openebs-system/ktmb1-g-srv-005.iot.home.alexeym.net'
I0501 14:37:16.256841 1 lvmnode.go:306] Successfully synced 'openebs-system/ktmb1-g-srv-004.iot.home.alexeym.net'
I0501 14:37:35.632538 1 lvmnode.go:306] Successfully synced 'openebs-system/ktmb1-g-srv-005.iot.home.alexeym.net'
I0501 14:38:16.265125 1 lvmnode.go:306] Successfully synced 'openebs-system/ktmb1-g-srv-004.iot.home.alexeym.net'
I0501 14:38:35.640765 1 lvmnode.go:306] Successfully synced 'openebs-system/ktmb1-g-srv-005.iot.home.alexeym.net'
I0501 14:39:16.294034 1 lvmnode.go:306] Successfully synced 'openebs-system/ktmb1-g-srv-004.iot.home.alexeym.net'
I0501 14:39:33.432159 1 lvmnode.go:165] Got update event for lvm node openebs-system/ktmb1-g-srv-005.iot.home.alexeym.net
I0501 14:39:33.560451 1 lvmnode.go:306] Successfully synced 'openebs-system/ktmb1-g-srv-005.iot.home.alexeym.net'
I0501 14:39:35.608849 1 lvmnode.go:306] Successfully synced 'openebs-system/ktmb1-g-srv-005.iot.home.alexeym.net'
I0501 14:40:14.269000 1 lvmnode.go:165] Got update event for lvm node openebs-system/ktmb1-g-srv-004.iot.home.alexeym.net
I0501 14:40:14.428713 1 lvmnode.go:306] Successfully synced 'openebs-system/ktmb1-g-srv-004.iot.home.alexeym.net'
@13567436138 From the PVC describe I can see that, cloning out of a snapshot is being performed. This is not supported in lvm-localpv as of today. For more options, you can follow this thread on our slack channel -- https://kubernetes.slack.com/archives/CUAKPFU78/p1714627792264429