Local Path Provisioner not working as documented.

[solarisfire]

Bug Report

The local storage configuration (namely Local Path Provisioner as documented here: https://www.talos.dev/v1.10/kubernetes-guides/configuration/local-storage/) works under Talos 1.9.x, however it ceases to work under talos 1.10.x and is unable to create volumes.

Description

This worked under older versions of Talos.

Logs

time="2025-06-23T15:02:39Z" level=debug msg="Applied config: {\"nodePathMap\":[{\"node\":\"DEFAULT_PATH_FOR_NON_LISTED_NODES\",\"paths\":[\"/var/mnt/local-path-provisioner\"]}]}"
time="2025-06-23T15:02:39Z" level=debug msg="Provisioner started"
I0623 15:02:39.602425       1 controller.go:811] Starting provisioner controller rancher.io/local-path_local-path-provisioner-6bc759bc5-zcftj_b914344b-1acf-480b-a29a-762d558062ef!
I0623 15:02:39.702661       1 controller.go:860] Started provisioner controller rancher.io/local-path_local-path-provisioner-6bc759bc5-zcftj_b914344b-1acf-480b-a29a-762d558062ef!
I0623 15:11:45.555728       1 controller.go:1337] provision "redis/redis-0" class "local-path": started
time="2025-06-23T15:11:45Z" level=debug msg="config doesn't contain node worker-3, use DEFAULT_PATH_FOR_NON_LISTED_NODES instead"
time="2025-06-23T15:11:45Z" level=info msg="Creating volume pvc-3bed200e-efdd-483a-8833-3ab49121ba40 at worker-3:/var/mnt/local-path-provisioner/pvc-3bed200e-efdd-483a-8833-3ab49121ba40_redis_redis-0"
time="2025-06-23T15:11:45Z" level=info msg="create the helper pod helper-pod-create-pvc-3bed200e-efdd-483a-8833-3ab49121ba40 into local-path-storage"
I0623 15:11:45.562743       1 event.go:298] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"redis", Name:"redis-0", UID:"3bed200e-efdd-483a-8833-3ab49121ba40", APIVersion:"v1", ResourceVersion:"3929", FieldPath:""}): type: 'Normal' reason: 'Provisioning' External provisioner is provisioning volume for claim "redis/redis-0"
W0623 15:11:45.614179       1 warnings.go:70] would violate PodSecurity "restricted:latest": allowPrivilegeEscalation != false (container "helper-pod" must set securityContext.allowPrivilegeEscalation=false), unrestricted capabilities (container "helper-pod" must set securityContext.capabilities.drop=["ALL"]), restricted volume types (volume "data" uses restricted volume type "hostPath"), runAsNonRoot != true (pod or container "helper-pod" must set securityContext.runAsNonRoot=true), seccompProfile (pod or container "helper-pod" must set securityContext.seccompProfile.type to "RuntimeDefault" or "Localhost")
time="2025-06-23T15:13:46Z" level=error msg="failed to save helper-pod-create-pvc-3bed200e-efdd-483a-8833-3ab49121ba40 logs: error in opening stream: container \"helper-pod\" in pod \"helper-pod-create-pvc-3bed200e-efdd-483a-8833-3ab49121ba40\" is waiting to start: ContainerCreating"
W0623 15:13:46.162254       1 controller.go:937] Retrying syncing claim "3bed200e-efdd-483a-8833-3ab49121ba40" because failures 0 < threshold 15
E0623 15:13:46.162312       1 controller.go:957] error syncing claim "3bed200e-efdd-483a-8833-3ab49121ba40": failed to provision volume with StorageClass "local-path": failed to create volume pvc-3bed200e-efdd-483a-8833-3ab49121ba40: create process timeout after 120 seconds
I0623 15:13:46.162371       1 event.go:298] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"redis", Name:"redis-0", UID:"3bed200e-efdd-483a-8833-3ab49121ba40", APIVersion:"v1", ResourceVersion:"3929", FieldPath:""}): type: 'Warning' reason: 'ProvisioningFailed' failed to provision volume with StorageClass "local-path": failed to create volume pvc-3bed200e-efdd-483a-8833-3ab49121ba40: create process timeout after 120 seconds
I0623 15:14:01.162496       1 controller.go:1337] provision "redis/redis-0" class "local-path": started
time="2025-06-23T15:14:01Z" level=debug msg="config doesn't contain node worker-3, use DEFAULT_PATH_FOR_NON_LISTED_NODES instead"
time="2025-06-23T15:14:01Z" level=info msg="Creating volume pvc-3bed200e-efdd-483a-8833-3ab49121ba40 at worker-3:/var/mnt/local-path-provisioner/pvc-3bed200e-efdd-483a-8833-3ab49121ba40_redis_redis-0"
time="2025-06-23T15:14:01Z" level=info msg="create the helper pod helper-pod-create-pvc-3bed200e-efdd-483a-8833-3ab49121ba40 into local-path-storage"
I0623 15:14:01.169024       1 event.go:298] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"redis", Name:"redis-0", UID:"3bed200e-efdd-483a-8833-3ab49121ba40", APIVersion:"v1", ResourceVersion:"3929", FieldPath:""}): type: 'Normal' reason: 'Provisioning' External provisioner is provisioning volume for claim "redis/redis-0"
W0623 15:14:01.178371       1 warnings.go:70] would violate PodSecurity "restricted:latest": allowPrivilegeEscalation != false (container "helper-pod" must set securityContext.allowPrivilegeEscalation=false), unrestricted capabilities (container "helper-pod" must set securityContext.capabilities.drop=["ALL"]), restricted volume types (volume "data" uses restricted volume type "hostPath"), runAsNonRoot != true (pod or container "helper-pod" must set securityContext.runAsNonRoot=true), seccompProfile (pod or container "helper-pod" must set securityContext.seccompProfile.type to "RuntimeDefault" or "Localhost")
time="2025-06-23T15:16:01Z" level=error msg="failed to save helper-pod-create-pvc-3bed200e-efdd-483a-8833-3ab49121ba40 logs: error in opening stream: container \"helper-pod\" in pod \"helper-pod-create-pvc-3bed200e-efdd-483a-8833-3ab49121ba40\" is waiting to start: ContainerCreating"
W0623 15:16:01.735724       1 controller.go:937] Retrying syncing claim "3bed200e-efdd-483a-8833-3ab49121ba40" because failures 1 < threshold 15
E0623 15:16:01.735771       1 controller.go:957] error syncing claim "3bed200e-efdd-483a-8833-3ab49121ba40": failed to provision volume with StorageClass "local-path": failed to create volume pvc-3bed200e-efdd-483a-8833-3ab49121ba40: create process timeout after 120 seconds
I0623 15:16:01.735814       1 event.go:298] Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"redis", Name:"redis-0", UID:"3bed200e-efdd-483a-8833-3ab49121ba40", APIVersion:"v1", ResourceVersion:"3929", FieldPath:""}): type: 'Warning' reason: 'ProvisioningFailed' failed to provision volume with StorageClass "local-path": failed to create volume pvc-3bed200e-efdd-483a-8833-3ab49121ba40: create process timeout after 120 seconds
I0623 15:16:31.736627       1 controller.go:1337] provision "redis/redis-0" class "local-path": started

Environment

• Talos version: 1.10.x
• Kubernetes version: All
• Platform: Hetzner Cloud (But possibly all)