alibaba-cloud-csi-driver icon indicating copy to clipboard operation
alibaba-cloud-csi-driver copied to clipboard

Published 20 hours ago • verified publisher icon kubernetes-sigs

磁盘已经挂载但是还是不能用

Open zhoudi94 opened this issue 1 year ago • 3 comments

What happened:

已经通过CSI插件成功创建云盘并挂载成功，但是容器始终无法启动。 pod 事件 image

csi-plugin 日志

/etc/os-release
Running oss plugin....
Running nas plugin....
Running disk plugin....
Last metadata expiration check: 1:50:53 ago on Wed Jun  7 18:34:42 2023.
Package libcurl-devel-7.61.1-25.0.2.al8.3.x86_64 is already installed.
Package libxml2-devel-2.9.7-15.0.1.al8.1.x86_64 is already installed.
Package fuse-devel-2.9.7-15.al8.x86_64 is already installed.
Package openssl-devel-1:1.1.1k-9.0.1.al8.x86_64 is already installed.
Dependencies resolved.
Nothing to do.
Complete!
Starting deploy oss csi-plugin...
osHost:alinux3
ossfsVersion:1.88.0
ossfsArch:centos8
Check ossfs Version....
Upgrade ossfs, ossfsVersion: 1.88.0
Dependencies resolved.
================================================================================
 Package         Architecture     Version              Repository          Size
================================================================================
Removing:
 ossfs           x86_64           1.86.2-1             @@System           8.2 M

Transaction Summary
================================================================================
Remove  1 Package

Freed space: 8.2 M
Running transaction check
Transaction check succeeded.
Running transaction test
Transaction test succeeded.
Running transaction
  Preparing        :                                                        1/1 
  Erasing          : ossfs-1.86.2-1.x86_64                                  1/1 
  Verifying        : ossfs-1.86.2-1.x86_64                                  1/1 

Removed:
  ossfs-1.86.2-1.x86_64                                                         

Complete!
No match for argument: ossfs
No packages marked for removal.
Dependencies resolved.
Nothing to do.
Complete!
Check csiplugin-connector.service....
Starting systemctl enable csiplugin-connector.service.
Starting systemctl restart csiplugin-connector.service.
time="2023-06-07T20:25:38+08:00" level=info msg="Multi CSI Driver Name: oss,nas,disk, nodeID: , endPoints: unix://var/lib/kubelet/csi-plugins/driverplugin.csi.alibabacloud.com-replace/csi.sock"
time="2023-06-07T20:25:38+08:00" level=info msg="CSI Driver Branch: , Version: , Build time: \n"
time="2023-06-07T20:25:38+08:00" level=info msg="Create Stroage Path: /var/lib/kubelet/csi-plugins/ossplugin.csi.alibabacloud.com/controller"
time="2023-06-07T20:25:38+08:00" level=info msg="Create Stroage Path: /var/lib/kubelet/csi-plugins/ossplugin.csi.alibabacloud.com/node"
time="2023-06-07T20:25:38+08:00" level=info msg="Create Stroage Path: /var/lib/kubelet/csi-plugins/nasplugin.csi.alibabacloud.com/controller"
time="2023-06-07T20:25:38+08:00" level=info msg="Create Stroage Path: /var/lib/kubelet/csi-plugins/nasplugin.csi.alibabacloud.com/node"
time="2023-06-07T20:25:38+08:00" level=info msg="Create Stroage Path: /var/lib/kubelet/csi-plugins/diskplugin.csi.alibabacloud.com/controller"
time="2023-06-07T20:25:38+08:00" level=info msg="Create Stroage Path: /var/lib/kubelet/csi-plugins/diskplugin.csi.alibabacloud.com/node"
time="2023-06-07T20:25:38+08:00" level=info msg="CSI is running status."
time="2023-06-07T20:25:38+08:00" level=info msg="Metric listening on address: /healthz"
W0607 20:25:38.881915 2761065 client_config.go:552] Neither --kubeconfig nor --master was specified.  Using the inClusterConfig.  This might not work.
time="2023-06-07T20:25:38+08:00" level=info msg="Driver: ossplugin.csi.alibabacloud.com version: 1.0.0"
time="2023-06-07T20:25:38+08:00" level=info msg="Driver: nasplugin.csi.alibabacloud.com version: 1.0.0"
W0607 20:25:38.884650 2761065 client_config.go:552] Neither --kubeconfig nor --master was specified.  Using the inClusterConfig.  This might not work.
W0607 20:25:38.885063 2761065 client_config.go:552] Neither --kubeconfig nor --master was specified.  Using the inClusterConfig.  This might not work.
W0607 20:25:38.885096 2761065 client_config.go:552] Neither --kubeconfig nor --master was specified.  Using the inClusterConfig.  This might not work.
W0607 20:25:38.885770 2761065 client_config.go:552] Neither --kubeconfig nor --master was specified.  Using the inClusterConfig.  This might not work.
time="2023-06-07T20:25:38+08:00" level=info msg="Metric listening on address: /metrics"
time="2023-06-07T20:25:38+08:00" level=info msg="RetryGetMetaData: successful get metadata instance-id: i-bp16ivxo89f7sjd7qsz1"
time="2023-06-07T20:25:38+08:00" level=info msg="Use node id : i-bp16ivxo89f7sjd7qsz1"
I0607 20:25:38.898347 2761065 driver.go:93] Enabling volume access mode: MULTI_NODE_MULTI_WRITER
I0607 20:25:38.898356 2761065 driver.go:81] Enabling controller service capability: CREATE_DELETE_VOLUME
I0607 20:25:38.898359 2761065 driver.go:81] Enabling controller service capability: PUBLISH_UNPUBLISH_VOLUME
I0607 20:25:38.898362 2761065 driver.go:81] Enabling controller service capability: EXPAND_VOLUME
W0607 20:25:38.898366 2761065 client_config.go:552] Neither --kubeconfig nor --master was specified.  Using the inClusterConfig.  This might not work.
time="2023-06-07T20:25:38+08:00" level=info msg="RetryGetMetaData: successful get metadata instance-id: i-bp16ivxo89f7sjd7qsz1"
time="2023-06-07T20:25:38+08:00" level=info msg="Use node id : i-bp16ivxo89f7sjd7qsz1"
I0607 20:25:38.899978 2761065 driver.go:93] Enabling volume access mode: MULTI_NODE_MULTI_WRITER
I0607 20:25:38.899983 2761065 driver.go:81] Enabling controller service capability: CREATE_DELETE_VOLUME
I0607 20:25:38.899987 2761065 driver.go:81] Enabling controller service capability: UNKNOWN
time="2023-06-07T20:25:38+08:00" level=info msg="RetryGetMetaData: successful get metadata instance-id: i-bp16ivxo89f7sjd7qsz1"
time="2023-06-07T20:25:38+08:00" level=info msg="Use node id : i-bp16ivxo89f7sjd7qsz1"
I0607 20:25:38.900198 2761065 driver.go:81] Enabling controller service capability: CREATE_DELETE_VOLUME
I0607 20:25:38.900202 2761065 driver.go:81] Enabling controller service capability: PUBLISH_UNPUBLISH_VOLUME
I0607 20:25:38.900206 2761065 driver.go:81] Enabling controller service capability: CREATE_DELETE_SNAPSHOT
I0607 20:25:38.900209 2761065 driver.go:81] Enabling controller service capability: LIST_SNAPSHOTS
I0607 20:25:38.900213 2761065 driver.go:81] Enabling controller service capability: EXPAND_VOLUME
I0607 20:25:38.900224 2761065 driver.go:93] Enabling volume access mode: MULTI_NODE_MULTI_WRITER
W0607 20:25:38.900230 2761065 client_config.go:552] Neither --kubeconfig nor --master was specified.  Using the inClusterConfig.  This might not work.
W0607 20:25:38.900541 2761065 client_config.go:552] Neither --kubeconfig nor --master was specified.  Using the inClusterConfig.  This might not work.
I0607 20:25:38.903810 2761065 server.go:108] Listening for connections on address: &net.UnixAddr{Name:"/var/lib/kubelet/csi-plugins/ossplugin.csi.alibabacloud.com/csi.sock", Net:"unix"}
time="2023-06-07T20:25:38+08:00" level=info msg="Not found configmap named as csi-plugin under kube-system, with error: configmaps \"csi-plugin\" not found"
time="2023-06-07T20:25:38+08:00" level=info msg="Not found configmap named as csi-plugin under kube-system, with: configmaps \"csi-plugin\" not found"
time="2023-06-07T20:25:38+08:00" level=info msg="AD-Controller is disabled, CSI Disk Plugin running in kubelet mode."
time="2023-06-07T20:25:38+08:00" level=info msg="Describe node k8s-node1 and set RunTimeClass to runc"
time="2023-06-07T20:25:38+08:00" level=info msg="Node InternalIP is: 172.16.68.231"
time="2023-06-07T20:25:38+08:00" level=info msg="Describe node k8s-node1 and Set RunTimeClass to runc"
time="2023-06-07T20:25:38+08:00" level=info msg="NAS Global Config: { false false false false runc k8s-node1 172.16.68.231  false true 0xc0006a2420 0xc0000bc5f0 <nil>}"
time="2023-06-07T20:25:38+08:00" level=info msg="Starting with GlobalConfigVar: region(), zone(), NodeID(i-bp16ivxo89f7sjd7qsz1), ADControllerEnable(false), DiskTagEnable(false), DiskBdfEnable(false), MetricEnable(true), RunTimeClass(runc), DetachDisabled(false), DetachBeforeDelete(true), ClusterID()"
time="2023-06-07T20:25:38+08:00" level=info msg="Get AK: use ENV AK"
time="2023-06-07T20:25:38+08:00" level=info msg="Starting csi-plugin without sts."
W0607 20:25:38.939028 2761065 client_config.go:552] Neither --kubeconfig nor --master was specified.  Using the inClusterConfig.  This might not work.
time="2023-06-07T20:25:38+08:00" level=info msg="NewNodeServer: MAX_VOLUMES_PERNODE is set to(not default): 15"
time="2023-06-07T20:25:38+08:00" level=info msg="Get AK: use ENV AK"
time="2023-06-07T20:25:38+08:00" level=info msg="NewControllerServer: current provisioner nas limit is 2"
W0607 20:25:38.942735 2761065 client_config.go:552] Neither --kubeconfig nor --master was specified.  Using the inClusterConfig.  This might not work.
I0607 20:25:38.943250 2761065 server.go:108] Listening for connections on address: &net.UnixAddr{Name:"/var/lib/kubelet/csi-plugins/nasplugin.csi.alibabacloud.com/csi.sock", Net:"unix"}
time="2023-06-07T20:25:38+08:00" level=info msg="NewNodeServer: zone id: cn-hangzhou-i, GlobalConfigVar.zoneID: "
time="2023-06-07T20:25:38+08:00" level=info msg="Currently node is NOT VF model"
time="2023-06-07T20:25:38+08:00" level=info msg="Starting csi-plugin Driver: diskplugin.csi.alibabacloud.com version: 1.0.0"
I0607 20:25:38.970840 2761065 server.go:108] Listening for connections on address: &net.UnixAddr{Name:"/var/lib/kubelet/csi-plugins/diskplugin.csi.alibabacloud.com/csi.sock", Net:"unix"}
time="2023-06-07T20:25:39+08:00" level=error msg="UpdateNode:: describe available resource with nodeID: "
time="2023-06-07T20:25:39+08:00" level=info msg="UpdateNode: record ecs openapi req: &{RpcRequest:0xc000012a90 ResourceOwnerId: Memory: IoOptimized: DataDiskCategory: Cores: SystemDiskCategory: Scope: InstanceType: NetworkCategory: InstanceChargeType: ResourceOwnerAccount: OwnerAccount: DedicatedHostId: OwnerId: SpotDuration: ResourceType: SpotStrategy: DestinationResource:DataDisk ZoneId:}, resp: HTTP/1.1 400 Bad Request\nKeep-Alive: timeout=25\nAccess-Control-Allow-Origin: *\nX-Acs-Trace-Id: e40af6398bbd01de1fe7063e2a4e5b37\nContent-Type: application/json;charset=utf-8\nContent-Length: 308\nConnection: keep-alive\nDate: Wed, 07 Jun 2023 12:25:39 GMT\nAccess-Control-Expose-Headers: *\nX-Acs-Request-Id: EF9E02D6-657A-5E0F-9903-7A4E35487E26\n\n{\"RequestId\":\"EF9E02D6-657A-5E0F-9903-7A4E35487E26\",\"HostId\":\"ecs.cn-hangzhou.aliyuncs.com\",\"Code\":\"Invalid.Param\",\"Message\":\"The input parameter DestinationResource that is mandatory for processing this request is not supplied.\",\"Recommend\":\"https://api.aliyun.com/troubleshoot?q=Invalid.Param&product=Ecs\"}\n"
time="2023-06-07T20:25:39+08:00" level=error msg="UpdateNode:: multi available zones error: []"
time="2023-06-07T20:26:38+08:00" level=info msg="NodeStageVolume: Stage VolumeId: d-bp1iuj8gu5yanaxkzr7i, Target Path: /var/lib/kubelet/plugins/kubernetes.io/csi/pv/d-bp1iuj8gu5yanaxkzr7i/globalmount, VolumeContext: map[mkfsOptions:-O project,quota regionId:cn-hangzhou storage.kubernetes.io/csiProvisionerIdentity:1686140745880-4067-diskplugin.csi.alibabacloud.com type:cloud_essd volume.kubernetes.io/storage-provisioner:diskplugin.csi.alibabacloud.com zoneId:cn-hangzhou-i]"
time="2023-06-07T20:26:38+08:00" level=info msg="checkStagingPathMounted: check path: /var/lib/kubelet/plugins/kubernetes.io/csi/pv/d-bp1iuj8gu5yanaxkzr7i/globalmount, passedPath: /var/lib/kubelet/plugins/kubernetes.io/csi/pv/d-bp1iuj8gu5yanaxkzr7i/globalmount, mounted: false"
time="2023-06-07T20:26:38+08:00" level=info msg="checkStagingPathMounted: check path: /var/lib/kubelet/plugins/kubernetes.io/csi/pv/d-bp1iuj8gu5yanaxkzr7i/globalmount, passedPath: /var/lib/kubelet/plugins/kubernetes.io/csi/pv/d-bp1iuj8gu5yanaxkzr7i/globalmount, mounted: false"
time="2023-06-07T20:26:38+08:00" level=info msg="AttachDisk: Starting Do AttachDisk: DiskId: d-bp1iuj8gu5yanaxkzr7i, InstanceId: i-bp16ivxo89f7sjd7qsz1, Region: "
time="2023-06-07T20:26:38+08:00" level=info msg="Get AK: use ENV AK"
time="2023-06-07T20:26:38+08:00" level=info msg="AttachDisk: Waiting for Disk d-bp1iuj8gu5yanaxkzr7i is Attached to instance i-bp16ivxo89f7sjd7qsz1 with RequestId: 12221323-3DCA-5D67-92BE-2BC4EB71DD4A"
time="2023-06-07T20:26:41+08:00" level=info msg="GetDevice: Use the serial to find device, got /dev/vdb, volumeID: d-bp1iuj8gu5yanaxkzr7i, devices: [/dev/vdb /dev/vdb1]"
time="2023-06-07T20:26:41+08:00" level=error msg="AttachDisk: volume d-bp1iuj8gu5yanaxkzr7i get device with diff, and check partition error Root device /dev/vdb is partition, and you should format /dev/vdb1 by hands "
time="2023-06-07T20:26:41+08:00" level=error msg="NodeStageVolume: Attach volume: d-bp1iuj8gu5yanaxkzr7i with error: Root device /dev/vdb is partition, and you should format /dev/vdb1 by hands "
E0607 20:26:41.597253 2761065 utils.go:101] GRPC error: rpc error: code = Aborted desc = NodeStageVolume: Attach volume: d-bp1iuj8gu5yanaxkzr7i with error: Root device /dev/vdb is partition, and you should format /dev/vdb1 by hands 
time="2023-06-07T20:26:42+08:00" level=info msg="NodeStageVolume: Stage VolumeId: d-bp1iuj8gu5yanaxkzr7i, Target Path: /var/lib/kubelet/plugins/kubernetes.io/csi/pv/d-bp1iuj8gu5yanaxkzr7i/globalmount, VolumeContext: map[mkfsOptions:-O project,quota regionId:cn-hangzhou storage.kubernetes.io/csiProvisionerIdentity:1686140745880-4067-diskplugin.csi.alibabacloud.com type:cloud_essd volume.kubernetes.io/storage-provisioner:diskplugin.csi.alibabacloud.com zoneId:cn-hangzhou-i]"
time="2023-06-07T20:26:42+08:00" level=info msg="checkStagingPathMounted: check path: /var/lib/kubelet/plugins/kubernetes.io/csi/pv/d-bp1iuj8gu5yanaxkzr7i/globalmount, passedPath: /var/lib/kubelet/plugins/kubernetes.io/csi/pv/d-bp1iuj8gu5yanaxkzr7i/globalmount, mounted: false"
time="2023-06-07T20:26:42+08:00" level=info msg="checkStagingPathMounted: check path: /var/lib/kubelet/plugins/kubernetes.io/csi/pv/d-bp1iuj8gu5yanaxkzr7i/globalmount, passedPath: /var/lib/kubelet/plugins/kubernetes.io/csi/pv/d-bp1iuj8gu5yanaxkzr7i/globalmount, mounted: false"
time="2023-06-07T20:26:42+08:00" level=info msg="AttachDisk: Starting Do AttachDisk: DiskId: d-bp1iuj8gu5yanaxkzr7i, InstanceId: i-bp16ivxo89f7sjd7qsz1, Region: "
time="2023-06-07T20:26:42+08:00" level=info msg="Get AK: use ENV AK"
time="2023-06-07T20:26:42+08:00" level=info msg="GetDevice: Use the serial to find device, got /dev/vdb, volumeID: d-bp1iuj8gu5yanaxkzr7i, devices: [/dev/vdb /dev/vdb1]"
time="2023-06-07T20:26:42+08:00" level=info msg="attachDisk: rootDevice: , subDevice: , err: Root device /dev/vdb is partition, and you should format /dev/vdb1 by hands "
time="2023-06-07T20:26:47+08:00" level=info msg="AttachDisk: find disk dev after 5 seconds"
time="2023-06-07T20:26:47+08:00" level=info msg="GetDevice: Use the serial to find device, got /dev/vdb, volumeID: d-bp1iuj8gu5yanaxkzr7i, devices: [/dev/vdb /dev/vdb1]"
time="2023-06-07T20:26:47+08:00" level=error msg="NodeStageVolume: Attach volume: d-bp1iuj8gu5yanaxkzr7i with error: AttachDisk: disk device cannot be found in node, diskid: d-bp1iuj8gu5yanaxkzr7i, devicenName: , err: Root device /dev/vdb is partition, and you should format /dev/vdb1 by hands "
E0607 20:26:47.184118 2761065 utils.go:101] GRPC error: rpc error: code = Aborted desc = NodeStageVolume: Attach volume: d-bp1iuj8gu5yanaxkzr7i with error: AttachDisk: disk device cannot be found in node, diskid: d-bp1iuj8gu5yanaxkzr7i, devicenName: , err: Root device /dev/vdb is partition, and you should format /dev/vdb1 by hands 
time="2023-06-07T20:26:48+08:00" level=info msg="NodeStageVolume: Stage VolumeId: d-bp1iuj8gu5yanaxkzr7i, Target Path: /var/lib/kubelet/plugins/kubernetes.io/csi/pv/d-bp1iuj8gu5yanaxkzr7i/globalmount, VolumeContext: map[mkfsOptions:-O project,quota regionId:cn-hangzhou storage.kubernetes.io/csiProvisionerIdentity:1686140745880-4067-diskplugin.csi.alibabacloud.com type:cloud_essd volume.kubernetes.io/storage-provisioner:diskplugin.csi.alibabacloud.com zoneId:cn-hangzhou-i]"
time="2023-06-07T20:26:48+08:00" level=info msg="checkStagingPathMounted: check path: /var/lib/kubelet/plugins/kubernetes.io/csi/pv/d-bp1iuj8gu5yanaxkzr7i/globalmount, passedPath: /var/lib/kubelet/plugins/kubernetes.io/csi/pv/d-bp1iuj8gu5yanaxkzr7i/globalmount, mounted: false"
time="2023-06-07T20:26:48+08:00" level=info msg="checkStagingPathMounted: check path: /var/lib/kubelet/plugins/kubernetes.io/csi/pv/d-bp1iuj8gu5yanaxkzr7i/globalmount, passedPath: /var/lib/kubelet/plugins/kubernetes.io/csi/pv/d-bp1iuj8gu5yanaxkzr7i/globalmount, mounted: false"
time="2023-06-07T20:26:48+08:00" level=info msg="AttachDisk: Starting Do AttachDisk: DiskId: d-bp1iuj8gu5yanaxkzr7i, InstanceId: i-bp16ivxo89f7sjd7qsz1, Region: "
time="2023-06-07T20:26:48+08:00" level=info msg="Get AK: use ENV AK"
time="2023-06-07T20:26:48+08:00" level=info msg="GetDevice: Use the serial to find device, got /dev/vdb, volumeID: d-bp1iuj8gu5yanaxkzr7i, devices: [/dev/vdb /dev/vdb1]"
time="2023-06-07T20:26:48+08:00" level=info msg="attachDisk: rootDevice: , subDevice: , err: Root device /dev/vdb is partition, and you should format /dev/vdb1 by hands "
time="2023-06-07T20:26:53+08:00" level=info msg="AttachDisk: find disk dev after 5 seconds"
time="2023-06-07T20:26:53+08:00" level=info msg="GetDevice: Use the serial to find device, got /dev/vdb, volumeID: d-bp1iuj8gu5yanaxkzr7i, devices: [/dev/vdb /dev/vdb1]"
time="2023-06-07T20:26:53+08:00" level=error msg="NodeStageVolume: Attach volume: d-bp1iuj8gu5yanaxkzr7i with error: AttachDisk: disk device cannot be found in node, diskid: d-bp1iuj8gu5yanaxkzr7i, devicenName: , err: Root device /dev/vdb is partition, and you should format /dev/vdb1 by hands "
E0607 20:26:53.320459 2761065 utils.go:101] GRPC error: rpc error: code = Aborted desc = NodeStageVolume: Attach volume: d-bp1iuj8gu5yanaxkzr7i with error: AttachDisk: disk device cannot be found in node, diskid: d-bp1iuj8gu5yanaxkzr7i, devicenName: , err: Root device /dev/vdb is partition, and you should format /dev/vdb1 by hands 
time="2023-06-07T20:26:55+08:00" level=info msg="NodeStageVolume: Stage VolumeId: d-bp1iuj8gu5yanaxkzr7i, Target Path: /var/lib/kubelet/plugins/kubernetes.io/csi/pv/d-bp1iuj8gu5yanaxkzr7i/globalmount, VolumeContext: map[mkfsOptions:-O project,quota regionId:cn-hangzhou storage.kubernetes.io/csiProvisionerIdentity:1686140745880-4067-diskplugin.csi.alibabacloud.com type:cloud_essd volume.kubernetes.io/storage-provisioner:diskplugin.csi.alibabacloud.com zoneId:cn-hangzhou-i]"
time="2023-06-07T20:26:55+08:00" level=info msg="checkStagingPathMounted: check path: /var/lib/kubelet/plugins/kubernetes.io/csi/pv/d-bp1iuj8gu5yanaxkzr7i/globalmount, passedPath: /var/lib/kubelet/plugins/kubernetes.io/csi/pv/d-bp1iuj8gu5yanaxkzr7i/globalmount, mounted: false"
time="2023-06-07T20:26:55+08:00" level=info msg="checkStagingPathMounted: check path: /var/lib/kubelet/plugins/kubernetes.io/csi/pv/d-bp1iuj8gu5yanaxkzr7i/globalmount, passedPath: /var/lib/kubelet/plugins/kubernetes.io/csi/pv/d-bp1iuj8gu5yanaxkzr7i/globalmount, mounted: false"
time="2023-06-07T20:26:55+08:00" level=info msg="AttachDisk: Starting Do AttachDisk: DiskId: d-bp1iuj8gu5yanaxkzr7i, InstanceId: i-bp16ivxo89f7sjd7qsz1, Region: "
time="2023-06-07T20:26:55+08:00" level=info msg="Get AK: use ENV AK"
time="2023-06-07T20:26:55+08:00" level=info msg="GetDevice: Use the serial to find device, got /dev/vdb, volumeID: d-bp1iuj8gu5yanaxkzr7i, devices: [/dev/vdb /dev/vdb1]"
time="2023-06-07T20:26:55+08:00" level=info msg="attachDisk: rootDevice: , subDevice: , err: Root device /dev/vdb is partition, and you should format /dev/vdb1 by hands "
time="2023-06-07T20:27:00+08:00" level=info msg="AttachDisk: find disk dev after 5 seconds"
time="2023-06-07T20:27:00+08:00" level=info msg="GetDevice: Use the serial to find device, got /dev/vdb, volumeID: d-bp1iuj8gu5yanaxkzr7i, devices: [/dev/vdb /dev/vdb1]"
time="2023-06-07T20:27:00+08:00" level=error msg="NodeStageVolume: Attach volume: d-bp1iuj8gu5yanaxkzr7i with error: AttachDisk: disk device cannot be found in node, diskid: d-bp1iuj8gu5yanaxkzr7i, devicenName: , err: Root device /dev/vdb is partition, and you should format /dev/vdb1 by hands "
E0607 20:27:00.498885 2761065 utils.go:101] GRPC error: rpc error: code = Aborted desc = NodeStageVolume: Attach volume: d-bp1iuj8gu5yanaxkzr7i with error: AttachDisk: disk device cannot be found in node, diskid: d-bp1iuj8gu5yanaxkzr7i, devicenName: , err: Root device /dev/vdb is partition, and you should format /dev/vdb1 by hands 
time="2023-06-07T20:27:04+08:00" level=info msg="NodeStageVolume: Stage VolumeId: d-bp1iuj8gu5yanaxkzr7i, Target Path: /var/lib/kubelet/plugins/kubernetes.io/csi/pv/d-bp1iuj8gu5yanaxkzr7i/globalmount, VolumeContext: map[mkfsOptions:-O project,quota regionId:cn-hangzhou storage.kubernetes.io/csiProvisionerIdentity:1686140745880-4067-diskplugin.csi.alibabacloud.com type:cloud_essd volume.kubernetes.io/storage-provisioner:diskplugin.csi.alibabacloud.com zoneId:cn-hangzhou-i]"
time="2023-06-07T20:27:04+08:00" level=info msg="checkStagingPathMounted: check path: /var/lib/kubelet/plugins/kubernetes.io/csi/pv/d-bp1iuj8gu5yanaxkzr7i/globalmount, passedPath: /var/lib/kubelet/plugins/kubernetes.io/csi/pv/d-bp1iuj8gu5yanaxkzr7i/globalmount, mounted: false"
time="2023-06-07T20:27:04+08:00" level=info msg="checkStagingPathMounted: check path: /var/lib/kubelet/plugins/kubernetes.io/csi/pv/d-bp1iuj8gu5yanaxkzr7i/globalmount, passedPath: /var/lib/kubelet/plugins/kubernetes.io/csi/pv/d-bp1iuj8gu5yanaxkzr7i/globalmount, mounted: false"
time="2023-06-07T20:27:04+08:00" level=info msg="AttachDisk: Starting Do AttachDisk: DiskId: d-bp1iuj8gu5yanaxkzr7i, InstanceId: i-bp16ivxo89f7sjd7qsz1, Region: "
time="2023-06-07T20:27:04+08:00" level=info msg="Get AK: use ENV AK"
time="2023-06-07T20:27:04+08:00" level=info msg="GetDevice: Use the serial to find device, got /dev/vdb, volumeID: d-bp1iuj8gu5yanaxkzr7i, devices: [/dev/vdb /dev/vdb1]"
time="2023-06-07T20:27:04+08:00" level=info msg="attachDisk: rootDevice: , subDevice: , err: Root device /dev/vdb is partition, and you should format /dev/vdb1 by hands "
time="2023-06-07T20:27:09+08:00" level=info msg="AttachDisk: find disk dev after 5 seconds"
time="2023-06-07T20:27:09+08:00" level=info msg="GetDevice: Use the serial to find device, got /dev/vdb, volumeID: d-bp1iuj8gu5yanaxkzr7i, devices: [/dev/vdb /dev/vdb1]"
time="2023-06-07T20:27:09+08:00" level=error msg="NodeStageVolume: Attach volume: d-bp1iuj8gu5yanaxkzr7i with error: AttachDisk: disk device cannot be found in node, diskid: d-bp1iuj8gu5yanaxkzr7i, devicenName: , err: Root device /dev/vdb is partition, and you should format /dev/vdb1 by hands "
E0607 20:27:09.666876 2761065 utils.go:101] GRPC error: rpc error: code = Aborted desc = NodeStageVolume: Attach volume: d-bp1iuj8gu5yanaxkzr7i with error: AttachDisk: disk device cannot be found in node, diskid: d-bp1iuj8gu5yanaxkzr7i, devicenName: , err: Root device /dev/vdb is partition, and you should format /dev/vdb1 by hands 
time="2023-06-07T20:27:17+08:00" level=info msg="NodeStageVolume: Stage VolumeId: d-bp1iuj8gu5yanaxkzr7i, Target Path: /var/lib/kubelet/plugins/kubernetes.io/csi/pv/d-bp1iuj8gu5yanaxkzr7i/globalmount, VolumeContext: map[mkfsOptions:-O project,quota regionId:cn-hangzhou storage.kubernetes.io/csiProvisionerIdentity:1686140745880-4067-diskplugin.csi.alibabacloud.com type:cloud_essd volume.kubernetes.io/storage-provisioner:diskplugin.csi.alibabacloud.com zoneId:cn-hangzhou-i]"
time="2023-06-07T20:27:17+08:00" level=info msg="checkStagingPathMounted: check path: /var/lib/kubelet/plugins/kubernetes.io/csi/pv/d-bp1iuj8gu5yanaxkzr7i/globalmount, passedPath: /var/lib/kubelet/plugins/kubernetes.io/csi/pv/d-bp1iuj8gu5yanaxkzr7i/globalmount, mounted: false"
time="2023-06-07T20:27:17+08:00" level=info msg="checkStagingPathMounted: check path: /var/lib/kubelet/plugins/kubernetes.io/csi/pv/d-bp1iuj8gu5yanaxkzr7i/globalmount, passedPath: /var/lib/kubelet/plugins/kubernetes.io/csi/pv/d-bp1iuj8gu5yanaxkzr7i/globalmount, mounted: false"
time="2023-06-07T20:27:17+08:00" level=info msg="AttachDisk: Starting Do AttachDisk: DiskId: d-bp1iuj8gu5yanaxkzr7i, InstanceId: i-bp16ivxo89f7sjd7qsz1, Region: "
time="2023-06-07T20:27:17+08:00" level=info msg="Get AK: use ENV AK"
time="2023-06-07T20:27:17+08:00" level=info msg="GetDevice: Use the serial to find device, got /dev/vdb, volumeID: d-bp1iuj8gu5yanaxkzr7i, devices: [/dev/vdb /dev/vdb1]"
time="2023-06-07T20:27:17+08:00" level=info msg="attachDisk: rootDevice: , subDevice: , err: Root device /dev/vdb is partition, and you should format /dev/vdb1 by hands "
time="2023-06-07T20:27:22+08:00" level=info msg="AttachDisk: find disk dev after 5 seconds"
time="2023-06-07T20:27:22+08:00" level=info msg="GetDevice: Use the serial to find device, got /dev/vdb, volumeID: d-bp1iuj8gu5yanaxkzr7i, devices: [/dev/vdb /dev/vdb1]"
time="2023-06-07T20:27:22+08:00" level=error msg="NodeStageVolume: Attach volume: d-bp1iuj8gu5yanaxkzr7i with error: AttachDisk: disk device cannot be found in node, diskid: d-bp1iuj8gu5yanaxkzr7i, devicenName: , err: Root device /dev/vdb is partition, and you should format /dev/vdb1 by hands "
E0607 20:27:22.862069 2761065 utils.go:101] GRPC error: rpc error: code = Aborted desc = NodeStageVolume: Attach volume: d-bp1iuj8gu5yanaxkzr7i with error: AttachDisk: disk device cannot be found in node, diskid: d-bp1iuj8gu5yanaxkzr7i, devicenName: , err: Root device /dev/vdb is partition, and you should format /dev/vdb1 by hands 
time="2023-06-07T20:27:38+08:00" level=info msg="NodeStageVolume: Stage VolumeId: d-bp1iuj8gu5yanaxkzr7i, Target Path: /var/lib/kubelet/plugins/kubernetes.io/csi/pv/d-bp1iuj8gu5yanaxkzr7i/globalmount, VolumeContext: map[mkfsOptions:-O project,quota regionId:cn-hangzhou storage.kubernetes.io/csiProvisionerIdentity:1686140745880-4067-diskplugin.csi.alibabacloud.com type:cloud_essd volume.kubernetes.io/storage-provisioner:diskplugin.csi.alibabacloud.com zoneId:cn-hangzhou-i]"
time="2023-06-07T20:27:38+08:00" level=info msg="checkStagingPathMounted: check path: /var/lib/kubelet/plugins/kubernetes.io/csi/pv/d-bp1iuj8gu5yanaxkzr7i/globalmount, passedPath: /var/lib/kubelet/plugins/kubernetes.io/csi/pv/d-bp1iuj8gu5yanaxkzr7i/globalmount, mounted: false"
time="2023-06-07T20:27:38+08:00" level=info msg="checkStagingPathMounted: check path: /var/lib/kubelet/plugins/kubernetes.io/csi/pv/d-bp1iuj8gu5yanaxkzr7i/globalmount, passedPath: /var/lib/kubelet/plugins/kubernetes.io/csi/pv/d-bp1iuj8gu5yanaxkzr7i/globalmount, mounted: false"
time="2023-06-07T20:27:38+08:00" level=info msg="AttachDisk: Starting Do AttachDisk: DiskId: d-bp1iuj8gu5yanaxkzr7i, InstanceId: i-bp16ivxo89f7sjd7qsz1, Region: "
time="2023-06-07T20:27:38+08:00" level=info msg="Get AK: use ENV AK"
time="2023-06-07T20:27:38+08:00" level=info msg="GetDevice: Use the serial to find device, got /dev/vdb, volumeID: d-bp1iuj8gu5yanaxkzr7i, devices: [/dev/vdb /dev/vdb1]"
time="2023-06-07T20:27:38+08:00" level=info msg="attachDisk: rootDevice: , subDevice: , err: Root device /dev/vdb is partition, and you should format /dev/vdb1 by hands "
time="2023-06-07T20:27:43+08:00" level=info msg="AttachDisk: find disk dev after 5 seconds"
time="2023-06-07T20:27:43+08:00" level=info msg="GetDevice: Use the serial to find device, got /dev/vdb, volumeID: d-bp1iuj8gu5yanaxkzr7i, devices: [/dev/vdb /dev/vdb1]"
time="2023-06-07T20:27:43+08:00" level=error msg="NodeStageVolume: Attach volume: d-bp1iuj8gu5yanaxkzr7i with error: AttachDisk: disk device cannot be found in node, diskid: d-bp1iuj8gu5yanaxkzr7i, devicenName: , err: Root device /dev/vdb is partition, and you should format /dev/vdb1 by hands "
E0607 20:27:43.988652 2761065 utils.go:101] GRPC error: rpc error: code = Aborted desc = NodeStageVolume: Attach volume: d-bp1iuj8gu5yanaxkzr7i with error: AttachDisk: disk device cannot be found in node, diskid: d-bp1iuj8gu5yanaxkzr7i, devicenName: , err: Root device /dev/vdb is partition, and you should format /dev/vdb1 by hands 
time="2023-06-07T20:28:16+08:00" level=info msg="NodeStageVolume: Stage VolumeId: d-bp1iuj8gu5yanaxkzr7i, Target Path: /var/lib/kubelet/plugins/kubernetes.io/csi/pv/d-bp1iuj8gu5yanaxkzr7i/globalmount, VolumeContext: map[mkfsOptions:-O project,quota regionId:cn-hangzhou storage.kubernetes.io/csiProvisionerIdentity:1686140745880-4067-diskplugin.csi.alibabacloud.com type:cloud_essd volume.kubernetes.io/storage-provisioner:diskplugin.csi.alibabacloud.com zoneId:cn-hangzhou-i]"
time="2023-06-07T20:28:16+08:00" level=info msg="checkStagingPathMounted: check path: /var/lib/kubelet/plugins/kubernetes.io/csi/pv/d-bp1iuj8gu5yanaxkzr7i/globalmount, passedPath: /var/lib/kubelet/plugins/kubernetes.io/csi/pv/d-bp1iuj8gu5yanaxkzr7i/globalmount, mounted: false"
time="2023-06-07T20:28:16+08:00" level=info msg="checkStagingPathMounted: check path: /var/lib/kubelet/plugins/kubernetes.io/csi/pv/d-bp1iuj8gu5yanaxkzr7i/globalmount, passedPath: /var/lib/kubelet/plugins/kubernetes.io/csi/pv/d-bp1iuj8gu5yanaxkzr7i/globalmount, mounted: false"
time="2023-06-07T20:28:16+08:00" level=info msg="AttachDisk: Starting Do AttachDisk: DiskId: d-bp1iuj8gu5yanaxkzr7i, InstanceId: i-bp16ivxo89f7sjd7qsz1, Region: "
time="2023-06-07T20:28:16+08:00" level=info msg="Get AK: use ENV AK"
time="2023-06-07T20:28:16+08:00" level=info msg="GetDevice: Use the serial to find device, got /dev/vdb, volumeID: d-bp1iuj8gu5yanaxkzr7i, devices: [/dev/vdb /dev/vdb1]"
time="2023-06-07T20:28:16+08:00" level=info msg="attachDisk: rootDevice: , subDevice: , err: Root device /dev/vdb is partition, and you should format /dev/vdb1 by hands "
time="2023-06-07T20:28:21+08:00" level=info msg="AttachDisk: find disk dev after 5 seconds"
time="2023-06-07T20:28:21+08:00" level=info msg="GetDevice: Use the serial to find device, got /dev/vdb, volumeID: d-bp1iuj8gu5yanaxkzr7i, devices: [/dev/vdb /dev/vdb1]"
time="2023-06-07T20:28:21+08:00" level=error msg="NodeStageVolume: Attach volume: d-bp1iuj8gu5yanaxkzr7i with error: AttachDisk: disk device cannot be found in node, diskid: d-bp1iuj8gu5yanaxkzr7i, devicenName: , err: Root device /dev/vdb is partition, and you should format /dev/vdb1 by hands "
E0607 20:28:21.142720 2761065 utils.go:101] GRPC error: rpc error: code = Aborted desc = NodeStageVolume: Attach volume: d-bp1iuj8gu5yanaxkzr7i with error: AttachDisk: disk device cannot be found in node, diskid: d-bp1iuj8gu5yanaxkzr7i, devicenName: , err: Root device /dev/vdb is partition, and you should format /dev/vdb1 by hands 
time="2023-06-07T20:29:25+08:00" level=info msg="NodeStageVolume: Stage VolumeId: d-bp1iuj8gu5yanaxkzr7i, Target Path: /var/lib/kubelet/plugins/kubernetes.io/csi/pv/d-bp1iuj8gu5yanaxkzr7i/globalmount, VolumeContext: map[mkfsOptions:-O project,quota regionId:cn-hangzhou storage.kubernetes.io/csiProvisionerIdentity:1686140745880-4067-diskplugin.csi.alibabacloud.com type:cloud_essd volume.kubernetes.io/storage-provisioner:diskplugin.csi.alibabacloud.com zoneId:cn-hangzhou-i]"
time="2023-06-07T20:29:25+08:00" level=info msg="checkStagingPathMounted: check path: /var/lib/kubelet/plugins/kubernetes.io/csi/pv/d-bp1iuj8gu5yanaxkzr7i/globalmount, passedPath: /var/lib/kubelet/plugins/kubernetes.io/csi/pv/d-bp1iuj8gu5yanaxkzr7i/globalmount, mounted: false"
time="2023-06-07T20:29:25+08:00" level=info msg="checkStagingPathMounted: check path: /var/lib/kubelet/plugins/kubernetes.io/csi/pv/d-bp1iuj8gu5yanaxkzr7i/globalmount, passedPath: /var/lib/kubelet/plugins/kubernetes.io/csi/pv/d-bp1iuj8gu5yanaxkzr7i/globalmount, mounted: false"
time="2023-06-07T20:29:25+08:00" level=info msg="AttachDisk: Starting Do AttachDisk: DiskId: d-bp1iuj8gu5yanaxkzr7i, InstanceId: i-bp16ivxo89f7sjd7qsz1, Region: "
time="2023-06-07T20:29:25+08:00" level=info msg="Get AK: use ENV AK"
time="2023-06-07T20:29:25+08:00" level=info msg="GetDevice: Use the serial to find device, got /dev/vdb, volumeID: d-bp1iuj8gu5yanaxkzr7i, devices: [/dev/vdb /dev/vdb1]"
time="2023-06-07T20:29:25+08:00" level=info msg="attachDisk: rootDevice: , subDevice: , err: Root device /dev/vdb is partition, and you should format /dev/vdb1 by hands "
time="2023-06-07T20:29:30+08:00" level=info msg="AttachDisk: find disk dev after 5 seconds"
time="2023-06-07T20:29:30+08:00" level=info msg="GetDevice: Use the serial to find device, got /dev/vdb, volumeID: d-bp1iuj8gu5yanaxkzr7i, devices: [/dev/vdb /dev/vdb1]"
time="2023-06-07T20:29:30+08:00" level=error msg="NodeStageVolume: Attach volume: d-bp1iuj8gu5yanaxkzr7i with error: AttachDisk: disk device cannot be found in node, diskid: d-bp1iuj8gu5yanaxkzr7i, devicenName: , err: Root device /dev/vdb is partition, and you should format /dev/vdb1 by hands "
E0607 20:29:30.367692 2761065 utils.go:101] GRPC error: rpc error: code = Aborted desc = NodeStageVolume: Attach volume: d-bp1iuj8gu5yanaxkzr7i with error: AttachDisk: disk device cannot be found in node, diskid: d-bp1iuj8gu5yanaxkzr7i, devicenName: , err: Root device /dev/vdb is partition, and you should format /dev/vdb1 by hands 
[root@k8s-master csi]# 


`[root@k8s-master csi]# kubectl logs csi-plugin-mdhqv -c csi-plugin -n kube-system
/etc/os-release
Running oss plugin....
Running nas plugin....
Running disk plugin....
Last metadata expiration check: 1:57:32 ago on Wed Jun  7 18:27:58 2023.
Package libcurl-devel-7.61.1-25.0.2.al8.3.x86_64 is already installed.
Package libxml2-devel-2.9.7-15.0.1.al8.1.x86_64 is already installed.
Package fuse-devel-2.9.7-15.al8.x86_64 is already installed.
Package openssl-devel-1:1.1.1k-9.0.1.al8.x86_64 is already installed.
Dependencies resolved.
Nothing to do.
Complete!
Starting deploy oss csi-plugin...
osHost:alinux3
ossfsVersion:1.88.0
ossfsArch:centos8
Check ossfs Version....
Upgrade ossfs, ossfsVersion: 1.88.0
Dependencies resolved.
================================================================================
 Package         Architecture     Version              Repository          Size
================================================================================
Removing:
 ossfs           x86_64           1.86.2-1             @@System           8.2 M

Transaction Summary
================================================================================
Remove  1 Package

Freed space: 8.2 M
Running transaction check
Transaction check succeeded.
Running transaction test
Transaction test succeeded.
Running transaction
  Preparing        :                                                        1/1 
  Erasing          : ossfs-1.86.2-1.x86_64                                  1/1 
  Verifying        : ossfs-1.86.2-1.x86_64                                  1/1 

Removed:
  ossfs-1.86.2-1.x86_64                                                         

Complete!
No match for argument: ossfs
Dependencies resolved.
Nothing to do.
Complete!
No packages marked for removal.
Check csiplugin-connector.service....
Starting systemctl enable csiplugin-connector.service.
Starting systemctl restart csiplugin-connector.service.
time="2023-06-07T20:25:37+08:00" level=info msg="Multi CSI Driver Name: oss,nas,disk, nodeID: , endPoints: unix://var/lib/kubelet/csi-plugins/driverplugin.csi.alibabacloud.com-replace/csi.sock"
time="2023-06-07T20:25:37+08:00" level=info msg="CSI Driver Branch: , Version: , Build time: \n"
time="2023-06-07T20:25:37+08:00" level=info msg="Create Stroage Path: /var/lib/kubelet/csi-plugins/ossplugin.csi.alibabacloud.com/controller"
time="2023-06-07T20:25:37+08:00" level=info msg="Create Stroage Path: /var/lib/kubelet/csi-plugins/ossplugin.csi.alibabacloud.com/node"
time="2023-06-07T20:25:37+08:00" level=info msg="Create Stroage Path: /var/lib/kubelet/csi-plugins/nasplugin.csi.alibabacloud.com/controller"
time="2023-06-07T20:25:37+08:00" level=info msg="Create Stroage Path: /var/lib/kubelet/csi-plugins/nasplugin.csi.alibabacloud.com/node"
time="2023-06-07T20:25:37+08:00" level=info msg="Create Stroage Path: /var/lib/kubelet/csi-plugins/diskplugin.csi.alibabacloud.com/controller"
time="2023-06-07T20:25:37+08:00" level=info msg="Create Stroage Path: /var/lib/kubelet/csi-plugins/diskplugin.csi.alibabacloud.com/node"
time="2023-06-07T20:25:37+08:00" level=info msg="CSI is running status."
time="2023-06-07T20:25:37+08:00" level=info msg="Metric listening on address: /healthz"
W0607 20:25:37.793339 2431638 client_config.go:552] Neither --kubeconfig nor --master was specified.  Using the inClusterConfig.  This might not work.
W0607 20:25:37.795135 2431638 client_config.go:552] Neither --kubeconfig nor --master was specified.  Using the inClusterConfig.  This might not work.
W0607 20:25:37.796245 2431638 client_config.go:552] Neither --kubeconfig nor --master was specified.  Using the inClusterConfig.  This might not work.
W0607 20:25:37.796326 2431638 client_config.go:552] Neither --kubeconfig nor --master was specified.  Using the inClusterConfig.  This might not work.
W0607 20:25:37.798487 2431638 client_config.go:552] Neither --kubeconfig nor --master was specified.  Using the inClusterConfig.  This might not work.
time="2023-06-07T20:25:37+08:00" level=info msg="Driver: ossplugin.csi.alibabacloud.com version: 1.0.0"
time="2023-06-07T20:25:37+08:00" level=info msg="Driver: nasplugin.csi.alibabacloud.com version: 1.0.0"
time="2023-06-07T20:25:37+08:00" level=info msg="Metric listening on address: /metrics"
time="2023-06-07T20:25:37+08:00" level=info msg="RetryGetMetaData: successful get metadata instance-id: i-bp14gdn0n96ms4q0c7xn"
time="2023-06-07T20:25:37+08:00" level=info msg="Use node id : i-bp14gdn0n96ms4q0c7xn"
I0607 20:25:37.826096 2431638 driver.go:81] Enabling controller service capability: CREATE_DELETE_VOLUME
I0607 20:25:37.826108 2431638 driver.go:81] Enabling controller service capability: PUBLISH_UNPUBLISH_VOLUME
I0607 20:25:37.826113 2431638 driver.go:81] Enabling controller service capability: CREATE_DELETE_SNAPSHOT
I0607 20:25:37.826119 2431638 driver.go:81] Enabling controller service capability: LIST_SNAPSHOTS
I0607 20:25:37.826125 2431638 driver.go:81] Enabling controller service capability: EXPAND_VOLUME
I0607 20:25:37.826135 2431638 driver.go:93] Enabling volume access mode: MULTI_NODE_MULTI_WRITER
W0607 20:25:37.826146 2431638 client_config.go:552] Neither --kubeconfig nor --master was specified.  Using the inClusterConfig.  This might not work.
time="2023-06-07T20:25:37+08:00" level=info msg="RetryGetMetaData: successful get metadata instance-id: i-bp14gdn0n96ms4q0c7xn"
time="2023-06-07T20:25:37+08:00" level=info msg="Use node id : i-bp14gdn0n96ms4q0c7xn"
I0607 20:25:37.827687 2431638 driver.go:93] Enabling volume access mode: MULTI_NODE_MULTI_WRITER
I0607 20:25:37.827694 2431638 driver.go:81] Enabling controller service capability: CREATE_DELETE_VOLUME
I0607 20:25:37.827700 2431638 driver.go:81] Enabling controller service capability: UNKNOWN
W0607 20:25:37.828762 2431638 client_config.go:552] Neither --kubeconfig nor --master was specified.  Using the inClusterConfig.  This might not work.
time="2023-06-07T20:25:37+08:00" level=info msg="RetryGetMetaData: successful get metadata instance-id: i-bp14gdn0n96ms4q0c7xn"
time="2023-06-07T20:25:37+08:00" level=info msg="Use node id : i-bp14gdn0n96ms4q0c7xn"
I0607 20:25:37.829169 2431638 driver.go:93] Enabling volume access mode: MULTI_NODE_MULTI_WRITER
I0607 20:25:37.829176 2431638 driver.go:81] Enabling controller service capability: CREATE_DELETE_VOLUME
I0607 20:25:37.829182 2431638 driver.go:81] Enabling controller service capability: PUBLISH_UNPUBLISH_VOLUME
I0607 20:25:37.829187 2431638 driver.go:81] Enabling controller service capability: EXPAND_VOLUME
W0607 20:25:37.829193 2431638 client_config.go:552] Neither --kubeconfig nor --master was specified.  Using the inClusterConfig.  This might not work.
I0607 20:25:37.853573 2431638 server.go:108] Listening for connections on address: &net.UnixAddr{Name:"/var/lib/kubelet/csi-plugins/ossplugin.csi.alibabacloud.com/csi.sock", Net:"unix"}
time="2023-06-07T20:25:37+08:00" level=info msg="Not found configmap named as csi-plugin under kube-system, with: configmaps \"csi-plugin\" not found"
time="2023-06-07T20:25:37+08:00" level=info msg="AD-Controller is disabled, CSI Disk Plugin running in kubelet mode."
time="2023-06-07T20:25:37+08:00" level=info msg="Not found configmap named as csi-plugin under kube-system, with error: configmaps \"csi-plugin\" not found"
time="2023-06-07T20:25:37+08:00" level=info msg="Describe node k8s-master and set RunTimeClass to runc"
time="2023-06-07T20:25:37+08:00" level=info msg="Node InternalIP is: 172.16.68.230"
time="2023-06-07T20:25:37+08:00" level=info msg="NAS Global Config: { false false false false runc k8s-master 172.16.68.230  false true 0xc0005f06e0 0xc0000123e8 <nil>}"
time="2023-06-07T20:25:37+08:00" level=info msg="Describe node k8s-master and Set RunTimeClass to runc"
time="2023-06-07T20:25:37+08:00" level=info msg="Starting with GlobalConfigVar: region(), zone(), NodeID(i-bp14gdn0n96ms4q0c7xn), ADControllerEnable(false), DiskTagEnable(false), DiskBdfEnable(false), MetricEnable(true), RunTimeClass(runc), DetachDisabled(false), DetachBeforeDelete(true), ClusterID()"
time="2023-06-07T20:25:37+08:00" level=info msg="Get AK: use ENV AK"
time="2023-06-07T20:25:37+08:00" level=info msg="Get AK: use ENV AK"
time="2023-06-07T20:25:37+08:00" level=info msg="NewControllerServer: current provisioner nas limit is 2"
W0607 20:25:37.932528 2431638 client_config.go:552] Neither --kubeconfig nor --master was specified.  Using the inClusterConfig.  This might not work.
time="2023-06-07T20:25:37+08:00" level=info msg="Starting csi-plugin without sts."
W0607 20:25:37.934812 2431638 client_config.go:552] Neither --kubeconfig nor --master was specified.  Using the inClusterConfig.  This might not work.
time="2023-06-07T20:25:37+08:00" level=info msg="NewNodeServer: MAX_VOLUMES_PERNODE is set to(not default): 15"
I0607 20:25:37.936337 2431638 server.go:108] Listening for connections on address: &net.UnixAddr{Name:"/var/lib/kubelet/csi-plugins/nasplugin.csi.alibabacloud.com/csi.sock", Net:"unix"}
time="2023-06-07T20:25:37+08:00" level=info msg="NewNodeServer: zone id: cn-hangzhou-i, GlobalConfigVar.zoneID: "
time="2023-06-07T20:25:38+08:00" level=info msg="Currently node is NOT VF model"
time="2023-06-07T20:25:38+08:00" level=info msg="Starting csi-plugin Driver: diskplugin.csi.alibabacloud.com version: 1.0.0"
I0607 20:25:38.038665 2431638 server.go:108] Listening for connections on address: &net.UnixAddr{Name:"/var/lib/kubelet/csi-plugins/diskplugin.csi.alibabacloud.com/csi.sock", Net:"unix"}
time="2023-06-07T20:25:38+08:00" level=error msg="UpdateNode:: describe available resource with nodeID: "
time="2023-06-07T20:25:38+08:00" level=info msg="UpdateNode: record ecs openapi req: &{RpcRequest:0xc0000122c0 ResourceOwnerId: Memory: IoOptimized: DataDiskCategory: Cores: SystemDiskCategory: Scope: InstanceType: NetworkCategory: InstanceChargeType: ResourceOwnerAccount: OwnerAccount: DedicatedHostId: OwnerId: SpotDuration: ResourceType: SpotStrategy: DestinationResource:DataDisk ZoneId:}, resp: HTTP/1.1 400 Bad Request\nContent-Length: 308\nConnection: keep-alive\nAccess-Control-Expose-Headers: *\nX-Acs-Request-Id: 253FE352-6B4C-55A9-9985-7AC20F159E39\nDate: Wed, 07 Jun 2023 12:25:38 GMT\nContent-Type: application/json;charset=utf-8\nKeep-Alive: timeout=25\nAccess-Control-Allow-Origin: *\nX-Acs-Trace-Id: 2a6f780b4d8c48b339501b03d3793021\n\n{\"RequestId\":\"253FE352-6B4C-55A9-9985-7AC20F159E39\",\"HostId\":\"ecs.cn-hangzhou.aliyuncs.com\",\"Code\":\"Invalid.Param\",\"Message\":\"The input parameter DestinationResource that is mandatory for processing this request is not supplied.\",\"Recommend\":\"https://api.aliyun.com/troubleshoot?q=Invalid.Param&product=Ecs\"}\n"
time="2023-06-07T20:25:38+08:00" level=error msg="UpdateNode:: multi available zones error: []"```




#### What you expected to happen:

#### How to reproduce it (as minimally and precisely as possible):

#### Anything else we need to know?:

#### Environment:
- Kubernetes version v1.23.17 (use `kubectl version`):
- Cloud provider or hardware configuration:
- OS (e.g: `cat /etc/os-release`): 
NAME="Alibaba Cloud Linux"
VERSION="3 (Soaring Falcon)"
ID="alinux"
ID_LIKE="rhel fedora centos anolis"
VERSION_ID="3"
PLATFORM_ID="platform:al8"
PRETTY_NAME="Alibaba Cloud Linux 3 (Soaring Falcon)"
ANSI_COLOR="0;31"
HOME_URL="https://www.aliyun.com/"

- Kernel (e.g. `uname -a`): 
Linux k8s-master 5.10.134-13.1.al8.x86_64  SMP Mon Feb 6 14:54:50 CST 2023 x86_64 x86_64 x86_64 GNU/Linux
- Install tools:
- Network plugin and version (if this is a network-related bug):
- Others:
- 
云盘ID: d-bp1iuj8gu5yanaxkzr7i

zhoudi94 avatar Jun 07 '23 11:06 zhoudi94

k8s 原则上不支持磁盘分区, 如果您的盘是新建的话, 请检查集群里面是否包含会将挂载设备自动分区的组件(例如 openebs)

mowangdk avatar Jun 29 '23 11:06 mowangdk

The Kubernetes project currently lacks enough contributors to adequately respond to all issues.

This bot triages un-triaged issues according to the following rules:

  • After 90d of inactivity, lifecycle/stale is applied
  • After 30d of inactivity since lifecycle/stale was applied, lifecycle/rotten is applied
  • After 30d of inactivity since lifecycle/rotten was applied, the issue is closed

You can:

  • Mark this issue as fresh with /remove-lifecycle stale
  • Close this issue with /close
  • Offer to help out with Issue Triage

Please send feedback to sig-contributor-experience at kubernetes/community.

/lifecycle stale

k8s-triage-robot avatar Jan 23 '24 13:01 k8s-triage-robot

The Kubernetes project currently lacks enough active contributors to adequately respond to all issues.

This bot triages un-triaged issues according to the following rules:

  • After 90d of inactivity, lifecycle/stale is applied
  • After 30d of inactivity since lifecycle/stale was applied, lifecycle/rotten is applied
  • After 30d of inactivity since lifecycle/rotten was applied, the issue is closed

You can:

  • Mark this issue as fresh with /remove-lifecycle rotten
  • Close this issue with /close
  • Offer to help out with Issue Triage

Please send feedback to sig-contributor-experience at kubernetes/community.

/lifecycle rotten

k8s-triage-robot avatar Feb 22 '24 13:02 k8s-triage-robot

The Kubernetes project currently lacks enough active contributors to adequately respond to all issues and PRs.

This bot triages issues according to the following rules:

  • After 90d of inactivity, lifecycle/stale is applied
  • After 30d of inactivity since lifecycle/stale was applied, lifecycle/rotten is applied
  • After 30d of inactivity since lifecycle/rotten was applied, the issue is closed

You can:

  • Reopen this issue with /reopen
  • Mark this issue as fresh with /remove-lifecycle rotten
  • Offer to help out with Issue Triage

Please send feedback to sig-contributor-experience at kubernetes/community.

/close not-planned

k8s-triage-robot avatar Mar 23 '24 14:03 k8s-triage-robot

@k8s-triage-robot: Closing this issue, marking it as "Not Planned".

In response to this:

The Kubernetes project currently lacks enough active contributors to adequately respond to all issues and PRs.

This bot triages issues according to the following rules:

  • After 90d of inactivity, lifecycle/stale is applied
  • After 30d of inactivity since lifecycle/stale was applied, lifecycle/rotten is applied
  • After 30d of inactivity since lifecycle/rotten was applied, the issue is closed

You can:

  • Reopen this issue with /reopen
  • Mark this issue as fresh with /remove-lifecycle rotten
  • Offer to help out with Issue Triage

Please send feedback to sig-contributor-experience at kubernetes/community.

/close not-planned

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

k8s-ci-robot avatar Mar 23 '24 14:03 k8s-ci-robot