oci-cloud-controller-manager
oci-cloud-controller-manager copied to clipboard
Published
20 hours ago •
oracle
oracle
Deleting an attached block volume triggers too many delete requests
Is this a BUG REPORT or FEATURE REQUEST?
BUG REPORT
Versions
cloud-provider-oci Version:
iad.ocir.io/spinnaker/cloud-provider-oci:946500f9
What happened?
When the E2E tests deleted a volume that was still attached to an instance many requests to delete the volume were made in quick succession.
What you expected to happen?
A handful of requests are made at most (with exponential backoff).
How to reproduce it (as minimally and precisely as possible)?
Run the E2E tests and watch the logs of the block volume provisioner.
Anything else we need to know?
2018-10-30T08:54:31.079Z INFO record/event.go:221 Event(v1.ObjectReference{Kind:"PersistentVolumeClaim", Namespace:"volume-provisioner-e2e-tests-backup-restore-hpx8b", Name:"volume-provisioner-e2e-tests-pvcm4746-restored", UID:"5fc2e8c7-dc21-11e8-88a8-020017002d99", APIVersion:"v1", ResourceVersion:"1700266", FieldPath:""}): type: 'Normal' reason: 'ProvisioningSucceeded' Successfully provisioned volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna
2018-10-30T08:54:32.942Z INFO leaderelection/leaderelection.go:198 stopped trying to renew lease to provision for pvc volume-provisioner-e2e-tests-backup-restore-hpx8b/volume-provisioner-e2e-tests-pvcm4746-restored, task succeeded
2018-10-30T08:55:20.898Z INFO block/block.go:206 Deleting volume {"provisionerType": "oracle.com/oci", "compartmentID": "ocid1.compartment.oc1..aaaaaaaaujjg4lf3v6uaqeml7xfk7stzvrxeweaeyolhh75exuoqxpqjb4qq", "tenancyID": "ocid1.tenancy.oc1..aaaaaaaaxf3fuazosc6xng7l75rj6uist5jb6ken64t3qltimxnkymddqbma", "volumeID": "ocid1.volume.oc1.iad.abuwcljt33cwfklmh4boni7uzst5zgyeaeu3bsnow2misfnexkeme5zqqo6a"}
2018-10-30T08:55:20.996Z INFO controller/controller.go:1325 volume "ocid1.volume.oc1.iad.abuwcljt33cwfklmh4boni7uzst5zgyeaeu3bsnow2misfnexkeme5zqqo6a" deleted
2018-10-30T08:55:21.009Z INFO controller/controller.go:1336 volume "ocid1.volume.oc1.iad.abuwcljt33cwfklmh4boni7uzst5zgyeaeu3bsnow2misfnexkeme5zqqo6a" deleted from database
2018-10-30T08:55:21.037Z INFO block/block.go:206 Deleting volume {"provisionerType": "oracle.com/oci", "compartmentID": "ocid1.compartment.oc1..aaaaaaaaujjg4lf3v6uaqeml7xfk7stzvrxeweaeyolhh75exuoqxpqjb4qq", "tenancyID": "ocid1.tenancy.oc1..aaaaaaaaxf3fuazosc6xng7l75rj6uist5jb6ken64t3qltimxnkymddqbma", "volumeID": "ocid1.volume.oc1.iad.abuwcljt33cwfklmh4boni7uzst5zgyeaeu3bsnow2misfnexkeme5zqqo6a"}
2018-10-30T08:55:22.093Z INFO block/block.go:209 Volume not found. Presuming already deleted. {"provisionerType": "oracle.com/oci", "compartmentID": "ocid1.compartment.oc1..aaaaaaaaujjg4lf3v6uaqeml7xfk7stzvrxeweaeyolhh75exuoqxpqjb4qq", "tenancyID": "ocid1.tenancy.oc1..aaaaaaaaxf3fuazosc6xng7l75rj6uist5jb6ken64t3qltimxnkymddqbma", "volumeID": "ocid1.volume.oc1.iad.abuwcljt33cwfklmh4boni7uzst5zgyeaeu3bsnow2misfnexkeme5zqqo6a", "error": "Service error:NotAuthorizedOrNotFound. Authorization failed or requested resource not found.. http status code: 404", "errorVerbose": "Service error:NotAuthorizedOrNotFound. Authorization failed or requested resource not found.. http status code: 404\ngithub.com/oracle/oci-cloud-controller-manager/pkg/oci/client.(*client).DeleteVolume\n\t/go/src/github.com/oracle/oci-cloud-controller-manager/pkg/oci/client/block_storage.go:104\ngithub.com/oracle/oci-cloud-controller-manager/pkg/volume/provisioner/block.(*blockProvisioner).Delete\n\t/go/src/github.com/oracle/oci-cloud-controller-manager/pkg/volume/provisioner/block/block.go:207\ngithub.com/oracle/oci-cloud-controller-manager/pkg/volume/provisioner/core.(*OCIProvisioner).Delete\n\t/go/src/github.com/oracle/oci-cloud-controller-manager/pkg/volume/provisioner/core/provisioner.go:219\ngithub.com/oracle/oci-cloud-controller-manager/vendor/github.com/kubernetes-incubator/external-storage/lib/controller.(*ProvisionController).deleteVolumeOperation\n\t/go/src/github.com/oracle/oci-cloud-controller-manager/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:1312\ngithub.com/oracle/oci-cloud-controller-manager/vendor/github.com/kubernetes-incubator/external-storage/lib/controller.(*ProvisionController).syncVolume\n\t/go/src/github.com/oracle/oci-cloud-controller-manager/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:810\ngithub.com/oracle/oci-cloud-controller-manager/vendor/github.com/kubernetes-incubator/external-storage/lib/controller.(*ProvisionController).syncVolumeHandler\n\t/go/src/github.com/oracle/oci-cloud-controller-manager/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:774\ngithub.com/oracle/oci-cloud-controller-manager/vendor/github.com/kubernetes-incubator/external-storage/lib/controller.(*ProvisionController).processNextVolumeWorkItem.func1\n\t/go/src/github.com/oracle/oci-cloud-controller-manager/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:725\ngithub.com/oracle/oci-cloud-controller-manager/vendor/github.com/kubernetes-incubator/external-storage/lib/controller.(*ProvisionController).processNextVolumeWorkItem\n\t/go/src/github.com/oracle/oci-cloud-controller-manager/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:739\ngithub.com/oracle/oci-cloud-controller-manager/vendor/github.com/kubernetes-incubator/external-storage/lib/controller.(*ProvisionController).runVolumeWorker\n\t/go/src/github.com/oracle/oci-cloud-controller-manager/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:663\ngithub.com/oracle/oci-cloud-controller-manager/vendor/github.com/kubernetes-incubator/external-storage/lib/controller.(*ProvisionController).runVolumeWorker-fm\n\t/go/src/github.com/oracle/oci-cloud-controller-manager/vendor/github.com/kubernetes-incubator/external-storage/lib/controller/controller.go:649\ngithub.com/oracle/oci-cloud-controller-manager/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil.func1\n\t/go/src/github.com/oracle/oci-cloud-controller-manager/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:133\ngithub.com/oracle/oci-cloud-controller-manager/vendor/k8s.io/apimachinery/pkg/util/wait.JitterUntil\n\t/go/src/github.com/oracle/oci-cloud-controller-manager/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:134\ngithub.com/oracle/oci-cloud-controller-manager/vendor/k8s.io/apimachinery/pkg/util/wait.Until\n\t/go/src/github.com/oracle/oci-cloud-controller-manager/vendor/k8s.io/apimachinery/pkg/util/wait/wait.go:88\nruntime.goexit\n\t/tools/go/src/runtime/asm_amd64.s:1333"}
2018-10-30T08:55:22.093Z INFO controller/controller.go:1325 volume "ocid1.volume.oc1.iad.abuwcljt33cwfklmh4boni7uzst5zgyeaeu3bsnow2misfnexkeme5zqqo6a" deleted
2018-10-30T08:55:22.097Z INFO controller/controller.go:1332 failed to delete volume "ocid1.volume.oc1.iad.abuwcljt33cwfklmh4boni7uzst5zgyeaeu3bsnow2misfnexkeme5zqqo6a" from database: persistentvolumes "ocid1.volume.oc1.iad.abuwcljt33cwfklmh4boni7uzst5zgyeaeu3bsnow2misfnexkeme5zqqo6a" not found
2018-10-30T08:55:22.097Z WARN controller/controller.go:727 retrying syncing volume "ocid1.volume.oc1.iad.abuwcljt33cwfklmh4boni7uzst5zgyeaeu3bsnow2misfnexkeme5zqqo6a" because failures 0 < threshold 5
2018-10-30T08:55:22.097Z ERROR runtime/runtime.go:114 error syncing volume "ocid1.volume.oc1.iad.abuwcljt33cwfklmh4boni7uzst5zgyeaeu3bsnow2misfnexkeme5zqqo6a": persistentvolumes "ocid1.volume.oc1.iad.abuwcljt33cwfklmh4boni7uzst5zgyeaeu3bsnow2misfnexkeme5zqqo6a" not found
2018-10-30T08:55:22.097Z ERROR runtime/runtime.go:114 volume "ocid1.volume.oc1.iad.abuwcljt33cwfklmh4boni7uzst5zgyeaeu3bsnow2misfnexkeme5zqqo6a" in work queue no longer exists
2018-10-30T08:55:22.097Z ERROR runtime/runtime.go:114 volume "ocid1.volume.oc1.iad.abuwcljt33cwfklmh4boni7uzst5zgyeaeu3bsnow2misfnexkeme5zqqo6a" in work queue no longer exists
2018-10-30T08:55:27.866Z INFO block/block.go:206 Deleting volume {"provisionerType": "oracle.com/oci", "compartmentID": "ocid1.compartment.oc1..aaaaaaaaujjg4lf3v6uaqeml7xfk7stzvrxeweaeyolhh75exuoqxpqjb4qq", "tenancyID": "ocid1.tenancy.oc1..aaaaaaaaxf3fuazosc6xng7l75rj6uist5jb6ken64t3qltimxnkymddqbma", "volumeID": "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna"}
2018-10-30T08:55:27.932Z ERROR controller/controller.go:1320 Deletion of volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna" failed: failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:27.932Z WARN controller/controller.go:727 retrying syncing volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna" because failures 0 < threshold 5
2018-10-30T08:55:27.932Z ERROR runtime/runtime.go:114 error syncing volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna": failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:27.933Z INFO record/event.go:221 Event(v1.ObjectReference{Kind:"PersistentVolume", Namespace:"", Name:"ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna", UID:"6a54aff3-dc21-11e8-88a8-020017002d99", APIVersion:"v1", ResourceVersion:"1700535", FieldPath:""}): type: 'Warning' reason: 'VolumeFailedDelete' failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:27.936Z INFO block/block.go:206 Deleting volume {"provisionerType": "oracle.com/oci", "compartmentID": "ocid1.compartment.oc1..aaaaaaaaujjg4lf3v6uaqeml7xfk7stzvrxeweaeyolhh75exuoqxpqjb4qq", "tenancyID": "ocid1.tenancy.oc1..aaaaaaaaxf3fuazosc6xng7l75rj6uist5jb6ken64t3qltimxnkymddqbma", "volumeID": "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna"}
2018-10-30T08:55:28.017Z ERROR controller/controller.go:1320 Deletion of volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna" failed: failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:28.017Z WARN controller/controller.go:727 retrying syncing volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna" because failures 0 < threshold 5
2018-10-30T08:55:28.017Z ERROR runtime/runtime.go:114 error syncing volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna": failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:28.017Z INFO record/event.go:221 Event(v1.ObjectReference{Kind:"PersistentVolume", Namespace:"", Name:"ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna", UID:"6a54aff3-dc21-11e8-88a8-020017002d99", APIVersion:"v1", ResourceVersion:"1700535", FieldPath:""}): type: 'Warning' reason: 'VolumeFailedDelete' failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:28.020Z INFO block/block.go:206 Deleting volume {"provisionerType": "oracle.com/oci", "compartmentID": "ocid1.compartment.oc1..aaaaaaaaujjg4lf3v6uaqeml7xfk7stzvrxeweaeyolhh75exuoqxpqjb4qq", "tenancyID": "ocid1.tenancy.oc1..aaaaaaaaxf3fuazosc6xng7l75rj6uist5jb6ken64t3qltimxnkymddqbma", "volumeID": "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna"}
2018-10-30T08:55:28.095Z ERROR controller/controller.go:1320 Deletion of volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna" failed: failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:28.095Z WARN controller/controller.go:727 retrying syncing volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna" because failures 0 < threshold 5
2018-10-30T08:55:28.095Z ERROR runtime/runtime.go:114 error syncing volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna": failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:28.095Z INFO record/event.go:221 Event(v1.ObjectReference{Kind:"PersistentVolume", Namespace:"", Name:"ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna", UID:"6a54aff3-dc21-11e8-88a8-020017002d99", APIVersion:"v1", ResourceVersion:"1700535", FieldPath:""}): type: 'Warning' reason: 'VolumeFailedDelete' failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:28.099Z INFO block/block.go:206 Deleting volume {"provisionerType": "oracle.com/oci", "compartmentID": "ocid1.compartment.oc1..aaaaaaaaujjg4lf3v6uaqeml7xfk7stzvrxeweaeyolhh75exuoqxpqjb4qq", "tenancyID": "ocid1.tenancy.oc1..aaaaaaaaxf3fuazosc6xng7l75rj6uist5jb6ken64t3qltimxnkymddqbma", "volumeID": "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna"}
2018-10-30T08:55:28.155Z ERROR controller/controller.go:1320 Deletion of volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna" failed: failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:28.155Z WARN controller/controller.go:727 retrying syncing volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna" because failures 0 < threshold 5
2018-10-30T08:55:28.156Z INFO record/event.go:221 Event(v1.ObjectReference{Kind:"PersistentVolume", Namespace:"", Name:"ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna", UID:"6a54aff3-dc21-11e8-88a8-020017002d99", APIVersion:"v1", ResourceVersion:"1700535", FieldPath:""}): type: 'Warning' reason: 'VolumeFailedDelete' failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:28.155Z ERROR runtime/runtime.go:114 error syncing volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna": failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:28.158Z INFO block/block.go:206 Deleting volume {"provisionerType": "oracle.com/oci", "compartmentID": "ocid1.compartment.oc1..aaaaaaaaujjg4lf3v6uaqeml7xfk7stzvrxeweaeyolhh75exuoqxpqjb4qq", "tenancyID": "ocid1.tenancy.oc1..aaaaaaaaxf3fuazosc6xng7l75rj6uist5jb6ken64t3qltimxnkymddqbma", "volumeID": "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna"}
2018-10-30T08:55:29.096Z ERROR controller/controller.go:1320 Deletion of volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna" failed: failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:29.096Z WARN controller/controller.go:727 retrying syncing volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna" because failures 0 < threshold 5
2018-10-30T08:55:29.096Z ERROR runtime/runtime.go:114 error syncing volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna": failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:29.096Z INFO record/event.go:221 Event(v1.ObjectReference{Kind:"PersistentVolume", Namespace:"", Name:"ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna", UID:"6a54aff3-dc21-11e8-88a8-020017002d99", APIVersion:"v1", ResourceVersion:"1700535", FieldPath:""}): type: 'Warning' reason: 'VolumeFailedDelete' failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:29.101Z INFO block/block.go:206 Deleting volume {"provisionerType": "oracle.com/oci", "compartmentID": "ocid1.compartment.oc1..aaaaaaaaujjg4lf3v6uaqeml7xfk7stzvrxeweaeyolhh75exuoqxpqjb4qq", "tenancyID": "ocid1.tenancy.oc1..aaaaaaaaxf3fuazosc6xng7l75rj6uist5jb6ken64t3qltimxnkymddqbma", "volumeID": "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna"}
2018-10-30T08:55:29.135Z ERROR controller/controller.go:1320 Deletion of volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna" failed: failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:29.135Z WARN controller/controller.go:727 retrying syncing volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna" because failures 0 < threshold 5
2018-10-30T08:55:29.135Z ERROR runtime/runtime.go:114 error syncing volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna": failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:29.135Z INFO record/event.go:221 Event(v1.ObjectReference{Kind:"PersistentVolume", Namespace:"", Name:"ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna", UID:"6a54aff3-dc21-11e8-88a8-020017002d99", APIVersion:"v1", ResourceVersion:"1700535", FieldPath:""}): type: 'Warning' reason: 'VolumeFailedDelete' failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:29.138Z INFO block/block.go:206 Deleting volume {"provisionerType": "oracle.com/oci", "compartmentID": "ocid1.compartment.oc1..aaaaaaaaujjg4lf3v6uaqeml7xfk7stzvrxeweaeyolhh75exuoqxpqjb4qq", "tenancyID": "ocid1.tenancy.oc1..aaaaaaaaxf3fuazosc6xng7l75rj6uist5jb6ken64t3qltimxnkymddqbma", "volumeID": "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna"}
2018-10-30T08:55:29.222Z ERROR controller/controller.go:1320 Deletion of volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna" failed: failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:29.222Z WARN controller/controller.go:727 retrying syncing volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna" because failures 0 < threshold 5
2018-10-30T08:55:29.222Z ERROR runtime/runtime.go:114 error syncing volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna": failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:29.222Z INFO record/event.go:221 Event(v1.ObjectReference{Kind:"PersistentVolume", Namespace:"", Name:"ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna", UID:"6a54aff3-dc21-11e8-88a8-020017002d99", APIVersion:"v1", ResourceVersion:"1700535", FieldPath:""}): type: 'Warning' reason: 'VolumeFailedDelete' failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:29.227Z INFO block/block.go:206 Deleting volume {"provisionerType": "oracle.com/oci", "compartmentID": "ocid1.compartment.oc1..aaaaaaaaujjg4lf3v6uaqeml7xfk7stzvrxeweaeyolhh75exuoqxpqjb4qq", "tenancyID": "ocid1.tenancy.oc1..aaaaaaaaxf3fuazosc6xng7l75rj6uist5jb6ken64t3qltimxnkymddqbma", "volumeID": "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna"}
2018-10-30T08:55:29.310Z ERROR controller/controller.go:1320 Deletion of volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna" failed: failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:29.310Z WARN controller/controller.go:727 retrying syncing volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna" because failures 0 < threshold 5
2018-10-30T08:55:29.310Z ERROR runtime/runtime.go:114 error syncing volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna": failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:29.310Z INFO record/event.go:221 Event(v1.ObjectReference{Kind:"PersistentVolume", Namespace:"", Name:"ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna", UID:"6a54aff3-dc21-11e8-88a8-020017002d99", APIVersion:"v1", ResourceVersion:"1700535", FieldPath:""}): type: 'Warning' reason: 'VolumeFailedDelete' failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:29.314Z INFO block/block.go:206 Deleting volume {"provisionerType": "oracle.com/oci", "compartmentID": "ocid1.compartment.oc1..aaaaaaaaujjg4lf3v6uaqeml7xfk7stzvrxeweaeyolhh75exuoqxpqjb4qq", "tenancyID": "ocid1.tenancy.oc1..aaaaaaaaxf3fuazosc6xng7l75rj6uist5jb6ken64t3qltimxnkymddqbma", "volumeID": "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna"}
2018-10-30T08:55:29.393Z ERROR controller/controller.go:1320 Deletion of volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna" failed: failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:29.393Z WARN controller/controller.go:727 retrying syncing volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna" because failures 0 < threshold 5
2018-10-30T08:55:29.393Z ERROR runtime/runtime.go:114 error syncing volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna": failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:29.393Z INFO record/event.go:221 Event(v1.ObjectReference{Kind:"PersistentVolume", Namespace:"", Name:"ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna", UID:"6a54aff3-dc21-11e8-88a8-020017002d99", APIVersion:"v1", ResourceVersion:"1700535", FieldPath:""}): type: 'Warning' reason: 'VolumeFailedDelete' failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:29.453Z INFO block/block.go:206 Deleting volume {"provisionerType": "oracle.com/oci", "compartmentID": "ocid1.compartment.oc1..aaaaaaaaujjg4lf3v6uaqeml7xfk7stzvrxeweaeyolhh75exuoqxpqjb4qq", "tenancyID": "ocid1.tenancy.oc1..aaaaaaaaxf3fuazosc6xng7l75rj6uist5jb6ken64t3qltimxnkymddqbma", "volumeID": "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna"}
2018-10-30T08:55:29.502Z ERROR controller/controller.go:1320 Deletion of volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna" failed: failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:29.502Z WARN controller/controller.go:727 retrying syncing volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna" because failures 0 < threshold 5
2018-10-30T08:55:29.502Z ERROR runtime/runtime.go:114 error syncing volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna": failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:29.502Z INFO record/event.go:221 Event(v1.ObjectReference{Kind:"PersistentVolume", Namespace:"", Name:"ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna", UID:"6a54aff3-dc21-11e8-88a8-020017002d99", APIVersion:"v1", ResourceVersion:"1700535", FieldPath:""}): type: 'Warning' reason: 'VolumeFailedDelete' failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:29.853Z INFO block/block.go:206 Deleting volume {"provisionerType": "oracle.com/oci", "compartmentID": "ocid1.compartment.oc1..aaaaaaaaujjg4lf3v6uaqeml7xfk7stzvrxeweaeyolhh75exuoqxpqjb4qq", "tenancyID": "ocid1.tenancy.oc1..aaaaaaaaxf3fuazosc6xng7l75rj6uist5jb6ken64t3qltimxnkymddqbma", "volumeID": "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna"}
2018-10-30T08:55:30.442Z ERROR controller/controller.go:1320 Deletion of volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna" failed: failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:30.442Z WARN controller/controller.go:727 retrying syncing volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna" because failures 0 < threshold 5
2018-10-30T08:55:30.442Z ERROR runtime/runtime.go:114 error syncing volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna": failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:30.442Z INFO record/event.go:221 Event(v1.ObjectReference{Kind:"PersistentVolume", Namespace:"", Name:"ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna", UID:"6a54aff3-dc21-11e8-88a8-020017002d99", APIVersion:"v1", ResourceVersion:"1700535", FieldPath:""}): type: 'Warning' reason: 'VolumeFailedDelete' failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:30.453Z INFO block/block.go:206 Deleting volume {"provisionerType": "oracle.com/oci", "compartmentID": "ocid1.compartment.oc1..aaaaaaaaujjg4lf3v6uaqeml7xfk7stzvrxeweaeyolhh75exuoqxpqjb4qq", "tenancyID": "ocid1.tenancy.oc1..aaaaaaaaxf3fuazosc6xng7l75rj6uist5jb6ken64t3qltimxnkymddqbma", "volumeID": "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna"}
2018-10-30T08:55:30.504Z ERROR controller/controller.go:1320 Deletion of volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna" failed: failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:30.504Z WARN controller/controller.go:727 retrying syncing volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna" because failures 0 < threshold 5
2018-10-30T08:55:30.504Z ERROR runtime/runtime.go:114 error syncing volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna": failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:30.504Z INFO record/event.go:221 Event(v1.ObjectReference{Kind:"PersistentVolume", Namespace:"", Name:"ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna", UID:"6a54aff3-dc21-11e8-88a8-020017002d99", APIVersion:"v1", ResourceVersion:"1700535", FieldPath:""}): type: 'Warning' reason: 'VolumeFailedDelete' failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:30.653Z INFO block/block.go:206 Deleting volume {"provisionerType": "oracle.com/oci", "compartmentID": "ocid1.compartment.oc1..aaaaaaaaujjg4lf3v6uaqeml7xfk7stzvrxeweaeyolhh75exuoqxpqjb4qq", "tenancyID": "ocid1.tenancy.oc1..aaaaaaaaxf3fuazosc6xng7l75rj6uist5jb6ken64t3qltimxnkymddqbma", "volumeID": "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna"}
2018-10-30T08:55:30.752Z ERROR controller/controller.go:1320 Deletion of volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna" failed: failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:30.753Z WARN controller/controller.go:727 retrying syncing volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna" because failures 0 < threshold 5
2018-10-30T08:55:30.753Z ERROR runtime/runtime.go:114 error syncing volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna": failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:30.753Z INFO record/event.go:221 Event(v1.ObjectReference{Kind:"PersistentVolume", Namespace:"", Name:"ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna", UID:"6a54aff3-dc21-11e8-88a8-020017002d99", APIVersion:"v1", ResourceVersion:"1700535", FieldPath:""}): type: 'Warning' reason: 'VolumeFailedDelete' failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:31.053Z INFO block/block.go:206 Deleting volume {"provisionerType": "oracle.com/oci", "compartmentID": "ocid1.compartment.oc1..aaaaaaaaujjg4lf3v6uaqeml7xfk7stzvrxeweaeyolhh75exuoqxpqjb4qq", "tenancyID": "ocid1.tenancy.oc1..aaaaaaaaxf3fuazosc6xng7l75rj6uist5jb6ken64t3qltimxnkymddqbma", "volumeID": "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna"}
2018-10-30T08:55:31.136Z ERROR controller/controller.go:1320 Deletion of volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna" failed: failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:31.136Z WARN controller/controller.go:727 retrying syncing volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna" because failures 0 < threshold 5
2018-10-30T08:55:31.136Z ERROR runtime/runtime.go:114 error syncing volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna": failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:31.136Z INFO record/event.go:221 Event(v1.ObjectReference{Kind:"PersistentVolume", Namespace:"", Name:"ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna", UID:"6a54aff3-dc21-11e8-88a8-020017002d99", APIVersion:"v1", ResourceVersion:"1700535", FieldPath:""}): type: 'Warning' reason: 'VolumeFailedDelete' failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:31.453Z INFO block/block.go:206 Deleting volume {"provisionerType": "oracle.com/oci", "compartmentID": "ocid1.compartment.oc1..aaaaaaaaujjg4lf3v6uaqeml7xfk7stzvrxeweaeyolhh75exuoqxpqjb4qq", "tenancyID": "ocid1.tenancy.oc1..aaaaaaaaxf3fuazosc6xng7l75rj6uist5jb6ken64t3qltimxnkymddqbma", "volumeID": "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna"}
2018-10-30T08:55:31.504Z ERROR controller/controller.go:1320 Deletion of volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna" failed: failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:31.504Z WARN controller/controller.go:727 retrying syncing volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna" because failures 0 < threshold 5
2018-10-30T08:55:31.504Z ERROR runtime/runtime.go:114 error syncing volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna": failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:31.504Z INFO record/event.go:221 Event(v1.ObjectReference{Kind:"PersistentVolume", Namespace:"", Name:"ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna", UID:"6a54aff3-dc21-11e8-88a8-020017002d99", APIVersion:"v1", ResourceVersion:"1700535", FieldPath:""}): type: 'Warning' reason: 'VolumeFailedDelete' failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:31.853Z INFO block/block.go:206 Deleting volume {"provisionerType": "oracle.com/oci", "compartmentID": "ocid1.compartment.oc1..aaaaaaaaujjg4lf3v6uaqeml7xfk7stzvrxeweaeyolhh75exuoqxpqjb4qq", "tenancyID": "ocid1.tenancy.oc1..aaaaaaaaxf3fuazosc6xng7l75rj6uist5jb6ken64t3qltimxnkymddqbma", "volumeID": "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna"}
2018-10-30T08:55:32.116Z ERROR controller/controller.go:1320 Deletion of volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna" failed: failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:32.116Z WARN controller/controller.go:727 retrying syncing volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna" because failures 0 < threshold 5
2018-10-30T08:55:32.116Z ERROR runtime/runtime.go:114 error syncing volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna": failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:32.116Z INFO record/event.go:221 Event(v1.ObjectReference{Kind:"PersistentVolume", Namespace:"", Name:"ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna", UID:"6a54aff3-dc21-11e8-88a8-020017002d99", APIVersion:"v1", ResourceVersion:"1700535", FieldPath:""}): type: 'Warning' reason: 'VolumeFailedDelete' failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:32.253Z INFO block/block.go:206 Deleting volume {"provisionerType": "oracle.com/oci", "compartmentID": "ocid1.compartment.oc1..aaaaaaaaujjg4lf3v6uaqeml7xfk7stzvrxeweaeyolhh75exuoqxpqjb4qq", "tenancyID": "ocid1.tenancy.oc1..aaaaaaaaxf3fuazosc6xng7l75rj6uist5jb6ken64t3qltimxnkymddqbma", "volumeID": "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna"}
2018-10-30T08:55:32.339Z ERROR controller/controller.go:1320 Deletion of volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna" failed: failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:32.339Z WARN controller/controller.go:727 retrying syncing volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna" because failures 0 < threshold 5
2018-10-30T08:55:32.339Z ERROR runtime/runtime.go:114 error syncing volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna": failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:32.339Z INFO record/event.go:221 Event(v1.ObjectReference{Kind:"PersistentVolume", Namespace:"", Name:"ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna", UID:"6a54aff3-dc21-11e8-88a8-020017002d99", APIVersion:"v1", ResourceVersion:"1700535", FieldPath:""}): type: 'Warning' reason: 'VolumeFailedDelete' failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:32.653Z INFO block/block.go:206 Deleting volume {"provisionerType": "oracle.com/oci", "compartmentID": "ocid1.compartment.oc1..aaaaaaaaujjg4lf3v6uaqeml7xfk7stzvrxeweaeyolhh75exuoqxpqjb4qq", "tenancyID": "ocid1.tenancy.oc1..aaaaaaaaxf3fuazosc6xng7l75rj6uist5jb6ken64t3qltimxnkymddqbma", "volumeID": "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna"}
2018-10-30T08:55:32.729Z ERROR controller/controller.go:1320 Deletion of volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna" failed: failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:32.730Z WARN controller/controller.go:727 retrying syncing volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna" because failures 0 < threshold 5
2018-10-30T08:55:32.730Z ERROR runtime/runtime.go:114 error syncing volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna": failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:32.730Z INFO record/event.go:221 Event(v1.ObjectReference{Kind:"PersistentVolume", Namespace:"", Name:"ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna", UID:"6a54aff3-dc21-11e8-88a8-020017002d99", APIVersion:"v1", ResourceVersion:"1700535", FieldPath:""}): type: 'Warning' reason: 'VolumeFailedDelete' failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:33.055Z INFO block/block.go:206 Deleting volume {"provisionerType": "oracle.com/oci", "compartmentID": "ocid1.compartment.oc1..aaaaaaaaujjg4lf3v6uaqeml7xfk7stzvrxeweaeyolhh75exuoqxpqjb4qq", "tenancyID": "ocid1.tenancy.oc1..aaaaaaaaxf3fuazosc6xng7l75rj6uist5jb6ken64t3qltimxnkymddqbma", "volumeID": "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna"}
2018-10-30T08:55:33.130Z ERROR controller/controller.go:1320 Deletion of volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna" failed: failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:33.130Z WARN controller/controller.go:727 retrying syncing volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna" because failures 0 < threshold 5
2018-10-30T08:55:33.130Z ERROR runtime/runtime.go:114 error syncing volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna": failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:33.130Z INFO record/event.go:221 Event(v1.ObjectReference{Kind:"PersistentVolume", Namespace:"", Name:"ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna", UID:"6a54aff3-dc21-11e8-88a8-020017002d99", APIVersion:"v1", ResourceVersion:"1700535", FieldPath:""}): type: 'Warning' reason: 'VolumeFailedDelete' failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:33.453Z INFO block/block.go:206 Deleting volume {"provisionerType": "oracle.com/oci", "compartmentID": "ocid1.compartment.oc1..aaaaaaaaujjg4lf3v6uaqeml7xfk7stzvrxeweaeyolhh75exuoqxpqjb4qq", "tenancyID": "ocid1.tenancy.oc1..aaaaaaaaxf3fuazosc6xng7l75rj6uist5jb6ken64t3qltimxnkymddqbma", "volumeID": "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna"}
2018-10-30T08:55:33.525Z ERROR controller/controller.go:1320 Deletion of volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna" failed: failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:33.526Z WARN controller/controller.go:727 retrying syncing volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna" because failures 0 < threshold 5
2018-10-30T08:55:33.526Z ERROR runtime/runtime.go:114 error syncing volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna": failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:33.526Z INFO record/event.go:221 Event(v1.ObjectReference{Kind:"PersistentVolume", Namespace:"", Name:"ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna", UID:"6a54aff3-dc21-11e8-88a8-020017002d99", APIVersion:"v1", ResourceVersion:"1700535", FieldPath:""}): type: 'Warning' reason: 'VolumeFailedDelete' failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:33.853Z INFO block/block.go:206 Deleting volume {"provisionerType": "oracle.com/oci", "compartmentID": "ocid1.compartment.oc1..aaaaaaaaujjg4lf3v6uaqeml7xfk7stzvrxeweaeyolhh75exuoqxpqjb4qq", "tenancyID": "ocid1.tenancy.oc1..aaaaaaaaxf3fuazosc6xng7l75rj6uist5jb6ken64t3qltimxnkymddqbma", "volumeID": "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna"}
2018-10-30T08:55:33.928Z ERROR controller/controller.go:1320 Deletion of volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna" failed: failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:33.928Z WARN controller/controller.go:727 retrying syncing volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna" because failures 0 < threshold 5
2018-10-30T08:55:33.928Z ERROR runtime/runtime.go:114 error syncing volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna": failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:33.928Z INFO record/event.go:221 Event(v1.ObjectReference{Kind:"PersistentVolume", Namespace:"", Name:"ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna", UID:"6a54aff3-dc21-11e8-88a8-020017002d99", APIVersion:"v1", ResourceVersion:"1700535", FieldPath:""}): type: 'Warning' reason: 'VolumeFailedDelete' failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:34.253Z INFO block/block.go:206 Deleting volume {"provisionerType": "oracle.com/oci", "compartmentID": "ocid1.compartment.oc1..aaaaaaaaujjg4lf3v6uaqeml7xfk7stzvrxeweaeyolhh75exuoqxpqjb4qq", "tenancyID": "ocid1.tenancy.oc1..aaaaaaaaxf3fuazosc6xng7l75rj6uist5jb6ken64t3qltimxnkymddqbma", "volumeID": "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna"}
2018-10-30T08:55:34.454Z ERROR controller/controller.go:1320 Deletion of volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna" failed: failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:34.454Z WARN controller/controller.go:727 retrying syncing volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna" because failures 0 < threshold 5
2018-10-30T08:55:34.454Z ERROR runtime/runtime.go:114 error syncing volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna": failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:34.454Z INFO record/event.go:221 Event(v1.ObjectReference{Kind:"PersistentVolume", Namespace:"", Name:"ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna", UID:"6a54aff3-dc21-11e8-88a8-020017002d99", APIVersion:"v1", ResourceVersion:"1700535", FieldPath:""}): type: 'Warning' reason: 'VolumeFailedDelete' failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:34.653Z INFO block/block.go:206 Deleting volume {"provisionerType": "oracle.com/oci", "compartmentID": "ocid1.compartment.oc1..aaaaaaaaujjg4lf3v6uaqeml7xfk7stzvrxeweaeyolhh75exuoqxpqjb4qq", "tenancyID": "ocid1.tenancy.oc1..aaaaaaaaxf3fuazosc6xng7l75rj6uist5jb6ken64t3qltimxnkymddqbma", "volumeID": "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna"}
2018-10-30T08:55:34.729Z ERROR controller/controller.go:1320 Deletion of volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna" failed: failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:34.729Z WARN controller/controller.go:727 retrying syncing volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna" because failures 0 < threshold 5
2018-10-30T08:55:34.729Z ERROR runtime/runtime.go:114 error syncing volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna": failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:34.729Z INFO record/event.go:221 Event(v1.ObjectReference{Kind:"PersistentVolume", Namespace:"", Name:"ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna", UID:"6a54aff3-dc21-11e8-88a8-020017002d99", APIVersion:"v1", ResourceVersion:"1700535", FieldPath:""}): type: 'Warning' reason: 'VolumeFailedDelete' failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:35.053Z INFO block/block.go:206 Deleting volume {"provisionerType": "oracle.com/oci", "compartmentID": "ocid1.compartment.oc1..aaaaaaaaujjg4lf3v6uaqeml7xfk7stzvrxeweaeyolhh75exuoqxpqjb4qq", "tenancyID": "ocid1.tenancy.oc1..aaaaaaaaxf3fuazosc6xng7l75rj6uist5jb6ken64t3qltimxnkymddqbma", "volumeID": "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna"}
2018-10-30T08:55:35.127Z ERROR controller/controller.go:1320 Deletion of volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna" failed: failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:35.127Z WARN controller/controller.go:727 retrying syncing volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna" because failures 0 < threshold 5
2018-10-30T08:55:35.127Z ERROR runtime/runtime.go:114 error syncing volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna": failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:35.127Z INFO record/event.go:221 Event(v1.ObjectReference{Kind:"PersistentVolume", Namespace:"", Name:"ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna", UID:"6a54aff3-dc21-11e8-88a8-020017002d99", APIVersion:"v1", ResourceVersion:"1700535", FieldPath:""}): type: 'Warning' reason: 'VolumeFailedDelete' failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:35.453Z INFO block/block.go:206 Deleting volume {"provisionerType": "oracle.com/oci", "compartmentID": "ocid1.compartment.oc1..aaaaaaaaujjg4lf3v6uaqeml7xfk7stzvrxeweaeyolhh75exuoqxpqjb4qq", "tenancyID": "ocid1.tenancy.oc1..aaaaaaaaxf3fuazosc6xng7l75rj6uist5jb6ken64t3qltimxnkymddqbma", "volumeID": "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna"}
2018-10-30T08:55:35.532Z ERROR controller/controller.go:1320 Deletion of volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna" failed: failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:35.532Z WARN controller/controller.go:727 retrying syncing volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna" because failures 0 < threshold 5
2018-10-30T08:55:35.532Z ERROR runtime/runtime.go:114 error syncing volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna": failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:35.532Z INFO record/event.go:221 Event(v1.ObjectReference{Kind:"PersistentVolume", Namespace:"", Name:"ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna", UID:"6a54aff3-dc21-11e8-88a8-020017002d99", APIVersion:"v1", ResourceVersion:"1700535", FieldPath:""}): type: 'Warning' reason: 'VolumeFailedDelete' failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:35.853Z INFO block/block.go:206 Deleting volume {"provisionerType": "oracle.com/oci", "compartmentID": "ocid1.compartment.oc1..aaaaaaaaujjg4lf3v6uaqeml7xfk7stzvrxeweaeyolhh75exuoqxpqjb4qq", "tenancyID": "ocid1.tenancy.oc1..aaaaaaaaxf3fuazosc6xng7l75rj6uist5jb6ken64t3qltimxnkymddqbma", "volumeID": "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna"}
2018-10-30T08:55:35.889Z ERROR controller/controller.go:1320 Deletion of volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna" failed: failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:35.889Z WARN controller/controller.go:727 retrying syncing volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna" because failures 0 < threshold 5
2018-10-30T08:55:35.889Z ERROR runtime/runtime.go:114 error syncing volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna": failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:35.889Z INFO record/event.go:221 Event(v1.ObjectReference{Kind:"PersistentVolume", Namespace:"", Name:"ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna", UID:"6a54aff3-dc21-11e8-88a8-020017002d99", APIVersion:"v1", ResourceVersion:"1700535", FieldPath:""}): type: 'Warning' reason: 'VolumeFailedDelete' failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:36.253Z INFO block/block.go:206 Deleting volume {"provisionerType": "oracle.com/oci", "compartmentID": "ocid1.compartment.oc1..aaaaaaaaujjg4lf3v6uaqeml7xfk7stzvrxeweaeyolhh75exuoqxpqjb4qq", "tenancyID": "ocid1.tenancy.oc1..aaaaaaaaxf3fuazosc6xng7l75rj6uist5jb6ken64t3qltimxnkymddqbma", "volumeID": "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna"}
2018-10-30T08:55:37.221Z ERROR controller/controller.go:1320 Deletion of volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna" failed: failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:37.221Z WARN controller/controller.go:727 retrying syncing volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna" because failures 0 < threshold 5
2018-10-30T08:55:37.221Z INFO record/event.go:221 Event(v1.ObjectReference{Kind:"PersistentVolume", Namespace:"", Name:"ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna", UID:"6a54aff3-dc21-11e8-88a8-020017002d99", APIVersion:"v1", ResourceVersion:"1700535", FieldPath:""}): type: 'Warning' reason: 'VolumeFailedDelete' failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:37.221Z ERROR runtime/runtime.go:114 error syncing volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna": failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:37.224Z INFO block/block.go:206 Deleting volume {"provisionerType": "oracle.com/oci", "compartmentID": "ocid1.compartment.oc1..aaaaaaaaujjg4lf3v6uaqeml7xfk7stzvrxeweaeyolhh75exuoqxpqjb4qq", "tenancyID": "ocid1.tenancy.oc1..aaaaaaaaxf3fuazosc6xng7l75rj6uist5jb6ken64t3qltimxnkymddqbma", "volumeID": "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna"}
2018-10-30T08:55:37.341Z ERROR controller/controller.go:1320 Deletion of volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna" failed: failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:37.341Z WARN controller/controller.go:727 retrying syncing volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna" because failures 0 < threshold 5
2018-10-30T08:55:37.341Z ERROR runtime/runtime.go:114 error syncing volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna": failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:37.341Z INFO record/event.go:221 Event(v1.ObjectReference{Kind:"PersistentVolume", Namespace:"", Name:"ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna", UID:"6a54aff3-dc21-11e8-88a8-020017002d99", APIVersion:"v1", ResourceVersion:"1700535", FieldPath:""}): type: 'Warning' reason: 'VolumeFailedDelete' failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:37.343Z INFO block/block.go:206 Deleting volume {"provisionerType": "oracle.com/oci", "compartmentID": "ocid1.compartment.oc1..aaaaaaaaujjg4lf3v6uaqeml7xfk7stzvrxeweaeyolhh75exuoqxpqjb4qq", "tenancyID": "ocid1.tenancy.oc1..aaaaaaaaxf3fuazosc6xng7l75rj6uist5jb6ken64t3qltimxnkymddqbma", "volumeID": "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna"}
2018-10-30T08:55:37.387Z ERROR controller/controller.go:1320 Deletion of volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna" failed: failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:37.388Z WARN controller/controller.go:727 retrying syncing volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna" because failures 0 < threshold 5
2018-10-30T08:55:37.388Z INFO record/event.go:221 Event(v1.ObjectReference{Kind:"PersistentVolume", Namespace:"", Name:"ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna", UID:"6a54aff3-dc21-11e8-88a8-020017002d99", APIVersion:"v1", ResourceVersion:"1700535", FieldPath:""}): type: 'Warning' reason: 'VolumeFailedDelete' failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:37.388Z ERROR runtime/runtime.go:114 error syncing volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna": failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:37.392Z INFO block/block.go:206 Deleting volume {"provisionerType": "oracle.com/oci", "compartmentID": "ocid1.compartment.oc1..aaaaaaaaujjg4lf3v6uaqeml7xfk7stzvrxeweaeyolhh75exuoqxpqjb4qq", "tenancyID": "ocid1.tenancy.oc1..aaaaaaaaxf3fuazosc6xng7l75rj6uist5jb6ken64t3qltimxnkymddqbma", "volumeID": "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna"}
2018-10-30T08:55:37.430Z ERROR controller/controller.go:1320 Deletion of volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna" failed: failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:37.431Z WARN controller/controller.go:727 retrying syncing volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna" because failures 0 < threshold 5
2018-10-30T08:55:37.431Z ERROR runtime/runtime.go:114 error syncing volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna": failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:37.431Z INFO record/event.go:221 Event(v1.ObjectReference{Kind:"PersistentVolume", Namespace:"", Name:"ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna", UID:"6a54aff3-dc21-11e8-88a8-020017002d99", APIVersion:"v1", ResourceVersion:"1700535", FieldPath:""}): type: 'Warning' reason: 'VolumeFailedDelete' failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:37.433Z INFO block/block.go:206 Deleting volume {"provisionerType": "oracle.com/oci", "compartmentID": "ocid1.compartment.oc1..aaaaaaaaujjg4lf3v6uaqeml7xfk7stzvrxeweaeyolhh75exuoqxpqjb4qq", "tenancyID": "ocid1.tenancy.oc1..aaaaaaaaxf3fuazosc6xng7l75rj6uist5jb6ken64t3qltimxnkymddqbma", "volumeID": "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna"}
2018-10-30T08:55:37.555Z ERROR controller/controller.go:1320 Deletion of volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna" failed: failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:37.555Z WARN controller/controller.go:727 retrying syncing volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna" because failures 0 < threshold 5
2018-10-30T08:55:37.555Z ERROR runtime/runtime.go:114 error syncing volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna": failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:37.556Z INFO record/event.go:221 Event(v1.ObjectReference{Kind:"PersistentVolume", Namespace:"", Name:"ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna", UID:"6a54aff3-dc21-11e8-88a8-020017002d99", APIVersion:"v1", ResourceVersion:"1700535", FieldPath:""}): type: 'Warning' reason: 'VolumeFailedDelete' failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:37.559Z INFO block/block.go:206 Deleting volume {"provisionerType": "oracle.com/oci", "compartmentID": "ocid1.compartment.oc1..aaaaaaaaujjg4lf3v6uaqeml7xfk7stzvrxeweaeyolhh75exuoqxpqjb4qq", "tenancyID": "ocid1.tenancy.oc1..aaaaaaaaxf3fuazosc6xng7l75rj6uist5jb6ken64t3qltimxnkymddqbma", "volumeID": "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna"}
2018-10-30T08:55:37.642Z ERROR controller/controller.go:1320 Deletion of volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna" failed: failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:37.642Z WARN controller/controller.go:727 retrying syncing volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna" because failures 0 < threshold 5
2018-10-30T08:55:37.642Z ERROR runtime/runtime.go:114 error syncing volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna": failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:37.642Z INFO record/event.go:221 Event(v1.ObjectReference{Kind:"PersistentVolume", Namespace:"", Name:"ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna", UID:"6a54aff3-dc21-11e8-88a8-020017002d99", APIVersion:"v1", ResourceVersion:"1700535", FieldPath:""}): type: 'Warning' reason: 'VolumeFailedDelete' failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:37.650Z INFO block/block.go:206 Deleting volume {"provisionerType": "oracle.com/oci", "compartmentID": "ocid1.compartment.oc1..aaaaaaaaujjg4lf3v6uaqeml7xfk7stzvrxeweaeyolhh75exuoqxpqjb4qq", "tenancyID": "ocid1.tenancy.oc1..aaaaaaaaxf3fuazosc6xng7l75rj6uist5jb6ken64t3qltimxnkymddqbma", "volumeID": "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna"}
2018-10-30T08:55:37.767Z ERROR controller/controller.go:1320 Deletion of volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna" failed: failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:37.767Z WARN controller/controller.go:727 retrying syncing volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna" because failures 0 < threshold 5
2018-10-30T08:55:37.767Z ERROR runtime/runtime.go:114 error syncing volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna": failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:37.769Z INFO record/event.go:221 Event(v1.ObjectReference{Kind:"PersistentVolume", Namespace:"", Name:"ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna", UID:"6a54aff3-dc21-11e8-88a8-020017002d99", APIVersion:"v1", ResourceVersion:"1700535", FieldPath:""}): type: 'Warning' reason: 'VolumeFailedDelete' failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:37.771Z INFO block/block.go:206 Deleting volume {"provisionerType": "oracle.com/oci", "compartmentID": "ocid1.compartment.oc1..aaaaaaaaujjg4lf3v6uaqeml7xfk7stzvrxeweaeyolhh75exuoqxpqjb4qq", "tenancyID": "ocid1.tenancy.oc1..aaaaaaaaxf3fuazosc6xng7l75rj6uist5jb6ken64t3qltimxnkymddqbma", "volumeID": "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna"}
2018-10-30T08:55:37.859Z ERROR controller/controller.go:1320 Deletion of volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna" failed: failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:37.859Z WARN controller/controller.go:727 retrying syncing volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna" because failures 0 < threshold 5
2018-10-30T08:55:37.859Z ERROR runtime/runtime.go:114 error syncing volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna": failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:37.860Z INFO record/event.go:221 Event(v1.ObjectReference{Kind:"PersistentVolume", Namespace:"", Name:"ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna", UID:"6a54aff3-dc21-11e8-88a8-020017002d99", APIVersion:"v1", ResourceVersion:"1700535", FieldPath:""}): type: 'Warning' reason: 'VolumeFailedDelete' failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:37.862Z INFO block/block.go:206 Deleting volume {"provisionerType": "oracle.com/oci", "compartmentID": "ocid1.compartment.oc1..aaaaaaaaujjg4lf3v6uaqeml7xfk7stzvrxeweaeyolhh75exuoqxpqjb4qq", "tenancyID": "ocid1.tenancy.oc1..aaaaaaaaxf3fuazosc6xng7l75rj6uist5jb6ken64t3qltimxnkymddqbma", "volumeID": "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna"}
2018-10-30T08:55:37.897Z ERROR controller/controller.go:1320 Deletion of volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna" failed: failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:37.897Z WARN controller/controller.go:727 retrying syncing volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna" because failures 0 < threshold 5
2018-10-30T08:55:37.897Z ERROR runtime/runtime.go:114 error syncing volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna": failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:37.897Z INFO record/event.go:221 Event(v1.ObjectReference{Kind:"PersistentVolume", Namespace:"", Name:"ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna", UID:"6a54aff3-dc21-11e8-88a8-020017002d99", APIVersion:"v1", ResourceVersion:"1700535", FieldPath:""}): type: 'Warning' reason: 'VolumeFailedDelete' failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:38.068Z INFO block/block.go:206 Deleting volume {"provisionerType": "oracle.com/oci", "compartmentID": "ocid1.compartment.oc1..aaaaaaaaujjg4lf3v6uaqeml7xfk7stzvrxeweaeyolhh75exuoqxpqjb4qq", "tenancyID": "ocid1.tenancy.oc1..aaaaaaaaxf3fuazosc6xng7l75rj6uist5jb6ken64t3qltimxnkymddqbma", "volumeID": "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna"}
2018-10-30T08:55:38.154Z ERROR controller/controller.go:1320 Deletion of volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna" failed: failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:38.154Z WARN controller/controller.go:727 retrying syncing volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna" because failures 0 < threshold 5
2018-10-30T08:55:38.154Z ERROR runtime/runtime.go:114 error syncing volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna": failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:38.154Z INFO record/event.go:221 Event(v1.ObjectReference{Kind:"PersistentVolume", Namespace:"", Name:"ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna", UID:"6a54aff3-dc21-11e8-88a8-020017002d99", APIVersion:"v1", ResourceVersion:"1700535", FieldPath:""}): type: 'Warning' reason: 'VolumeFailedDelete' failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:38.253Z INFO block/block.go:206 Deleting volume {"provisionerType": "oracle.com/oci", "compartmentID": "ocid1.compartment.oc1..aaaaaaaaujjg4lf3v6uaqeml7xfk7stzvrxeweaeyolhh75exuoqxpqjb4qq", "tenancyID": "ocid1.tenancy.oc1..aaaaaaaaxf3fuazosc6xng7l75rj6uist5jb6ken64t3qltimxnkymddqbma", "volumeID": "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna"}
2018-10-30T08:55:38.331Z ERROR controller/controller.go:1320 Deletion of volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna" failed: failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:38.331Z WARN controller/controller.go:727 retrying syncing volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna" because failures 0 < threshold 5
2018-10-30T08:55:38.331Z ERROR runtime/runtime.go:114 error syncing volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna": failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:38.331Z INFO record/event.go:221 Event(v1.ObjectReference{Kind:"PersistentVolume", Namespace:"", Name:"ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna", UID:"6a54aff3-dc21-11e8-88a8-020017002d99", APIVersion:"v1", ResourceVersion:"1700535", FieldPath:""}): type: 'Warning' reason: 'VolumeFailedDelete' failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:38.453Z INFO block/block.go:206 Deleting volume {"provisionerType": "oracle.com/oci", "compartmentID": "ocid1.compartment.oc1..aaaaaaaaujjg4lf3v6uaqeml7xfk7stzvrxeweaeyolhh75exuoqxpqjb4qq", "tenancyID": "ocid1.tenancy.oc1..aaaaaaaaxf3fuazosc6xng7l75rj6uist5jb6ken64t3qltimxnkymddqbma", "volumeID": "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna"}
2018-10-30T08:55:38.549Z ERROR controller/controller.go:1320 Deletion of volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna" failed: failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:38.549Z WARN controller/controller.go:727 retrying syncing volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna" because failures 0 < threshold 5
2018-10-30T08:55:38.549Z ERROR runtime/runtime.go:114 error syncing volume "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna": failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:38.549Z INFO record/event.go:221 Event(v1.ObjectReference{Kind:"PersistentVolume", Namespace:"", Name:"ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna", UID:"6a54aff3-dc21-11e8-88a8-020017002d99", APIVersion:"v1", ResourceVersion:"1700535", FieldPath:""}): type: 'Warning' reason: 'VolumeFailedDelete' failed to delete volume from OCI: Service error:Conflict. Volume ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna may not be deleted while attached to an Instance.. http status code: 409
2018-10-30T08:55:38.653Z INFO block/block.go:206 Deleting volume {"provisionerType": "oracle.com/oci", "compartmentID": "ocid1.compartment.oc1..aaaaaaaaujjg4lf3v6uaqeml7xfk7stzvrxeweaeyolhh75exuoqxpqjb4qq", "tenancyID": "ocid1.tenancy.oc1..aaaaaaaaxf3fuazosc6xng7l75rj6uist5jb6ken64t3qltimxnkymddqbma", "volumeID": "ocid1.volume.oc1.iad.abuwcljtaitlqrk3p6q6daui46xgjpb6dy5o5r77z4g2b3bbgfb4iuhzyhna"}
