velero-plugin-for-vsphere
velero-plugin-for-vsphere copied to clipboard
Published
20 hours ago •
vmware-tanzu
vmware-tanzu
Thin-provisioned VMDKs inflated during upload process
Overview
It appears that thin-provisioned VMDKs on the datastore are being inflated during upload process to S3-compatible storage.
Is there any roadmap to being able to upload the thin VMDKs or otherwise save space, or have I otherwise misunderstood?
You can see in the logs and the minio snapshot below that 3G has been uploaded whereas in the vSphere snapshot, the different disk components don't sum up to nearly that much.
Additional information
velero deployment images
image: velero/velero:v1.5.2
image: velero/velero-plugin-for-aws:v1.1.0
image: velero/velero-plugin-for-microsoft-azure:v1.1.0
image: vsphereveleroplugin/velero-plugin-for-vsphere:1.1.0
image: velero/velero-plugin-for-csi:v0.1.2
Persistent volume
apiVersion: v1
kind: PersistentVolumeClaim
metadata:
labels:
example-vsphere-csi-backup: "yes"
name: example-vsphere-csi-v2-volume
namespace: default
spec:
accessModes:
- ReadWriteOnce
resources:
requests:
storage: 3Gi
storageClassName: vsphere-csi-v2
Backup
apiVersion: velero.io/v1
kind: Backup
metadata:
labels:
velero.io/storage-location: minio-gateway
name: example-vsphere-csi-v2-backup-2021-02-02t15-48-08-00
namespace: backup
spec:
defaultVolumesToRestic: true
includedNamespaces:
- default
labelSelector:
matchExpressions:
- key: example-vsphere-csi-backup
operator: Exists
storageLocation: minio-gateway
ttl: 720h0m0s
volumeSnapshotLocations:
- vsl-vsphere
minio pod and service
apiVersion: v1
kind: Pod
metadata:
labels:
run: minio-gateway
name: minio-gateway
namespace: backup
spec:
containers:
- args:
- gateway
- azure
envFrom:
- secretRef:
name: minio-azure-credentials
image: minio/minio
imagePullPolicy: Always
name: minio-gateway
---
apiVersion: v1
kind: Service
metadata:
name: minio-gateway
namespace: backup
spec:
selector:
run: minio-gateway
ports:
- protocol: TCP
port: 80
targetPort: 9000
BackupStorageLocation
apiVersion: velero.io/v1
kind: BackupStorageLocation
metadata:
name: minio-gateway
namespace: backup
spec:
backupSyncPeriod: 2m0s
provider: aws
objectStorage:
bucket: velero
prefix: example-prefix
config:
region: minio
s3ForcePathStyle: "true"
s3Url: http://minio-gateway.backup.svc
# AWS profile within the credentials file to use for the backup storage location.
# This is mounted within the velero pod
profile: default
time="2021-02-02T23:41:58Z" level=info msg="Starting data manager server 1.1.0-rc6 (b29517b6a79ced28d8d14d5ab69e38388fec259b-dirty)" logSource="/go/src/github.com/vmware-tanzu/velero-plugin-for-vsphere/pkg/cmd/datamgr/cli/server/server.go:112"
time="2021-02-02T23:41:58Z" level=info msg="data manager server is started" logSource="/go/src/github.com/vmware-tanzu/velero-plugin-for-vsphere/pkg/cmd/datamgr/cli/server/server.go:216"
time="2021-02-02T23:41:58Z" level=info msg="VC Configuration will be retrieved from cluster secret" logSource="/go/src/github.com/vmware-tanzu/velero-plugin-for-vsphere/pkg/cmd/datamgr/cli/server/server.go:237"
time="2021-02-02T23:41:58Z" level=info msg="SnapshotManager: vSphere VC credential is retrieved" logSource="/go/src/github.com/vmware-tanzu/velero-plugin-for-vsphere/pkg/snapshotmgr/snapshot_manager.go:120"
time="2021-02-02T23:41:58Z" level=info msg="Initializing IVD Protected Entity Manager" logSource="/go/pkg/mod/github.com/vmware-tanzu/[email protected]/pkg/ivd/ivd_protected_entity_type_manager.go:53"
time="2021-02-02T23:41:58Z" level=info msg="Loading new IVD Protected Entity Manager" logSource="/go/pkg/mod/github.com/vmware-tanzu/[email protected]/pkg/ivd/ivd_protected_entity_type_manager.go:58"
time="2021-02-02T23:41:58Z" level=info msg="Detected VirtualCenterConfig change during periodic reload." logSource="/go/pkg/mod/github.com/vmware-tanzu/[email protected]/pkg/ivd/ivd_protected_entity_type_manager.go:303"
time="2021-02-02T23:41:58Z" level=info msg="Attempting login for user: [email protected]" logSource="/go/pkg/mod/github.com/vmware-tanzu/[email protected]/pkg/common/vsphere/virtual_center.go:164"
time="2021-02-02T23:41:58Z" level=info msg="New session ID for 'VSPHERE.LOCAL\\vsphere-velero' = 52e32a27-11a4-a93e-41bd-c78505923a12" logSource="/go/pkg/mod/github.com/vmware-tanzu/[email protected]/pkg/common/vsphere/virtual_center.go:151"
time="2021-02-02T23:41:58Z" level=info msg="Initializing VSLM Manager" logSource="/go/pkg/mod/github.com/vmware-tanzu/[email protected]/pkg/ivd/ivd_protected_entity_type_manager.go:320"
time="2021-02-02T23:41:58Z" level=info msg="Initializing new VslmManager..." logSource="/go/pkg/mod/github.com/vmware-tanzu/[email protected]/pkg/common/vsphere/vslm_manager.go:24"
time="2021-02-02T23:41:58Z" level=info msg="Initializing CNS Manager" logSource="/go/pkg/mod/github.com/vmware-tanzu/[email protected]/pkg/ivd/ivd_protected_entity_type_manager.go:331"
time="2021-02-02T23:41:58Z" level=info msg="Initializing new CnsManager..." logSource="/go/pkg/mod/github.com/vmware-tanzu/[email protected]/pkg/common/vsphere/cns_manager.go:20"
2021-02-02T23:41:59.148Z info -[00009] [Originator@6876 sub=Default] Glibc malloc guards disabled.
2021-02-02T23:41:59.148Z info -[00009] [Originator@6876 sub=Default] Initialized SystemFactory
2021-02-02T23:41:59.148Z warning -[00009] [Originator@6876 sub=Default] Unrecognized log/level '' using 'info'
2021-02-02T23:41:59.148Z info -[00009] [Originator@6876 sub=Default] Logging uses fast path: true
2021-02-02T23:41:59.148Z info -[00009] [Originator@6876 sub=Libs] DictionaryLoad: Cannot open file "/etc/vmware/vsphereFeatures/techPreview.cfg": No such file or directory.
2021-02-02T23:41:59.148Z info -[00009] [Originator@6876 sub=Libs] [msg.dictionary.load.openFailed] Cannot open file "/etc/vmware/vsphereFeatures/techPreview.cfg": No such file or directory.
2021-02-02T23:41:59.148Z info -[00009] [Originator@6876 sub=Libs] FeatureStateLib: Error while loading tech preview config file: /etc/vmware/vsphereFeatures/techPreview.cfg, using default (disabled) for all Tech Preview features.
2021-02-02T23:41:59.148Z info -[00009] [Originator@6876 sub=Default] The bora/lib logs WILL be handled by VmaCore
2021-02-02T23:41:59.148Z info -[00009] [Originator@6876 sub=Default] Initialized channel manager
2021-02-02T23:41:59.148Z info -[00009] [Originator@6876 sub=Default] Current working directory: /
2021-02-02T23:41:59.148Z info -[00009] [Originator@6876 sub=ThreadPool] Catch work item exceptions disabled.
2021-02-02T23:41:59.148Z info -[00009] [Originator@6876 sub=FairScheduler] Priority level 4 is now active.
2021-02-02T23:41:59.148Z info -[00009] [Originator@6876 sub=WorkQueue.vmacoreDefaultIOCompletionQueue] Created: WorkQueue.vmacoreDefaultIOCompletionQueue, type = fair, priority = 4, itemWeight = 1
2021-02-02T23:41:59.148Z info -[00009] [Originator@6876 sub=FairScheduler] Priority level 8 is now active.
2021-02-02T23:41:59.148Z info -[00009] [Originator@6876 sub=WorkQueue.vmacoreDefaultIOQueue] Created: WorkQueue.vmacoreDefaultIOQueue, type = fair, priority = 8, itemWeight = 1
2021-02-02T23:41:59.148Z info -[00009] [Originator@6876 sub=FairScheduler] Priority level 16 is now active.
2021-02-02T23:41:59.148Z info -[00009] [Originator@6876 sub=WorkQueue.vmacoreDefaultLongTaskQueue] Created: WorkQueue.vmacoreDefaultLongTaskQueue, type = fair, priority = 16, itemWeight = 1
2021-02-02T23:41:59.148Z info -[00009] [Originator@6876 sub=ThreadPool] Registered foreign worker - allocated: 1, idle: 0
2021-02-02T23:41:59.148Z info -[00009] [Originator@6876 sub=ThreadPool] Registered foreign worker - allocated: 2, idle: 0
2021-02-02T23:41:59.148Z info -[00009] [Originator@6876 sub=ThreadPool] Registered foreign worker - allocated: 3, idle: 0
2021-02-02T23:41:59.148Z info -[00009] [Originator@6876 sub=ThreadPool] Registered foreign worker - allocated: 4, idle: 0
2021-02-02T23:41:59.148Z info -[00018] [Originator@6876 sub=ThreadPool] Thread enlisted
2021-02-02T23:41:59.148Z info -[00018] [Originator@6876 sub=ThreadPool] Entering worker thread loop
2021-02-02T23:41:59.149Z info -[00019] [Originator@6876 sub=ThreadPool] Thread enlisted
2021-02-02T23:41:59.149Z info -[00019] [Originator@6876 sub=ThreadPool] Entering worker thread loop
2021-02-02T23:41:59.149Z info -[00020] [Originator@6876 sub=ThreadPool] Thread enlisted
2021-02-02T23:41:59.149Z info -[00020] [Originator@6876 sub=ThreadPool] Entering worker thread loop
2021-02-02T23:41:59.149Z info -[00021] [Originator@6876 sub=ThreadPool] Thread enlisted
2021-02-02T23:41:59.149Z info -[00021] [Originator@6876 sub=ThreadPool] Entering worker thread loop
2021-02-02T23:41:59.149Z info -[00022] [Originator@6876 sub=ThreadPool] Thread enlisted
2021-02-02T23:41:59.149Z info -[00022] [Originator@6876 sub=ThreadPool] Entering IO thread loop
2021-02-02T23:41:59.149Z info -[00009] [Originator@6876 sub=ThreadPool] Thread pool fair initial threads spawned. IO: 2, Min workers: 4, Max workers: 13, Reservation ratio: 9
2021-02-02T23:41:59.149Z info -[00009] [Originator@6876 sub=ThreadPool] Thread enlisted
2021-02-02T23:41:59.149Z info -[00023] [Originator@6876 sub=ThreadPool] Thread enlisted
2021-02-02T23:41:59.149Z info -[00009] [Originator@6876 sub=Default] Syscommand enabled: true
2021-02-02T23:41:59.149Z info -[00023] [Originator@6876 sub=ThreadPool] Entering IO thread loop
2021-02-02T23:41:59.149Z info -[00009] [Originator@6876 sub=Default] ReaperManager Initialized
2021-02-02T23:41:59.149Z info -[00024] [Originator@6876 sub=ThreadPool] Thread enlisted
2021-02-02T23:41:59.149Z info -[00024] [Originator@6876 sub=ThreadPool] Entering fair thread loop
2021-02-02T23:41:59.149Z info -[00018] [Originator@6876 sub=ThreadPool] Spawning additional worker - allocated: 5, idle: 0
time="2021-02-02T23:41:59Z" level=info msg="Initialized VDDK" logSource="/go/pkg/mod/github.com/vmware-tanzu/[email protected]/pkg/ivd/ivd_protected_entity_type_manager.go:346"
time="2021-02-02T23:41:59Z" level=info msg="Load Config of IVD Protected Entity Manager completed successfully." logSource="/go/pkg/mod/github.com/vmware-tanzu/[email protected]/pkg/ivd/ivd_protected_entity_type_manager.go:347"
time="2021-02-02T23:41:59Z" level=info msg="SnapshotManager is initialized with the configuration: map[SnapshotManagerLocation:DataServer]" logSource="/go/src/github.com/vmware-tanzu/velero-plugin-for-vsphere/pkg/snapshotmgr/snapshot_manager.go:139"
time="2021-02-02T23:41:59Z" level=info msg="SnapshotManager: Velero Backup Storage Location is retrieved, region=, bucket=velero" logSource="/go/src/github.com/vmware-tanzu/velero-plugin-for-vsphere/pkg/snapshotmgr/snapshot_manager.go:157"
time="2021-02-02T23:41:59Z" level=info msg="Got for s3ForcePathStyle, setting s3ForcePathStyle to false" logSource="/go/src/github.com/vmware-tanzu/velero-plugin-for-vsphere/pkg/utils/utils.go:380"
time="2021-02-02T23:41:59Z" level=info msg="Created S3 repo type=ivd bucket=velero prefix=plugins/vsphere-astrolabe-repo/" logSource="/go/pkg/mod/github.com/vmware-tanzu/[email protected]/pkg/s3repository/repository_protected_entity_type_manager.go:70"
time="2021-02-02T23:41:59Z" level=info msg="SnapshotManager: Get s3PETM from the params map" logSource="/go/src/github.com/vmware-tanzu/velero-plugin-for-vsphere/pkg/snapshotmgr/snapshot_manager.go:167"
time="2021-02-02T23:41:59Z" level=info msg="Registered External ProtectedEntityTypeManager: ivd" logSource="/go/pkg/mod/github.com/vmware-tanzu/[email protected]/pkg/server/direct_protected_entity_manager.go:218"
time="2021-02-02T23:41:59Z" level=info msg="SnapshotManager is initialized with the configuration: map[SnapshotManagerLocation:DataServer]" logSource="/go/src/github.com/vmware-tanzu/velero-plugin-for-vsphere/pkg/snapshotmgr/snapshot_manager.go:193"
time="2021-02-02T23:41:59Z" level=info msg="Initializing IVD Protected Entity Manager" logSource="/go/pkg/mod/github.com/vmware-tanzu/[email protected]/pkg/ivd/ivd_protected_entity_type_manager.go:53"
time="2021-02-02T23:41:59Z" level=info msg="Loading new IVD Protected Entity Manager" logSource="/go/pkg/mod/github.com/vmware-tanzu/[email protected]/pkg/ivd/ivd_protected_entity_type_manager.go:58"
time="2021-02-02T23:41:59Z" level=info msg="Detected VirtualCenterConfig change during periodic reload." logSource="/go/pkg/mod/github.com/vmware-tanzu/[email protected]/pkg/ivd/ivd_protected_entity_type_manager.go:303"
time="2021-02-02T23:41:59Z" level=info msg="Attempting login for user: [email protected]" logSource="/go/pkg/mod/github.com/vmware-tanzu/[email protected]/pkg/common/vsphere/virtual_center.go:164"
time="2021-02-02T23:41:59Z" level=info msg="New session ID for 'VSPHERE.LOCAL\\vsphere-velero' = 526c2900-f704-74c5-2adf-e472e8dd305c" logSource="/go/pkg/mod/github.com/vmware-tanzu/[email protected]/pkg/common/vsphere/virtual_center.go:151"
time="2021-02-02T23:41:59Z" level=info msg="Initializing VSLM Manager" logSource="/go/pkg/mod/github.com/vmware-tanzu/[email protected]/pkg/ivd/ivd_protected_entity_type_manager.go:320"
time="2021-02-02T23:41:59Z" level=info msg="Initializing new VslmManager..." logSource="/go/pkg/mod/github.com/vmware-tanzu/[email protected]/pkg/common/vsphere/vslm_manager.go:24"
time="2021-02-02T23:41:59Z" level=info msg="Initializing CNS Manager" logSource="/go/pkg/mod/github.com/vmware-tanzu/[email protected]/pkg/ivd/ivd_protected_entity_type_manager.go:331"
time="2021-02-02T23:41:59Z" level=info msg="Initializing new CnsManager..." logSource="/go/pkg/mod/github.com/vmware-tanzu/[email protected]/pkg/common/vsphere/cns_manager.go:20"
time="2021-02-02T23:41:59Z" level=info msg="Initialized VDDK" logSource="/go/pkg/mod/github.com/vmware-tanzu/[email protected]/pkg/ivd/ivd_protected_entity_type_manager.go:346"
time="2021-02-02T23:41:59Z" level=info msg="Load Config of IVD Protected Entity Manager completed successfully." logSource="/go/pkg/mod/github.com/vmware-tanzu/[email protected]/pkg/ivd/ivd_protected_entity_type_manager.go:347"
time="2021-02-02T23:41:59Z" level=info msg="DataMover: Get ivdPETM from the params map" logSource="/go/src/github.com/vmware-tanzu/velero-plugin-for-vsphere/pkg/dataMover/data_mover.go:60"
time="2021-02-02T23:41:59Z" level=info msg="DataMover is initialized" logSource="/go/src/github.com/vmware-tanzu/velero-plugin-for-vsphere/pkg/dataMover/data_mover.go:71"
time="2021-02-02T23:41:59Z" level=info msg="data manager server is up and running" logSource="/go/src/github.com/vmware-tanzu/velero-plugin-for-vsphere/pkg/cmd/datamgr/cli/server/server.go:163"
time="2021-02-02T23:41:59Z" level=info msg="Checking existence of namespace" logSource="/go/src/github.com/vmware-tanzu/velero-plugin-for-vsphere/pkg/cmd/datamgr/cli/server/server.go:303" namespace=backup
time="2021-02-02T23:41:59Z" level=info msg="Namespace exists" logSource="/go/src/github.com/vmware-tanzu/velero-plugin-for-vsphere/pkg/cmd/datamgr/cli/server/server.go:309" namespace=backup
time="2021-02-02T23:41:59Z" level=info msg="Starting data manager controllers" logSource="/go/src/github.com/vmware-tanzu/velero-plugin-for-vsphere/pkg/cmd/datamgr/cli/server/server.go:327"
time="2021-02-02T23:41:59Z" level=info msg="Registering controllers" logSource="/go/src/github.com/vmware-tanzu/velero-plugin-for-vsphere/pkg/cmd/datamgr/cli/server/server.go:332"
time="2021-02-02T23:41:59Z" level=info msg="Watching for vc config secret changes." logSource="/go/src/github.com/vmware-tanzu/velero-plugin-for-vsphere/pkg/cmd/datamgr/cli/server/server.go:355"
W0202 23:41:59.271937 1 shared_informer.go:432] The specified resyncPeriod 5m0s is invalid because this shared informer doesn't support resyncing
time="2021-02-02T23:41:59Z" level=info msg="Server started successfully" logSource="/go/src/github.com/vmware-tanzu/velero-plugin-for-vsphere/pkg/cmd/datamgr/cli/server/server.go:385"
time="2021-02-02T23:41:59Z" level=info msg="Starting controller" controller=vc-config logSource="/go/src/github.com/vmware-tanzu/velero-plugin-for-vsphere/pkg/controller/generic_controller.go:77"
time="2021-02-02T23:41:59Z" level=info msg="Waiting for caches to sync" controller=vc-config logSource="/go/src/github.com/vmware-tanzu/velero-plugin-for-vsphere/pkg/controller/generic_controller.go:80"
time="2021-02-02T23:41:59Z" level=info msg="Starting controller" controller=upload logSource="/go/src/github.com/vmware-tanzu/velero-plugin-for-vsphere/pkg/controller/generic_controller.go:77"
time="2021-02-02T23:41:59Z" level=info msg="Waiting for caches to sync" controller=upload logSource="/go/src/github.com/vmware-tanzu/velero-plugin-for-vsphere/pkg/controller/generic_controller.go:80"
time="2021-02-02T23:41:59Z" level=info msg="Starting controller" controller=download logSource="/go/src/github.com/vmware-tanzu/velero-plugin-for-vsphere/pkg/controller/generic_controller.go:77"
time="2021-02-02T23:41:59Z" level=info msg="Waiting for caches to sync" controller=download logSource="/go/src/github.com/vmware-tanzu/velero-plugin-for-vsphere/pkg/controller/generic_controller.go:80"
time="2021-02-02T23:41:59Z" level=info msg="Caches are synced" controller=upload logSource="/go/src/github.com/vmware-tanzu/velero-plugin-for-vsphere/pkg/controller/generic_controller.go:84"
time="2021-02-02T23:41:59Z" level=info msg="Caches are synced" controller=vc-config logSource="/go/src/github.com/vmware-tanzu/velero-plugin-for-vsphere/pkg/controller/generic_controller.go:84"
time="2021-02-02T23:41:59Z" level=info msg="Caches are synced" controller=download logSource="/go/src/github.com/vmware-tanzu/velero-plugin-for-vsphere/pkg/controller/generic_controller.go:84"
2021/02/02 23:48:54 pei = ivd:1fe29249-ba03-44da-b01c-58129c5d23aa:323ee907-c5e3-4947-8dfc-73ddfa8e006f
I0202 23:48:55.046764 1 leaderelection.go:242] attempting to acquire leader lease backup/upload-lease.upload-323ee907-c5e3-4947-8dfc-73ddfa8e006f...
I0202 23:48:55.060668 1 leaderelection.go:252] successfully acquired lease backup/upload-lease.upload-323ee907-c5e3-4947-8dfc-73ddfa8e006f
time="2021-02-02T23:48:55Z" level=info msg="Lock is acquired by current node - vaultdev-0 to process Upload upload-323ee907-c5e3-4947-8dfc-73ddfa8e006f." controller=upload key=backup/upload-323ee907-c5e3-4947-8dfc-73ddfa8e006f logSource="/go/src/github.com/vmware-tanzu/velero-plugin-for-vsphere/pkg/controller/upload_controller.go:255"
time="2021-02-02T23:48:55Z" level=info msg="Upload starting" controller=upload generation=1 logSource="/go/src/github.com/vmware-tanzu/velero-plugin-for-vsphere/pkg/controller/upload_controller.go:279" name=upload-323ee907-c5e3-4947-8dfc-73ddfa8e006f namespace=backup phase=New snapshotID="ivd:1fe29249-ba03-44da-b01c-58129c5d23aa:323ee907-c5e3-4947-8dfc-73ddfa8e006f"
2021/02/02 23:48:55 pei = ivd:1fe29249-ba03-44da-b01c-58129c5d23aa:323ee907-c5e3-4947-8dfc-73ddfa8e006f
time="2021-02-02T23:48:55Z" level=info msg="Upload status updated from New to InProgress" controller=upload generation=1 logSource="/go/src/github.com/vmware-tanzu/velero-plugin-for-vsphere/pkg/controller/upload_controller.go:497" name=upload-323ee907-c5e3-4947-8dfc-73ddfa8e006f namespace=backup phase=New snapshotID="ivd:1fe29249-ba03-44da-b01c-58129c5d23aa:323ee907-c5e3-4947-8dfc-73ddfa8e006f"
2021/02/02 23:48:55 pei = ivd:1fe29249-ba03-44da-b01c-58129c5d23aa:323ee907-c5e3-4947-8dfc-73ddfa8e006f
time="2021-02-02T23:48:55Z" level=info msg="Using explicitly found credentials for S3 repository access." logSource="/go/src/github.com/vmware-tanzu/velero-plugin-for-vsphere/pkg/utils/utils.go:357"
time="2021-02-02T23:48:55Z" level=info msg="Got true for s3ForcePathStyle, setting s3ForcePathStyle to true" logSource="/go/src/github.com/vmware-tanzu/velero-plugin-for-vsphere/pkg/utils/utils.go:377"
time="2021-02-02T23:48:55Z" level=info msg="Created S3 repo type=ivd bucket=velero prefix=plugins/vsphere-astrolabe-repo/" logSource="/go/pkg/mod/github.com/vmware-tanzu/[email protected]/pkg/s3repository/repository_protected_entity_type_manager.go:70"
time="2021-02-02T23:48:55Z" level=info msg="Copying the snapshot from local to remote repository" Local PEID="ivd:1fe29249-ba03-44da-b01c-58129c5d23aa:323ee907-c5e3-4947-8dfc-73ddfa8e006f" logSource="/go/src/github.com/vmware-tanzu/velero-plugin-for-vsphere/pkg/dataMover/data_mover.go:103"
time="2021-02-02T23:48:55Z" level=info msg="Registering a in-progress cancel function." Local PEID="ivd:1fe29249-ba03-44da-b01c-58129c5d23aa:323ee907-c5e3-4947-8dfc-73ddfa8e006f" logSource="/go/src/github.com/vmware-tanzu/velero-plugin-for-vsphere/pkg/dataMover/data_mover.go:111"
time="2021-02-02T23:48:55Z" level=info msg="Registered a on-going cancel function." PEID="ivd:1fe29249-ba03-44da-b01c-58129c5d23aa:323ee907-c5e3-4947-8dfc-73ddfa8e006f" logSource="/go/src/github.com/vmware-tanzu/velero-plugin-for-vsphere/pkg/dataMover/data_mover.go:227"
2021-02-02T23:48:55.495Z warning -[00030] [Originator@6876 sub=Default] Closing Response processing in unexpected state: 3
2021-02-02T23:48:55.504Z warning -[00001] [Originator@6876 sub=vimaccess] cannot get thumbprint: SSL error code '151441516', exception: 'Wrong X.509 Certificate format'
2021-02-02T23:48:55.608Z warning -[00025] [Originator@6876 sub=Default] Closing Response processing in unexpected state: 3
2021-02-02T23:48:55.618Z warning -[00001] [Originator@6876 sub=vimaccess] cannot get thumbprint: SSL error code '151441516', exception: 'Wrong X.509 Certificate format'
2021-02-02T23:48:56.086Z warning -[00021] [Originator@6876 sub=Default] Closing Response processing in unexpected state: 3
2021-02-02T23:48:56.092Z warning -[00001] [Originator@6876 sub=vimaccess] cannot get thumbprint: SSL error code '151441516', exception: 'Wrong X.509 Certificate format'
2021-02-02T23:48:56.145Z warning -[00020] [Originator@6876 sub=Default] Closing Response processing in unexpected state: 3
2021-02-02T23:48:56.156Z warning -[00001] [Originator@6876 sub=vimaccess] cannot get thumbprint: SSL error code '151441516', exception: 'Wrong X.509 Certificate format'
time="2021-02-02T23:48:57Z" level=info msg="Found 0 existing segments for bucket: velero name: plugins/vsphere-astrolabe-repo/ivd/data/ivd:1fe29249-ba03-44da-b01c-58129c5d23aa:323ee907-c5e3-4947-8dfc-73ddfa8e006f.data" logSource="/go/pkg/mod/github.com/vmware-tanzu/[email protected]/pkg/s3repository/repository_protected_entity.go:228"
time="2021-02-02T23:48:57Z" level=info msg="Upload ongoing, Part: 0 Bytes Uploaded: 0 MB" logSource="/go/pkg/mod/github.com/vmware-tanzu/[email protected]/pkg/s3repository/repository_protected_entity.go:384"
time="2021-02-02T23:48:57Z" level=info msg="Read returning 10485760, len(p) = 10485760, offset=10485760\n" logSource="/go/src/github.com/vmware-tanzu/astrolabe/vendor/github.com/vmware/gvddk/gvddk-high/gvddk.go:87"
time="2021-02-02T23:48:58Z" level=info msg="Upload ongoing, Part: 1 Bytes Uploaded: 10 MB" logSource="/go/pkg/mod/github.com/vmware-tanzu/[email protected]/pkg/s3repository/repository_protected_entity.go:384"
time="2021-02-02T23:48:58Z" level=info msg="Read returning 10485760, len(p) = 10485760, offset=20971520\n" logSource="/go/src/github.com/vmware-tanzu/astrolabe/vendor/github.com/vmware/gvddk/gvddk-high/gvddk.go:87"
time="2021-02-02T23:48:59Z" level=info msg="Upload ongoing, Part: 2 Bytes Uploaded: 20 MB" logSource="/go/pkg/mod/github.com/vmware-tanzu/[email protected]/pkg/s3repository/repository_protected_entity.go:384"
time="2021-02-02T23:48:59Z" level=info msg="Read returning 10485760, len(p) = 10485760, offset=31457280\n" logSource="/go/src/github.com/vmware-tanzu/astrolabe/vendor/github.com/vmware/gvddk/gvddk-high/gvddk.go:87"
time="2021-02-02T23:48:59Z" level=info msg="Upload ongoing, Part: 3 Bytes Uploaded: 30 MB" logSource="/go/pkg/mod/github.com/vmware-tanzu/[email protected]/pkg/s3repository/repository_protected_entity.go:384"
...
time="2021-02-03T00:07:47Z" level=info msg="Read returning 10485760, len(p) = 10485760, offset=3208642560\n" logSource="/go/src/github.com/vmware-tanzu/astrolabe/vendor/github.com/vmware/gvddk/gvddk-high/gvddk.go:87"
time="2021-02-03T00:07:50Z" level=info msg="Upload ongoing, Part: 306 Bytes Uploaded: 3060 MB" logSource="/go/pkg/mod/github.com/vmware-tanzu/[email protected]/pkg/s3repository/repository_protected_entity.go:384"
time="2021-02-03T00:07:50Z" level=info msg="Read returning 10485760, len(p) = 10485760, offset=3219128320\n" logSource="/go/src/github.com/vmware-tanzu/astrolabe/vendor/github.com/vmware/gvddk/gvddk-high/gvddk.go:87"
time="2021-02-03T00:07:54Z" level=info msg="Upload ongoing, Part: 307 Bytes Uploaded: 3070 MB" logSource="/go/pkg/mod/github.com/vmware-tanzu/[email protected]/pkg/s3repository/repository_protected_entity.go:384"
time="2021-02-03T00:07:54Z" level=info msg="Read returning 2097152, len(p) = 10485760, offset=3221225472\n" logSource="/go/src/github.com/vmware-tanzu/astrolabe/vendor/github.com/vmware/gvddk/gvddk-high/gvddk.go:87"
time="2021-02-03T00:07:54Z" level=info msg="Read returning 0, len(p) = 8388608, offset=3221225472\n" logSource="/go/src/github.com/vmware-tanzu/astrolabe/vendor/github.com/vmware/gvddk/gvddk-high/gvddk.go:87"
time="2021-02-03T00:08:32Z" level=info msg="Segment upload completed: {\n Bucket: \"velero\",\n ETag: \"\\\"4724f324181272882033a41b2c5279ec-308\\\"\",\n Key: \"plugins/vsphere-astrolabe-repo/ivd/data/ivd:1fe29249-ba03-44da-b01c-58129c5d23aa:323ee907-c5e3-4947-8dfc-73ddfa8e006f.data/000000-0000000000000000\",\n Location: \"http://minio-gateway.backup.svc/velero/plugins/vsphere-astrolabe-repo/ivd/data/ivd:1fe29249-ba03-44da-b01c-58129c5d23aa:323ee907-c5e3-4947-8dfc-73ddfa8e006f.data/000000-0000000000000000\"\n}" logSource="/go/pkg/mod/github.com/vmware-tanzu/[email protected]/pkg/s3repository/repository_protected_entity.go:507"
time="2021-02-03T00:08:32Z" level=info msg="Found 0 existing segments for bucket: velero name: plugins/vsphere-astrolabe-repo/ivd/md/ivd:1fe29249-ba03-44da-b01c-58129c5d23aa:323ee907-c5e3-4947-8dfc-73ddfa8e006f.md" logSource="/go/pkg/mod/github.com/vmware-tanzu/[email protected]/pkg/s3repository/repository_protected_entity.go:228"
time="2021-02-03T00:08:32Z" level=info msg="Upload ongoing, Part: 0 Bytes Uploaded: 0 MB" logSource="/go/pkg/mod/github.com/vmware-tanzu/[email protected]/pkg/s3repository/repository_protected_entity.go:384"
time="2021-02-03T00:08:33Z" level=info msg="Successfully uploaded to%!(EXTRA string=http://minio-gateway.backup.svc/velero/plugins/vsphere-astrolabe-repo/ivd/md/ivd%3A1fe29249-ba03-44da-b01c-58129c5d23aa%3A323ee907-c5e3-4947-8dfc-73ddfa8e006f.md/000000-0000000000000000)" logSource="/go/pkg/mod/github.com/vmware-tanzu/[email protected]/pkg/s3repository/repository_protected_entity.go:411"
Is there any roadmap to being able to upload the thin VMDKs or otherwise save space, or have I otherwise misunderstood?
Your observation is expected. Currently, only full backup is supported. Uploading thin VMDKs or incremental changes of VMDKs will fall into the category of the incremental backup support. We do plan to support the incremental backup. But currently, there is no any concrete plan yet.
Is the compression of VMDK backup supported? Would be strange not to have it.
Is the compression of VMDK backup supported? Would be strange not to have it.
velero-plugin-for-vsphere is still growing and doesn't support it for now.