velero-plugin icon indicating copy to clipboard operation
velero-plugin copied to clipboard

Large backup in aws without setting multiPartChunkSize stops at 50Gi

Open pando85 opened this issue 11 months ago • 0 comments

What steps did you take and what happened: I just try to do a backup of a ZFS volume bigger than 50Gi and it crashes saying that:

caused by: TotalPartsExceeded: exceeded total allowed configured MaxUploadParts (10000). Adjust PartSize to fit in this limit"

What did you expect to happen: With multiPartChunkSize not set up it should calculate partSize automatically but it seems that it took 5Mi as default value.

Anything else you would like to add: [Miscellaneous information that will assist in solving the issue.] I fixed it setting it explicitly to a bigger value.

Environment:

  • Velero version (use velero version):
velero version
Client:
	Version: v1.13.0
	Git commit: 76670e940c52880a18dbbc59e3cbee7b94cd3352
Server:
	Version: v1.13.0
  • Velero features (use velero client config get features):
velero client config get features
features: <NOT SET>
  • Velero-plugin version: 3.6.0
  • OpenEBS version: zfs-localpv-2.4.0
  • Kubernetes version (use kubectl version): Server Version: v1.28.6+k3s
  • Kubernetes installer & version: Custom ansible installer: https://github.com/pando85/homelab/tree/master/metal
  • Cloud provider or hardware configuration: https://github.com/pando85/homelab/?tab=readme-ov-file#-hardware
  • OS (e.g. from /etc/os-release):
PRETTY_NAME="Ubuntu 22.04.3 LTS"
NAME="Ubuntu"
VERSION_ID="22.04"
VERSION="22.04.3 LTS (Jammy Jellyfish)"
VERSION_CODENAME=jammy
ID=ubuntu
ID_LIKE=debian
HOME_URL="https://www.ubuntu.com/"
SUPPORT_URL="https://help.ubuntu.com/"
BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
UBUNTU_CODENAME=jammy

pando85 avatar Mar 12 '24 20:03 pando85