azure-cli-extensions icon indicating copy to clipboard operation
azure-cli-extensions copied to clipboard

Stream blob upload OOM

Open baelter opened this issue 1 year ago • 2 comments

Trying to use this now, and the az process is OOMing even with a tiny "length"

Related command

pg_basebackup -D - -X fetch --format tar --gzip --compress=3 --max-rate 2M | \
  az storage blob upload --data @- --length 1024 -c wal -n $(hostname -s)/base.tar.gz

The pg_basebackup process uses 8MB, and az is growing indefinitely until OOM killed (at 2GB on the current VM)

Extension name (the extension in question)

storage-blob-preview

Originally posted here, but extracted to separate issue.

baelter avatar Jul 12 '22 07:07 baelter

storage

yonzhan avatar Jul 12 '22 07:07 yonzhan

Thanks for the feedback! We are routing this to the appropriate team for follow-up. cc @xgithubtriage.

Issue Details

Trying to use this now, and the az process is OOMing even with a tiny "length"

Related command

pg_basebackup -D - -X fetch --format tar --gzip --compress=3 --max-rate 2M | \
  az storage blob upload --data @- --length 1024 -c wal -n $(hostname -s)/base.tar.gz

The pg_basebackup process uses 8MB, and az is growing indefinitely until OOM killed (at 2GB on the current VM)

Extension name (the extension in question)

storage-blob-preview

Originally posted here, but extracted to separate issue.

Author: baelter
Assignees: evelyn-ys
Labels:

customer-reported, Storage, Service Attention, Auto-Assign, Azure CLI Team

Milestone: Backlog

ghost avatar Aug 14 '22 03:08 ghost