docker icon indicating copy to clipboard operation
docker copied to clipboard

allow setting s3 concurrency, proxy, timeout, uploadPartSize, putSizeLimit, version, and verify_bucket_exists

Open jessebot opened this issue 1 year ago • 5 comments

Adds missing S3 related environment variables. Fixes #2270

Per the docs here's the missing supported S3 parameters:

  • concurrency defaults to 5 [Note: This defines the maximum number of concurrent multipart uploads]

  • proxy defaults to false

  • timeout defaults to 15

  • uploadPartSize defaults to 524288000

  • putSizeLimit defaults to 104857600

  • version defaults to latest

  • useMultipartCopy defaults to true

  • copySizeLimit defaults to 5242880000

  • verify_bucket_exists defaults to true [Note: Setting this to false after confirming the bucket has been created may provide a performance benefit, but may not be possible in multibucket scenarios.]

This also helps us get ready to merge https://github.com/nextcloud/helm/pull/614 downstream 🙏

Let me know if you need anything else :)

jessebot avatar Jul 26 '24 12:07 jessebot

@joshtrichards wanted to gently follow up and ask if anything else is needed here?

jessebot avatar Oct 14 '24 12:10 jessebot

@J0WI or @joshtrichards can I ask if there's anything else needed here to get this merged into the default branch? Sorry to be a pest. I just want to make sure this gets merged so we can support it in the helm chart properly.

jessebot avatar Dec 13 '24 09:12 jessebot

@joshtrichards or @J0WI could you take another look at this when you have a moment?

jessebot avatar Jan 05 '25 09:01 jessebot

Any chance of an update on this? It's blocking using the helm chart 😢

yaleman avatar Apr 10 '25 23:04 yaleman

Hi @jessebot, any update on this? Not being able to set OBJECTSTORE_S3_VERIFY_BUCKET_EXISTS is currently blocking for me

SamyDjemai avatar Nov 07 '25 17:11 SamyDjemai