zio-connect
zio-connect copied to clipboard
S3 connector's putObject is wrong
It seems to repeatedly call putObject
for each chunk, which just overwrites the same object every time. It should use the multipart upload API: https://docs.aws.amazon.com/AmazonS3/latest/userguide/mpuoverview.html
Is there a workaround for this?
One workaround is to rechunk your ZStream to have 1 underlying chunk.