connect-stream-s3 icon indicating copy to clipboard operation
connect-stream-s3 copied to clipboard

Set Metadata and GZIP compress files

Open JonnyBGod opened this issue 12 years ago • 2 comments

I believe it would be great to have both these two features.

Probably compressing can be achieved with some middleware that compresses the file on the server before it gets pushed to S3.

JonnyBGod avatar Jun 01 '12 21:06 JonnyBGod

Hi Andy,

I would like to discuss the chance to implement some kind of compression support.

I was studying the best way to do it but go stuck on two problems.

One way to do it would be to compress the stream before it is uploaded to S3, the problem with this is that we do not know the end file size to include on the S3 request header.

The way to do it then would be to fully compress the file before streaming it to S3. This would break all the streaming flow of the process...

Any ideas? not sure if the first problem has a solution. If not I say we should include the second solution as an option.

JonnyBGod avatar Jun 09 '12 14:06 JonnyBGod

Wow, guys, I seriously didn't see this. Sorry. I think I need email notifications on the project.

I'd be happy to consider this as an option, but yes, I'm not sure how to implement it yet. Let me have a think about it.

chilts avatar Mar 23 '13 07:03 chilts