s3funnel icon indicating copy to clipboard operation
s3funnel copied to clipboard

PUT from stdin?

Open mjwillson opened this issue 10 years ago • 3 comments

So it says: "Unix-friendly input and output. Pipe things in, out, and all around." which I took to mean I could do something like

tar -czv big-directory | s3funnel bucket PUT big-directory.tgz

seemingly not though. Is this possible via some combination of args? might be nice to document it if so...

mjwillson avatar Jul 17 '13 10:07 mjwillson

+1

hrp avatar Oct 25 '13 04:10 hrp

Don't think s3funnel supports streaming a single file from STDIN right now, but that would be a cool addition.

Normally I'd say it should be tar -cvf somedir | s3funnel bucket PUT - but then there is no destination filename. Perhaps we need a syntax for specifying separate input vs output files (which could also be used in the FILE manifest)?

Maybe something like

s3funnel bucket PUT local_name:remote_name

Then we could have...

tar -cvf somedir | s3funnel bucket PUT :big-directory.tgz

Anyone want to do a PR? :)

For completeness, might be wise to provide some kind of --remote-delim flag which defaults to : but can be overridden to something else in case you want to have :'s in your filename... \t's could be nice for manifest inputs.

shazow avatar Oct 25 '13 08:10 shazow

+1

tcwalther avatar Nov 17 '14 17:11 tcwalther