s3-tar
s3-tar copied to clipboard
xtream1101
Stream s3 data into a tar file in s3
There is an issue with the module which causes larger files(>8MB or maybe depending on the memory of the server) to truncate. The issue seems to be the tell() command...
Hi, Firstly, thanks! S3-tar has been really useful for archiving some of our buckets. We have a number that contain a mix of small files and files that are larger...
I needed this option (to upload archives directly do Glacier), so I added some lines. If you find this helpful, you could use it.
Observed truncation of large files inserted into archive. It seems necessary to flush and seek to the EOF of `source_key_io` to avoid this, see https://github.com/boto/boto3/issues/1304. As this Boto issue indicates,...
This is a question and not an issue, I am having trouble so hopefully it's not something obvious I am missing. I don't see a way to make a "snapshot"...
