s3sync
s3sync copied to clipboard
larrabee
Really fast sync tool for S3
My workplace is using Amazon S3 buckets which mandate that server-side encryption is enabled (specifically bucket policy there mandates [SSE-S3](https://docs.aws.amazon.com/AmazonS3/latest/userguide/UsingServerSideEncryption.html)). The following pull request implements this, and lays some initial...
Hi Is there a way to add --delete as exists in S3 Sync to have a ongoing sync. If you don't want to add this feature could you point me...
I use s3sync to synf file with option skip ./s3sync --tk xx --ts yyy --te "https://hn.ss.bfcplatform.vn" -w 8 /media/ s3://demo-media/media/ --sync-progress --on-fail skip --s3-retry 3 --s3-retry-sleep 10 --s3-acl public-read --fs-disable-xattr...
`--fs-atomic-write` docs suggest > New files will be written to temp file and renamed but `fs.NewFSStorage` (the sole consumer of `cli.args.FSAtomicWrite`) ignores its incoming `atomicWrite` bool.
Maximum upload size for S3 seems to be limited to 5GB. For now, I am skipping these files. Any way to get s3sync to sync files larger than 5GB?
I am using the version 2.25, when i run the sync with these parameters > ./s3sync -d --sync-log --sk **** --ss *** --se hostaddr -w 20 s3://test fs://./data/ it is...
It would be cool to have an optional flag that compares the md5 checksum between locations before syncing, this would reduce a lot wasted time re-syncing a directory.
s3sync works with few s3 files and for few, it fails saying NoSuchKey: The specified key does not exist, anything to fix form s3 permission for am I missing any...
Hi All, Its a wonderful project to sync the S3 data from one location to Another Location. Just I have few Questions. Is it possible to Get how much bytes...
It would be great if there were an option to not sync files that exist at the destination and are newer than the source file. I think this is even...
