s3sync
s3sync copied to clipboard
Tool belt for managing your S3 buckets
The patch-level semantic versioning isn't necessary here; AWS's API is stable through v2.
Suddenly seeing this error a lot copying backups to AWS bucket using s3sync. Indeed 3 AMI boxes have managed the full 100 retries on successive night. Been stable for years,...
Our Use case: deploy a Jekyll generated site to S3 For that it would be cleaner to call the Sync command directly as Ruby code in the Rakefile instead of...
Not sure if this is s3sync, or the aws-sdk: /var/lib/gems/1.9.1/gems/aws-sdk-1.38.0/lib/aws/core/data.rb:117:in `method_missing': undefined method`has_key?' for #String:0x00000003ecc388 (NoMethodError) from /var/lib/gems/1.9.1/gems/aws-sdk-1.38.0/lib/aws/core/response.rb:184:in `method_missing' from /var/lib/gems/1.9.1/gems/aws-sdk-1.38.0/lib/aws/s3/prefix_and_delimiter_collection.rb:31:in`each_member_in_page' from /var/lib/gems/1.9.1/gems/aws-sdk-1.38.0/lib/aws/s3/object_collection.rb:288:in `each_member_in_page' from /var/lib/gems/1.9.1/gems/aws-sdk-1.38.0/lib/aws/s3/paginated_collection.rb:31:in`_each_item' from /var/lib/gems/1.9.1/gems/aws-sdk-1.38.0/lib/aws/core/collection/with_limit_and_next_token.rb:54:in `_each_batch' from...
I'm trying to upload about 370GB of data to S3 and it is eating my resources like a beast, just saying ``` PID USER PR NI VIRT RES SHR S...
Shouldn't a utility that uses AWS follow closely to AWS's conventions? I have to keep extra pairs of configuration variables around when deploying stuff and it's hard to keep track...
Hello, I'm trying to use this tool and after creating a file name s3sync.yml with my AWS credentials when I try to list my buckets I get this error: ```...
I'm trying to backup one of my old buckets (used with Jungle Disk) and this is what I get: ``` $ s3sync sync : /Users/olivier/.rvm/gems/ruby-1.9.3-p448/gems/aws-sdk-1.19.0/lib/aws/core/http/net_http_handler.rb:83:in `block (2 levels) in handle':...
I figured out why s3sync was always uploading everything every time. It turns out that it was appending the source directory path into the target path. e.g. if I run:...
Everybody loves ASCII progress bars. It will be awesome to have one for the current file and another one for the overall process.