boto_rsync
boto_rsync copied to clipboard
seedifferently
Implement an ignore-size option to force copy operations to execute even...
... if the file is the same size. This is useful when using createrepo as the repomd.xml is sometimes the same size on disk, but comprised of different hashes.
Actually ran in to the exact same issue with repomd.xml. I solved this a bit hacky using s3put on the specific repomd.xml files. All other files change in size or name. Not sure if the option should be ignore-size, it is bascially making boto-rsync not doing any rsyncing any more. A better solution would be to add an option to actually check md5 on specific files or all files (this can be an issue if you have billions of files in your s3 bucket)
I am evaluating the new awscli py package provided by AWS as a replacement for boto-rsync, s3put, s3cmd, etc.
-Chris
On Tuesday, February 18, 2014, David Röhr [email protected] wrote:
Actually ran in to the exact same issue with repomd.xml. I solved this a bit hacky using s3put on the specific repomd.xml files. All other files change in size or name. Not sure if the option should be ignore-size, it is bascially making boto-rsync not doing any rsyncing any more. A better solution would be to add an option to actually check md5 on specific files or all files (this can be an issue if you have billions of files in your s3 bucket)
Reply to this email directly or view it on GitHubhttps://github.com/seedifferently/boto_rsync/pull/22#issuecomment-35392733 .
@cbrinker Nice to see that AWS has finally stepped up to the plate with something like this.
I have some time coming up in a bit and I thought I might revisit this package, but now I'm not entirely sure that's necessary. Please let me know how your evaluation goes.
