s3s3mirror icon indicating copy to clipboard operation
s3s3mirror copied to clipboard

Support point-in-time selection from source location

Open wenslayer opened this issue 7 years ago • 3 comments

As a system operator, I need to be able to mirror a bucket (with optional prefix) as of a recent point in time to target location (bucket + optional prefix) to satisfy an external time constraint on the restored data.

With buckets that have versioning enabled, it's possible to select files from a certain point in time. I see there is s3-pit-restore, but it downloads files locally, whereas s3s3mirror's ability to move contents bucket to bucket is critical.

wenslayer avatar Oct 16 '17 23:10 wenslayer

@wenslayer, did you find a solution? We have the same need.

urbien avatar Oct 21 '18 20:10 urbien

@urbien, no, unfortunately not. We fell back to copying a live bucket to an interim location on a periodic basis, and then using that as our source, despite that it isn't a true point-in-time snapshot.

wenslayer avatar Oct 30 '18 19:10 wenslayer

@wenslayer I recently merged a change that adds support for "sync strategies".

You could define a new custom sync strategy that does exactly what you want. If you can parameterize it so that others might find it useful, it could be an interesting PR to merge into master.

cobbzilla avatar Jan 20 '21 12:01 cobbzilla