herd icon indicating copy to clipboard operation
herd copied to clipboard

Restore Data from Glacier Lifecycle to S3

Open nateiam opened this issue 7 years ago • 0 comments

As a Herd Consumer I want to restore a Bdata to S3 that had been archived to Glacier so I can access the data.

Existing restore endpoint currently restores from old Glacier 0d bucket. This story updates restore to work with data archived by the new approach as implemented in #324

Acceptance Criteria

  • Restore is triggered by existing BData Restore POST endpoint.
    • Only change to endpoint is additional input for restore duration. Default if value not provided by user is configurable and defaults to 30d.
  • Herd uses new AWS 'Bulk' restore tier, see AWS documentation
  • Herd checks at configurable interval for completion of restore
  • Once Glacier restore for all S3 Objects (Herd Storage Files) is complete, the following should occur
    • Herd validates metadata against restored files in original S3 locations
    • Herd modifies metadata to reflect completed restore and availability of data
  • Glacier Storage is removed
    • Availability and DDL services behave as expected after data is restored

nateiam avatar May 13 '17 20:05 nateiam