Databases Migration + Backups

[tltran-legion]

We will need to recreate the databases on UAT the databases for Source Control, Build-output, and Telemetry We will need to migrate data that where injected into Telemetry stack. We will need to have an automated backup and retention policy

[tltran-legion]

• [x] The creation of DB in UAT for Source Control, Build-output, and Telemetry is done.

• [x] The first solution implemented for the backup and restore of database using AWS snapshots works. We have been able to automate the snapshots for the dbs source-control, telemetry, buildoutput.
  

• [x] Restore from backup, we have been also able to manually restore the backup from playground to UAT Using backup from playground

And restoring it to UAT

• [x] The retention policies have been set to 5 days.

[tltran-legion]

Although the solution of backup/restore and retention of Databases is done, it is important to acknowledge that this solution for a system that use multiple distinct data store type. Is not the best and will create data inconsistency. Ex:

• telemetry use RDS + S3, we should be able to not only backup RDS but also S3 in the same period.
• source-control is using RDS, we should also be able to backup RDS + Content store
• content-store is using DynamoDB + S3 but eventually other data store.
  We should be able to make a snapshot of all the data store. The solution that seems to be interesting to use for this kind of behavior is to use AWS Backup.