astro-sdk icon indicating copy to clipboard operation
astro-sdk copied to clipboard

Published 20 hours ago • verified publisher icon astronomer

Add git job for the creating/deleting redshift cluster

Open utkarsharma2 opened this issue 2 years ago • 1 comments

This PR adds the logic to create and delete redshift clusters on the fly. Covers

  1. Gitaction
  2. Master DAG

utkarsharma2 avatar Jun 16 '23 14:06 utkarsharma2

Moving this PR to draft

  1. As we are still facing issues for the dc2 instance created from a snapshot
  2. Can't usera3 clusters as they are 4time the cost of `dc2.

We have logged a ticket with AWS for the same and awaiting a response from them. Once they fix the dc2 instance we will use this PR to dynamically bring up the cluster reducing the cost even more.

utkarsharma2 avatar Jun 21 '23 10:06 utkarsharma2