bdit_data-sources icon indicating copy to clipboard operation
bdit_data-sources copied to clipboard

Automating EOY maintenance 🎐

Open radumas opened this issue 3 years ago • 4 comments

What this pull request accomplishes:

  • automates the creation of new child tables in the new year
    • HERE
    • Miovision
    • WYS
    • Bluetooth
  • automates the replacement of triggers for those new children
  • automates updating the holiday table

Issue(s) this solves:

  • Closes #439

What, in particular, needs to reviewed:

  • 😎
  • Where do you think stuff should be documented?

radumas avatar Dec 31 '21 19:12 radumas

Ittttt would be nice to have a Slack message notifying of success of all the tasks so someone can review that tables were properly created.

radumas avatar Dec 31 '21 19:12 radumas

Ittttt would be nice to have a Slack message notifying of success of all the tasks so someone can review that tables were properly created.

Can be done by adding a send alert trigger task that only runs if all the above tasks ran successfully. Gonna quickly create that :meow_salute:

chmnata avatar Feb 16 '22 20:02 chmnata

Logic looks like dis meow image

chmnata avatar Feb 16 '22 22:02 chmnata

This is looking good. Wondering if the HERE trigger task should use the same logic from Bluetooth or Miovision to just replace the trigger instead of sending the slack message. Also where should this be documented?

radumas avatar Apr 08 '22 02:04 radumas

Will have to update the here tables creation + add the congestion ones

chmnata avatar Dec 07 '22 14:12 chmnata

Was gonna merge this but for some reason this dag ran today again. It is only suppose to run once every year but it ran three times this year already. This is the schedule which is correct so im confused as to why it was scheduled today and yesterday as well image

chmnata avatar Dec 16 '22 17:12 chmnata

lol uh oh

radumas avatar Dec 16 '22 18:12 radumas

seems like it's "Mondays and every day between 14-21 in December"

radumas avatar Dec 16 '22 18:12 radumas

can you deal with the CodeFactor Except issues? I think catch except Exception: and then do a string concatenation with it and the custom error messages

radumas avatar Dec 16 '22 19:12 radumas