bdit_data-sources
bdit_data-sources copied to clipboard
Automating EOY maintenance 🎐
What this pull request accomplishes:
- automates the creation of new child tables in the new year
- HERE
- Miovision
- WYS
- Bluetooth
- automates the replacement of triggers for those new children
- automates updating the holiday table
Issue(s) this solves:
- Closes #439
What, in particular, needs to reviewed:
- 😎
- Where do you think stuff should be documented?
Ittttt would be nice to have a Slack message notifying of success of all the tasks so someone can review that tables were properly created.
Ittttt would be nice to have a Slack message notifying of success of all the tasks so someone can review that tables were properly created.
Can be done by adding a send alert trigger task that only runs if all the above tasks ran successfully. Gonna quickly create that :meow_salute:
Logic looks like dis meow
This is looking good. Wondering if the HERE trigger task should use the same logic from Bluetooth or Miovision to just replace the trigger instead of sending the slack message. Also where should this be documented?
Will have to update the here tables creation + add the congestion ones
Was gonna merge this but for some reason this dag ran today again. It is only suppose to run once every year but it ran three times this year already.
This is the schedule which is correct so im confused as to why it was scheduled today and yesterday as well
lol uh oh
seems like it's "Mondays and every day between 14-21 in December"
can you deal with the CodeFactor Except
issues?
I think catch except Exception:
and then do a string concatenation with it and the custom error messages