bdit_data-sources
bdit_data-sources copied to clipboard
Add functionality to send a slack message if there
Per this SO post it's possible to get the return value from a BashOperator. The return value should modify what message Slack sends. There are a few non-critical the script will log that won't kill the program. These should bubble to some final sys.exit() call which would trigger a Slack message to notify that the data pipeline encountered a weird issue.
Kind of wondering if I should make these unusual errors fail it instead.
If there what?
are non-critical errors
Wow I was really allergic to writing "errors" when I wrote the issue title and description. Updated.
This has been dealt with in the splitting the BashOperator into python tasks