Add "test alerting" on Slack

[Maayan-s]

Slack alerts are only sent if there are failed tests. When users deploy Elementary, they want to have a way to validate the deployment worked. We should have a flag for validating the deployment.

[ronmorgen1]

Looks interesting I would be happy to take this. How would you classify a successful deployment?

[Maayan-s]

@ronmorgen1

Important background - the CLI has an internal dbt project. This project queries the Elementary tables from the dbt package deployment. So the flow is:

1. User installs the dbt package, that collects data to an elementary schema
2. The CLI has an internal dbt project, with a profile pointing at the elementary schema
3. The CLI dbt project runs and reads data that should be sent as alerts
4. The CLI sends alerts to Slack

So a successful deployment means that the elementary schema exists, the CLI can read from it (the profile is well configured), and the CLI can find a Slack config and send a message.

[ronmorgen1]

@Maayan-s

I see. So after the CLI installation when the user runs the command edt monitor, a slack message is sent only when tests fail, and now we want to send one when deployment is successful (?)

[Maayan-s]

@ronmorgen1

I think we should probably have a --test flag. The use case here is that you install but don't have any failed tests at the moment, but you still want to make sure the deployment actually works.

[github-actions[bot]]

This issue is stale because it has been open for too long with no activity. If you would like the issue to remain open, please remove the stale label or leave a comment.

[elongl]

Added as edr monitor --test.

 --test BOOLEAN                  Whether to send a test message in case there
                                  are no alerts.