dbt-snowflake-monitoring
dbt-snowflake-monitoring copied to clipboard
get-select
Testing and alerting
Curious whether the brains behind this excellent package have considered building data tests / alerts on top of the base analytical cost data currently being logged here. I've taken a few steps in this direction in one of my private projects, and would love to collaborate if anyone is interested!
hey @matt-winkler! thanks for opening the issue. Can you share some more details on what types of tests / alerts you have in mind?
Hi @ian-whitestone, broadly thinking a few different flavors:
- Basic: write a dbt test to alert when total spend crosses X in the past 7 / 30 days
- Intermediate: dbt test to alert when someone runs incremental with the full refresh flag more than X times
- Advanced: feed cost data to a python model and forecast future spend
@matt-winkler these are neat ideas, we hadn't put much thought into this since we figured users would configure their own custom alerts on top of this package with whatever tool they preferred.
With that said, I think if we had some optional tests that users could configure with their own parameters, that would be quite useful.
This could be a neat way to showcase dbt tests / alerts if you're interested in contributing!
@matt-winkler @ian-whitestone might be worth checking out https://blog.fal.ai/how-to-dbt-slack-integration/
