elementary
elementary copied to clipboard
The dbt-native data observability solution for data & analytics engineers. Monitor your data pipelines in minutes. Available as self-hosted or cloud service with premium features.
(Feel free to close if this isn't helpful :) ) We (Superwall S21) have been looking for a tool like this to help us monitor our data pipelines. We help...
### Requirements (reported on Slack) - We have a table with daily amount of sales grouped by store. We would like to group that table by day and monitor the...
Slack alerts are only sent if there are failed tests. When users deploy Elementary, they want to have a way to validate the deployment worked. We should have a flag...
In Bigquery partitioned tables have a pseudo-column named _PARTITIONTIME. https://cloud.google.com/bigquery/docs/querying-partitioned-tables Before running the test query, Elementary checks the information schema to see if the column provided as the timestamp column...
In data anomalies tests we collect metrics for 14 days back by default (configurable as 'days_back'). For performance reasons, if elementary already has data for some of the days, it...
This is a new type of integration that was requested in the [Slack community](https://elementary-community.slack.com/archives/C02BPB78J4T/p1650907380944009). - From a quick look it seems like dbt [already supports databricks](https://github.com/databricks/dbt-databricks) and it seems like...
## Motivation As far as I know, we don't have any CI jobs to run unit tests. I would like to introduce a CI job using GitHub Actions so that...
The feature is a new monitor for column anomalies detection. **Monitor goal:** Detecting a change in the distribution of the different values in a column. **Example:** An example would be...
Right now it seems only possible to monitor the results of aggregate functions outlined in the column level monitors defined here: https://docs.elementary-data.com/guides/data-monitoring/tests-and-monitors-types It would be cool to allow users to...
At the time of writing this with elementary 0.4.1, elementary persists results per dbt's `schema`. But, personally, it can get messy, as I have a lot of dbt's schema, that...