Issue with freshness test display on Elementary dashboard
Describe the bug We had a jump in versions from v0.14.1 to v0.15.1 due to an oversight in our deployment script. That's been sorted, and things work fine for the most part except how freshness tests are shown on the dashboard. It looks like elementary now sees the freshness test as both a generic, and freshness type test as opposed to just freshness before.
Old version:
New:
Notice the 1 of each kind of test detected on most of these models. We haven't changed anything in the model specifically, and the freshness test is the only kind of test defined on it:
models:
- name: engage_campaign_members
description: desc
tests:
- elementary.freshness_anomalies:
timestamp_column: created
config:
severity: warn
To Reproduce Steps to reproduce the behavior:
- Go to the elementary dashboard.
- Click on the tests under "Freshness"
- Test type "generic" is displayed instead of freshness.
- But, if you navigate to the model where the freshness test is added, it correctly shows that the test type is freshness rather than generic.
Expected behavior It is expected that only the freshness test shows up in this view.
Screenshots
Previous:
Current:
Environment (please complete the following information):
- Elementary CLI (edr) version: v0.15.1
- Elementary dbt package version: 0.13.2
- dbt version you're using: 1.8.1
- Data warehouse Snowflake
- Infrastructure details: dev and prod
Would you be willing to contribute a fix for this issue? I am happy to contribute if I can get some guidelines.
Hi @arjunanandkumar , Thanks for submitting the issue. Other than the different "test type" values, did you notice any change in behavior? Are the results the same?
Hi @ellakz, Besides that, there is no change in behavior. I can see that it has run and passed if I navigate directly to the model where the freshness test is defined (Indicated by the green "1").
Hi @ellakz, I was wondering if you had any new insight on this.
Hey again @ellakz, we've located the issue. We completely oversaw this warning:
WARNING — You are using incompatible versions between edr (0.15.1) and Elementary's dbt package (0.13.2).
And this is something we have forgotten to handle on our end after we upgraded to dbt 1.8. I will close down this issue now.
Thanks for updating @arjunanandkumar !