dbt_artifacts icon indicating copy to clipboard operation
dbt_artifacts copied to clipboard

Add source freshness status to sources table

Open emilyjia opened this issue 2 years ago • 9 comments

Thanks for the updates to version 1.0.0. Is there a way to access the status of source freshness tests in the existing models? I see the freshness criteria in the sources table, but not the freshness status. Alternatively, is it possible to add the status property (from sources.json) to the sources table?

emilyjia avatar Aug 10 '22 16:08 emilyjia

Hey @emilyjia - this is not possible today while we wait for https://github.com/dbt-labs/dbt-core/issues/5609 but thank you for bringing it up!

NiallRees avatar Aug 17 '22 14:08 NiallRees

hi @NiallRees

I was looking at this as we also want to use the freshness status.

status is present in sources.yml, after dbt source freshness - and it does not get overwritten after dbt run

but when we upload the freshness only has criteria and no freshness status. Could we not add column for status if the key is present it is there, otherwise null? Is there a reason to wait for the issue mentioned?

rudeb0y avatar Jan 12 '23 11:01 rudeb0y

Hi @rudeb0y apologies for the delay in getting back to you here. dbt artifacts relies on the run result object provided via the on-run-end hook rather than the files created themselves. This doesn't include the source freshness status though unfortunately. The PR that Niall has referenced aims to make this data available though, which is why we are unable to use it until that has been implemented.

glsdown avatar Mar 31 '23 09:03 glsdown

is this feature implemented or are there any timelines on this ? Since we are also looking for the same.

zs-gpillai avatar Sep 27 '23 11:09 zs-gpillai

Just mentioning that https://github.com/dbt-labs/dbt-core/issues/5609 is merged.

VDFaller avatar Jan 23 '24 21:01 VDFaller

Just pinging... Any update on this feature? https://github.com/dbt-labs/dbt-core/issues/5609 is merged

aryan-tmg avatar Mar 20 '24 13:03 aryan-tmg