elementary icon indicating copy to clipboard operation
elementary copied to clipboard
verified publisher icon elementary-data

From dbt-core 1.8 - Add support to load source freshness data as well

Open b-per opened this issue 1 year ago • 4 comments

Is your feature request related to a problem? Please describe. Until dbt-core 1.7, it is not possible to use on-run-end hooks to upload freshness data to the warehouse.

This merged PR provides this ability going forward (e.g. 1.8+)

There is also a flag that needs to be set in dbt_project.yml for the hook to be triggered

# dbt_project.yml
flags:
  source_freshness_run_project_hooks: true

Describe the solution you'd like Update the package so that source freshness data can be loaded to the warehouse as well

b-per avatar Feb 22 '24 13:02 b-per

@b-per this PR was actually contributed by @ofek1weiss from our team :) We are waiting for dbt to make the release official.

Maayan-s avatar May 05 '24 13:05 Maayan-s

@Maayan-s since 1.8 has been released, can we expect Elementary to use on-run-end hook to upload source freshness?

kokorin avatar May 20 '24 12:05 kokorin

Hi @kokorin ! Yes definitely, we'll likely prioritize this in the near future!

haritamar avatar May 20 '24 13:05 haritamar

Hello folks any updates on this one? We have been watching this since the release of 1.8 😃

Shadowsong27 avatar Jul 15 '24 04:07 Shadowsong27