augur
augur copied to clipboard
chaoss
"Hello World" for DBT Analytical Transformation Workflows
Querying Augur requires a certain degree of learning time, and although there are a number of queries available for starting out in https://github.com/chaoss/augur-community-reports and blog posts, something like "DBT" could make this more systematic.
Overview: https://github.com/chipzx92/DataEngineeringI320/blob/main/docs/presentations/dbt_intro/index.md
Documentation Introduction: https://docs.getdbt.com/docs/introduction
This is issue is ONLY about creating a "Hello World" with these tools.
dbt can help with transformations, so augur could have additional schemas which are built as downstream "data products" to make access to different views possible. It is also useful when you have complex queries with a lot of CTEs, sub-queries, or unions, to make the sub parts more easily reusable and testable.
It requires a place to run, and write access to the schemas. I think that one can get started soonest using dbt cloud, but you can also install locally https://docs.getdbt.com/docs/quickstarts/dbt-core/quickstart
It works fine with postgres and while its SQL native you can also have python tasks, so it becomes more of a complete dag (e.g., the sentiment analysis or the email addresses entity resolution, can run at the right point in a pipeline.
@jameshowison : Does anyone on your team happen to have tried this with Augur? I am guessing not since it requires table creation permissions, it seems.
