oliver-twist
oliver-twist copied to clipboard
a rule check specification
add the following rules: lineage checks:
- 🆗 Disabled Scripts
- 🆗 Orphan models
- 🆗 Rejoined models. Given following model dependency:
A -> B -> C
. ModelC
should not depend onA
- 🆗 Staging scripts referencing a staging script in a different area
- 🆗 Staging scripts referencing a mart
- 🆗 Marts directly referencing a source
meta checks on physical models(model that is not ephemeral):
- 🆗 no owner defined as per(https://docs.getdbt.com/reference/resource-properties/meta/#designate-a-model-owner)
- no description defined
- no pii defined
advanced lineage check:
- detect similar sub graphs which they originate from the same set of sources to figure out if there is a potential code reuse(enforce single source of truth, thinking that it would highlight duplicate code)
TODO:
- think about seeds
@georgim0 where are you up to with this?