hooli-data-eng-pipelines
hooli-data-eng-pipelines copied to clipboard
dagster-io
Example Dagster Cloud code for the Hooli Data Engineering organization.
The past version of hooli relied on auto-materialization policies. Primarily these policies were based on the default eager auto-materialization strategy, with some customization to prevent missing or outdated partitions from...
Small change, but useful to show how you could use the stream_definition to determine the asset group name (similar to how we do so with dbt metadata format of `stream_definition`...
moves from using `**build_kind_tags` to `kinds=` wherever possible. Currently seems like Sling and dagstermill are the two exceptions. Tested locally by making sure that the kind tags did what I...
This blueprints example constructs a dbt job for any yaml file with the appropriate config under the `hooli_data_eng/blueprints/blueprints_jobs/` directory—the job config is defined by the `DbtSelectScheduledJobBlueprint` class.
Metadata
Owner
Metadata
Example Dagster Cloud code for the Hooli Data Engineering organization.