dagster icon indicating copy to clipboard operation
dagster copied to clipboard

Published 20 hours ago • verified publisher icon dagster-io

Handle `dbt deps` in DbtProject

Open maximearmstrong opened this issue 10 months ago • 2 comments

Summary & Motivation

This PR updates DbtProject and DagsterDbtManifestPreparer to handle dbt deps.

Process in DagsterDbtManifestPreparer:

  • Check for the presence of dependencies.yml or packages.yml
  • Check for the presence of dbt_packages
  • If (a) exists and (b) is not present, then run dbt deps. On subsequent manifest creation, we shouldn't need to redownload the deps.

Fixes our dbt NUX for dbt project including a dependencies.yml file.

How I Tested These Changes

BK make apidoc-build dagster dev

maximearmstrong avatar Apr 18 '24 21:04 maximearmstrong

  • #21296 Graphite 👈
  • master

This stack of pull requests is managed by Graphite. Learn more about stacking.

Join @maximearmstrong and the rest of your teammates on Graphite Graphite

maximearmstrong avatar Apr 18 '24 21:04 maximearmstrong

Deploy preview for dagster-docs ready!

Preview available at https://dagster-docs-ogdpu020e-elementl.vercel.app https://maxime-run-dbt-deps-in-dbt-project.dagster.dagster-docs.io

Direct link to changed pages:

github-actions[bot] avatar Apr 18 '24 21:04 github-actions[bot]