OpenMetadata icon indicating copy to clipboard operation
OpenMetadata copied to clipboard

Support ingestion of dbt Core artifacts from Fivetran-managed dbt runs

Open Prajwal214 opened this issue 5 months ago • 0 comments

Feature Add feature issue reference -- We’re using Fivetran’s managed dbt Core transformations for our pipelines. In this setup:

  • Fivetran executes our dbt project based on our Git repository.
  • However, the generated manifest.json, catalog.json, and run_results.json artifacts are not exposed for download or external hosting.

Currently, Collate relies on these artifacts (or a direct dbt Cloud integration) to map dbt models for lineage.

Describe the task A clear and concise description of what the bug is.

  • Native Fivetran integration that fetches or syncs dbt artifacts directly from Fivetran’s managed runs.
  • Support for pulling dbt run metadata through Fivetran’s API (if available).
  • Or an alternate Collate connector that can reconstruct model lineage directly from database metadata for Fivetran-managed dbt runs.

Prajwal214 avatar Jun 16 '25 11:06 Prajwal214