OpenMetadata
OpenMetadata copied to clipboard
Support ingestion of dbt Core artifacts from Fivetran-managed dbt runs
Feature Add feature issue reference -- We’re using Fivetran’s managed dbt Core transformations for our pipelines. In this setup:
- Fivetran executes our dbt project based on our Git repository.
- However, the generated manifest.json, catalog.json, and run_results.json artifacts are not exposed for download or external hosting.
Currently, Collate relies on these artifacts (or a direct dbt Cloud integration) to map dbt models for lineage.
Describe the task A clear and concise description of what the bug is.
- Native Fivetran integration that fetches or syncs dbt artifacts directly from Fivetran’s managed runs.
- Support for pulling dbt run metadata through Fivetran’s API (if available).
- Or an alternate Collate connector that can reconstruct model lineage directly from database metadata for Fivetran-managed dbt runs.