elementary
elementary copied to clipboard
BigQuery cross region lineage
Overview -
- Today the location defined in profiles.yml is being used when querying the information schema (BigQuery's information schema view name contains the region)
- If the same project contains different datasets in different locations, the lineage will be calculated based on queries in the configured region only
- The requested enhancement here is to get a list of configured regions and to use queries from all regions when building the lineage graph