overwatch
overwatch copied to clipboard
Check for Warehouse ID values in all Job Runs executed on Warehouse
Databricks Jobs team does not deliver warehouse ID for all SQL task executions. Identify the gaps and determine if the jobs team is willing/able to deliver this data.
As part of the investigation, let's ensure all the data (cluster and warehouse_ids) are flowing properly, and that overall the pipeline works as expected.
@aman-db now that the ES ticket is resolved, please double check if this is still an ongoing issue