public-datasets-pipelines
public-datasets-pipelines copied to clipboard
Check for missing or incorrectly named variables during a DAG deploy
Description
A common gotcha is when the Airflow variables are incorrectly set or missing in the .dev|.staging|.prod folders. We can catch this error upstream by checking if the variables in variables.json match the ones needed by the DAG file.
Checklist
- [x] I created this issue in accordance with the Code of Conduct.
- [x] This issue is appropriately labeled.