airflow
airflow copied to clipboard
Explore and add static checks for DAGs for early detection of common issues
Description
As per users' feedback in the Airflow Debugging Survey 2024, 48.3% of respondents chose early issue detection during execution as one of their top 2 choices.
Use case/motivation
Goal of this issue:
- Enhance early detection of DAG issues to minimize dev time
- Some sort of static analysis similar to Ruff checks for DAGs
- Runtime analysis of DAGs if feasible can also be done to save dev time
Related issues
Parent Issue: https://github.com/apache/airflow/issues/40975
Are you willing to submit a PR?
- [ ] Yes I am willing to submit a PR!
Code of Conduct
- [x] I agree to follow this project's Code of Conduct