airflow icon indicating copy to clipboard operation
airflow copied to clipboard

Explore and add static checks for DAGs for early detection of common issues

Open omkar-foss opened this issue 1 year ago • 0 comments

Description

As per users' feedback in the Airflow Debugging Survey 2024, 48.3% of respondents chose early issue detection during execution as one of their top 2 choices.

Use case/motivation

Goal of this issue:

  • Enhance early detection of DAG issues to minimize dev time
  • Some sort of static analysis similar to Ruff checks for DAGs
  • Runtime analysis of DAGs if feasible can also be done to save dev time

Related issues

Parent Issue: https://github.com/apache/airflow/issues/40975

Are you willing to submit a PR?

  • [ ] Yes I am willing to submit a PR!

Code of Conduct

omkar-foss avatar Oct 18 '24 20:10 omkar-foss