airflow icon indicating copy to clipboard operation
airflow copied to clipboard

Add todo re exception handling in dagrun create loop

Open dstandish opened this issue 3 weeks ago • 0 comments

In SchedulerJobRunner, in _create_dag_runs, we do except Exception: ... continue but this does not work when the exception is the result of a db error; in that case you need to roll the transaction back.

To fix this we need either smaller transactions (e.g. one per dag run create attempt) or savepoints. either way it's a bit of a refactor.

Issue: https://github.com/apache/airflow/issues/59120


^ Add meaningful description above Read the Pull Request Guidelines for more information. In case of fundamental code changes, an Airflow Improvement Proposal (AIP) is needed. In case of a new dependency, check compliance with the ASF 3rd Party License Policy. In case of backwards incompatible changes please leave a note in a newsfragment file, named {pr_number}.significant.rst or {issue_number}.significant.rst, in airflow-core/newsfragments.

dstandish avatar Dec 05 '25 23:12 dstandish