apache
Support Task execution interface (AIP-72) in Airflow 3 in EdgeExecutor
The introduction of AIP-72 and removal of AIP-44 in main broke the EdgeExecutor/EdgeWorker on main.
This PR makes it working again as the second executor supporting AIP-72 for the first "edge cases" and check.
Note: Two commits, first one is an extension in the Executor API which is needed to ship a session context to EdgeExecutor not to break DB lock during scheduling as EdgeExecutor need to write to DB. Let me know if I should separate into two PRs... (as of dev rules core and provider changes bundled here)
@ashb Would very much favor a review from you here if the design anticipated for AIP-72 is correctly understood how integrated.
If you want to test with Airflow 3, use:
breeze start-airflow --python 3.12 --load-example-dags --backend postgres --executor EdgeExecutor --answer y
In Airflow 3 the "example_bash_operator" is working, not all other DAGs.
If somebody wants to test Airflow 2.10 as regression, this can be made via:
breeze down && rm dist/* && breeze release-management prepare-provider-packages --include-not-ready-providers edge && breeze start-airflow --python 3.12 --load-example-dags --backend postgres --executor EdgeExecutor --answer y --use-airflow-version 2.10.4 --use-packages-from-dist
FYI @AutomationDev85
