airflow
airflow copied to clipboard
apache
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
## Related Issue #50873 ## Why - The current asset graph doesn’t display data dependencies. ## How - add a toggle to switch between scheduling and data lineage gragh https://github.com/user-attachments/assets/49aacac6-7cce-4f6a-87d5-b6a3605810f2...
Attempting to fix the MySQL deadlocks and other SQLA2 no-autocommit issues. related: #58049 --- **^ Add meaningful description above** Read the **[Pull Request Guidelines](https://github.com/apache/airflow/blob/main/contributing-docs/05_pull_requests.rst#pull-request-guidelines)** for more information. In case of...
Root Cause Investigation: Intermittent failures and restarts of the DAG processor when using MySQL
### Apache Airflow version 3.1.0 ### If "Other Airflow 2/3 version" selected, which one? _No response_ ### What happened? I deployed Airflow in a Kubernetes environment and observed that the...
### Official Helm Chart version 1.18.0 (latest released) ### Apache Airflow version 3.0.2 ### Kubernetes Version 1.31 ### Helm Chart configuration ```yaml # List of existing Kubernetes secrets containing Base64...
### Apache Airflow Provider(s) amazon ### Versions of Apache Airflow Providers [apache-airflow-providers-amazon](https://airflow.apache.org/docs/apache-airflow-providers-amazon/8.28.0) - version 8.28.0 ### Apache Airflow version 2.10.1 ### Operating System MWAA ### Deployment Amazon (AWS) MWAA ###...
### Body This was previously discussed on [dev mailing list here](https://lists.apache.org/thread/d1klvrhlzjy819q6gr2lc80frb0ncmd4) and part of the proposal in [this doc](https://docs.google.com/document/d/1CXis3Ovmxm3pt4moiBIpsajX7GmRpGbcEfwt_blkSLI/edit?usp=sharing). ### User Story As a developer building interactive, data-driven applications, I...
Currently, [`models.BaseOperator`](https://github.com/apache/airflow/blob/887ac6b8610f2095e4a6df3799cca231cae4dde2/airflow-core/src/airflow/models/baseoperator.py#L80C7-L80C19) and [`models.DAG`](https://github.com/apache/airflow/blob/887ac6b8610f2095e4a6df3799cca231cae4dde2/airflow-core/src/airflow/models/dag.py#L308) use the Task SDK classes. This was done to maintain backwards-compat and to get 3.0 in a timely manner. However, we don't want to depend on...
This PR is part of the migration to SQLAlchemy 2.0 Previously, the hook only detected usage of `.query()` which returns a `Query` object. This update extends the check to also...
This PR updates the dependency to the v3-1-test branch. This ensures that we use the latest cache image built from v3-1-test when running the docker-compose setup in the airflowctl integration...
Dependabot had a lot of updates. I manually went through them. Will do eslint and typescript in a separate PR because it broke our CI --- **^ Add meaningful description...
