airflow
airflow copied to clipboard
apache
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
- Background: GCS blobs can be associated with metadata to make tracking and validating data easier. The `GCSHook` doesn't yet allow for the metadata attribute to be exposed, although it...
related: #28723 fix deprecations for SQLAlchemy 2.0 for Airflow core task command. SQLAlchemy 2.0 is changing the behavior when an object is being merged into a Session along the backref...
API endpoint to request reparsing of DAG. The API is useful in cases when users have lots of dags and want to prioritize the parsing of a particular dag. We...
Add the `triggered_by` field to the DAG Run model to distinguish the source of a trigger. This is for the discussion in https://github.com/apache/airflow/pull/37087. > Currently this PR contains only the...
> Before merging this PR we need to merge #38633 This PR is for raising exception for the deprecated services of [AutoML](https://cloud.google.com/automl/docs) ([Tables](https://cloud.google.com/automl-tables/docs/deprecations), [Vision](https://cloud.google.com/vision/automl/docs/deprecations), [Video Intelligence](https://cloud.google.com/video-intelligence/automl/docs/deprecations), [Natural Language](https://cloud.google.com/natural-language/automl/docs/deprecations)) which are...
After debugging some user issues i feel like we could add some more DEBUG level logs, so that we can deduce more information about what's happening inside OpenLineage. We should...
This PR adds a new `retry_from_failure` parameter to the `DbtRunJobOperator` to retry a failed run of a dbt Cloud job from the point of failure. The implementation uses the new...
### Apache Airflow Provider(s) cncf-kubernetes ### Versions of Apache Airflow Providers apache-airflow-providers-cncf-kubernetes 8.0.1 apache-airflow-providers-celery 3.6.1 ### Apache Airflow version 2.8.3 ### Operating System Debian GNU/Linux 12 (bookworm) ### Deployment Official...
--- When I use ftp hook in my airflow env, it will wait till timeout when I use a none-standard ftp port. I fixed it by modify the source code....
This is a huge PR being result of over a 100 commits made by a number of people in ##36052 and #37638. It switches to Connexion 3 as the driving...
