airflow
airflow copied to clipboard
apache
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
### Apache Airflow version Other Airflow 2 version (please specify below) ### If "Other Airflow 2 version" selected, which one? 2.8.1 ### What happened? Some of the SQL Sensors from...
This PR allows TaskGroup(s) to be passed as `branch` in the operators that use `BranchMixIn`. With this implementation, if the provided string is a `task_group_id` instead of `task_id`, it will...
Fix GCSObjectExistenceSensor to return the xcom value if the object already exists upon first run. At present, if the object already exists before the DAG runs, the xcom value is...
### Apache Airflow version Other Airflow 2 version (please specify below) ### If "Other Airflow 2 version" selected, which one? 2.8.3 ### What happened? We are facing intermittent json error...
closes: https://github.com/apache/airflow/issues/35271 related: Attempt to fix tests and checks from https://github.com/apache/airflow/pull/35292 This PR adds support to use role arn's for AWS credentials in storage transfer jobs. All of the substantive...
### Description When you're on the UI page for a specific dataset `datasets?uri=MY_DATASET`, I think it would be nice to show the `extra` dictionary. ### Use case/motivation I sometimes attach...
Closes: #32928 A race condition occurs in the _adopt_completed_pods function when schedulers are running concurrently. _adopt_completed_pods function doesn't keep track of which scheduler went down so it constantly tries to...
This PR adds `CloudDataTransferServiceRunJobOperator` which runs a pre-configured storage data transfer service using it's `job_name`. Closes: #22016
Validate and truncate `trigger_reason` field if it is longer than the limit of 255 characters. closes: #34676