airflow

airflow copied to clipboard

Add `output` property to common operator implementation

3

Currently the `output` property of operators is only available to unmapped "classic" operators. There can be use cases in which `XComs` from a set of mapped tasks need to be...

josh-fell

Add impersonation_chain parameter for ComputeEngineSSHHook

11

The parameter delegate_to parameter in the ComputeEngineSSHHook seems not working at all. So we dug into the code and added impersonation_chain parameter which is fully supported by the other file...

ginolegigot

Container specific extra environment variables

5

--- Adds the ability to inject additional environment variables to specific containers. This currently supports addition to scheduler, webserver, worker, triggerer, flower, cleanup jobs and wait-for-migrations containers **^ Add meaningful...

rishkarajgi

DatabricksSubmitRunOperator dbt task support

1

This PR adds support for the upcoming `dbt_task` to `DatabricksSubmitRunOperator`. Databricks is launching the Public Preview of the dbt task [1] soon, and this small change adds first-class support to...

gaborratky-db

Failed to manage per-DAG permission in clearing DAG run

5

### Apache Airflow version Other Airflow 2 version ### What happened I am using Airflow 2.2.4 and I am trying to achieve per-DAG permissions. I want to give a role...

twang90

Google cloud tasks sensor addition

4

### Description Needed a sensor for cloud tasks which can check if the cloud task queue is empty or not ### Use case/motivation We quite often find need of us...

vinitpayal

Dynamic Tasks inside of TaskGroup do not have group_id prepended to task_id

11

### Apache Airflow version 2.3.3 (latest released) ### What happened As the title states, if you have dynamically mapped tasks inside of a `TaskGroup`, those tasks do not get the...

Gollum999

Dockerfile centos

7

Hello @mik-laj and @potiuk I would like to contribute to airflow and I am sending preliminary changes for dockerfile for centos.

sfc-gh-mkmak

log_filename_template writes different try_number, then when it reads the log

7

### Apache Airflow version 2.3.3 (latest released) ### What happened When you use `remote_logging = True `and push the logs to GCS. It writes the log exactly as defined in...

kuikeelc

Separate instruction to install OS dependencies in images

2

This change will allow to experiment with other base images (for example CentOS that our users highly demand) but also it has a few nice simplifications and improvements along the...

potiuk