airflow

airflow copied to clipboard

templated fields logic checks for cloud_storage_transfer_service

8

--- The PR fixes assignment of parameters in constructor initialization for the google cloud_storage_transfer_service ensuring templated fields' parameters correspond to constructor initialization. **^ Add meaningful description above** Read the **[Pull...

okirialbert

BigQueryDataTransferServiceStartTransferRunsOperator got Access Denied error on long-running migration jobs.

1

### Apache Airflow Provider(s) google ### Versions of Apache Airflow Providers latest ### Apache Airflow version 2.3.x ~ latest ### Operating System Debian GNU/Linux 11 (bullseye) ### Deployment Official Apache...

okayhooni

Airflow variable export-import does not include description field

1

### Apache Airflow version Other Airflow 2 version (please specify below) ### If "Other Airflow 2 version" selected, which one? 2.6.3 ### What happened? On airflow UI, Admin > Variables...

prithvi-git

--- Update logic in `Amazon/aws` providers for `batch_client` `hook`'s `parse_job_description` function. This function is ONLY called within the `get_job_description` function that allows for retries; however, there is only handling of...

evgenyslab

Statsd metric name components are unsanitized

2

### Apache Airflow version Other Airflow 2 version (please specify below) ### What happened [2.2.5] I recently enabled statsd metric emission on my team's deploy and began writing views on...

waldoppper

Add dataset event dataset dag run queue association

1

--- **^ Add meaningful description above** Read the **[Pull Request Guidelines](https://github.com/apache/airflow/blob/main/contributing-docs/05_pull_requests.rst#pull-request-guidelines)** for more information. In case of fundamental code changes, an Airflow Improvement Proposal ([AIP](https://cwiki.apache.org/confluence/display/AIRFLOW/Airflow+Improvement+Proposals)) is needed. In case of...

sunank200

Airflow Helm Chart 1.11.0 doesn't fresh install Airflow on an On Premises Kubernetes 1.28.2 Cluster

3

### Official Helm Chart version 1.11.0 (latest released) ### Apache Airflow version 2.7.1 ### Kubernetes Version 1.28.2 ### Helm Chart configuration The vanilla command copied from documentation: ``` helm upgrade...

gbonazzoli

Re-launch the same spark operator is failing with error "sparkapplications.sparkoperator.k8s.io \"smoke-test\" already exists"

1

### Apache Airflow version 2.7.2 ### What happened I am using following code to launch PySpark Job:- t1 = SparkKubernetesOperator( task_id='env-check', namespace="spark-operator", application_file='pipeline.yaml', do_xcom_push=True, dag=dag, ) t2 = SparkKubernetesSensor( task_id='env_app_monitor',...

xs2tarunkukreja

Fix docker compose command in "Running Airflow in Docker"

11

On the page [Running Airflow in Docker](https://airflow.apache.org/docs/apache-airflow/stable/howto/docker-compose/index.html#initialize-the-database) Running `docker compose up airflow-init` with the [provided docker-compose.yaml](https://airflow.apache.org/docs/apache-airflow/2.8.0/docker-compose.yaml) does not initialize the database. It will execute the command provided in the docker-compose.yaml...

jtommi

Dynamic Task Mapping TriggerDagRunOperator breaks grid/graph view

6

### Apache Airflow version 2.8.1 ### If "Other Airflow 2 version" selected, which one? 2.6.1 ### What happened? I am using dynamic task mapping of TriggerDagRunOperator to trigger sub-dags based...

jkarun