airflow

airflow copied to clipboard

--- This may possibly fix #39232. I tested the solution many times locally and deployed in Astro Cloud (so it gives me quite certainty it works). I don't really know...

JDarDagran

Decision for broken task log prefix feature

11

### Apache Airflow version 2.9.0 ### What happened? There is a part of code that may have been dead since airflow 2.0.0 for task logs prefix. The code is extending...

abhishekbhakat

We added `idx_last_scheduling_decision` on the `last_scheduling_decision` column in the `dag_run` table with Airflow 2.0.0. However, this index seems to have been unused with 0 index_scan counts throughout. I verified scheduler...

pankajkoti

let BigQueryGetData operator take a list of fields for the "order by" clause

5

### Description Sometimes you just need a the latest value of a field (e.g. `updatedAt`) so further operators downstream could use said value in their own query. This can be...

lopezvit

Increment try_number while clearing deferred tasks.

4

closes: #38735 related: #38735 This is already done while marking tasks as success/failure. Should this be done for up_for_reschedule tasks too? See also https://github.com/apache/airflow/pull/30669 https://github.com/apache/airflow/blob/d03ba594b3158c127c1c1b3f1d0c31fb93104367/airflow/api/common/mark_tasks.py#L161-L164

tirkarthi

Bugfix yaml parsing for GKEStartKueueInsideClusterOperator

2

Bugfix yaml parsing for `GKEStartKueueInsideClusterOperator`

moiseenkov

Power BI Provider

6

# Apache Airflow Provider for Power BI. ## Operators ### PowerBIDatasetRefreshOperator The operator triggers the Power BI dataset refresh and pushes the details of refresh in Xcom. It can accept...

ambika-garg

Add metrics_allow_list and metrics_block_list to statsd deployments env

1

I think it is needed to be ensure that the metrics_allow_list and metrics_block_list are added to the StatsD pod's environment variables. This update is crucial for refreshing the pod configuration...

Xiroo

Use kubeconfig as one of the optional parameters for creating KubernetesHook

1

### Description When we use `KubernetesPodOperator`, we need to create `KubernetesHook` in order to connect to Kubernetes services. There are currently 3 supported methods for creating `KubernetesHook`: 1、environment variable method,...

luoyuliuyin

We have plenty of the builtins variables/function with the same name as a builtins functions or constants . This PR rename it into the non production codebase (dev, tests) and...

Taragolis