airflow

airflow copied to clipboard

Versioned dag run uses the latest version of serialized dag in the Scheduler instead of sticking to their version

2

### Apache Airflow version 3.0.0 ### If "Other Airflow 2 version" selected, which one? _No response_ ### What happened? Previously, when a DAG had multiple versions due to changes (e.g.,...

vatsrahul1001

changing import path to airflow.sdk

8

related: #49648 Changes imports in amazon provider to use airflow.sdk --- **^ Add meaningful description above** Read the **[Pull Request Guidelines](https://github.com/apache/airflow/blob/main/contributing-docs/05_pull_requests.rst#pull-request-guidelines)** for more information. In case of fundamental code changes,...

Bowrna

Add dataset import data verification

1

For the: - VertexAI datasets - Trasnalation native model datasets --- **^ Add meaningful description above** Read the **[Pull Request Guidelines](https://github.com/apache/airflow/blob/main/contributing-docs/05_pull_requests.rst#pull-request-guidelines)** for more information. In case of fundamental code changes,...

olegkachur-e

### Description Initially we thought of move the tutorials (dags, tasks, taskflow etc etc.) from apache-airflow-core to task-sdk docs but later with discussion with @cmarteepants we have decided to cross-link...

sunank200

--- This PR introduces a new BteqOperator within the Airflow Teradata provider to support the execution of Teradata BTEQ (Basic Teradata Query) scripts as part of Airflow DAGs. The operator...

sc250072

Verify decorators parameter in __init__.pyi matches operator

6

related: #48448 closes: #48448 Add tests to all existed decorators to make sure the parameter list they accept matches the operator. In this PR, I have added tests to verify...

Bowrna

(cherry picked from commit 23ecee8c08dc1bc5e5e12151ccd3eb39632d739d) Co-authored-by: Amogh Desai

github-actions[bot]

Do not dynamically determine operator extra links for BatchOperator

4

--- This pull request is an extension of [Do not dynamically determine op links for emr serverless start job operator](https://github.com/apache/airflow/pull/40627). For the same reasons pointed out by @o-nikolas on his...

laredoo

Resolve OOM When Reading Large Logs in Webserver

10

related issue: #45079 related PR: #45129 related discussion on slack: https://apache-airflow.slack.com/archives/CCZRF2U5A/p1736767159693839 ## Why In short, this PR aims to eliminate OOM issues by: - Replacing full log sorting with a...

jason810496

Investigate `Timetable` usage for client-server separation

3

Analyze current timetable usage in scheduler vs DAG processor. Decide if timetables belong in core, task-sdk, or separate package (`airflow-commons`/`airflow-protocols`).

kaxil