airflow

airflow copied to clipboard

Fix incorrect data interval alignment due to assumption on input time alignment

5

This introduces a new `_align_to_prev` util function for cron-based interval alignment. Previously we assumed `_get_prev(_align_to_next(t))` is enough for this purpose, but this proved incorrect (see discussions in #21715), and an...

wanlce

breeze test parallel

11

relates to: #23538 closes: #23538 --- **^ Add meaningful description above** Read the **[Pull Request Guidelines](https://github.com/apache/airflow/blob/main/CONTRIBUTING.rst#pull-request-guidelines)** for more information. In case of fundamental code change, Airflow Improvement Proposal ([AIP](https://cwiki.apache.org/confluence/display/AIRFLOW/Airflow+Improvements+Proposals)) is...

Bowrna

WIP: Operator name separate from class

4

Closes #22762. --- **^ Add meaningful description above** Read the **[Pull Request Guidelines](https://github.com/apache/airflow/blob/main/CONTRIBUTING.rst#pull-request-guidelines)** for more information. In case of fundamental code change, Airflow Improvement Proposal ([AIP](https://cwiki.apache.org/confluence/display/AIRFLOW/Airflow+Improvements+Proposals)) is needed. In case...

norm

Add the option of sending the DAG parser logs to stdout

2

jhtimmins

Random DagRuns set to running during large catch up

1

### Apache Airflow version Other Airflow 2 version; 2.2.3. We are planning to upgrade soon but that takes some time with custom plugins :p ### What happened We cleared a...

Jorricks

Only excluded actually expanded fields from render

1

Previously we excluded all mapped kwargs from being rendered, which cause issues for fields that are not actually rendered during expansion (i.e. those that are literals). This new implementation adds...

uranusjr

Dataproc submit job operator async

10

Add `deferrable` capability to existing `DataprocJobBaseOperator` and `DataprocSubmitJobOperator` operators. --- **^ Add meaningful description above** Read the **[Pull Request Guidelines](https://github.com/apache/airflow/blob/main/CONTRIBUTING.rst#pull-request-guidelines)** for more information. In case of fundamental code changes, an...

bjankie1

Moves dataset-triggered dagrun creation to the main scheduler loop so that the _target_ dag can be locked. Makes the run_id of the dataset-triggered dagrun deterministic. Adds a table to map...

dstandish

Dynamically mapped sensor with mode='reschedule' fails with violated foreign key constraint

1

### Apache Airflow version 2.3.3 (latest released) ### What happened If you are using [Dynamic Task Mapping](https://airflow.apache.org/docs/apache-airflow/stable/concepts/dynamic-task-mapping.html) to map a Sensor with `.partial(mode='reschedule')`, and if that sensor fails its poke...

Gollum999

Update azure-storage-blob version

16

We restricted version in https://github.com/apache/airflow/pull/18443 due to error in static checks https://github.com/apache/airflow/pull/17068#issuecomment-925264410 Tests pass locally with the updated version --- **^ Add meaningful description above** Read the **[Pull Request Guidelines](https://github.com/apache/airflow/blob/main/CONTRIBUTING.rst#pull-request-guidelines)**...

eladkal