Daniel Standish

Results 38 issues of Daniel Standish

Grid view optimization

Work in progress branch for grid optimization I break up the monolith that is grid_data. The headline here is, with 3k tasks in a dag, loading time for 10 runs...

area:API
area:UI

Provide interface for getting partition key (and updating asset partition) when dag has no partition key but does have logical date???

### Body _No response_ ### Committer - [x] I acknowledge that I am a maintainer/committer of the Apache Airflow project.

kind:feature
kind:meta
area:core

Ability to not update asset partition when dag run has partition key?

### Body _No response_ ### Committer - [x] I acknowledge that I am a maintainer/committer of the Apache Airflow project.

kind:feature
kind:meta
area:core

Implement rollup / windowing

### Body _No response_ ### Committer - [x] I acknowledge that I am a maintainer/committer of the Apache Airflow project.

kind:feature
kind:meta

Implement multi-asset dependencies

### Body _No response_ ### Committer - [x] I acknowledge that I am a maintainer/committer of the Apache Airflow project.

kind:feature
kind:meta

Resolve race condition re creation of APDR records

10 comment

### Body When two tasks run at the same time and they contribute to the creation of the same dag run and partition key, then they can create different apdr...

kind:bug
area:Scheduler
kind:meta

Implement partition-driven scheduling on a dag (i.e. not asset-driven)

area:Scheduler

Add todo re exception handling in dagrun create loop

In SchedulerJobRunner, in _create_dag_runs, we do except Exception: ... continue but this does not work when the exception is the result of a db error; in that case you need...

area:Scheduler