airflow

airflow copied to clipboard

Kubernetes Executor Task Leak

37

### Apache Airflow version 2.8.1 ### If "Other Airflow 2 version" selected, which one? _No response_ ### What happened? Scheduler stops processing DAGs and moving them to the queued status....

smhood

Feature Request - Pool Support for Task Groups in Apache Airflow

3

### Description I would like to propose a new feature for Apache Airflow: the ability to assign a pool to an entire task group, enabling better control over the execution...

rodolfo-nobrega

Allow Dag Processor Manager to log to stdout

4

### Description On Airflow 2.8.1, the DAG processor manager no longer logs out to stdout (whereas it did on 2.6.2). ### Use case/motivation We currently have a configuration option for...

plmnguyen

Add ability to disable a running DAG only after after it's in a finished state

26

### Description I'd like the ability to "drain" a DAG from the UI. This would mean: - If a DAG is in a running state - disable the DAG after...

SangwanP

KubernetesPodOperator callback example from Doc doesn't work

2

### What do you see as an issue? https://airflow.apache.org/docs/apache-airflow-providers-cncf-kubernetes/stable/operators.html#id13 The problem may related to the None value for api_version and kind see. log below ```python import kubernetes.client as k8s import...

owler

fix: use `sqlalchemy_url` property in `get_uri` for postgresql provider

2

~~closes: #38187~~ related : #38195 Update `get_uri` to return URI in sqlAlchemy URI format.

rawwar

Create a Cloud Storage Operator that could return a list of objects in a folder

2

### Description Create a new operator inside of `airflow.providers.google.cloud.operators.gcs` that, given a pattern/preffix would return a list of files in said folder, similar to the client method: storage_client.get_bucket(BUCKET_NAME) bucket.list_blobs(prefix=filename) ###...

lopezvit

Rendering custom map index before task is run.

5

### Description The map_index_template field on a task is used to render a custom name for each individual sub task in a mapped task. It is generated by rendering the...

tomrutter

KubernetesPodOperator duplicating logs when interrupted

4

### Apache Airflow version Other Airflow 2 version (please specify below) ### If "Other Airflow 2 version" selected, which one? 2.8.1 ### What happened? The KubernetesPodOperator is duplicating tasks's logs...

Nikita-Sobolev

Fix TIPydantic serialization of MappedOperator

1

Previously we relied on SerializedBaseOperator.serialize_operator for serialization of all Operator objects but this is no bueno because it does not work for mapped operator. Instead we use BaseSerialization.serialize, which calls...

dstandish