airflow
airflow copied to clipboard
apache
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
In examing our use of the statsd_exporter in airflow, we found a couple issues. We couldn't easily override the fork of the exporter image, becuase it requires pushing statsd.extraMappings. We...
### Apache Airflow version main (development) ### What happened When mapped, classic operator tasks exist within TaskGroups, the `group_id` of the TaskGroup is prepended to the displayed `task_id` in the...
Hello, We are used to using `helm install` / `helm upgrade` with the `--wait` option ; which is nice because the command returns only if install / upgrade is kind...
This has caused a bit of confusion to committers (missing off the `as dag`) and is just more user friendly This is on by default but can be disabled by...
Decorator to execute functions in k8s using KubernetesPodOperator closes: #19135 ``` @task.kubernetes(image='python:3.8-slim-buster', name='k8s_test', namespace='default') def k8s_decorator_func(): print("decorator func") ``` If no parameters passed, defaults are set in kubernetes.py ``` #...
Hi, This pull request is a fix to a potential variable misuse bug at `airflow/models/dagrun.py`. Please check the changes. Given the surrounding context, it seems to me that the correct...
--- Adds the ability to inject additional labels to specific components. This currently supports addition to scheduler, webserver, worker, pod template, triggerer, flower, cleanup and create user job. **^ Add...
--- **^ Add meaningful description above** Read the **[Pull Request Guidelines](https://github.com/apache/airflow/blob/main/CONTRIBUTING.rst#pull-request-guidelines)** for more information. In case of fundamental code change, Airflow Improvement Proposal ([AIP](https://cwiki.apache.org/confluence/display/AIRFLOW/Airflow+Improvements+Proposals)) is needed. In case of a...
Implement a pluggable dataset event manager. The idea is to have all of the logic that creates dataset events and adds rows to the `DatasetDagRunQueue` table flow through this manager....
### Apache Airflow version 2.2.4 ### What happened We would like to set up DAG specific permissions for users of our Airflow instance. We use LDAP for authentication, and have...
