airflow
airflow copied to clipboard
apache
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
This PR adds `scheduler.hostAliases` and `webserver.hostAliases` parameter in helm chart in order to use [kubernetes HostAliases](https://kubernetes.io/docs/concepts/services-networking/add-entries-to-pod-etc-hosts-with-host-aliases/) in scheduler and webserver pods.
This adds a liveness probe to our workers, to help guard against the worker being "up" but not communicating with Celery. Might help with #24731, though it'll be a pretty...
### Apache Airflow version main (development) ### What happened Any mapped task will do, but here's a DAG with two: ```python3 with DAG( dag_id="zip_tf", schedule_interval=timedelta(days=30 * 365), start_date=datetime(1970, 1, 1),...
There are two issues with mapped sensor with `reschedule` mode. First, the reschedule table is being populated with a default map_index of -1 even when the map_index is not -1....
According to k8s's docs on pod phase [1], "Running" state means "The Pod has been bound to a node, and all of the containers have been created. At least one...
### Body I have a kind request for all the contributors to the latest provider packages release. Could you please help us to test the RC versions of the providers?...
splitting out to other PR so as not to block main one
While releasing the providers two small problems were detected (as I recreated all my envs from scratch and released even rc3 this time :)) --- **^ Add meaningful description above**...
### Discussed in https://github.com/apache/airflow/discussions/25638 See the discussion. There are a couple of improvements that can be done: * add atribute to download the log rather than open it in-browser *...
Updating statsd-exporter `mappings.yml` file, for all current Airflow supported metrics that require mapping - metrics with variable name that can be mapped to Prometheus label (like job/dag/task_id). > We should...
