airflow
airflow copied to clipboard
apache
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
- This resolves the following issue: https://github.com/apache/airflow/issues/25765 - We have tested this on our most recent deployment and confirmed that we are retrying these deadlocks gracefully now with this change...
### Description There already exists an SFTPOperator (documentation [here](https://airflow.apache.org/docs/apache-airflow-providers-sftp/stable/_api/airflow/providers/sftp/operators/sftp/index.html)) which provides an easy way to read data from an SFTP Server to the local disk or write data to an...
Sometimes Airflow doesn't have the ability to search across all indices in an Elasticsearch server. This might be due to security settings in the server. In these cases fetching the...
This PR tries to land https://github.com/apache/airflow/pull/3584. Most changes are from @Eronarn, I rebased on master and added a few tests. As per @Eronarn : > ### JIRA > AIRFLOW-249 Refactor...
### Apache Airflow version 2.3.4 ### What happened Tasks are no longer scheduled since upgrading to airflow.2.3.4, with logs: ``` {base_executor.py:211} INFO - task TaskInstanceKey(dag_id='sys_liveness', task_id='liveness', run_id='scheduled__2022-09-14T12:15:00+00:00', try_number=1, map_index=-1) is...
**Description** Following the useful feature of tags with https://airflow.apache.org/docs/apache-airflow/2.0.0/howto/add-dag-tags.html it would be great if there was an option here to choose different colours for the tags. **Use case / motivation**...
### Apache Airflow version 2.4.0 ### What happened Stopped existing processes, upgraded from airflow 2.3.4 to 2.4.0, and ran airflow db upgrade successfully. Upon restarting the services, I'm not seeing...
Amazon ECR Private registry [do not have permanent credentials](https://docs.aws.amazon.com/AmazonECR/latest/userguide/registry_auth.html#registry-auth-token). Users required manually obtain credentials and renew them every 12 hours or use [amazon-ecr-credential-helper](https://github.com/awslabs/amazon-ecr-credential-helper). This PR allow DockerHook get credentials not...
In PostgresHook the "schema" field is only being called like that to make it compatible with the underlying DbApiHook which uses the schema for the sql alchemy connector. The postgres...
--- **^ Add meaningful description above** Read the **[Pull Request Guidelines](https://github.com/apache/airflow/blob/main/CONTRIBUTING.rst#pull-request-guidelines)** for more information. In case of fundamental code changes, an Airflow Improvement Proposal ([AIP](https://cwiki.apache.org/confluence/display/AIRFLOW/Airflow+Improvement+Proposals)) is needed. In case of...
