airflow
airflow copied to clipboard
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
--- The project id is passed pretty much everywhere except here. From my understanding it causes the hook to fallback to the account's project id only for `get_job` method. It...
We've expanded the dataset dependency handling in Airflow, building on PR apache/airflow#37016. This PR introduces the use of logical operators (`|` for OR and `&` for AND) to link `Dataset`...
### What do you see as an issue? Referring to: https://airflow.apache.org/docs/apache-airflow/2.3.4/howto/create-custom-decorator.html The documentation is unclear. It assumes that the reader has done a bunch of things that haven't been well...
This PR implements a filesystem listener to immediately process changes in the DAGs folder. Still some TODOs but creating the PR for testing/feedback. closes: https://github.com/apache/airflow/discussions/27208
related: #36723 --- This PR introduces a new POST endpoint for dataset events in Apache Airflow. It allows for the registration of dataset events, enabling more dynamic tracking and management...
closes: #36270 Avoid malicious scripts by escaping html tags in the different fields. This does not apply to the password because it is not a string field. Previous attempt PR:...
### Apache Airflow Provider(s) amazon ### Versions of Apache Airflow Providers 8.7.1 ### Apache Airflow version 2.7.2 ### Operating System AWS service ### Deployment Amazon (AWS) MWAA ### Deployment details...
This PR adds secret caching for the Airflow CLI. [Secret caching](https://airflow.apache.org/docs/apache-airflow/stable/configurations-ref.html#use-cache) current only works for the DAG-processing job, but is ignored when parsing the files through the CLI. This currently...
--- **^ Add meaningful description above** Read the **[Pull Request Guidelines](https://github.com/apache/airflow/blob/main/contributing-docs/05_pull_requests.rst#pull-request-guidelines)** for more information. In case of fundamental code changes, an Airflow Improvement Proposal ([AIP](https://cwiki.apache.org/confluence/display/AIRFLOW/Airflow+Improvement+Proposals)) is needed. In case of...
### Apache Airflow Provider(s) databricks ### Versions of Apache Airflow Providers The error has not been present in version `apache-airflow-providers-databricks==4.7.0` I upgraded to the latest and it is present`apache-airflow-providers-databricks==6.0.0` ###...