airflow

airflow copied to clipboard

[FEAT] raise exception with main notebook error in DatabricksRunNowDeferrableOperator

4

1. Implement async method for getting job run output 2. logic for getting main notebook exception via async api calling and raising the exception **^ Add meaningful description above** Read...

gaurav7261

Add messages to task log about moving to queued

2

--- When troubleshooting a task that failed somewhere other than the main execute function, it is necessary to look across multiple logs and amidst many unrelated messages in the scheduler....

collinmcnulty

Fix invalid escape sequence in EKS Hook module

2

### Body Right now import `airflow/providers/amazon/aws/hooks/eks.py` raise **DeprecationWarning** / **SyntaxWarning** (depends on python version) ```json { "category":"DeprecationWarning", "message":"invalid escape sequence \\s", "filename":"airflow/providers/amazon/aws/hooks/eks.py", "lineno":79, "when":"collect", "node_id":null } ``` We should avoid...

Taragolis

Fix visible DagRun doesn't point to the same dag run id

4

As stated by @nivdror, displaying a DAG RUN date different from the dag run id may cause confusion to users. I fixed this by changing the default displayed date to...

lotrias17

Fix DAG test command stuck in infinite loop

8

closes: https://github.com/apache/airflow/issues/28865 The DAG test command stuck in infinite loop when DAG is paused 1. task resume from deferable state: TI change from deferrable to scheduled 2. task has retry...

pankajastro

Increment try_number for externally failed tasks

9

While working on PR #32646, I observed that when tasks are marked failed externally like from the scheduler e.g. in the case when scheduler marks the task as failed as...

pankajkoti

Fix parsing connection uri which contains a composite protocol sparated by :

10

closes: #33442 It seems like urlsplit fails to correctly parse the url when the protocol contains a colon character. As a workaround, this PR replaces the colon character in the...

hussein-awala

related: #36797 #38902 Be able to render map index while dry-running, as .dry-run() already renders templated fields (all but map index) --- **^ Add meaningful description above** Read the **[Pull...

anteverse

Fix "matchExpressions" for "nodeAffinity"

2

chs2

kubernetes_executor does not properly fail task-instances in cleanup_stuck_queued_tasks

4

### Apache Airflow version Other Airflow 2 version (please specify below) ### If "Other Airflow 2 version" selected, which one? 2.8.3 ### What happened? I'm chasing an issue involving a...

waldoppper