airflow icon indicating copy to clipboard operation
airflow copied to clipboard

Accept task_key as an argument in `DatabricksNotebookOperator`

Open hardeybisey opened this issue 1 year ago • 0 comments

This PR introduces the ability for users to explicitly specify databricks_task_key as a parameter for the DatabricksNotebookOperator. If databricks_task_key is not provided, a default value is generated using the hash of the dag_id and task_id.

Key Changes:

  • Users can now define databricks_task_key explicitly.
  • When not provided, the key defaults to a deterministic hash based on dag_id and task_id.

Fixes: #41816 Fixes: #44250 related: #43106


^ Add meaningful description above Read the Pull Request Guidelines for more information. In case of fundamental code changes, an Airflow Improvement Proposal (AIP) is needed. In case of a new dependency, check compliance with the ASF 3rd Party License Policy. In case of backwards incompatible changes please leave a note in a newsfragment file, named {pr_number}.significant.rst or {issue_number}.significant.rst, in newsfragments.

hardeybisey avatar Dec 16 '24 13:12 hardeybisey