Accept task_key as an argument in `DatabricksNotebookOperator`
This PR introduces the ability for users to explicitly specify databricks_task_key as a parameter for the DatabricksNotebookOperator. If databricks_task_key is not provided, a default value is generated using the hash of the dag_id and task_id.
Key Changes:
- Users can now define databricks_task_key explicitly.
- When not provided, the key defaults to a deterministic hash based on dag_id and task_id.
Fixes: #41816 Fixes: #44250 related: #43106
^ Add meaningful description above
Read the Pull Request Guidelines for more information.
In case of fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in a newsfragment file, named {pr_number}.significant.rst or {issue_number}.significant.rst, in newsfragments.