Allow passing airflow params as job parameter in databricks job

[SubhamSinghal]

Description

Currently if we need to pass any parameter to spark job we need to hardcode parameters in json config. But we want to pass parameters dynamically through airflow. This feature allows to pass airflow config paramaters as job parameters in spark job.

Use case/motivation

Dynamically update job parameter in spark job

Related issues

no

Are you willing to submit a PR?

• [X] Yes I am willing to submit a PR!

Code of Conduct

• [X] I agree to follow this project's Code of Conduct