[FEA] Add support for Databricks 14.3 ML LTS

[sameerz]

Is your feature request related to a problem? Please describe. Add support to the plugin for Databricks 14.3 ML LTS

Describe the solution you'd like Add a shim layer for Databricks 14.3 (Spark 3.5.0)

Describe alternatives you've considered N/A

Additional context