[FEA] Move `_databricks_internal` check to shim layer

[andygrove]

Is your feature request related to a problem? Please describe. PR https://github.com/NVIDIA/spark-rapids/pull/6257 added a check for _databricks_internal for 22.08. We need to move check to the shim layer so that we only look for this when running on Databricks.

Describe the solution you'd like As above.

Describe alternatives you've considered None

Additional context None