[Bug] New test failure for `tests/functional/adapter/test_python_model.py::TestPythonIncrementalModelSpark::test_incremental`

[mikealfare]

Current Behavior

This is a consistently failing new test. It's only failing for the databricks_cluster and databricks_http_cluster profiles.

Expected Behavior

Tests should be passing

Steps To Reproduce

Example run: https://github.com/dbt-labs/dbt-spark/actions/runs/8929946690/job/24528918056. This resulted from a dev-requirement.txt update.