Ben Cassell
Ben Cassell
@krifra1234 is the alter operation slow? The alternative is querying for metadata to decide whether to do it or not, and that is not particularly fast.
I mean set it as an environment variable. It might also work as a dbt variable, but not as config.
that variable only affects whether we call optimize explicitly.
@NodeJSmith since I commented that, I have subsequently seen issues where the connection gets broken but the thrift server does schedule the command for execution ;(
If we have a statement id, does that mean it was scheduled? I think the core idea makes sense if we have the ID available in cases where we get...
@jackyhu-db do you have ideas on this one?
https://docs.getdbt.com/reference/global-configs/behavior-changes#behavior-change-flags there is a bit about silencing the warnings.
The docs are a little hard to parse, but maybe "Deprecations"? https://docs.getdbt.com/reference/global-configs/warnings#configuration
@DVAlexHiggs recommend flagging to dbt Labs about this behavior
Almost certainly its because Databricks is truncating the type. Can you try specifying your column data_types in yml, and for the column in question, set the type as variant?