Ben Cassell
Ben Cassell
@AliAl-Gburi this is something we are thinking about as well. I think where things are a little complicated is that some dbt tags are strictly for dbt operations (e.g. I...
Hi @AliAl-Gburi. I've got a PR for this now, for our 2.0.0 release (aligning with the dbt-core 1.8.0 release).
Recommend filing a ticket with Databricks to understand your options. I suspect there has been a Databricks Runtime change, and if you are using an AP Cluster, you can set...
Unfortunately no transaction support in Databricks at this time. I think the core issue though is that Databricks treats external locations as unmanaged, i.e. that if you have files in...
@sugendran that line exists because a delta table cannot 'create or replace' a non-delta table, so the old table needs to be dropped. With parquet in an external location, I'm...
You should be able to download them from the Workflow UI after the job has completed, though I have seen instances where the button doesn't show up. If the commands...
This issue is best addressed by filing tickets with Databricks. The adapter does not control whether you can download artifacts from a job.
Thanks for reporting.
This is somewhat fixed now, but since I don't yet have a PySpark API that lets me apply as part of create, it is applied as an alter, and I'm...
Thanks for the report and the debugging. Will incorporate the fix into the next release; due to holidays, however, this release will probably not be available until after New Year.