Ben Cassell
Ben Cassell
Are you running from a single local directory against the cluster? As part of compilation, dbt writes files to your target folder, and I'm wondering if running multiple tasks in...
Interesting, that is surprising. I'm fairly sure this should work, as I believe people do this sort of thing with airflow, so I'm surprised this wouldn't have come up sooner....
Can you submit a PR for your macro override? I was unaware this limitation has been lifted. I wonder which Databricks runtime version it's compatible with.
Oh yeah! I had forgotten that existed, but I do think it would be better to opt out on the config level.
Is this concurrency within a single run, or are you talking about running multiple instances of dbt targetting the same table? The latter I don't think has ever been intentionally...
Thanks for the report, will investigate.
Can you validate, do you have this same problem with 1.7.3? I think I know the cause, but getting that additional data point would help significantly. I'm pretty sure this...
Yeah, unfortunately there is required coordination. 1.7.4 has been pulled because it does not play nicely with cold-starting non-serverless SQL Warehouses. Working on fixing that at high priority so that...
Do you happen to know if you see the same behavior without using a composite key? It seems from your description that the core issue is that not-null constraints need...
Could you expand on this: > This is occurring on my workstation, as well as in our Dagster instance, but is not occurring in a Databricks workflow job (which are...