dbt-databricks icon indicating copy to clipboard operation
dbt-databricks copied to clipboard

Support for `MERGE WITH SCHEMA EVOLUTION`

Open stevenayers-bge opened this issue 1 year ago • 2 comments
trafficstars

Describe the feature

Add support for the new MERGE WITH SCHEMA EVOLUTION syntax available on the current and preview channel SQL Warehouse versions. https://docs.databricks.com/en/delta/update-schema.html#schema-evolution-syntax-for-sql.

This is especially useful if you need schema evolution on struct data types.

The change is quite easy SQL wise, but I don't know how you would want to expose the option... via on_schema_change?

stevenayers-bge avatar Jun 24 '24 07:06 stevenayers-bge

@stevenayers-bge Hi, just to be sure I understand correctly. What is the difference between running this and setting the parameter for the table?

Based on Databricks documentation there are no differences.

Some use case might be helpful.

mi-volodin avatar Jul 25 '24 16:07 mi-volodin

Fixed in #739

mi-volodin avatar Aug 21 '24 12:08 mi-volodin