dlt-meta icon indicating copy to clipboard operation
dlt-meta copied to clipboard

It appears that schema ddl is being required when using cdc_apply_changes

Open mweirath opened this issue 1 year ago • 3 comments

I am trying to use cdc_apply_changes with a bronze table that we are using schema evolution (so no defined schema). Having a schema isn't required by Databricks for this operation, but it appears that the code is checking for a schema ddl before you can run use cdc_apply_changes.

mweirath avatar Aug 16 '24 23:08 mweirath

@mweirath see if this fix resolves it! If you are using autoloader you dont need to provide schema ddl and apply_changes would work for evolving schema.

ravi-databricks avatar Aug 17 '24 20:08 ravi-databricks

Thanks I will work on getting this version pulled in and tested tomorrow.

mweirath avatar Aug 19 '24 00:08 mweirath

@ravi-databricks - I confirmed with my team that we were able to pull in the change, and everything appears to be working now. Thank you for the quick fix. I will keep an eye out for v0.9 to come out.

I'm not sure if you close these or me.

mweirath avatar Aug 20 '24 04:08 mweirath

@mweirath you can close it with comments! thanks!

ravi-databricks avatar Aug 20 '24 16:08 ravi-databricks

Confirmed fixed, thank you.

mweirath avatar Aug 20 '24 23:08 mweirath