dataform icon indicating copy to clipboard operation
dataform copied to clipboard

Does Dataform support `ALLOW_FIELD_ADDITION` for incremental table related jobs ?

Open Rstar1998 opened this issue 2 years ago • 3 comments

Big Query does support addition of new column if it does not exist. For incremental tables there might be instances that a new column might be added. Hence it would be beneficial to have a parameter like ALLOW_FIELD_ADDITION=true which will add new columns in the target table if they are added in the source table

Rstar1998 avatar Oct 25 '22 16:10 Rstar1998

+1

nmohseny-atz avatar Feb 14 '23 19:02 nmohseny-atz

Yes please! This is very painful in models with heavy use of incrementals.

astorrs avatar Feb 14 '23 19:02 astorrs

Note: this implementation for this is similar to the request in https://github.com/dataform-co/dataform/issues/1359, as it interacts with the API in the same way.

Ekrekr avatar Apr 02 '24 13:04 Ekrekr