dbt-labs-experimental-features icon indicating copy to clipboard operation
dbt-labs-experimental-features copied to clipboard

Adding partition/cluster functionality to bigquery mv config

Open makermary opened this issue 2 years ago • 5 comments

Using logic similar to the partition/cluster code for a regular table, this commit adds this functionality to the bigquery materialized_view feature.

Tested by replacing the code in my local install of dbt-labs-experimental-features. If a materialized view already exists without partitions, users must do a --full-refresh for the partition to exist.

Solves #28.

makermary avatar Apr 26 '22 12:04 makermary

This would be an extremely helpful feature to have for us. Thank you.

waitsfornone avatar May 02 '22 13:05 waitsfornone

Definitely appreciate if this becomes a feature!

minhnhat992 avatar May 05 '22 18:05 minhnhat992

@makermary Very cool, thanks for opening! I'll take a look in the next couple days. The MV code needs a bit of a refresh as is.

jtcohen6 avatar May 06 '22 12:05 jtcohen6

@makermary Very cool, thanks for opening! I'll take a look in the next couple days. The MV code needs a bit of a refresh as is.

Have you had any more thoughts on this @jtcohen6? This would be really useful for us.

judahrand avatar Jun 01 '22 09:06 judahrand

Having recently become enamored of BQ's clustering, this could be a huge help for us.

Also I noticed @lihan's new PR:

  • #30 covers much the same territory.

From the dbt labs side, what would it take to get either of these contributions to included status?

riordan avatar Aug 31 '22 16:08 riordan