incubator-gluten icon indicating copy to clipboard operation
incubator-gluten copied to clipboard

[GLUTEN-7647][CH] Lazy expand for aggregation

Open lgbo-ustc opened this issue 4 months ago • 3 comments

What changes were proposed in this pull request?

(Please fill in changes proposed in this fix)

Fixes: #7647

Reduce the size of data explosion of expand.

  1. Move the expand after the aggregate which is in stage initial to intermedate.

  2. Add a aggregate step after the expand for aggregating low cardinality grouping keys. image

How was this patch tested?

(Please explain how this patch was tested. E.g. unit tests, integration tests, manual tests)

unit tests

(If this patch involves UI changes, please attach a screenshot; otherwise, remove this)

lgbo-ustc avatar Oct 23 '24 04:10 lgbo-ustc