BInwei Yang comments

Results 167 comments of


                                            BInwei Yang

[VL] Use conf to control C2R occupied memory

@XinShuoWang Can you update?

[VL] Use conf to control C2R occupied memory

@XinShuoWang can you fix the UT?

[VL] Use conf to control C2R occupied memory

@XinShuoWang can you fix the UT? the bug triggered many queries failed in our test.

[VL] Use conf to control C2R occupied memory

@XinShuoWang Would you continue to fix the issue? If not we can pickup and fix it. The bug blocked our adoption

[VL] Use conf to control C2R occupied memory

Looks like the generator operator already limit the output rowvector size to the one we set. The OOM isn't caused by C2R, but the R2C after parquet scan, because the...

[VL] Use conf to control C2R occupied memory

> #6009 It should be more efficient to break or combine batches in the next operator, instead of implement a dedicated one. Dedicated operator must have a memcpy.

[VL] Use conf to control C2R occupied memory

> ay need to be added in Velox to fit into Velox's task processing. We don't want to break whole-stage transformer by the operator in query plan. Velox should hornor...

[VL] Use conf to control C2R occupied memory

> ow operation is completed in one go, which consumes a lot of memory and causes the program OOM. In this commit, I modified the C2 @XinShuoWang what's your case...

[VL] Use conf to control C2R occupied memory

It's caused by a bug when calculating row size.

[GLUTEN-4241][VL] Add plan node to convert Vanilla spark columnar format data to Velox columnar format data

Do you convert to Velox format directly? or convert to Arrow then to Velox?