WangGuangxin

MemoryChunkCleaner is hanged when do cleanAll

4

I encountered a problem that one of my task is blocked when doing memory chunk cleanup. You can find the stack trace in the following snapshot.  By adding some...

[GLUTEN-4889][VL] Support approx_percentile

11

## What changes were proposed in this pull request? Support approx_percentile for VL backend (Fixes: \#4889) ## How was this patch tested? UT

Remove row vector encoding check for ApproxPercentile's intermediate input

4

The row vector's encoding for intermediate input can't be guaranteed, since for Spark (with Gluten), the partial agg's result vector maybe flattened in Gluten's Exchange Operator when doing shuffle partition...

Is there any more information about UDF framework?

1

Hi, can you share more information about UDF framework and how can we migrate our existing udf?

[GLUTEN-6202][VL] No extra SortExec needed before WindowExec if window type is `sort`

11

## What changes were proposed in this pull request? When `spark.gluten.sql.columnar.backend.velox.window.type` is set to `sort`, there should be no extra `SortExec` before `WindowExec` in plan. (Fixes: \#6202) ## How was...

[VL] No extra SortExec needed before WindowExec if window type is `sort`

6

### Backend VL (Velox) ### Bug description When `spark.gluten.sql.columnar.backend.velox.window.type` is set to `sort`, there should be no extra `SortExec` before `WindowExec` in plan. ### Spark version None ### Spark configurations...

[GLUTEN-6101][VL] Enable map_from_array function

5

## What changes were proposed in this pull request? Enable map_from_array function (Fixes: \#6101) ## How was this patch tested? UT

[GLUTEN-5953][VL] Prevent pushdown filters with unsupported data types to scan node

6

## What changes were proposed in this pull request? Prevent pushdown filters with unsupported data types to scan node in case the scan fallback to vanilla scan operator (Fixes: \#5953)...

### Backend VL (Velox) ### Bug description We shouldn't pushdown undeterministic filter to scan node ### Spark version None ### Spark configurations _No response_ ### System information _No response_ ###...