gazelle_plugin

gazelle_plugin copied to clipboard

Driver side build table for braodcast join is too slow as compared to vanilla in multiple TPCDS querries like Q4,Q24a,24b,Q30

4

**Describe the bug** A clear and concise description of what the bug is.Driver side build table for braodcast side is too slow as compared to vanilla in multiple TPCDS querries...

Manoj-red-hat

[DNM]Test arrow Decode_function_optimization branch

1

## What changes were proposed in this pull request? (Please fill in changes proposed in this fix) ## How was this patch tested? (Please explain how this patch was tested....

zhixingheyi-tian

**Is your feature request related to a problem or challenge? Please describe what you are trying to do.** Currently gazelle used a gandiva-based proto file to ser/de-ser the plans, which...

zhouyuan

**Describe the bug** There are some unused legacy code on shuffle **To Reproduce** clean up those unused code **Expected behavior** N/A **Additional context** N/A

zhouyuan

**Is your feature request related to a problem or challenge? Please describe what you are trying to do.** Spark is case-insensitive column names inside one query. E.g `select col_a, count(col_A),...

zhouyuan

adding docker file

1

Signed-off-by: Yuan Zhou ## What changes were proposed in this pull request? (Please fill in changes proposed in this fix) ## How was this patch tested? (Please explain how this...

zhouyuan

Not enough spark off-heap execution memory

1

We often find that spark overflows to disk when it runs out of memory. When NSE applies for off-heap memory, if it is insufficient, an exception will be thrown, causing...

githhhub570

Physical memory limits appear when the grouping sets operator is processing

1

**Describe the bug** When the grouping sets operator is processing, the data will be multiplied, which will cause memory overflow. However, we observed that spark does not have this problem...

ziyangRen

Limitations in columnar sort

1

The limitation mentioned in docs mention not supporting spill. But there are multiple test cases for sort supporting spill to the disk using external sorter and the sort and spill...

kepler42

**Describe the bug** This is a rare case of hashagg over multiple columns, as the keys are combined into one "row" like String, some different rows will be counted into...

zhouyuan