gazelle_plugin
gazelle_plugin copied to clipboard
Native SQL Engine plugin for Spark SQL with vectorized SIMD optimizations.
**Is your feature request related to a problem or challenge? Please describe what you are trying to do.** - [x] conv - [x] row_number - [x] lower - [x] lpad...
**Describe the bug** Memory leak with OOM spark failure `22/08/10 23:29:13 WARN SparkMemoryUtils: Detected leaked allocator, size: 16089088... 22/08/10 23:29:13 WARN Executor: Managed memory leak detected; size = 16777216 bytes,...
**Describe the bug** Memory leak with OOM spark failure `22/08/10 17:13:27 WARN SparkMemoryUtils: Detected leaked allocator, size: 1427456... 22/08/10 17:13:27 WARN Executor: Managed memory leak detected; size = 8388608 bytes,...
I encountered a problem that one of my task is blocked when doing memory chunk cleanup. You can find the stack trace in the following snapshot.  By adding some...
Signed-off-by: Yuan Zhou ## What changes were proposed in this pull request? (Please fill in changes proposed in this fix) ## How was this patch tested? (Please explain how this...
## What changes were proposed in this pull request? This patch adds supportCodegenCheck for all functions - by default all functions are set to not supporting codegen Signed-off-by: Yuan Zhou...
**Is your feature request related to a problem or challenge? Please describe what you are trying to do.** Existing solution allow fetch data from Parquet files using Arrow Dataset API...
## What changes were proposed in this pull request? Add the strategy to fallback to Vanilla Spark shuffle manager. o Enable fallback shuffle configuration and reuse the ColumnarShuffleExchangeExec o Initiate...
## What changes were proposed in this pull request? Testing projection codegen is lacking in the current code. This PR is proposing a test suite for testing it. ## How...
## What changes were proposed in this pull request? (Please fill in changes proposed in this fix) ## How was this patch tested? (Please explain how this patch was tested....