Yuan

**Is your feature request related to a problem or challenge? Please describe what you are trying to do.** - [x] conv - [x] row_number - [x] lower - [x] lpad...

[DNM] testing new arrow

1

Signed-off-by: Yuan Zhou ## What changes were proposed in this pull request? (Please fill in changes proposed in this fix) ## How was this patch tested? (Please explain how this...

[NSE-1019] fix codegen for all expressions

4

## What changes were proposed in this pull request? This patch adds supportCodegenCheck for all functions - by default all functions are set to not supporting codegen Signed-off-by: Yuan Zhou...

[NSE-987] fix string date

1

## What changes were proposed in this pull request? Signed-off-by: Yuan Zhou ## How was this patch tested? pass jenkins

version bump to 1.5

4

## What changes were proposed in this pull request? Signed-off-by: Yuan Zhou ## How was this patch tested? no tests required

**Is your feature request related to a problem or challenge? Please describe what you are trying to do.** We use to maintain two jars for data source and engine core,...

[NSE-956] allow to write parquet with compression

1

## What changes were proposed in this pull request? This patch adds support for writing parquet with compression `df.coalesce(1).write.format("arrow").option("parquet.compression","zstd").save(path)` this patch depends on https://github.com/oap-project/arrow/pull/122 Signed-off-by: Yuan Zhou ## How was...

**Is your feature request related to a problem or challenge? Please describe what you are trying to do.** Spark321 adds more limit push down. Should also enable this feature. **Describe...

[NSE-1109] Clean up shuffle AQE

2

## What changes were proposed in this pull request? This patch cleans up unused code on shuffle Signed-off-by: Yuan Zhou ## How was this patch tested? pass jenkins

runtime filter for Spark321

1

Signed-off-by: Yuan Zhou ## What changes were proposed in this pull request? (Please fill in changes proposed in this fix) ## How was this patch tested? (Please explain how this...