Rong Ma

[OPPRO-235] Add tranformer UT for arrow backend

1

## What changes were proposed in this pull request? (Please fill in changes proposed in this fix) ## How was this patch tested? (Please explain how this patch was tested....

[OPPRO-245] Port shuffle benchmark from gazelle

1

## What changes were proposed in this pull request? (Please fill in changes proposed in this fix) ## How was this patch tested? (Please explain how this patch was tested....

RoundRobinPartitioning fails with map type

1

### Backend VL (Velox) ### Bug description Got exception when do round robin repartitioning if the input contains map type. The cause is that by default `HashExpression` will fail to...

[VL] Support native UDAF

2

Add `UserDefinedAggregateFunction` as wrapper for all native udaf. User should define and register UDAFs in the same way as UDFs. Gluten framework will handle the differences. issue: #5110

Support complex types in sparksql hash and xxhash64 function

26

Currently, sparksql hash functions only supports primitive types. This patch adds the implementation for complex types, including array, map and row. The expected results in UT are obtained from spark's...

[VL] Hash shuffle writer cache multiple inputs and split

3

Cache input RowVectors and split together until certain conditions are satisfied ( `VeloxHashBasedShuffleWriter::shouldSplit`). Addressed code cleanups.