Yan Ma

Check failed: mr happens when RDMA enabled

3

**Describe the bug** Check failed: mr happen on scheduler when RDMA enabled **To Reproduce** We have 2 GPU nodes and 2 CPU nodes, and could run byteps using tcp-ip successfully,...

[CORE] Change domain name to org.apache.gluten

16

## What changes were proposed in this pull request? Change gluten domain name to `org.apache.gluten`. User needs to note the plugin configuration is affected. ``` --conf spark.plugins=org.apache.gluten.GlutenPlugin ``` ## How...

[DNM]Enable iceberg test in CI

2

## What changes were proposed in this pull request? (Please fill in changes proposed in this fix) (Fixes: \#ISSUE-ID) ## How was this patch tested? (Please explain how this patch...

[DNM][VL]Support map_from_entries in Gluten

5

## What changes were proposed in this pull request? Enable map_from_entries for Velox backend in Gluten. It has dependency on upstream [PR](https://github.com/facebookincubator/velox/pull/8692). ## How was this patch tested? UT

Add map_from_entries Spark function

6

`map_from_entries` in Spark is similar as Presto but has difference in `null` handling. If`null` entry exists in a array, it returns `null` for the whole array. Examples: ``` Seq((1, "10"),...

Currently, the fallback from plasma cache to simple cache is determined by the process detection of plasma-store-server. This is not applicable to K8S cluster env.

Add RetryStrategy for S3 file system

9

This PR add `RetryStrategy` support for s3 file system, thus it will retry when connection fails. It also upgrade aws sdk to `1.11.321` which supports `AdaptiveRetryStrategy` which user may choose...

### Bug description Core dump happens when reading [file](https://github.com/facebookincubator/velox/files/15228773/str_gzip.zip), following is the key trace: ``` Stack: [0x00007f4567200000,0x00007f4567300000], sp=0x00007f45672fc8a0, free space=1010k Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code)...

### What changes were proposed in this pull request? This PR proposes changes to count memory used by external cache in storage memory and include it in overall spill logic....