xianjingfeng

HBASE-26351 Implement a table-based region grouping strategy for Re…

8

Implement a table-based region grouping strategy for RegionGroupingProvider

[Improvement] try read from backup shuffle servers when fetched data is inconsistent

6

### What changes were proposed in this pull request? 1.In client side, try read from all shuffle servers when read shuffle data. When read shuffle data from memory, pass `processBlockIds`...

[Bug] Blocks read inconsistent: expected xxx blocks, actual xxx blocks

12

1. If we set `spark.rss.data.replica.write=2` and `spark.rss.data.replica=3`,Data integrity cannot be guaranteed in any one shuffle server. right? 2. But in method `org.apache.uniffle.storage.handler.impl.LocalFileQuorumClientReadHandler#readShuffleData`, it just read from one shuffle server

[Improvement] Read shuffle data fail because read index file fail

11

Every commit calls must success when `sendCommit` now, this will casue if one shuffle server dead, then application fail

Execute start script with nohup

13

### What changes were proposed in this pull request? Execute start script with nohup ### Why are the changes needed? Process don't exit if exec start script using ansible. Therefore,...

[Improvement] Disallow sendShuffleData if requireBufferId expired

6

We found shuffle server which under high load is easy encounter `java.lang.OutOfMemoryError: Java heap space` even we allocate more jvm heap memory and less `rss.server.buffer.capacity ` The steps for the...

[Feature Request] Support shuffle server decommissioned

10

kill process is not graceful, so we need shuffle server support decommissioned

[Improvement] There should be a bounded and blocked queue when sendShuffleData in client side

5

In `RssShuffleManager`，the `workQueue` of `threadPoolExecutor`is unbounded now. If `sendShuffleData` not fast enough, it will cost a lot of memory

[Improvement] Process don't exit if exec start script using ansible

5

Process don't exit if exec start script using ansible. Therefore, we can't do batch start operation for this.