YangJie

### What changes were proposed in this pull request? This pr aims upgrade scala-maven-plugin to 4.7.1 ### Why are the changes needed? This version brings some bug fix related to...

[SPARK-38909][CORE][YARN] Encapsulate `LevelDB` used to store remote/external shuffle state as `DB`

12

### What changes were proposed in this pull request? `ExternalShuffleBlockResolver`, `YarnShuffleService` and `RemoteBlockPushResolver` use `LevelDB` directly, this is not conducive to extending the use of `RocksDB` in this scenario. This...

[SPARK-39696][CORE] Ensure Concurrent r/w `TaskMetrics` not throw Exception

17

### What changes were proposed in this pull request? This PR changes the declaration type of `TaskMetrics#externalAccums` from `s.c.mutable.ArrayBuffer` to `j.u.concurrent.CopyOnWriteArrayList` to ensure that errors described in SPARK-39696(`java.util.ConcurrentModificationException: mutation occurred...

### What changes were proposed in this pull request? The same `UnsupportedOperationException` is constructed in 3 places in `AccumulatorV2`, this pr extract an helper method to deduplicate code. ### Why...

Flaky test HealthCheckCoordinatorGrpcTest on Apple Silicon

4

Run `mvn clean install ` on Apple Silicon, `HealthCheckCoordinatorGrpcTest` failed as follows: ``` [INFO] Running org.apache.uniffle.test.HealthCheckCoordinatorGrpcTest [ERROR] Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 71.009 s

Flaky test RssShuffleUtilsTest

2

run `mvn clean install` ``` [INFO] Running org.apache.uniffle.common.RssShuffleUtilsTest [ERROR] Tests run: 7, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 0.356 s

Performance gap of calling `toArray` on `Array[Any]` as `Seq[Any]` between using Scala 2.12 and Scala 2.13

13

## Reproduction steps Scala version: Scala 2.13.8 ```scala val valuesPerIteration: Long = 1000 * 1000 * 10 val arraySize = 1000 val arr: Seq[Any] = new Array[Any](arraySize) var n =...

I found `junit-interface` 0.13.3 already release, but the correspondence between `junit-interface` 0.13.3 and JUnit4 version is not updated in the `README.md`

[SPARK-40511][BUILD][CORE] Upgrade slf4j to 2.0.2

6

### What changes were proposed in this pull request? This pr aims to upgrade slf4j from 1.7.36 to 2.0.x, the main change as follows: 1. Upgrade slf4j version from 1.7.36...

### What changes were proposed in this pull request? Spark 3.4 support Python 3.7+ , but python related UTs only check python executable exist, not check the python version. So...