YangJie

[DON'T MERGE] Try to replace all `json4s` with `Jackson`

6

### What changes were proposed in this pull request? ### Why are the changes needed? ### Does this PR introduce _any_ user-facing change? ### How was this patch tested?

[WIP][SPARK-40497][BUILD] Upgrade Scala to 2.13.9

1

### What changes were proposed in this pull request? This pr aims to update from Scala 2.13.8 to Scala 2.13.9 for Apache Spark 3.4. ### Why are the changes needed?...

[SPARK-40364][CORE] Use the unified `DBProvider#initDB ` method

13

### What changes were proposed in this pull request? There are 2 `initDB` in `DBProvider` 1. `DB initDB(DBBackend dbBackend, File dbFile, StoreVersion version, ObjectMapper mapper)` 2. `DB initDB(DBBackend dbBackend, File...

### What changes were proposed in this pull request? ### Why are the changes needed? ### Does this PR introduce _any_ user-facing change? ### How was this patch tested?

[SPARK-40255][YARN][TESTS] Increase `BaseYarnClusterSuite#runSpark` timeout from 3 minutes to 5 minutes

4

### What changes were proposed in this pull request? This pr Increase `BaseYarnClusterSuite#runSpark` timeout from 3 minutes to 5 minutes to make the tests extends `BaseYarnClusterSuite` more stable. ### Why...

[SPARK-40216][SQL] Extract common `ParquetUtils.prepareWrite` method to deduplicate code in `ParquetFileFormat` and `ParquetWrite`

1

### What changes were proposed in this pull request? This pr is a refactor work, the main change is extract `ParquetUtils.prepareWrite` method to eliminate duplicate code in `ParquetFileFormat` and `ParquetWrite`....

`StringBuilder` change in 2.13.9 (`append` returning `this.type`) exposes poor interaction between eta-expansion and overloading

4

## Reproduction steps Scala version: 2.13.9 ```scala Welcome to Scala 2.13.9 (OpenJDK 64-Bit Server VM, Java 1.8.0_322). Type in expressions for evaluation. Or try :help. scala> :paste // Entering paste...

[SPARK-46919][BUILD][CONNECT] Upgrade `grpcio*` to 1.60.0 and `grpc-java` to 1.61.0

1

### What changes were proposed in this pull request? This PR aims to upgrade `grpcio*` from 1.59.3 to [1.60.1](https://pypi.org/project/grpcio/1.60.1/)and `grpc-java` from 1.59.0 to 1.61.0 for Apache Spark 4.0.0. ### Why...

`ammonite.session.ProjectTests.deeplearning` using `import $ivy.org.nd4j:nd4j-native-platform:0.8.0`, but it seems that nd4j lacks support for `MacOS/Apple Silicon`: ``` ProjectTests @ import $ivy.`com.thoughtworks.deeplearning::plugins-builtins:2.0.0-RC0` @ import $ivy.`org.nd4j:nd4j-native-platform:0.8.0` X ammonite.session.ProjectTests.deeplearning 327ms utest.AssertionError: assert{ error: String =...

run `./mill -i unitTest "2.13.10" ` on Apple M2 Max zulu 8u372: ``` openjdk version "1.8.0_372" OpenJDK Runtime Environment (Zulu 8.70.0.23-CA-macos-aarch64) (build 1.8.0_372-b07) OpenJDK 64-Bit Server VM (Zulu 8.70.0.23-CA-macos-aarch64) (build...