Angerszhuuuu

[KYUUBI #5738][FEATURE] Add a spark commit protocol to support compact small file before commit job

3

# :mag: Description ## Issue References 🔗 This pull request fixes #5738 ## Describe Your Solution 🔧 Add a spark commit protocol to support compact small file before commit job....

[SPARK-48155][SQL] AQEPropagateEmptyRelation for join should check if remain child is just BroadcastQueryStageExec

3

### What changes were proposed in this pull request? It's a new approach to fix [SPARK-39551](https://issues.apache.org/jira/browse/SPARK-39551) This situation happened for AQEPropagateEmptyRelation when one side is empty and one side is...

[SPARK-36691][PYTHON] PythonRunner failed should pass error message to ApplicationMaster too

39

### What changes were proposed in this pull request? In current pyspark, stderr and stdout are print together, if python script exit, PythonRunner will only throw a `SparkUserAppsException` with exit...

[CELEBORN-1340] Congestion control slow start logic should make all interval can be customized and make it smaller

3

### What changes were proposed in this pull request? In this pr we do two things: 1. Current sleep time is too long for small task, will cause task delay...

[CELEBORN-1335] RpcTimeoutException should inherit from CelebornIOException

4

### What changes were proposed in this pull request? We meet a case Spark task throw `RpcTimeoutException`, then causing all executor excluded when enable `spark.excludeOnFailure.application.fetchFailure.enabled`. Even we have ignore `CelebornIOException`...

[CELEBORN-1334][BUILD] Client side should not import unnecessary deps

3

### What changes were proposed in this pull request? Current spark client pom import hadoop client jar and jdk tool jar Client side should not contain such pom deps ###...

[SPARK-48667][PYTHON] Arrow python UDFS didn't support UDT as outputType

2

### What changes were proposed in this pull request? Arrow Python UDF didn't support UDT as return type ``` df.select(udf(lambda x: x, returnType=ExamplePointUDT(), useArrow=useArrow)("point")), ``` ``` java.lang.AssertionError: assertion failed: Invalid...

[RATIS-2082] RaftPeers equal should also check address

2

## What changes were proposed in this pull request? We have two raft cluster, A cluster IP is A1:7082,A2:7082,A3:7082 B cluster master ip is  B1:7082,B2:7082,B3:7082 When we start A cluster...

[Bug] Running with paimon failed with class not found exception

1

### Code of Conduct - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct) ### Search before asking - [X] I have searched in the [issues](https://github.com/apache/kyuubi/issues?q=is%3Aissue) and found no...

[KYUUBI #6633][Bug] Running with paimon failed with class not found exception

5

# :mag: Description ## Issue References 🔗 This pull request fixes # Running spark + auth + paimon extension throw below exception ``` java.lang.NoClassDefFoundError: [Lorg/apache/spark/sql/connector/catalog/Column; at java.lang.Class.getDeclaredMethods0(Native Method) at java.lang.Class.privateGetDeclaredMethods(Class.java:2701)...