Xi Lyu

[SPARK-48359][SQL] Built-in functions for Zstd compression and decompression

8

### What changes were proposed in this pull request? Some users are using UDFs for Zstd compression and decompression, which results in poor performance. If we provide native functions, the...

[SPARK-52450][CONNECT] Improve performance of schema deepcopy

1

### What changes were proposed in this pull request? In Spark Connect, `DataFrame.schema` returns a deep copy of the schema to prevent unexpected behavior caused by user modifications to the...

[SPARK-52104][CONNECT][SCALA] Validate column name eagerly in Spark Connect Scala Client

4

### What changes were proposed in this pull request? Currently, calling DataFrame.col(colName) with a non-existent column in the Scala Spark Connect client does not raise an error. In contrast, both...