YangJie

icon indicating an email [email protected]

icon company @baidu icon location Beijing icon location Apache Spark Committer&PMC / Apache uniffle PPMC

Results 232 comments of YangJie

[SPARK-49203][SQL] Add expression for `java.util.Arrays.binarySearch`

> > https://github.com/openjdk/jdk/blob/dfacda488bfbe2e11e8d607a6d08527710286982/src/java.base/share/classes/java/util/Arrays.java#L2146-L2173 > > ``` > > /** > > * Searches the specified array for the specified object using the binary > > * search algorithm. The array...

[SPARK-47702][CORE] Remove Shuffle service endpoint from the locations list when RDD block is removed form a node.

Merged into master and branch-3.5. Thanks @attilapiros

[SPARK-47702][CORE] Remove Shuffle service endpoint from the locations list when RDD block is removed form a node.

@attilapiros I have reverted the merge on branch-3.5 because it was causing compilation failures. If you have the time, please submit an independent pr for branch-3.5. Thanks ~

[SPARK-48881][SQL] Some dynamic partitions can be compensated to specific partition values

I haven't reviewed the code changes in the pr yet, but: 1. The PR title should reflect the work done in the current PR as much as possible, the current...

[SPARK-48881][SQL] Some dynamic partitions can be compensated to specific partition values

@fusheng-rd Could you add some new test cases for this?

[SPARK-48881][SQL] Some dynamic partitions can be compensated to specific partition values

@fusheng-rd hmm... It seems that the way you merge the code is not quite right.

[SPARK-51831][SQL] Column pruning with existsJoin for Datasource V2

friendly ping @cloud-fan

[SPARK-51831][SQL] Column pruning with existsJoin for Datasource V2

Removed `Stale` because it represented a genuine existing issue.

[SPARK-33538][SQL]Directly push IN predicates to the Hive Metastore

Merged into master.Thanks @yuexing @wangyum @pan3793 and @Tagar

[SPARK-52381][Core] JsonProtocol: Only accept subclasses of SparkListenerEvent

> It looks like the discussion thread is not accessible ? I am trying to understand the rationale for the change - is it to prevent a class cast exception...