YangJie comments

Results 132 comments of


                                            YangJie

Performance gap of calling `toArray` on `Array[Any]` as `Seq[Any]` between using Scala 2.12 and Scala 2.13

> > Using Scala 2.12, the class type of `arr` is `mutable.WrappedArray$ofRef`, the `toArray` method did not trigger memory copy > > Honestly, if that's the case, it seems like...

[SPARK-40501][SQL] Enhance 'SpecialLimits' to support project(..., limit(...))

cc @wangyum @cloud-fan FYI

[SPARK-40216][SQL] Extract common `ParquetUtils.prepareWrite` method to deduplicate code in `ParquetFileFormat` and `ParquetWrite`

cc @gengliangwang @cloud-fan Do you have time to help review? Thanks

[SPARK-40216][SQL] Extract common `ParquetUtils.prepareWrite` method to deduplicate code in `ParquetFileFormat` and `ParquetWrite`

Thanks @cloud-fan @sadikovi

[SPARK-40216][SQL] Extract common `ParquetUtils.prepareWrite` method to deduplicate code in `ParquetFileFormat` and `ParquetWrite`

Thanks @sadikovi ~ rebase to keep the code up to date, let's wait for GA

[SPARK-40216][SQL] Extract common `ParquetUtils.prepareWrite` method to deduplicate code in `ParquetFileFormat` and `ParquetWrite`

friendly ping @cloud-fan , should we merge this one?

[SPARK-40216][SQL] Extract common `ParquetUtils.prepareWrite` method to deduplicate code in `ParquetFileFormat` and `ParquetWrite`

Thanks @sadikovi @cloud-fan

[SPARK-40355][SQL] Improve pushdown for orc & parquet when cast scenario

cc @cloud-fan @huaxingao @wangyum FYI

[SPARK-40511][BUILD][CORE] Upgrade slf4j to 2.0.2

Test API compatibility first

[SPARK-40511][BUILD][CORE] Upgrade slf4j to 2.0.2

close and wait log4j 2.19.x