YangJie

Thanks @JacobZheng0927

Should we continue to push this one forward？

ready to go ?

Let's wait one more day

Merged into master. Thanks @panbingkun

is this a bug of log4j 2.23.1?

``` [info] - primitive type - no column index *** FAILED *** (12 milliseconds) [info] java.lang.ArrayIndexOutOfBoundsException: Index 1 out of bounds for length 1 [info] at org.apache.parquet.column.statistics.SizeStatistics$Builder.add(SizeStatistics.java:83) [info] at org.apache.parquet.column.statistics.SizeStatistics$Builder.add(SizeStatistics.java:95)...

> @LuciferYang Could you please check the test case? It seems to be writing `def_level=1` to a column with `max_def_level=0`. This is an existing test case in Spark, this error...

@wgtmac Thank you for your explanation, it seems you are correct, should Line 505 be changed from ```scala val definitionLevels = inputValues.map(v => if (v == null) 0 else 1)...

> Could you make CI happy, @Fokko ? > > ``` > [info] - SPARK-30269 failed to update partition stats if it's equal to table's old stats *** FAILED ***...