JiaKe comments

Results 97 comments of


                                            JiaKe

Support jvm version libhdfs in velox

@majetideepak Resolved all your comments. Can you help to review again? Thanks.

Support jvm version libhdfs in velox

@majetideepak I resolved all your comments. Can you help to review again? Thanks.

Support jvm version libhdfs in velox

@majetideepak Thanks for your review. I have resolved all your comments. Can you help to review again. Thanks.

[GLUTEN-7675][VL] Support parquet write with complex data type(eg. MAP, ARRYY and STRUCT)

> Do we only need to enable Spark35 UT? > > @JkSelf @FelixYBW The existing unit tests in spark 32, 33, 34 ,35 can verify this change. @weixiuli The unit...

[VL] No extra SortExec needed before WindowExec if window type is `sort`

In order to remove the duplicated sort operator, we implement the streaming window for spark in velox. Why need to set the sort based window in your use case? Can...

[VL] No extra SortExec needed before WindowExec if window type is `sort`

@WangGuangxin Sort based window is designed for presto backend. And the streaming based window is for spark to remove the sort. Can you use streaming window in your use case?...

An unsupported nested encoding was found.

@mbasmanova @majetideepak @rui-mo Do you have any input? Thanks.

Fix the "An unsupported nested encoding was found." exception in parquet writer

@mbasmanova @majetideepak @rui-mo Can you help to review? Thanks.

Fix the "An unsupported nested encoding was found." exception in parquet writer

@majetideepak It seems https://github.com/facebookincubator/velox/pull/9406 can resolve this [issue](https://github.com/facebookincubator/velox/issues/10397). I will close this PR. Thanks.

Erase the previous processed WindowPartition in RowStreamingWindowBuild

> > In Velox we track the memory by plan node memory pool or global spill memory pool. In gluten the memory pool for plan node is counted into offheap...