JiaKe

Results 54 comments of JiaKe

@jinchengchenghh There may have some compile issue in gazelle backend. It may related with the changes in [PR#372](https://github.com/oap-project/gluten/pull/372) ``` [ERROR] /home/sparkuser/jk/projects/gluten/backends-gazelle/src/main/scala/io/glutenproject/backendsapi/velox/GazelleSparkPlanExecApi.scala:21: error: value SimpleColumnarRule is not a member of object...

@zhztheplayer @lidavidm Sorry for the delay response. I have resolved the comments. Please help to review again. Thanks.

> Can you rebase to see if the CI issue is fixed? Rebased.

@KevinyhZou Is this error related to the size of the dataset?

> > @KevinyhZou Is this error related to the size of the dataset? > > the original parquet file's size is about 11KB, not big, do you mean the small...

@KevinyhZou It seems this issue is not related with the configurations. I use your configuration and still can not reproduce this issue. ![image](https://user-images.githubusercontent.com/11972570/189267634-4b41d945-972c-49ea-a2d6-c43366dd7a59.png)

@clee704 @zhouyuan The Velox backend lacks support for writing complex types. Spark 34 has already implemented a fallback mechanism. PR (https://github.com/apache/incubator-gluten/pull/5107) has been filed to extend this fallback to Spark...

@clee704 Sorry for delayed response. It seems this issue has been fixed [here](https://github.com/apache/incubator-gluten/blob/main/cpp/velox/substrait/SubstraitToVeloxExpr.cc#L494). Can you help to verify in your environment?

@majetideepak @mbasmanova Can you help to review? Thanks.