BInwei Yang comments

Results 167 comments of


                                            BInwei Yang

Use jvm libhdfs replace c++ libhdfs3

@JkSelf the PR is depending on the Velox PR, right?

Use jvm libhdfs replace c++ libhdfs3

@JkSelf can you rebase the PR?

Support jvm version libhdfs in velox

@JkSelf can you resolve the conflict?

[VL] TPCDS Performance drop after new operator "VeloxAppendBatches"

So Q64 elapsed time is 22841 -> 50712. Append operator's input is 4.15 row per batch, output is 3070 row per batch, which benefit performance in our test. The operator's...

[VL] TPCDS Performance drop after new operator "VeloxAppendBatches"

@zhztheplayer @marin-ma Why the patch caused the plan changing? Looks a bug. Do we use batch numbers instead of row numbers as the plan creating?

[VL] TPCDS Performance drop after new operator "VeloxAppendBatches"

@Surbhi-Vijay Any update? It doesn't make sense the merge batch operators impact the shuffle data size.

[GLUTEN-7174][VL] Force fallback scan operator when spark.sql.parquet.mergeSchema enabled

Is it common? should we fix it in Velox in future?

Cannot build Gluten in Ubuntu 20.04 container

Let's close this since docker script is changed a lots

[GLUTEN-6285][VL] Add debian10 vcpkg depends

We don't have CI to track this. Would you like to maintain this support?

[VL] random issue on GHA: terminate called without an active exception

I met the same issue, no extra info. The error log: ``` 24/06/24 22:39:56 INFO [Executor task launch worker for task 988.0 in stage 10.0 (TID 311445)] codec.CodecConfig: Compression: ZSTD...