Jinhai （陈锦海） comments

Results 6 comments of


                                            Jinhai （陈锦海）

Support for plain and dictionary encoded INT64 timestamp in parquet files

@mskapilks Hi, The unit tests of commit 6081415d0 run fine on my machine. But the unit tests of commit 9166ff65b run fail on my machine. Can you provided some information...

ShuffleExternalSorter occupy too many memory and cause OOM

> Does the shuffle fallback? yes @FelixYBW ``` == Fallback Summary == (8) Exchange: Gluten does not touch it or does not support it == Physical Plan == Exchange (8)...

[DOC] build arrow first when build Velox separately.

Actually, build Velox script includes building Arrow. The error I encountered before was that the arrow jar was not installed in the system. Maybe it was accidental.

Why still build arrow when --enable_ep_cache=ON

fix on #6351

Why still build arrow when --enable_ep_cache=ON

> I think `enable_ep_cache` is just for controlling velox ep. Arrow build/installation can be categorized to Gluten dependency setup, though we have no such overall control for dependency setup by...

Why still build arrow when --enable_ep_cache=ON

> @j7nhai, yes, generally only first time build needs to build arrow. Arrow code and build option are not changed after installation, unless we upgrade it or need to apply...