李扬 comments

Results 37 comments of


                                            李扬

Implement parallel and splittable bzip2 read buffer and apply it to file engine

> @taiyang-li, could you explain, please, why we can't use bzip2 library and need our own implementation of bzip2 decompression in SplittableBzip2ReadBuffer.cpp? In hadoop, single bzip2 compressed file is splitted...

[GLUTEN-4745][CH] support Sort Merge Join

> From https://opencicd.kyligence.com/job/gluten/job/gluten-ci/7371/console i can see all test passed. Not sure why report faliure. > > ``` > ERROR: script returned exit code 1 > ``` @liuneng1994 could you see...

[GLUTEN-4745][CH] support Sort Merge Join

> PR for support nulls first. [Kyligence/ClickHouse#483](https://github.com/Kyligence/ClickHouse/pull/483) May be can make nulls order configurable in ClickHouse later. Is there any side effect about this change ? Pls try to complete...

Speed up `replaceRegexpAll` and `replaceAll` by replacing underlying regexp library

@rschu1ze any progress recently ?

Speed up `replaceRegexpAll` and `replaceAll` by replacing underlying regexp library

Anybody help to review it ?

Implement parallel and splittable bzip2 read buffer and apply it to file engine

> > In hadoop, single bzip2 compressed file is splitted into serveral splits, and each task processes one split, which means Hadoop MR could process single bzip2 file in parallel,...

Implement parallel and splittable bzip2 read buffer and apply it to file engine

@alexey-milovidov This PR has been blocked for a long time. Parallel bzip decompressor helps improve the performance when reading bzip2 files. Do you think it is possible to be merged...