incubator-gluten icon indicating copy to clipboard operation
incubator-gluten copied to clipboard

[OPPRO-266] Use the smaller table to build hashmap in shuffled hash join

Open rui-mo opened this issue 3 years ago • 2 comments

What changes were proposed in this pull request?

Removed Spark's limitation for the build side of left and right outer join in shuffled hash join, so we could use the smaller table to build the hashmap. That means, LeftOuter and LeftSemi join can build left, and RightOuter join can build right when the left or right table is smaller.

How was this patch tested?

Verified on Jenkins.

rui-mo avatar Sep 28 '22 08:09 rui-mo

Thanks for opening a pull request!

Could you open an issue for this pull request on Github Issues?

https://github.com/oap-project/gluten/issues

Then could you also rename commit message and pull request title in the following format?

[Gluten-${ISSUES_ID}] ${detailed message}

See also:

github-actions[bot] avatar Sep 28 '22 08:09 github-actions[bot]

Verified locally on TPC-H and TPC-DS with correct result.

rui-mo avatar Oct 14 '22 05:10 rui-mo