datafusion-comet icon indicating copy to clipboard operation
datafusion-comet copied to clipboard

[BUG]: SortMergeJoin filtered LeftAnti fails on TPCH Q21

Open comphead opened this issue 1 year ago • 1 comments

[BUG]: SortMergeJoin filtered LeftAnti fails on TPCH Q21. It was a problem with DataFusion SMJ Join TPCH queries which has been fixed. However this particular problem can be related to https://github.com/apache/datafusion/issues/11555

Originally posted by @comphead in https://github.com/apache/datafusion-comet/pull/553#discussion_r1725752744

comphead avatar Aug 21 '24 21:08 comphead

I tried benches in DF with SMJ, it works on main

 PREFER_HASH_JOIN=false ./benchmarks/bench.sh run tpch

comphead avatar Aug 21 '24 21:08 comphead

Waiting for DataFusion 44.0.0

comphead avatar Nov 18 '24 22:11 comphead

Fixed with Datafusion 44 dependency update

comphead avatar Feb 25 '25 21:02 comphead