datafusion-comet icon indicating copy to clipboard operation
datafusion-comet copied to clipboard

feat: Investigate potential issues with HashJoin and LeftSemi

Open comphead opened this issue 2 months ago • 0 comments

What is the problem the feature request solves?

When having

      "spark.comet.exec.replaceSortMergeJoin" -> "true",
      "spark.sql.adaptive.enabled" -> "false",

The TPCDS Q69 giving correctness issues like analyzed in https://github.com/apache/datafusion-comet/issues/2667 Currently we stop join rewrite but it can be a bigger problem behind and we need to investigate the rootcause

Describe the potential solution

No response

Additional context

No response

comphead avatar Nov 05 '25 20:11 comphead