Andy Grove
Andy Grove
More learnings: - As soon as we encounter one SortMergeJoin with a join condition we fall back to Spark, and all subsequent SortMergeJoins also fall back regardless of whether they...
@dharanad I will close this PR for now since it has been inactive for a while. Feel free to reopen this or create a new PR if you continue work...
https://github.com/apache/datafusion-comet/issues/535
@comphead @parthchandra can we close this issue?
Hi @kazuyukitanimura. Would you mind handling this as part of the Spark 4 work you are working on?
Switching to JDK 17 resolved my issue. I will leave this issue open until we have documentation for building with Spark 4
This can be closed now
We currently fall back to Spark if the schema contains byte or short unless a Comet config is enabled, so this isn't an urgent bug to fix.
@shehabgamin @alamb I created an epic in Comet for implementing our current expressions as `ScalarUDFImpl` rather than `PhysicalExpr` as a first step towards contributing them in the `datafusion-spark` crate: https://github.com/apache/datafusion-comet/issues/1819
This sounds like a great idea. Thanks @linhr.