datafusion-comet
datafusion-comet copied to clipboard
Remove COMET_SHUFFLE_FALLBACK_TO_COLUMNAR config
What is the problem the feature request solves?
https://github.com/apache/datafusion-comet/pull/1209 enabled accelerating more queries with Comet but also exposed some new bugs so a COMET_SHUFFLE_FALLBACK_TO_COLUMNAR config was added as a temporary workaround to avoid Spark SQL tests failing.
We should remove this config once the bugs are fixed so that we test more of the Spark SQL queries with Comet shuffle.
Describe the potential solution
No response
Additional context
No response