datafusion-comet icon indicating copy to clipboard operation
datafusion-comet copied to clipboard

Published 20 hours ago • verified publisher icon apache

Comet possibly preventing AQE optimization

Open kazuyukitanimura opened this issue 10 months ago • 2 comments

Describe the bug

SPARK-50258: Fix output column order changed issue after AQE optimization test fails with Comet on because comet plan does not have AdaptiveSparkPlanExec in the executedPlan

Possibly comet plan is preventing AQE optimization from kicking in

Steps to reproduce

No response

Expected behavior

No response

Additional context

No response

kazuyukitanimura avatar Jan 10 '25 22:01 kazuyukitanimura

Is there some particular version of Spark that this failure is occurring with?

parthchandra avatar Jan 18 '25 01:01 parthchandra

Perhaps this SPARK-50258 is for Spark 4

kazuyukitanimura avatar Feb 04 '25 21:02 kazuyukitanimura

I removed the bug label since this does not seem to be a correctness issue

andygrove avatar Jun 16 '25 19:06 andygrove