datafusion-comet
datafusion-comet copied to clipboard
chore: Preparatory work for implementing custom C2R
Which issue does this PR close?
Closes https://github.com/apache/datafusion-comet/issues/837
Rationale for this change
This is in preparation for implementing an optimized C2R in Comet.
What changes are included in this PR?
- Add
CometColumnarToRowExec
which is currently an identical copy of Spark'sColumnarToRowExec
but with some comments showing how we could use this to specialize for reading data fromCometVector
- Adds new optimizer rules to replace
ColumnarToRowExec
withCometColumnarToRowExec
- Update expected plans
How are these changes tested?
Existing tests