datafusion icon indicating copy to clipboard operation
datafusion copied to clipboard

Stop copying LogicalPlan and Exprs in `OptimizeProjections`

Open alamb opened this issue 1 year ago • 0 comments

Is your feature request related to a problem or challenge?

As part of making the planner faster, we are updating the passes to avoid copying LogicalPlan and Expr (see https://github.com/apache/datafusion/issues/9637)

Recent profiling (https://github.com/apache/datafusion/issues/9637#issuecomment-2073325456) shows that a non trivial amount of plan time happens in OptimizeProjections

Describe the solution you'd like

I would like to reduce the amount of copying in this passso that it no longer appears in profiling traces

Describe alternatives you've considered

No response

Additional context

No response

alamb avatar Apr 24 '24 11:04 alamb