datafusion icon indicating copy to clipboard operation
datafusion copied to clipboard

Datafusion Optimizer Enhancement

Open jackwener opened this issue 3 years ago • 2 comments

Is your feature request related to a problem or challenge? Please describe what you are trying to do.

Enhance Optimizer Summary:

  • [x] https://github.com/apache/arrow-datafusion/issues/217
  • [ ] https://github.com/apache/arrow-datafusion/issues/475
  • [ ] https://github.com/apache/arrow-datafusion/issues/1612
  • [ ] https://github.com/apache/arrow-datafusion/issues/1585
  • [ ] https://github.com/apache/arrow-datafusion/issues/1692
  • [ ] https://github.com/apache/arrow-datafusion/issues/1342
  • [x] https://github.com/apache/arrow-datafusion/issues/2254
  • [ ] https://github.com/apache/arrow-datafusion/issues/2252
  • [ ] https://github.com/apache/arrow-datafusion/issues/2045
  • [ ] https://github.com/apache/arrow-datafusion/issues/1716
  • [x] https://github.com/apache/arrow-datafusion/issues/2256

Describe the solution you'd like

Describe alternatives you've considered

Additional context

jackwener avatar Apr 17 '22 12:04 jackwener

At present, a big problem is the limitation of schema on transformation.

We should consider schema change detail after transformation. In fact, I often meet problems in this like #2084, and I can't solve it because it is hard to debug. I will try fix them gradually.

jackwener avatar Apr 17 '22 12:04 jackwener

BTW, If you find other optimizer enhancement isn't in it, feel free ping me add it by @jackwener

jackwener avatar Apr 17 '22 12:04 jackwener