dask-sql icon indicating copy to clipboard operation
dask-sql copied to clipboard

[ENH] Use `filter_push_down` rule from DataFusion

Open andygrove opened this issue 3 years ago • 0 comments

Is your feature request related to a problem? Please describe. When upgrading to DataFusion 14.0.0, we saw regressions in the test suite due to changes in filter_push_down that caused the filter to be rewritten in disjunctive normal form. The workaround was to add a copy of the rule from DataFusion 13.0.0 into the Dask SQL repo.

Describe the solution you'd like Remove our copy and use DataFusion's. This may require changes in DataFusion.

Describe alternatives you've considered None

Additional context None

andygrove avatar Nov 08 '22 17:11 andygrove