dask-sql
dask-sql copied to clipboard
[ENH] Use `filter_push_down` rule from DataFusion
Is your feature request related to a problem? Please describe.
When upgrading to DataFusion 14.0.0, we saw regressions in the test suite due to changes in filter_push_down that caused the filter to be rewritten in disjunctive normal form. The workaround was to add a copy of the rule from DataFusion 13.0.0 into the Dask SQL repo.
Describe the solution you'd like Remove our copy and use DataFusion's. This may require changes in DataFusion.
Describe alternatives you've considered None
Additional context None