dask-sql icon indicating copy to clipboard operation
dask-sql copied to clipboard

[DF] [ENH] Push Dask DSL type syntax filter operations to push down operation

Open jdye64 opened this issue 3 years ago • 0 comments

Is your feature request related to a problem? Please describe. We currently support more filter operations than the optimizer is giving us. For example for parquet reader we can filter columns based on values. Right now all we support is passing down null values. This should be expanded to include the complete list of filter operations supported by Dask.

Describe the solution you'd like Push down sending all filter operations that are supported to the IO layer

Describe alternatives you've considered None

None

jdye64 avatar Jun 23 '22 23:06 jdye64