dask-sql
dask-sql copied to clipboard
[ENH] Allow more filters to be pushed down to table scan
Is your feature request related to a problem? Please describe.
We currently only push down IS NOT NULL filters to table scan:
fn is_supported_push_down_expr(expr: &Expr) -> bool {
match expr {
// for now, we just attempt to push down simple IS NOT NULL filters on columns
Expr::IsNotNull(ref a) => matches!(a.as_ref(), Expr::Column(_)),
_ => false,
}
}
Describe the solution you'd like Push down more filters.
Describe alternatives you've considered None
Additional context None