kuzu icon indicating copy to clipboard operation
kuzu copied to clipboard

Optimization: Push down projection and filter predicates down to scan from source

Open ray6080 opened this issue 6 months ago • 0 comments

Description

For simple cases, like LOAD FROM 'a.parquet' WHERE a.age < 10 RETURN a.name, we should be able to prune unrelated columns and push the filter down when scanning from the parquet file.

This should be generalized to other sources, such as Arrow tables, Polars & Pandas DataFrames, too.

ray6080 avatar Jul 30 '24 02:07 ray6080