lance icon indicating copy to clipboard operation
lance copied to clipboard

Don't materialize any data on `count_rows` if the filter can be satisfied by a scalar index

Open westonpace opened this issue 1 year ago • 1 comments

If we can satisfy a filter with a scalar index then we should be able to implement a fast path for count_rows where we simply return the size of the allow_list or even possibly subtract the size of the block_list from the metadata-only count_rows (might be some tricky bits if there are deletion vectors) to quickly answer queries like count_rows("x != 'foo'").

westonpace avatar Aug 02 '24 22:08 westonpace

Hi @westonpace, I would like to work on this. Could you please assign this to me?

ighose avatar Aug 06 '24 05:08 ighose