dione icon indicating copy to clipboard operation
dione copied to clipboard

Parquet index

Open shay1bz opened this issue 3 years ago • 0 comments

Summary

Adding the option to have Parquet index, instead of Avro btree. This is for batch-only use cases, where fetches are rare or not used at all. In such cases, in large scale, Avro index performance is (or at least should be) inferior to Parquet especially when filtering or projecting columns.

In this implementation the index type (avrobtree/parquet) is stored in the index table props, and fetch throws UnsupportedException under parquet index.

shay1bz avatar Aug 25 '21 12:08 shay1bz