Gaffer icon indicating copy to clipboard operation
Gaffer copied to clipboard

Removal of properties using an iterator

Open gaffer01 opened this issue 9 years ago • 1 comments

It should be possible to specify that certain properties are not required in the results of a query, and have an iterator filter them out. If complex properties such as a HyperLogLogPlus are not required then removing them early on in the iterator stack will significantly reduce the amount of serialisation, deserialisation and aggregation that later iterators have to perform. It will also reduce the amount of data that needs to be transferred from tablet servers to the client.

gaffer01 avatar Jul 15 '16 08:07 gaffer01

Being able to prune unwanted properties would be particularly beneficial for the Parquet store.

ac74475 avatar Jul 26 '17 13:07 ac74475