bitpacking icon indicating copy to clipboard operation
bitpacking copied to clipboard

Published 20 hours ago • verified publisher icon quickwit-oss

Remove simd bitpacking implementations for high bit width

Open fulmicoton opened this issue 2 years ago • 2 comments

For sorted stuff, having a super fast implementation is not necessary above bitwidth = 8. We can fallback to the scalar implementation. For unsorted stuff, I think we can also restrict ourselves to bitwidth <= 8, although this is a trade-off.

fulmicoton avatar Sep 13 '23 01:09 fulmicoton

The amount of generated code seems excessive currently

➜  bitpacking git:(master) cargo expand | wc -l

330128

PSeitz avatar Nov 19 '23 15:11 PSeitz

Definitely :)

fulmicoton avatar Nov 20 '23 00:11 fulmicoton