FastPFor

FastPFor copied to clipboard

C++ and Java implementations of fastpfor + varbyte unable to decode each others output

8

I've been investigating using the FastPFor algorithm for integer columns in Druid, following up on the discussion and experimentation mentioned [in this issue](https://github.com/apache/incubator-druid/issues/4080). Initially, I was solely using your [Java...

clintropolis

API design: user wants low-level control for block-based compression

3

Hi, one thing that I miss from this library is the ability to integrate into a bigger project where I handle the block encoding manually. To be more specific, it...

amallia

Friendly build system for integrating into larger projects.

1

Was looking at adding this and realized that the headers are not scoped to say `include/fpfor/*` for example ``` #include "common.h" #include "codecs.h" #include "vsencoding.h" #include "util.h" #include "simple16.h" #include...

emaxerrno

We have a vectorized encoder: https://github.com/lemire/streamvbyte

lemire

lemire

Function to compute or estimate compressed size

4

in "FastPFor/headers/codecs.h" virtual std::vector compress(const std::vector & data) Is it possible to compute the size of the compressed output or a close approximation instead of allocating a big chunk and...

maximecaron

Question on compressor of uint16_t

1

Hi, FastPFor is a wonderful project and has already been added to our database [infinity](https://github.com/infiniflow/infinity/blob/main/src/storage/common/int_encoder.cppm) as the posting list codec for the builtin full text search engine. However, currently we've...

yingfeng

Looking for software for delta compression

1

Hi Lemire, I found your software when searching for a solution regarding large binary data. We are using files with an unpublished proprietory file format. With hexdump I noticed that...

christophgil