pgvecto.rs
pgvecto.rs copied to clipboard
feat: Implement RabitQ
A new and simple quantization method shows strong performance.
It's the variant of binary quantization:
- The query vector can be quantized into multiple bits instead of single bit to improve the accuracy
- Computation has theoretical guarantee
Reference: https://github.com/gaoj0017/RaBitQ https://arxiv.org/abs/2405.12497
- Identify the precomputation part
- Implement the distance for L2 square
- Implement the distance for dot product and cosine distance
- Implement fast scan distance computation