pgvecto.rs icon indicating copy to clipboard operation
pgvecto.rs copied to clipboard

feat: Implement RabitQ

Open VoVAllen opened this issue 1 year ago • 1 comments

A new and simple quantization method shows strong performance.

It's the variant of binary quantization:

  • The query vector can be quantized into multiple bits instead of single bit to improve the accuracy
  • Computation has theoretical guarantee

Reference: https://github.com/gaoj0017/RaBitQ https://arxiv.org/abs/2405.12497

VoVAllen avatar Jul 05 '24 09:07 VoVAllen

  • Identify the precomputation part
  • Implement the distance for L2 square
  • Implement the distance for dot product and cosine distance
  • Implement fast scan distance computation

VoVAllen avatar Jul 12 '24 03:07 VoVAllen