pgvecto.rs icon indicating copy to clipboard operation
pgvecto.rs copied to clipboard

feat: FreshDiskANN

Open AveryQi115 opened this issue 1 year ago • 1 comments

TODO:

  • [x] In memory vamana based on current segments
  • [x] Vamana index with filtering
  • [ ] Vamana index with deletion
  • [ ] Optimize filtering algorithm

Discussions:

  • Current vamana index implementation use full precision building and searching, as current segments implementation is different from diskANN storage method, how to gradually build full-precision index stored in segments and using quantization to do the construction and searching process?

  • performance and precision

AveryQi115 avatar Jan 15 '24 21:01 AveryQi115

Really excited to see the amazing progress here, have you seen meillisearch's Arroy rust DiskANN implementation: https://github.com/meilisearch/arroy ?

marcusinthesky avatar Feb 12 '24 12:02 marcusinthesky