pgvecto.rs icon indicating copy to clipboard operation
pgvecto.rs copied to clipboard

Published 20 hours ago • verified publisher icon tensorchord

feat: ScaNN index

Open gaocegege opened this issue 2 years ago • 4 comments

gaocegege avatar May 10 '23 02:05 gaocegege

I'll take this.

karajan1001 avatar May 26 '23 04:05 karajan1001

@karajan1001 ScaNN might be hard to implement since original code highly coupled with tensorflow. I would suggest DiskANN, since it's designed for disk workload, which is suitable for postgres. And it's also adapted by Milvus.

VoVAllen avatar May 29 '23 07:05 VoVAllen

@karajan1001 ScaNN might be hard to implement since original code highly coupled with tensorflow. I would suggest DiskANN, since it's designed for disk workload, which is suitable for postgres. And it's also adapted by Milvus.

Yes, I had looked into their paper and source code and noticed that it's highly coupled with TensorFlow. So it's hard to say how much performance is gotten from the algorithm and how much is gotten from the TensorFlow optimization. I was just about to ask if implementing a ScaNN without the TensorFlow optimization would be a good choice.

karajan1001 avatar May 30 '23 02:05 karajan1001

https://services.google.com/fh/files/misc/scann_for_alloydb_whitepaper.pdf

Here is a whitepaper for SCANN in AlloyDB.

gaocegege avatar Apr 12 '24 02:04 gaocegege