VectorDBBench icon indicating copy to clipboard operation
VectorDBBench copied to clipboard

pgvector with postgresql / alloyDB and AlloyDB OMNI

Open pauldintel opened this issue 1 year ago • 8 comments

With significant performance boost offered by alloyDB postgres Pgvector solution and Zilliz showing open source pgvector worst performance I would like to see if team can publish and measure the benchmark with alloyDB and show competitive results please. thanks

pauldintel avatar Feb 20 '24 22:02 pauldintel

Feel free to contribute the AlloyDB client for test and share the performance with us~

alwayslove2013 avatar Feb 21 '24 01:02 alwayslove2013

Feel free to contribute the AlloyDB client for test and share the performance with us~

Sorry if the ask is misunderstood. I am not asking about contribution . Since Zilliz publish the benchmark using VectorDB and pgvector is the last item in the list from performance standpoint . The question is, if you guys may be missing the AlloyDB pgvector part of the story (which Google published as 4x faster on OLTP and 100x faster on analytics) . Does Zilliz having any future aspirations to add alloydb and alloydb omni in zilliz cloud benchmarking results ???

image

pauldintel avatar Feb 21 '24 21:02 pauldintel

@pauldintel Currently, we lack sufficient resources to undertake all requested features and enhancements. Therefore, we warmly invite other community members to contribute code or share their results. We truly appreciate your understanding and patience.

alwayslove2013 avatar Feb 22 '24 02:02 alwayslove2013

@alwayslove2013 is there a pgvector support? if there is , then anyone could simply run the test by themselves and we can add the result to leaderboard

xiaofan-luan avatar Feb 22 '24 05:02 xiaofan-luan

@alwayslove2013 Yes, vdbbench already supports pgvector and pgvectorrs, and we've posted test results of pgvector as well.

alwayslove2013 avatar Feb 22 '24 06:02 alwayslove2013

In Milestone 1.0.0, we will support testing AlloyDB.

alwayslove2013 avatar Mar 05 '24 03:03 alwayslove2013

And perhaps JVector from Cassandra / Datastax too ?

pauldintel avatar Apr 19 '24 23:04 pauldintel

And perhaps JVector from Cassandra / Datastax too ?

We are looking for some volunteers.

xiaofan-luan avatar Apr 20 '24 01:04 xiaofan-luan