vector-db-benchmark
vector-db-benchmark copied to clipboard
Framework for benchmarking vector search engines
We calculate precision but for higher values of K, it's more valuable to optimize for recall. Therefore, we should measure it.
Also specify schema for id in arxiv-titles-384-angular filters dataset. This is needed as default mapping created by opensearch takes the type as float, but in the dataset we also have...
I was investigating why the precision reported with Opensearch is low even after introducing efficient filtering in https://github.com/qdrant/vector-db-benchmark/pull/167 with arxiv-titles-384-angular-filters dataset. I observed two issues: 1. We were not ingesting...
Fixes #54 Furthermore, it also eases the process of running the milvus benchmark against remote hosts (like zilliz cloud deployments, or other SW deployments ). This has been used on...
updates: - [github.com/pre-commit/pre-commit-hooks: v4.5.0 → v4.6.0](https://github.com/pre-commit/pre-commit-hooks/compare/v4.5.0...v4.6.0) - [github.com/psf/black: 24.3.0 → 24.4.2](https://github.com/psf/black/compare/24.3.0...24.4.2) - [github.com/astral-sh/ruff-pre-commit: v0.3.5 → v0.5.0](https://github.com/astral-sh/ruff-pre-commit/compare/v0.3.5...v0.5.0)
## MongoDB vector search should reach the community edition later this year Following up on Mongo announcements [(link)](https://www.mongodb.com/blog/post/welcome-to-mongodb-local-nyc-2024?user_id=65dc5486537f352c1079f91c&sn_type=LINKEDIN&cpost_id=6634444b93478a165800f6c8&post_id=13326498860&asset_id=ADVOCACY_205_6633b0380dee4a4ba512dfe0) from Mongo's CEO: > So, I'm excited to share that we will...
The following PR adds support for Azure AI Vector Search, using the REST API (docs: https://learn.microsoft.com/en-us/azure/search/vector-search-overview). We've confirmed that this implementation is both correct WRT precision of results, and performance...
Make it easier to debug
more details
This pull request introduces enhancements to the Qdrant client configuration on issues observed on large vector count ( > 40M ). The key changes include: 1. **Max Optimization Threads**: -...