llama-stack icon indicating copy to clipboard operation
llama-stack copied to clipboard

feat(qdrant): implement hybrid and keyword search support

Open varshaprasad96 opened this issue 1 month ago • 3 comments

What does this PR do?

  • Part of #3009
  • Implement hybrid search using Qdrant's native query filtering
  • Add keyword search support
  • Update test suites to include qdrant for keyword and hybrid modes

Test Plan

pytest -sv tests/unit/providers/vector_io/

.......
============================================================================================== slowest 10 durations ===============================================================================================
0.20s call     tests/unit/providers/vector_io/test_vector_io_openai_vector_stores.py::test_max_concurrent_files_per_batch[qdrant]
0.20s call     tests/unit/providers/vector_io/test_vector_io_openai_vector_stores.py::test_max_concurrent_files_per_batch[pgvector]
0.20s call     tests/unit/providers/vector_io/test_vector_io_openai_vector_stores.py::test_max_concurrent_files_per_batch[sqlite_vec]
0.20s call     tests/unit/providers/vector_io/test_vector_io_openai_vector_stores.py::test_max_concurrent_files_per_batch[faiss]
0.06s setup    tests/unit/providers/vector_io/test_vector_io_openai_vector_stores.py::test_insert_chunks_with_missing_document_id[pgvector]
0.04s call     tests/unit/providers/vector_io/test_sqlite_vec.py::test_query_chunks_hybrid_tie_breaking
0.04s call     tests/unit/providers/vector_io/test_sqlite_vec.py::test_query_chunks_hybrid_weighted_reranker_parametrization
0.03s call     tests/unit/providers/vector_io/test_sqlite_vec.py::test_query_chunks_hybrid_score_selection
0.03s call     tests/unit/providers/vector_io/test_sqlite_vec.py::test_query_chunks_hybrid_edge_cases
0.03s setup    tests/unit/providers/vector_io/test_faiss.py::test_faiss_query_vector_returns_infinity_when_query_and_embedding_are_identical
======================================================================================== 180 passed, 47 warnings in 2.78s =========================================================================================

varshaprasad96 avatar Oct 31 '25 16:10 varshaprasad96

@Bobbins228 @ChristianZaccaria @Ygnas pls feel free to review!

varshaprasad96 avatar Oct 31 '25 16:10 varshaprasad96

@varshaprasad96 what's the latest on this? Are you still working on it? Thanks!

leseb avatar Nov 26 '25 09:11 leseb

Hi @leseb, Varsha is on PTO until the 2nd of December, but once she's back she'll continue to work on this.

ChristianZaccaria avatar Nov 26 '25 09:11 ChristianZaccaria

/retest

varshaprasad96 avatar Dec 03 '25 19:12 varshaprasad96