elasticsearch-labs icon indicating copy to clipboard operation
elasticsearch-labs copied to clipboard

Guides and examples for 2nd phase retrieval

Open joemcelroy opened this issue 2 years ago • 3 comments

Providing examples on how to re-rank using:

  • bi-encoders and cross-encoders
  • Learn to rank via feature extractors
  • boosting on attributes like dates, popularity

joemcelroy avatar Oct 17 '23 08:10 joemcelroy

Great suggestion.

Similar to how embedding pipelines can be added: https://www.elastic.co/guide/en/machine-learning/current/ml-nlp-text-emb-vector-search-example.html

or here:

https://www.elastic.co/search-labs/how-to-deploy-nlp-text-embeddings-and-vector-search

It would be cool to utilize the machine learning instance for re-ranking. Similarly, you could bring your own model via hugging face by installing it through the Eland Docker agent (as in the later link).

wenestam avatar Oct 17 '23 11:10 wenestam

cc @joshdevins @leemthompo related to our conversation around guides and documentation for reranking

serenachou avatar Mar 26 '24 22:03 serenachou

Yeah we should coordinate on this. We have some plans for documentation around this as well so let's make sure they are all talking about the same things.

joshdevins avatar Mar 27 '24 15:03 joshdevins