mteb icon indicating copy to clipboard operation
mteb copied to clipboard

How to Save Retrieved Documents in Retrieval Tasks

Open AugustLHHHHHH opened this issue 1 year ago • 0 comments

Hi,

I am currently working on an information retrieval task and I want to save the retrieved documents for bad case analysis. I have printed the output of the search function in beir/retrieval/search/dense/exact_search.py, and the format is {q_id: {pid: score}}. such as:

image

However, it seems that the corpus ids are not sorted according to the scores. Should I sort the results by cosine similarity from high to low and save them so that the most relevant documents are placed at the beginning?

Thanks!

AugustLHHHHHH avatar May 11 '24 08:05 AugustLHHHHHH