FlagEmbedding icon indicating copy to clipboard operation
FlagEmbedding copied to clipboard

How do I evaluates the miracl dataset with the Ndcg@10 metric?

Open daegonYu opened this issue 1 year ago • 1 comments

Is there any code that evaluates the miracl dataset with the Ndcg@10 metric? Or, I know that in order to evaluate Ndcg on the miracl dataset, the similarity between positives and negatives needs to be labeled. How do I know how to do labeling?

daegonYu avatar Apr 22 '24 07:04 daegonYu

You can refer to: https://github.com/castorini/pyserini?tab=readme-ov-file . And the evaluation of bge-m3 will be integrated into this repo in the future.

staoxiao avatar Apr 22 '24 12:04 staoxiao