C_MTEB 评测reranker报错问题

[qiangfanxj]

你好，我在用eval_cross_encoder.py 评估公开的的bge-reranker-large模型时候报错，如下所示。我用的代码是最新的https://github.com/FlagOpen/FlagEmbedding/blob/master/research/C_MTEB/eval_cross_encoder.py，MTEB包用的是1.15.0版本。请问该如何解决，``` ERROR:mteb.evaluation.MTEB:Error while evaluating MIRACLReranking: 'BaseReranker' object has no attribute 'encode' Traceback (most recent call last): File ".../FlagEmbedding/research/C_MTEB/eval_cross_encoder.py", line 27, in evaluation.run(model, output_folder=f"reranker_results/{save_name}") ... ... ... File ".../miniforge3/envs/myenv/lib/python3.10/site-packages/mteb/evaluation/evaluators/model_encode.py", line 61, in model_encode embeddings = model.encode(sentences, **kwargs) AttributeError: 'BaseReranker' object has no attribute 'encode'

[545999961]

reranker是不需要计算通过encode计算embedding的，reranker用的是compute功能，传入query和passage，计算获得一个score

[qiangfanxj]

reranker是不需要计算通过encode计算embedding的，reranker用的是compute功能，传入query和passage，计算获得一个score

可以更新一下reranker评估代码？当前的有些问题，https://github.com/FlagOpen/FlagEmbedding/tree/master/research/C_MTEB python eval_cross_encoder.py --model_name_or_path BAAI/bge-reranker-base