Cannot import name 'DRESModel' from 'mteb' .

Open UnableToUseGit opened this issue 1 year ago • 1 comments

When I run the eval code from repo of e5-mistral, the error occur:

Traceback (most recent call last): File "/share/minghao/Projects/TestCIL4Embedding/unilm/e5/mteb_beir_eval.py", line 12, in from mteb import MTEB, AbsTaskRetrieval, DRESModel ImportError: cannot import name 'DRESModel' from 'mteb' (/share/kunluo/Envs/cms/lib/python3.9/site-packages/mteb/init.py)

Mar 29 '24 04:03 UnableToUseGit

This issue seems to be related the repo of e5-mistral using an outdated version of MTEB. Should be solved either by downgrading the MTEB version (to ~1.2.X is my guess) or updating their scripts to match the most recent version of MTEB. I believe you can import DRESModel from:

from mteb.evaluation.evaluators.RetrievalEvaluator import DRESModel

Mar 29 '24 13:03 KennethEnevoldsen

Feel free to reopen if the issue persists after changing the version.

Aug 14 '24 19:08 isaac-chung