AutoAWQ ImportError cannot import name 'initialize_tasks' from 'lm

ImportError cannot import name 'initialize_tasks' from 'lm_eval.tasks'

Open xiaopengaia opened this issue 11 months ago • 4 comments

When I execute examples/eval.py, there is a Error about : ImportError cannot import name 'initialize_tasks' from 'lm_eval.tasks'

My lm_eval version is 0.4.2

Mar 19 '24 06:03 xiaopengaia

from lm_eval.tasks import TaskManager
initialize_tasks = TaskManager.initialize_tasks

it does work

Mar 19 '24 07:03 xiaopengaia

from lm_eval.tasks import TaskManager
initialize_tasks = TaskManager.initialize_tasks

it does work

Where did you add the code? i need your help!!

Mar 27 '24 11:03 kkwhale7

downgrade lm_eval to 0.4.1, it should work

Apr 02 '24 09:04 yantingxu

It seems the eval harness is broken after they made some updates. I think it's best to downgrade for now until they fix the issues

Apr 02 '24 09:04 casper-hansen