AutoAWQ icon indicating copy to clipboard operation
AutoAWQ copied to clipboard

ImportError: cannot import name 'initialize_tasks' from 'lm_eval.tasks'

Open kunzeng-ch opened this issue 1 year ago • 1 comments

When I run the examples/evaluator. py file, the code runs from awq.evaluation import( evaluate_perplexity, eval_librispeech, eval_mmlu, eval_humaneval, eval_kl_divergence,)An ImportError occurred: cannot import name 'initialized tasks' from' lm_ eval. tasks' error. Can you help me?

Here is my environment: cuda: 12.4 torch: 2.3.1 transformers: 4.42.4 vllm: 0.5.3 lm_eval: 0.4.3

kunzeng-ch avatar Aug 01 '24 07:08 kunzeng-ch

You can pip install -e .[eval] to get the right dependencies

casper-hansen avatar Aug 01 '24 07:08 casper-hansen