XIE JINGCHENG

icon indicating a website link https://xiejingcheng.github.io/ icon indicating an email [email protected]

icon company Xidian University icon location Xi'an, Shaanxi, China icon location I'm an undergrad at Xidian University, soon to become a master's student at USTC for my graduate studies. Currently, I am interning in image algorithms at VIVO.

Results 1 comments of XIE JINGCHENG

AttributeError: module 'lm_eval.tasks' has no attribute 'ALL_TASKS'

I think it is a lm_eval version problem, I modified the code as follows, but encountered other problems ``` def eval_zero_shot(model_name, model, tokenizer, task_list=["boolq","rte","hellaswag","winogrande","arc_challenge","arc_easy","openbookqa"], num_fewshot=0, use_accelerate=False, add_special_tokens=False): from lm_eval import...