lm-evaluation-harness icon indicating copy to clipboard operation
lm-evaluation-harness copied to clipboard

Published 20 hours ago • verified publisher icon EleutherAI

Mmlu Pro

Open ysjprojects opened this issue 1 year ago • 8 comments

https://huggingface.co/datasets/TIGER-Lab/MMLU-Pro

Added new task: MMLU-Pro

Improvements:

  • Higher quality/difficulty compared to original mmlu
  • Multiple-choice with 10 options instead of 4

Closes #1947

ysjprojects avatar Jun 13 '24 10:06 ysjprojects