uptrain icon indicating copy to clipboard operation
uptrain copied to clipboard

Add an operator to compute MMLU score

Open Dominastorm opened this issue 4 months ago • 0 comments

MMLU (Massive Multitask Language Understanding) is a benchmark designed to measure knowledge acquired during pretraining by evaluating models exclusively in zero-shot and few-shot settings.

Dominastorm avatar Feb 23 '24 05:02 Dominastorm