instruct-eval icon indicating copy to clipboard operation
instruct-eval copied to clipboard

Published 20 hours ago • verified publisher icon declare-lab

Reproduce the accuracy of chavinlo/alpaca-native on MMLU

Open sglucas opened this issue 2 years ago • 0 comments

Hi

I try to evaluate the accuracy of chavinlo/alpaca-native on MMLU.

I find the final accuracy is about 36 and I cannot reproduce the result about 41.6.

May I ask which parts I need to focus on, the setup, environments

Best Lucas

sglucas avatar Oct 25 '23 17:10 sglucas