owq icon indicating copy to clipboard operation
owq copied to clipboard
verified publisher icon xvyaward

llama 3 8B ppl

Open dorsa-zeinali opened this issue 1 year ago • 0 comments

Hi, I am reproducing your results, and does 44.55% accuracy for mmlu, 51.78% for hellaswag and 10.25 ppl for wikitext2 for llama 3 8B make sense? Please let me know. Thank you!

dorsa-zeinali avatar Aug 28 '24 18:08 dorsa-zeinali