GPTQ-for-LLaMa icon indicating copy to clipboard operation
GPTQ-for-LLaMa copied to clipboard

Published 20 hours ago • verified publisher icon qwopqwop200

What is the right perplexity number?

Open JianbangZ opened this issue 2 years ago • 0 comments

for base FP16 model --eval gives 5.68 PPL on wikitext2 --benchmark 2048 gives 6.43 on wikitext2

What's the difference?

JianbangZ avatar Jun 15 '23 16:06 JianbangZ