AQLM icon indicating copy to clipboard operation
AQLM copied to clipboard

Published 20 hours ago • verified publisher icon Vahe1994

How to run perplexity eval on HF hub models?

Open tsengalb99 opened this issue 9 months ago • 0 comments

Hi, what command should I run in your codebase to get perplexity numbers on wikitext and c4 for your HF hub models (eg https://huggingface.co/ISTA-DASLab/Meta-Llama-3-70B-AQLM-2Bit-1x16/tree/main)

tsengalb99 avatar May 18 '24 18:05 tsengalb99