wanda icon indicating copy to clipboard operation
wanda copied to clipboard

Published 20 hours ago • verified publisher icon locuslab

llama_7b wikitext perplexity 7.0915350914

Open xiaopengaia opened this issue 9 months ago • 3 comments

bash scripts/llama_7b.sh

the source model: wikitext perplexity is 5.67702

prune this model, sparsity 50%, get wikitext perplexity is 7.09153509

but the paper is : 50% 7.26

why?

xiaopengaia avatar Apr 30 '24 08:04 xiaopengaia