ANT_Micro22 icon indicating copy to clipboard operation
ANT_Micro22 copied to clipboard
verified publisher icon clevercool

OliVe-OPT-13b

Open Arthur-Ling opened this issue 1 year ago • 0 comments

Hi, I was trying to quantize OPT-13B in 8bits(W/A), but there is an error--'run out of memory(128G)'. So I want to know do you have the same problem? Or do you have PPL on wikitext-2 of OPT-13B-8bit with OliVe?

Arthur-Ling avatar Apr 14 '24 16:04 Arthur-Ling