gpt-fast icon indicating copy to clipboard operation
gpt-fast copied to clipboard

Published 20 hours ago • verified publisher icon pytorch-labs

Int4 perplexity

Open SinanAkkoyun opened this issue 1 year ago • 0 comments

Hi! How does ppl compare between fp16 and your int4?

SinanAkkoyun avatar Mar 07 '24 23:03 SinanAkkoyun