Drew Crawford
Results
42
comments of
Drew Crawford
Quantization is one part of the difference but even the fp16 model is inferior to this project. I have reason to believe llama.cpp has bugs which cause quality degradation, my...
Well it's good to have solid confirmation the resharding isn't the issue! Here is my equivalent screenshot, 13B is plausible while 30B is not Just to throw some other things...