Ginzyl
Results
3
comments of
Ginzyl
加载量化后的int4模型会报错： 
> am hello, how to enable int 8 quantization
I got the same problem when generate Chinese, and it seems to occur randomly, the same sentence could generated correctly when you test it.