相同的程序，用 Qwen1.5-7B-Chat-GPTQ-Int4 没问题，用Int8则推理时报错

[davidjia1972]

相同的程序，用 Qwen1.5-7B-Chat-GPTQ-Int4 没问题，用 Qwen1.5-7B-Chat-GPTQ-Int8 在推理的时候报错：

RuntimeError: probability tensor contains either inf, nan or element < 0

[JustinLin610]

this is the problem of autogptq. gotta report this to them

[i7990X]

same here

[shikimoon]

same to me

[Rundong-Li]

same