smoothquant icon indicating copy to clipboard operation
smoothquant copied to clipboard

set quantize_output True the acc drop to 0

Open lonleyodd opened this issue 5 months ago • 0 comments

hi, thanks for your nice work, I tried set param quantize_output as True when quantize model,like follow code def from_float(module, weight_quant='per_channel', act_quant='per_token', quantize_output=True), but the acc drop to 0 , is there anything wrong or smoothquant method unsupport quantize output?

lonleyodd avatar Jan 15 '24 07:01 lonleyodd