OFQ icon indicating copy to clipboard operation
OFQ copied to clipboard

The +0.5 term in StatQ results in asymmetric weight quantization.

Open LuletterSoul opened this issue 1 year ago • 1 comments

Unlike conventional symmetric weight quantization, I found that StatQ will let rounded integer weight add a term (+ 0.5), This item may cause the StatQ not to be actually deployed on hardware.

image

If we remove the -0.5 and +0.5 terms, the integer value of the weight will have an extra value, that is, 2**(bit - 1) -1. How do you modify this formula and achieve the same performance?

LuletterSoul avatar Jan 30 '24 06:01 LuletterSoul