ONE icon indicating copy to clipboard operation
ONE copied to clipboard

[circle-quantizer] Minimum MSE Quantization

Open SlavikMIPT opened this issue 1 year ago • 14 comments

What

Let's support calculating of scale using MSE minimization (see part 3.4).

Why

We can improve accuracy of quantized models (especially low-bit quantized) by finding optimal approximation of tensor (calculating scale factor using MSE minimization approach)

How

TBD:

SlavikMIPT avatar Dec 04 '23 09:12 SlavikMIPT