aimet icon indicating copy to clipboard operation
aimet copied to clipboard

What is the paper referenced by QAT with Range Learning?

Open 666DZY666 opened this issue 1 year ago • 3 comments

666DZY666 avatar May 26 '23 15:05 666DZY666

@666DZY666 the references are LSQ (https://arxiv.org/abs/1902.08153) and LSQ+ (https://arxiv.org/abs/2004.09576 but AIMET optimizes min/max instead of scale offset so our implementation is not exactly the same.

quic-mangal avatar May 30 '23 15:05 quic-mangal

@666DZY666 the references are LSQ (https://arxiv.org/abs/1902.08153) and LSQ+ (https://arxiv.org/abs/2004.09576 but AIMET optimizes min/max instead of scale offset so our implementation is not exactly the same.

Why does aimet optimize min/max instead of scale/offset, is this better?

666DZY666 avatar Jun 04 '23 04:06 666DZY666

@666DZY666 the references are LSQ (https://arxiv.org/abs/1902.08153) and LSQ+ (https://arxiv.org/abs/2004.09576 but AIMET optimizes min/max instead of scale offset so our implementation is not exactly the same.

Why does aimet optimize min/max instead of scale/offset, is this better?

There are obviously some mathematical differences. However, I believe it does not matter. So its an implementation choice.

quic-akhobare avatar Jun 04 '23 22:06 quic-akhobare