LEE, JIHO issues

Repositories
Issues
Comments

Results 2 issues of


                                            LEE, JIHO

I tried converting to PTQ, but it didn't work well...

Hello, I am JIHO LEE. I thoroughly enjoyed reading your paper and was deeply impressed by it. I believe that the ultimate goal of this research is to improve efficiency...

I think that the CGA is not applied on `w_q @ w_k` when using StatsQ and CGA..

Hi, I have a quick question about the StatsQuantizer_specific_4_qkreparam_cga implementation. https://github.com/nbasyl/OFQ/blob/7ed37d1dd33d39395edbf49fcbbc52f678ecf961/src/quantization/quantizer/statsq.py#L191C1-L192C1 The final line of the forward pass is: quan_weights = quan_weights_no_grad.detach() - real_weights.detach() + real_weights but, (in if self.training)...