Raj-vivid

Int8 quantized model performs worse or similar to non quantized fp32 or fp16 model.

4

I am using a pretrained model from timm for convnextv2. It comprises of layer norm and globalresponsenormalization layer but even after adding custom quant modules for layer norm , layer...