OmniQuant icon indicating copy to clipboard operation
OmniQuant copied to clipboard

The ckpt of Quantized OPT model is not be found

Open liuxy1103 opened this issue 1 year ago • 6 comments

We have tried to reproduce the quantization of OPT-30B, but it is still difficult for us. Would you mind releasing the details of the procedure?

liuxy1103 avatar Jan 12 '24 07:01 liuxy1103