Knowledge-Distillation-Toolkit icon indicating copy to clipboard operation
Knowledge-Distillation-Toolkit copied to clipboard

Published 20 hours ago • verified publisher icon georgian-io

How to save the quantized model properly for wav2vec.

Open vigneshgig opened this issue 3 years ago • 1 comments

I want to directly load the quantized model. So how to save the wav2vec model properly.

vigneshgig avatar May 24 '21 09:05 vigneshgig

I haven't tried to save and load quantized model. Maybe this thread (https://discuss.pytorch.org/t/how-do-i-save-and-load-quantization-model/64188/4) will help?

You may also save the original model and quantize it after loading.

zilunpeng avatar May 26 '21 02:05 zilunpeng