lsq-net icon indicating copy to clipboard operation
lsq-net copied to clipboard

Published 20 hours ago • verified publisher icon zhutmost

How to deploy the quantized model?

Open jiinhui opened this issue 3 years ago • 1 comments

When we have trained the quantization model, how to deploy it in cpu backend?

jiinhui avatar Oct 08 '21 03:10 jiinhui

For research proposes, you can run it with cpu backend by just modifying the config yaml. I am not similar with deployment in production environment. Maybe you can use the saved checkpoints to re-construct your model (or export it in ONNX)?

zhutmost avatar Oct 08 '21 05:10 zhutmost