mmdeploy
mmdeploy copied to clipboard
Quantized Model for Torchscript
Hello~ Do you have plan to support quantized models for torchscript?
Work In Progress.
It is very likely not to use torch directly, we need convert it to onnx first, quantize model based on static graph.
In dynamic graph, you define a tensor and slice it with []. It would be converted to gather opr. Not to mention if clause.
https://github.com/open-mmlab/mmdeploy/pull/476