mmdeploy icon indicating copy to clipboard operation
mmdeploy copied to clipboard

Quantized Model for Torchscript

Open xingyueye opened this issue 3 years ago • 3 comments

Hello~ Do you have plan to support quantized models for torchscript?

xingyueye avatar May 10 '22 07:05 xingyueye

Work In Progress.

It is very likely not to use torch directly, we need convert it to onnx first, quantize model based on static graph.

tpoisonooo avatar May 10 '22 09:05 tpoisonooo

In dynamic graph, you define a tensor and slice it with []. It would be converted to gather opr. Not to mention if clause.

tpoisonooo avatar May 10 '22 09:05 tpoisonooo

https://github.com/open-mmlab/mmdeploy/pull/476

tpoisonooo avatar May 16 '22 10:05 tpoisonooo