Xiaodong (Vincent) Huang
Xiaodong (Vincent) Huang
closing since no activity for more than 3 weeks, pls reopen if you still have question, thanks!
created internal issue to track this, the `getTensorFormatDesc` is not up to date with all the supported datatypes. And @lix19937 is right, let's use the `getTensorDataType` when we alloc the...
the fix will be available in next release (10.5), thanks all!
closing since no activity for more than 3 weeks, pls reopen if you still have question, thanks!
@lix19937 , TRT only have quantized INT8, no vanilla INT8 today. And you are right, only quantized int8 is supported in plugin. bool/uint8/vanilla int8 are not supported in plugin today....
@lix19937 , since you have pattern: input -> plugin And the plugin implementation is blackbox to trt, So we could also workaround this by pack your INT8/UINT8 input as kINT32,...
> Thanks very much @ttyio > > > use Q/DQ in your network > > This need add one mul layer before plugin > > > pack your INT8/UINT8 input...
@zerollzeng is this dup of #3257 ? thanks
> Is it also possible to fuse Conv, Sigmoid, Mul, Add? Could you try remove the Q/DQ between `mul` and `add`. leave the Q/DQ on the other branch of the...
Adding @nzmora for vis. > Both onnx and engine graphs were added already in the first post When I open your attachment, both image are the same. > So does...