onnx-tensorrt icon indicating copy to clipboard operation
onnx-tensorrt copied to clipboard

how to use precision 16 in python module?

Open cwlinghk opened this issue 3 years ago • 3 comments

As title, I would like to convert an onnx model to trt with fp16 by using python module. Thanks

cwlinghk avatar Feb 26 '21 03:02 cwlinghk

Hi, I wander how to use fp16 mode. Have you solved this?

ChanceQZ avatar May 21 '21 07:05 ChanceQZ

set_flag with FP16

zhenhuaw-me avatar May 24 '21 10:05 zhenhuaw-me

I recommend using the tools specified in https://github.com/onnx/onnx-tensorrt/blob/master/docs/faq.md#how-do-i-import-and-run-an-onnx-model-through-tensorrt for generating TensroRT engines from ONNX models since those tools are more supported.

kevinch-nv avatar May 24 '21 21:05 kevinch-nv