onnx-tensorrt
onnx-tensorrt copied to clipboard
how to use precision 16 in python module?
As title, I would like to convert an onnx model to trt with fp16 by using python module. Thanks
Hi, I wander how to use fp16 mode. Have you solved this?
I recommend using the tools specified in https://github.com/onnx/onnx-tensorrt/blob/master/docs/faq.md#how-do-i-import-and-run-an-onnx-model-through-tensorrt for generating TensroRT engines from ONNX models since those tools are more supported.