onnx-tensorrt icon indicating copy to clipboard operation
onnx-tensorrt copied to clipboard

Published 20 hours ago • verified publisher icon onnx

how to use fp16 infer of onnx-tensorRT

Open lcaikk1314 opened this issue 1 year ago • 0 comments

Hello, I would like to consult. Now I have tensorRT reasoning model of fp16, how to use fp16 infer of onnx-tensorRT

lcaikk1314 avatar Apr 21 '23 04:04 lcaikk1314