FasterTransformer Does it support python api? In a similar way to trtexec, transfer the engine model and do inference？

Does it support python api? In a similar way to trtexec, transfer the engine model and do inference？

Open tensorflowt opened this issue 2 years ago • 1 comments

Does it support python api? In a similar way to trtexec, transfer the engine model and do inference？

Does it support python api? In a similar way to trtexec, transfer the engine model and do inference？

Aug 05 '22 03:08 tensorflowt

No pure python api. If you want to run on python, you need use PyTorch/TensorFlow custom ops.

Aug 05 '22 04:08 byshiue

Close this bug because it is inactivated. Feel free to re-open this issue if you still have any problem.

Sep 08 '22 07:09 byshiue