subaligner icon indicating copy to clipboard operation
subaligner copied to clipboard

Published 20 hours ago • verified publisher icon baxtree

TensorRT

Open skimmy12 opened this issue 2 years ago • 1 comments

Do you use TensorRT, if so, what version?

skimmy12 avatar Jun 01 '23 04:06 skimmy12

Hi, @skimmy12, the short answer is no. However, it is possible to convert the TF saved model to a TRT model. Following that, the predictor needs to be modified to accommodate TRT APIs which are slightly different. Additionally, I am not sure how much gain in overall processing speed that could achieve, as a significant portion of processing time is currently consumed by various manipulations on media files. It would be useful to benchmark the improvement and any help on that will be welcomed.

baxtree avatar Jun 02 '23 08:06 baxtree