Jingzhao Ou (cisco)

icon company Cisco, Inc. icon location Milpitas, CA

Results 1 issues of Jingzhao Ou (cisco)

Possible to convert EncDecRNNTBPEModel into TensorRT and run them through Triton inference server?

1 comment

**Is your feature request related to a problem? Please describe.** I wonder how to efficiently host [the parakeet-tdt-0.6b-v2 model](https://huggingface.co/nvidia/parakeet-tdt-0.6b-v2) through the Triton inference server. I can use the python backend...