espnet_onnx icon indicating copy to clipboard operation
espnet_onnx copied to clipboard

converting to triton model

Open Macsim2 opened this issue 1 year ago • 1 comments

Hi, Thanks to this repository, I made the onnx model what I trained and I curious about the model is on cpu or gpu Now I'm trying to convert espnet onnx model to triton server model How can I do this? Let me some hint.. Thank you

Macsim2 avatar Nov 09 '23 02:11 Macsim2

Hi @Macsim2, sorry for the late reply. The converted model is on the CPU. I am not familiar with Triton server models, so I cannot help you with that part of the conversion process.

Masao-Someki avatar Dec 13 '23 13:12 Masao-Someki