tensorrtllm_backend icon indicating copy to clipboard operation
tensorrtllm_backend copied to clipboard

Published 20 hours ago • verified publisher icon triton-inference-server

support for whisper trt-llm engine triton deployment

Open haiderasad opened this issue 1 year ago • 1 comments

is triton deployment available for whisper trt llm engine ?

haiderasad avatar Oct 08 '24 10:10 haiderasad

@haiderasad See https://github.com/triton-inference-server/tensorrtllm_backend/blob/main/docs/whisper.md.

yuekaizhang avatar Nov 06 '24 04:11 yuekaizhang