SpeechT5 icon indicating copy to clipboard operation
SpeechT5 copied to clipboard
verified publisher icon microsoft

vLLM or TGI or any other serving at scale not supported

Open random-checkin opened this issue 9 months ago • 0 comments

Hello Team,

I wish to serve speech T5 model at scale using servers like vllm or TGI, but sadly, it is failing. Please advise.

random-checkin avatar Mar 19 '25 19:03 random-checkin