Fanhai Lu

Thanks @imsujinpark! I got same issues, after switching it to the release version (v.0.109.0), I can connect my vms.

More logs after skip zero output: only 2 of 300 had zero length -------- output_len is zero for 238th request -------- output_len is zero for 288th request

> > Any reason to add text back, I suggested we keep both str and id in response in #40. The answer is " don't want to decode it to...

> > Any reason to add text back, I suggested we keep both str and id in response in #40. The answer is " don't want to decode it to...

> > > > Any reason to add text back, I suggested we keep both str and id in response in #40. The answer is " don't want to decode...

> * When input text, return both text and token ids. Is it still a streaming mode?