void icon indicating copy to clipboard operation
void copied to clipboard
verified publisher icon voideditor

autocomplete request error? my model deployed vllm.

Open ccq1 opened this issue 8 months ago • 2 comments

Image

ccq1 avatar May 11 '25 19:05 ccq1

Looks like vLLM does not support suffix completion yet. Ollama works--can you try that?

andrewpareles avatar May 11 '25 23:05 andrewpareles

vllm same error ，Ollama works

vllm --version

0.8.5.post1

Image

Silencezjl avatar May 12 '25 06:05 Silencezjl