server icon indicating copy to clipboard operation
server copied to clipboard

Different result in triton with vllm backend and vLLM server

Open skj092 opened this issue 4 months ago • 0 comments

I am running same model on triton with vLLM backend and vLLM server.

vLLM result:

Image

triton vLLM backend result

Image

Why both are different?

skj092 avatar Sep 15 '25 11:09 skj092