Will Walden

https://wgantt.github.io/

Johns Hopkins University Baltimore, MD Research Scientist, HLTCOE @ Johns Hopkins University

Results 2 comments of


                                            Will Walden

[Bug]: topk=1 and temperature=0 cause different output in vllm

Pinging this issue to keep it unstable because many of us would still like to see it resolved.

[Bug]: topk=1 and temperature=0 cause different output in vllm

pinging again to keep unstale