同一prompt多次请求，输出不同坐标结果。这是正常的吗？还是有什么bug？

Open ZJUTSong opened this issue 10 months ago • 2 comments

Feb 11 '25 09:02 ZJUTSong

To ensure consistent outputs for the same input, we recommend disabling the sampling options in the inference parameters.

Feb 13 '25 06:02 JjjFangg

为了确保相同输入的输出一致，我们建议禁用推理参数中的采样选项。

Hello, may I ask for an example of vllm disabling sampling

Mar 18 '25 03:03 xumeng19