datalee

Results 100 comments of datalee

你好,我这个python版本是对的,为啥装不上: `ERROR: lmdeploy-0.5.3-cu118-cp310-cp310-manylinux2014_x86_64.whl is not a supported wheel on this platform.`

> 你好,我这个python版本是对的,为啥装不上: `ERROR: lmdeploy-0.5.3-cu118-cp310-cp310-manylinux2014_x86_64.whl is not a supported wheel on this platform.` python 环境为 3.10.2

> > 操作系统是什么? > > euleros 0.5.0的版本没问题,o(╥﹏╥)o

把采样关了试试,用greedy模式

top_k为1确实也会存在随机性,不知道是否可以参考ollama的seed方式,能确保一致性:https://github.com/ollama/ollama/blob/main/docs/modelfile.md#valid-parameters-and-values seed Sets the random number seed to use for generation. Setting this to a specific number will make the model generate the same text for the same prompt. (Default:...