PaddleNLP icon indicating copy to clipboard operation
PaddleNLP copied to clipboard

[Bug]: generation sample_d2s 没有正确实现 temperature 功能

Open sserdoubleh opened this issue 1 year ago • 0 comments

软件环境

- paddlepaddle:
- paddlepaddle-gpu: 2.6.0
- paddlenlp: 2.7.2

重复问题

  • [X] I have searched the existing issues

错误描述

需要对 logits 除以 temperature,再进行 top k / top p sampling

稳定复现步骤 & 代码

https://github.com/PaddlePaddle/PaddleNLP/blob/develop/paddlenlp/generation/utils.py#L1395-L1406

sserdoubleh avatar Feb 16 '24 08:02 sserdoubleh