mindnlp icon indicating copy to clipboard operation
mindnlp copied to clipboard

Published 20 hours ago • verified publisher icon mindspore-lab

由于topk行为异常导致的_beam_search函数错误

Open VikingDeng opened this issue 1 year ago • 0 comments

topk的行为异常参见这两个issue https://github.com/mindspore-lab/mindnlp/issues/1487 https://github.com/mindspore-lab/mindnlp/issues/1499 而在mindnlp/transformers/generation/utils.py的_beam_search函数的3228行， image 这里的topk在GPU下会生成负数索引从而导致索引越界，以至于rag测试无法通过

VikingDeng avatar Aug 08 '24 13:08 VikingDeng