transformers & mindnlp.transformers加载推理生成的结果差异大

[Copilot-X]

Describe the bug/ 问题描述 (Mandatory / 必填) A clear and concise description of what the bug is.

• Hardware Environment(Ascend/GPU/CPU) / 硬件环境: -显卡：GPU

• Software Environment / 软件环境 (Mandatory / 必填): --mindnlp 0.4.1(代码编译) -- MindSpore version 2.4.0 -- Python version 3.10.10 -- OS platform and distribution Ubuntu 20.04 -- GCC/Compiler version 9.4.0

加载mistral-v0.3-7b模型推理

Expected behavior / 预期结果 (Mandatory / 必填) transformers & mind.transformers方式生成的结果相近

Screenshots/ 日志 / 截图 (Mandatory / 必填)

Additional context / 备注 (Optional / 选填) Add any other context about the problem here.

[qhzhuang]

能否给一下代码？

[lvyufeng]

请尝试mindnlp 0.5版本，已兼容原版transformers