InternVL icon indicating copy to clipboard operation
InternVL copied to clipboard

[Bug] InternVL3.5-38B是默认think吗

Open zzk6626 opened this issue 4 months ago • 4 comments

Checklist

  • [ ] 1. I have searched related issues but cannot get the expected help.
  • [ ] 2. The bug has not been fixed in the latest version.
  • [ ] 3. Please note that if the bug-related issue you submitted lacks corresponding environment info and a minimal reproducible demo, it will be challenging for us to reproduce and resolve the issue, reducing the likelihood of receiving feedback.

Describe the bug

测试了很多样例,貌似都是think模式,请问是否可以修改chat_template.jinja让他不think,直接输出

以上测试温度为0.1,topp为0.3

Reproduction

Environment

-

Error traceback


zzk6626 avatar Sep 02 '25 03:09 zzk6626

请把system prompt设置成你是书生·万象,英文名是InternVL,是由上海人工智能实验室、清华大学及多家合作单位联合开发的多模态大语言模型。来关闭think模式

Weiyun1025 avatar Sep 02 '25 04:09 Weiyun1025

请把system prompt设置成你是书生·万象,英文名是InternVL,是由上海人工智能实验室、清华大学及多家合作单位联合开发的多模态大语言模型。来关闭think模式

我测试了一下情况确实好转,但是仍然有部分回复是think模式输出

zzk6626 avatar Sep 02 '25 07:09 zzk6626

依然会有输出,有办法能控制吗。

linxid avatar Sep 17 '25 07:09 linxid

可能是因为我们基模型用的Qwen3对think模式比较执着,可以试一下在response开头加上<think>\n</think>\n来完全关闭think模式

Weiyun1025 avatar Sep 22 '25 01:09 Weiyun1025