I use DeepSeep R1, Answer will suddenly stop when I ask question
Self Checks
- [x] This is only for bug report, if you would like to ask a question, please head to Discussions.
- [x] I have searched for existing issues search for existing issues, including closed ones.
- [x] I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
- [x] [FOR CHINESE USERS] 请务必使用英文提交 Issue,否则会被关闭。谢谢!:)
- [x] Please do not modify this template :) and fill in all the required fields.
Dify version
0.15.3
Cloud or Self Hosted
Self Hosted (Docker)
Steps to reproduce
I use DeepSeep R1, Answer will suddenly stop when I ask question in web. Like Following:
the setting like following:
✔️ Expected Behavior
No response
❌ Actual Behavior
No response
There are similar discussions regarding the issue of answers suddenly stopping when using the DeepSeek R1 model. Here are a few relevant threads:
-
I use DeepSeep R1, Answer will suddenly stop when I ask question in web. - This discussion is still open and might provide insights or solutions as it progresses [1].
-
Knowledge-related responses stop in the middle of answers - This is another open discussion that might be related to your issue [2].
-
[Help] “Navigating the ‘Stop Responding’ Prompt in Applications” - This discussion is also open and could contain useful information [3].
The issue you're experiencing with the DeepSeek R1 model in a self-hosted environment is a known problem related to the response_format=json_object setting. After multiple interactions, the API may return empty responses. To address this, you can disable the json_object response format setting and include JSON output instructions in your system prompt instead. This approach has been shown to yield better results [4][5].
To continue talking to Dosu, mention @dosu.
Help Dosu learn! Give it feedback: Great Response | Irrelevant Answer | Incorrect Sources | Too Verbose | Hallucination | Bug Report | Other
Check the logs and the model settings. Please provide the screenshot of the model setting, the log the the answer as well.
From provided information, we can not do much about it.
会不会是资源的问题,我的有时候也是这样,回答问题回答着回答着下文就没了
会不会是资源的问题,我的有时候也是这样,回答问题回答着回答着下文就没了
你解决了吗?
后期公司才加资源,目前我也没有任何头绪,目前勉强能跑7b的,7b的暂时没发现这个问题,32b倒是出现好多次
感觉还是软件的问题,我更新新版本之后,agent全是这种问题,上个版本也只是偶尔出现问题,现在agent基本用不了,只能使用工作流,而且工作室(自己创建的应用)提供外部访问的url现在也没办法访问了