dify icon indicating copy to clipboard operation
dify copied to clipboard

I use DeepSeep R1, Answer will suddenly stop when I ask question

Open mlzxdzl opened this issue 10 months ago • 5 comments

Self Checks

  • [x] This is only for bug report, if you would like to ask a question, please head to Discussions.
  • [x] I have searched for existing issues search for existing issues, including closed ones.
  • [x] I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
  • [x] [FOR CHINESE USERS] 请务必使用英文提交 Issue,否则会被关闭。谢谢!:)
  • [x] Please do not modify this template :) and fill in all the required fields.

Dify version

0.15.3

Cloud or Self Hosted

Self Hosted (Docker)

Steps to reproduce

I use DeepSeep R1, Answer will suddenly stop when I ask question in web. Like Following:

Image

the setting like following:

Image

✔️ Expected Behavior

No response

❌ Actual Behavior

No response

mlzxdzl avatar Feb 17 '25 02:02 mlzxdzl

There are similar discussions regarding the issue of answers suddenly stopping when using the DeepSeek R1 model. Here are a few relevant threads:

  1. I use DeepSeep R1, Answer will suddenly stop when I ask question in web. - This discussion is still open and might provide insights or solutions as it progresses [1].

  2. Knowledge-related responses stop in the middle of answers - This is another open discussion that might be related to your issue [2].

  3. [Help] “Navigating the ‘Stop Responding’ Prompt in Applications” - This discussion is also open and could contain useful information [3].

The issue you're experiencing with the DeepSeek R1 model in a self-hosted environment is a known problem related to the response_format=json_object setting. After multiple interactions, the API may return empty responses. To address this, you can disable the json_object response format setting and include JSON output instructions in your system prompt instead. This approach has been shown to yield better results [4][5].

To continue talking to Dosu, mention @dosu.


Help Dosu learn! Give it feedback: Great Response | Irrelevant Answer | Incorrect Sources | Too Verbose | Hallucination | Bug Report | Other

dosubot[bot] avatar Feb 17 '25 02:02 dosubot[bot]

Check the logs and the model settings. Please provide the screenshot of the model setting, the log the the answer as well.

From provided information, we can not do much about it.

crazywoola avatar Feb 17 '25 02:02 crazywoola

会不会是资源的问题,我的有时候也是这样,回答问题回答着回答着下文就没了

mu-dan avatar Feb 17 '25 03:02 mu-dan

会不会是资源的问题,我的有时候也是这样,回答问题回答着回答着下文就没了

你解决了吗?

mlzxdzl avatar Feb 17 '25 07:02 mlzxdzl

后期公司才加资源,目前我也没有任何头绪,目前勉强能跑7b的,7b的暂时没发现这个问题,32b倒是出现好多次

mu-dan avatar Feb 17 '25 08:02 mu-dan

感觉还是软件的问题,我更新新版本之后,agent全是这种问题,上个版本也只是偶尔出现问题,现在agent基本用不了,只能使用工作流,而且工作室(自己创建的应用)提供外部访问的url现在也没办法访问了

mu-dan avatar Feb 27 '25 01:02 mu-dan