dify icon indicating copy to clipboard operation
dify copied to clipboard

DeepSeek window memory error

Open juniorsereno opened this issue 11 months ago • 3 comments

Self Checks

  • [X] This is only for bug report, if you would like to ask a question, please head to Discussions.
  • [X] I have searched for existing issues search for existing issues, including closed ones.
  • [X] I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
  • [X] [FOR CHINESE USERS] 请务必使用英文提交 Issue,否则会被关闭。谢谢!:)
  • [X] Please do not modify this template :) and fill in all the required fields.

Dify version

0.14.2

Cloud or Self Hosted

Self Hosted (Docker)

Steps to reproduce

Include DeepSeek as LLM in ChatFlow, select response format to json_object, set the memory window to 5. From the sixth interaction onwards you will have an empty answer from the DeepSeek.

✔️ Expected Behavior

Normal Response from the LLM

❌ Actual Behavior

Empty Response image

juniorsereno avatar Jan 03 '25 15:01 juniorsereno

The issue you're experiencing with the DeepSeek LLM returning empty responses when the memory window is set to 5 might be related to how the memory window feature is configured or implemented. In Dify, the memory window setting allows you to control the amount of chat history passed to the model. When the memory window is closed, the system dynamically filters the chat history based on the model's context window. When open, it allows precise control over the chat history amount [1].

Given that you're using a self-hosted Docker setup, ensure that your configuration settings are correctly applied and that there are no constraints or limitations specific to your environment that might affect the memory window size. Additionally, check if there are any error handling or logging mechanisms in place that might provide more insight into why the responses are empty. The Dify platform does implement error handling and logging for such scenarios [2][1][3][4].

If the issue persists, consider reviewing the configuration settings related to the memory window and ensuring they align with the expected behavior.

To continue talking to Dosu, mention @dosu.


Help Dosu learn! Give it feedback: Great Response | Irrelevant Answer | Incorrect Sources | Too Verbose | Hallucination | Other

dosubot[bot] avatar Jan 03 '25 15:01 dosubot[bot]

We need a fix for this bug where deepseek's memory gives an error using json_object, this makes it impossible to have an app with short memory using json_object.

juniorsereno avatar Jan 09 '25 19:01 juniorsereno

Hi, @juniorsereno. I'm Dosu, and I'm helping the Dify team manage their backlog. I'm marking this issue as stale.

Issue Summary

  • Memory error reported with DeepSeek in ChatFlow on a self-hosted Docker setup.
  • Responses become empty from the sixth interaction when memory window is set to 5.
  • I suggested checking configuration settings and error handling mechanisms.
  • You emphasized the need for a fix due to difficulties maintaining an app with short memory.

Next Steps

  • Please confirm if this issue is still relevant to the latest version of the Dify repository. If so, you can keep the discussion open by commenting on the issue.
  • Otherwise, this issue will be automatically closed in 15 days.

Thank you for your understanding and contribution!

dosubot[bot] avatar Mar 08 '25 16:03 dosubot[bot]