dify icon indicating copy to clipboard operation
dify copied to clipboard

When the question classifier is using DeepSeek-70B, it sometimes reports an error.

Open smart68668 opened this issue 8 months ago • 1 comments

Self Checks

  • [x] This is only for bug report, if you would like to ask a question, please head to Discussions.
  • [x] I have searched for existing issues search for existing issues, including closed ones.
  • [x] I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
  • [x] [FOR CHINESE USERS] 请务必使用英文提交 Issue,否则会被关闭。谢谢!:)
  • [x] Please do not modify this template :) and fill in all the required fields.

Dify version

1.3

Cloud or Self Hosted

Self Hosted (Docker)

Steps to reproduce

Model :deepseek-r1-distill-llama-70b Model plugin : OpenAI-API-compatible Completion mode:Chat Delimiter for streaming results: \n\n There are generally no problems if it is the 671B model. Suggestion :Add exception handling to the Question Classifier #14204 Image

✔️ Expected Behavior

Image

❌ Actual Behavior

Image

smart68668 avatar Apr 27 '25 01:04 smart68668