dify icon indicating copy to clipboard operation
dify copied to clipboard

Request to add a DeepSeek Chat model to turn off the Think Chain switch

Open fsea opened this issue 11 months ago • 4 comments

Self Checks

  • [x] I have searched for existing issues search for existing issues, including closed ones.
  • [x] I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
  • [x] [FOR CHINESE USERS] 请务必使用英文提交 Issue,否则会被关闭。谢谢!:)
  • [x] Please do not modify this template :) and fill in all the required fields.

1. Is this request related to a challenge you're experiencing? Tell me about your story.

Sometimes you don't need to output a chain of thoughts, so it's recommended to add a switch

2. Additional context or comments

No response

3. Can you help us with this feature?

  • [ ] I am interested in contributing to this feature.

fsea avatar Feb 06 '25 03:02 fsea

Will do later :) The short term thing is we need to add deepseek for all kinds of providers. See the milestone here https://github.com/langgenius/dify/milestone/12

crazywoola avatar Feb 06 '25 05:02 crazywoola

Partly https://github.com/langgenius/dify/pull/13263 but not for all the providers.

crazywoola avatar Feb 06 '25 06:02 crazywoola

Is it a good idea to add the Enable CoT Trim option in OpenAI-API-compatible and configure the start and end markers of CoT (such as in the deepseek-r1 series)? Then remove the Think Chain in the OpenAI-API-compatible implementation.

zxfishhack avatar Feb 06 '25 08:02 zxfishhack

Hi, @fsea. I'm Dosu, and I'm helping the Dify team manage their backlog. I'm marking this issue as stale.

Issue Summary:

  • You requested a feature to disable the "Think Chain" switch in the DeepSeek Chat model.
  • Crazywoola mentioned plans to address this, focusing on adding deepseek for various providers.
  • Zxfishhack suggested an "Enable CoT Trim" option for OpenAI-API-compatible implementations, potentially removing the Think Chain feature.

Next Steps:

  • Please let us know if this issue is still relevant to the latest version of the Dify repository by commenting here.
  • If there is no further activity, this issue will be automatically closed in 15 days.

Thank you for your understanding and contribution!

dosubot[bot] avatar Mar 09 '25 16:03 dosubot[bot]