The model switch is not effective
Self Checks
- [x] This is only for bug report, if you would like to ask a question, please head to Discussions.
- [x] I have searched for existing issues search for existing issues, including closed ones.
- [x] I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
- [x] [FOR CHINESE USERS] 请务必使用英文提交 Issue,否则会被关闭。谢谢!:)
- [x] Please do not modify this template :) and fill in all the required fields.
Dify version
1.0.1
Cloud or Self Hosted
Self Hosted (Docker)
Steps to reproduce
I turned off these models:
Refresh and turn them all on again:
This problem is not only with Volcano Engine, but also with other model suppliers.
✔️ Expected Behavior
No response
❌ Actual Behavior
No response
The issue you're experiencing with model switching not being effective might be related to how Dify handles model state changes. Dify uses a snapshot system for model configurations, meaning that changes to model settings only apply to new conversations. Existing conversations will continue to use the configuration that was active when they were created. Therefore, if you're testing model changes, make sure to start a new conversation to see the effects [1].
Additionally, the UI updates for model toggling are managed through a debounced function, which ensures that rapid toggles do not result in multiple server requests. This might affect how quickly changes appear to take effect [2].
If the issue persists across different model suppliers, it might be worth checking if there are any cooldown periods or errors being logged that could prevent the models from being toggled effectively [3].
To continue talking to Dosu, mention @dosu.
Help Dosu learn! Give it feedback: Great Response | Irrelevant Answer | Incorrect Sources | Too Verbose | Hallucination | Bug Report | Other