[Bug] gpt-4o(Azure),使用自动生成标题时报错
📦 Deployment Method
Other
📌 Version
2.14.1
💻 Operating System
macOS
📌 System Version
14.5
🌐 Browser
Chrome
📌 Browser Version
Version 127.0.6533.89 (Official Build) (arm64)
🐛 Bug Description
v2.14.1 对于 gpt-4o(Azure),使用自动生成标题时,所有话题的标题返回值都为:
{ "error": { "code": "DeploymentNotFound", "message": "The API deployment for this resource does not exist. If you created the deployment within the last 5 minutes, please wait a moment and try again." }}
📷 Recurrence Steps
None
🚦 Expected Behavior
return normal title
📝 Additional Information
None
Please follow the issue template to update description of your issue.
Bot detected the issue body's language is not English, translate it automatically.
Title: [Bug]
https://github.com/ChatGPTNextWeb/ChatGPT-Next-Web/issues/5111 https://github.com/ChatGPTNextWeb/ChatGPT-Next-Web/issues/5165
You need to deploy a model with name gpt-4o-mini in your Azure, the title is generated using the mini model, not the gpt-4o model
Hi @EdiWang , our deployment is controlled by other team, and we can only use the gpt-4o model, how can I change the model which use to generate the title?
@cnjack Currently, you can't change the model used to summarize the title without modifying the code.
An workaround would be deploying a proxy in front of Azure Open AI's API, like Azure APIM to route /gpt-4o-mini requests to /gpt-4o. This approach is very 996.
I hope in the future this project can add the ability to customize the summarize model.
I found a workaround to solve this issue, set the custom_model="-all,gpt-4o@azure=gpt-4o", and I checked the get_summary_model func and if the gpt-4o-mini is not active and it will use the current model to generate the title. @EdiWang
自定义模型需要这么配置才能使用标题摘要:
-all,gpt-4o@azure=gpt-4o,gpt-4o-mini@azure=gpt-4o-mini,gpt-35-turbo@Azure=gpt-35-turbo
下面这样设置对话能用该模型,但是摘要压缩异常,报错没有提供key。:
gpt-4o@azure,gpt-35-turbo
Bot detected the issue body's language is not English, translate it automatically.
Custom models need to be configured like this to use title summaries:
-all,gpt-4o@azure=gpt-4o,gpt-4o-mini@azure=gpt-4o-mini,gpt-35-turbo@Azure=gpt-35-turbo
The model can be used by setting up the dialogue as follows, but the summary compression is abnormal and an error is reported without providing a key. :
gpt-4o@azure,gpt-35-turbo