NextChat icon indicating copy to clipboard operation
NextChat copied to clipboard

[Bug] gpt-4o(Azure),使用自动生成标题时报错

Open Mile-Away opened this issue 1 year ago • 3 comments

📦 Deployment Method

Other

📌 Version

2.14.1

💻 Operating System

macOS

📌 System Version

14.5

🌐 Browser

Chrome

📌 Browser Version

Version 127.0.6533.89 (Official Build) (arm64)

🐛 Bug Description

v2.14.1 对于 gpt-4o(Azure),使用自动生成标题时,所有话题的标题返回值都为:

{ "error": { "code": "DeploymentNotFound", "message": "The API deployment for this resource does not exist. If you created the deployment within the last 5 minutes, please wait a moment and try again." }}

📷 Recurrence Steps

None

🚦 Expected Behavior

return normal title

📝 Additional Information

None

Mile-Away avatar Aug 07 '24 17:08 Mile-Away

Please follow the issue template to update description of your issue.

nextchat-manager[bot] avatar Aug 07 '24 17:08 nextchat-manager[bot]

Bot detected the issue body's language is not English, translate it automatically.


Title: [Bug]

Issues-translate-bot avatar Aug 07 '24 17:08 Issues-translate-bot

https://github.com/ChatGPTNextWeb/ChatGPT-Next-Web/issues/5111 https://github.com/ChatGPTNextWeb/ChatGPT-Next-Web/issues/5165

Dogtiti avatar Aug 08 '24 02:08 Dogtiti

You need to deploy a model with name gpt-4o-mini in your Azure, the title is generated using the mini model, not the gpt-4o model

EdiWang avatar Aug 21 '24 06:08 EdiWang

Hi @EdiWang , our deployment is controlled by other team, and we can only use the gpt-4o model, how can I change the model which use to generate the title?

cnjack avatar Aug 27 '24 03:08 cnjack

@cnjack Currently, you can't change the model used to summarize the title without modifying the code.

An workaround would be deploying a proxy in front of Azure Open AI's API, like Azure APIM to route /gpt-4o-mini requests to /gpt-4o. This approach is very 996.

I hope in the future this project can add the ability to customize the summarize model.

EdiWang avatar Aug 27 '24 06:08 EdiWang

I found a workaround to solve this issue, set the custom_model="-all,gpt-4o@azure=gpt-4o", and I checked the get_summary_model func and if the gpt-4o-mini is not active and it will use the current model to generate the title. @EdiWang

cnjack avatar Aug 27 '24 07:08 cnjack

自定义模型需要这么配置才能使用标题摘要:

-all,gpt-4o@azure=gpt-4o,gpt-4o-mini@azure=gpt-4o-mini,gpt-35-turbo@Azure=gpt-35-turbo

下面这样设置对话能用该模型,但是摘要压缩异常,报错没有提供key。:

gpt-4o@azure,gpt-35-turbo 

guuguo avatar Oct 18 '24 02:10 guuguo

Bot detected the issue body's language is not English, translate it automatically.


Custom models need to be configured like this to use title summaries:

-all,gpt-4o@azure=gpt-4o,gpt-4o-mini@azure=gpt-4o-mini,gpt-35-turbo@Azure=gpt-35-turbo

The model can be used by setting up the dialogue as follows, but the summary compression is abnormal and an error is reported without providing a key. :

gpt-4o@azure,gpt-35-turbo

Issues-translate-bot avatar Oct 18 '24 02:10 Issues-translate-bot