dify
dify copied to clipboard
Code not valid in openai_api_compatible
Self Checks
- [X] This is only for bug report, if you would like to ask a question, please head to Discussions.
- [X] I have searched for existing issues search for existing issues, including closed ones.
- [X] I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
- [X] [FOR CHINESE USERS] 请务必使用英文提交 Issue,否则会被关闭。谢谢!:)
- [X] Please do not modify this template :) and fill in all the required fields.
Dify version
0.8.3
Cloud or Self Hosted
Self Hosted (Docker)
Steps to reproduce
The Chinese characters cannot be displayed and there is no help prompt. I haven't found any problems with the code.
✔️ Expected Behavior
No response
❌ Actual Behavior
No response
The code in openai_api_compatible in the llm.py file is not valid when configuring the AI model llama3.1-405b-instruct because there is a typo in the parameter name frequency_penalt. It should be frequency_penalty.
Here is the incorrect configuration:
- name: frequency_penalt
use_template: frequency_penalty
min: -2
max: 2
default: 0
And here is the corrected version:
- name: frequency_penalty
use_template: frequency_penalty
min: -2
max: 2
default: 0
Make sure to update the parameter name in your configuration file to resolve the issue [1].
To continue talking to Dosu, mention @dosu.