dify icon indicating copy to clipboard operation
dify copied to clipboard

Code not valid in openai_api_compatible

Open AAEE86 opened this issue 1 year ago • 1 comments

Self Checks

  • [X] This is only for bug report, if you would like to ask a question, please head to Discussions.
  • [X] I have searched for existing issues search for existing issues, including closed ones.
  • [X] I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
  • [X] [FOR CHINESE USERS] 请务必使用英文提交 Issue,否则会被关闭。谢谢!:)
  • [X] Please do not modify this template :) and fill in all the required fields.

Dify version

0.8.3

Cloud or Self Hosted

Self Hosted (Docker)

Steps to reproduce

Quicker_20240924_103947 The Chinese characters cannot be displayed and there is no help prompt. I haven't found any problems with the code.

✔️ Expected Behavior

No response

❌ Actual Behavior

No response

AAEE86 avatar Sep 24 '24 02:09 AAEE86

The code in openai_api_compatible in the llm.py file is not valid when configuring the AI model llama3.1-405b-instruct because there is a typo in the parameter name frequency_penalt. It should be frequency_penalty.

Here is the incorrect configuration:

- name: frequency_penalt
  use_template: frequency_penalty
  min: -2
  max: 2
  default: 0

And here is the corrected version:

- name: frequency_penalty
  use_template: frequency_penalty
  min: -2
  max: 2
  default: 0

Make sure to update the parameter name in your configuration file to resolve the issue [1].

To continue talking to Dosu, mention @dosu.

dosubot[bot] avatar Sep 24 '24 02:09 dosubot[bot]