dify icon indicating copy to clipboard operation
dify copied to clipboard

I need that Dify supports Xinference authentication feature.

Open michaelChe956 opened this issue 1 year ago • 2 comments

Self Checks

  • [X] I have searched for existing issues search for existing issues, including closed ones.
  • [X] I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
  • [X] [FOR CHINESE USERS] 请务必使用英文提交 Issue,否则会被关闭。谢谢!:)
  • [X] Please do not modify this template :) and fill in all the required fields.

1. Is this request related to a challenge you're experiencing? Tell me about your story.

My Xinference server requires SK authentication. When integrating Xinference LLM with Dify, I need that Dify supports this authentication feature.

Dify version

main

Cloud or Self Hosted

Self Hosted (Docker)

i find that there is not set the authorization in the func (_get_xinference_extra_parameter) when i set the sk in the fontend.I think it is the same in use Xinference llm. 图片 图片

i also find this issue(https://github.com/langgenius/dify/issues/6415),but i think it can not solve my issue.

2. Additional context or comments

No response

3. Can you help us with this feature?

  • [X] I am interested in contributing to this feature.

michaelChe956 avatar Jul 31 '24 03:07 michaelChe956

+1

elepherai avatar Aug 01 '24 03:08 elepherai

@michaelChe956 You can begin to make a PR.

GarfieldDai avatar Aug 02 '24 03:08 GarfieldDai

@GarfieldDai @elepherai @michaelChe956 I have fixed this issue. Please refer to #7369 for details.

This PR is currently open. You can temporarily disable Xinference's authentication by running the following command: xinference-local -H 0.0.0.0 -p 9997, don't append --auth-config at the end.

realethanhsu avatar Aug 18 '24 03:08 realethanhsu