I need that Dify supports Xinference authentication feature.
Self Checks
- [X] I have searched for existing issues search for existing issues, including closed ones.
- [X] I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
- [X] [FOR CHINESE USERS] 请务必使用英文提交 Issue,否则会被关闭。谢谢!:)
- [X] Please do not modify this template :) and fill in all the required fields.
1. Is this request related to a challenge you're experiencing? Tell me about your story.
My Xinference server requires SK authentication. When integrating Xinference LLM with Dify, I need that Dify supports this authentication feature.
Dify version
main
Cloud or Self Hosted
Self Hosted (Docker)
i find that there is not set the authorization in the func (_get_xinference_extra_parameter) when i set the sk in the fontend.I think it is the same in use Xinference llm.
i also find this issue(https://github.com/langgenius/dify/issues/6415),but i think it can not solve my issue.
2. Additional context or comments
No response
3. Can you help us with this feature?
- [X] I am interested in contributing to this feature.
+1
@michaelChe956 You can begin to make a PR.
@GarfieldDai @elepherai @michaelChe956 I have fixed this issue. Please refer to #7369 for details.
This PR is currently open. You can temporarily disable Xinference's authentication by running the following command: xinference-local -H 0.0.0.0 -p 9997, don't append --auth-config at the end.