langgenius
Add Support for DeepInfra and gemma-2-27b-it Model
Self Checks
- [X] I have searched for existing issues search for existing issues, including closed ones.
- [X] I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
- [X] 请务必使用英文提交 Issue，否则会被关闭。谢谢！:）
- [X] Please do not modify this template :) and fill in all the required fields.
1. Is this request related to a challenge you're experiencing? Tell me about your story.
I tried using OpenAI-API-compatible in dify with deploying models provided by deepinfra.
All models return empty.
I'd like to request that Dify add support for the DeepInfra platform and specifically the gemma-2-27b-it model.
Reasoning: Multilingual Excellence: gemma-2-27b-it is currently considered one of the best open-source models for multilingual tasks. Integrating it would significantly enhance Dify's capabilities in understanding and generating code across various languages.
Technical Details: Model: gemma-2-27b-it Platform: DeepInfra (https://deepinfra.com/google/gemma-2-27b-it/api)
I'd be happy to provide any additional information or assistance to help with this integration.
2. Additional context or comments
No response
3. Can you help us with this feature?
- [X] I am interested in contributing to this feature.
DeepInfra supports Llama 3.1 70B in a good price. please support DeepInfra, too.
Ditto... please add DeepInfra
Replicate costs more than DeepInfra and is 10x slower, with way fewer models.
