eino icon indicating copy to clipboard operation
eino copied to clipboard

Feature Request: Simplify Integration of Litellm with OpenAI-Compatible APIs

Open stillfox-lee opened this issue 11 months ago • 0 comments

Describe the solution you'd like

Litellm is a widely used tool in the AI community that allows deploying a proxy and providing access via HTTP API. Additionally, the Litellm API is compatible with the OpenAI API protocol. It would be beneficial to simplify the process of creating a LitellmModel using the existing implementation available at: https://github.com/cloudwego/eino-ext/tree/main/libs/acl/openai.

Additional Context: litellm proxy doc: https://docs.litellm.ai/docs/simple_proxy litellm api: https://litellm-api.up.railway.app/#/

stillfox-lee avatar Jan 17 '25 13:01 stillfox-lee