litellm
litellm copied to clipboard
[Feature]: Integration for Google's GenAI SDK
The Feature
Google has released a unified SDK for both Gemini and Vertex AI that has the newest models.
https://googleapis.github.io/python-genai/
Motivation, pitch
I'm currently evaluating frameworks to move forward with, and we'd love to get going with DSPy which uses liteLLM for it's models. However this LLM is critical for us. It will also help move everyone from maintain 2 versions of Google (Gemini API and VertexAI SDK) over to just one.
Are you a ML Ops Team?
No
Twitter / LinkedIn details
https://www.linkedin.com/in/mellybdev/