Add JSON mode for Gemini via Google AI Studio

[Manouchehri]

Resolves #3365.

Basically the same as #2964, but for Google AI Studio (instead of Vertex AI)

[vercel[bot]]

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name	Status	Preview	Comments	Updated (UTC)
litellm	✅ Ready (Inspect)	Visit Preview	💬 Add feedback	Apr 30, 2024 2:00pm

[krrishdholakia]

hey @Manouchehri i believe this will face the same issue as vertex ai.

Let's try and have both moved over to httpx like anthropic.py by end of this week

[alex4o]

would you be able to support the responseSchema as well https://ai.google.dev/api/generate-content#v1beta.GenerationConfig?

[krrishdholakia]

@Manouchehri closing this PR as this is already live

@alex4o just added response schema for google ai studio - https://github.com/BerriAI/litellm/commit/51211dc2a6ac5edc4e01a16a8ebc66152b4002f9

should be live by EOD

---

@alex4o also dm'ed on linkedin to follow-up and make sure this works as expected

[alex4o]

Thanks man