mirascope icon indicating copy to clipboard operation
mirascope copied to clipboard

Add support for Gemini's Multimodal Live API

Open willbakst opened this issue 1 year ago • 2 comments

Description

https://ai.google.dev/api/multimodal-live

We should add support like we have for OpenAI, and in the process we should unify the interfaces to provide a provider-agnostic Realtime interface.

willbakst avatar Dec 12 '24 20:12 willbakst

Somewhat related so I want to add that remark here: Google also introduced a new python SDK --> https://github.com/googleapis/python-genai

This unifies the interface between AI Studio & Vertex AI. So just for that it is worth considering IMO :)

Kigstn avatar Dec 19 '24 13:12 Kigstn

Somewhat related so I want to add that remark here: Google also introduced a new python SDK --> https://github.com/googleapis/python-genai

This unifies the interface between AI Studio & Vertex AI. So just for that it is worth considering IMO :)

I've created a new issue #750 to track this

willbakst avatar Dec 19 '24 18:12 willbakst

Closing this in favor of an upcoming RFC on a Realtime API that will support both OpenAI and Google in a provider-agnostic way.

willbakst avatar Jul 04 '25 20:07 willbakst