Add Search Suggestions, groundingMetadata functionality for the Gemini LiveAPI?

[getchannel]

pipecat version

No response

Python version

No response

Operating System

No response

Question

Would like to add search suggestions and groundingMetadata to the LiveAPI so users can display search suggestions and source links clientside. I know that the GoogleLLMService has this functionality built out, and uses frames.

Is there a way we could broaden that implementation to work with the GeminiMultimodalLiveLLMService as well?

LiveAPI:

ServerContent has a field groundingMetadata we can add. Can we use the LLMSearchResponseFrame that the regular GoogleLLMService and llm.py processes? Define new class to parse the JSON? Create helper method?

Pete

What I've tried

Looked through LiveAPI docs, Pipecat services.

Context

https://ai.google.dev/gemini-api/docs/live https://github.com/google-gemini/cookbook/blob/main/quickstarts/Get_started_LiveAPI_tools.ipynb