usdk icon indicating copy to clipboard operation
usdk copied to clipboard

Media perception improvements (WIP)

Open avaer opened this issue 1 year ago • 1 comments

This PR attempts to rewrite the media perception stack to be more directly in line with omni models.

Previously we were adding media queries for the medias that the agent is interested in. However, more generally, we can inject the media into the whole conversation as long as the agent thinks that's warranted. That is what this PR implements.

avaer avatar Oct 15 '24 21:10 avaer

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name Status Preview Comments Updated (UTC)
chat ✅ Ready (Inspect) Visit Preview 💬 Add feedback Oct 15, 2024 9:35pm
docs ✅ Ready (Inspect) Visit Preview 💬 Add feedback Oct 15, 2024 9:35pm

vercel[bot] avatar Oct 15 '24 21:10 vercel[bot]