Avaer Kazmer

LLM models additions + local models (WIP)

1

Expand the supported models: - more providers (especially Claude, for computer use https://github.com/UpstreetAI/monorepo/pull/348) - streaming infrastructure (https://github.com/UpstreetAI/monorepo/pull/346) - support local inference (https://ollama.com/library)

Json streaming POC (WIP)

1

This is a simple POC of how we could implement streaming output for our chat messages. This is a highly desirable feature and almost all AI inference endpoints support it....

Twitch support (WIP)

1

Adds Twitch connectivity support - Chat - Streaming video/audio (currently needs to be run from a headful machine that is capable of running a video stream) Depends on the twitch...

Media perception improvements (WIP)

1

This PR attempts to rewrite the media perception stack to be more directly in line with omni models. Previously we were adding media queries for the medias that the agent...

Story mode [WIP]

1

Adds the `/story` route and components for rendering a story scene.

We should deploy if automatically to `npm` from `main`.

We should document `react-agents-client` as a module you can use to integrate agents into your app. All of our integrations (CLI, chat app) already go through this library so we...

The agent interview currently operates purely in chat, but in the background it works on a configurable json object. We can add more low-level checkbox interface (optional) for the user...