agents

agents copied to clipboard

Fix bug with before_tts_cb when speech is string but before_tts_cb returns async iterable

3

If you said agent.say(), but your before_tts_cb returned an AsyncIterable, it'd throw - because the transcript was a string but the before_tts_cb was AsyncIterable.

martin-purplefish

How can I continue processing audio while returning it using MultimodalAgent/Openai realtime api

3

For example, voice conversion

phpmaple

Long time interval when synthesizing Chinese text-to-speech

8

I have encountered an issue with the voice assistant when synthesizing Chinese text. The time interval between LLM and synthesized speech outputs is noticeably longer when the output is in...

zhanghx0905

[Question] Inquiry on Best Practices for Deploying Stateful Agent-Services

4

I would like to consult about the best practices for deploying services, particularly in scenarios involving stateful agent-services. Currently, I have a program running, and I have added some new...

BaiMoHan

Fix SSML Implementation by Adding <voice> Tag

3

This pull request fixes the SSML implementation in the Azure Text-to-Speech (TTS) integration by correctly adding the tag. This ensures that the SSML is properly structured and the specified voice...

samirsalman

This PR was opened by the [Changesets release](https://github.com/changesets/action) GitHub action. When you're ready to do a release, you can merge this and the packages will be published to npm automatically....

github-actions[bot]

openai-realtime: reconnect OpenAI websocket on abnormal disconnection

2

The worker will exit due to websocket abnormal disconnection, causing the chat to be interrupted abnormally. Automatic reconnect OpenAI websocket after disconnection.

coderlxn

Hook to expose committed TTS audio before playing back to user

1

I'm looking for an elegant way to save the audio output of the Text-to-Speech (TTS) system, specifically the audio that is played back to users during interactions, as well as...

BaiMoHan

Log exception on tool error

2

I've gotten tripped up by this a bunch.

martin-purplefish

I can't get the TTS 11labs pluguin to work

3

When I use OpenAI TTS there is no problem, but when I use ElevenLabs TTS, it says the first message but then, I get this message in the terminal: {"message":...

llllCharliellll