agents
agents copied to clipboard
livekit
Build real-time multimodal AI applications 🤖🎙️📹
also fill the text field on synthesize/chunked requests for the SynthesizedAudio struct
``` if isinstance(data, rtc.AudioFrame): # TODO(theomonnom): The remix_and_resample method is low quality # and should be replaced with a continuous resampling frame = data.remix_and_resample( self._sample_rate, self._num_channels ) ``` When will...
I successfully deployed the worker locally and registered it using ElevenLabs, but after a successful connection, there is no voice saying "Hey, how can I help you today?". I talk...
When using LiveKit agents, sometimes the agent hears its own TTS output (eg via the laptop speakers) which is then interpreted as speech from the user. This then creates a...
With the minimal_assistant.py example, the above categories of voices don't seem to generate output properly. Instead it seems to hang for long periods of time. Am seeing LLM chat completion...
This is a more clear description + RCA of #279 I think the issue is related to the TTS streaming implementation of livekit-plugins-elevenlabs. The reason I think that is because...
Hi, I was able to make the minimal_assistant.py implementation work. Once I sorted out all the difficulties, it runs pretty well! Kudos for that 😃. I have a question regarding...
Just add this code to fix it please ``` text = '' try: text = ''.join(msg['normalizedAlignment']['chars']) except Exception: pass ``` In this section of the code env/lib/python3.10/site-packages/livekit/plugins/elevenlabs/tts.py ``` LINE 286:...
