Test-isom

hi, iam facing an issue with livekit agent version 0.8.4 and 0.8.5, it works well in 0.8.2, in this method _will_synthesize_assistant_answer() as per this example(we have a modified version of...

Useing RAG with openai multimodal agent

3

Is there a sample code or can you guide to pass additional context to llm, like in this pipeline agents example with new openai multimodal example? https://github.com/livekit/agents/blob/main/examples/voice-pipeline-agent/simple-rag/assistant.py

TTSSegmentsForwarder ERROR- agent stops speaking after this for 2-3 seconds. Facing this issue randomly.

8

{"message": "Task was destroyed but it is pending!\ntask: ", "level": "ERROR", "name": "asyncio", "pid": 166, "job_id": "AJ_yWi3pGCRRnqW", "timestamp": "2024-09-26T08:20:38.011601+00:00"}

Azure TTS Crash

2

{"message": "Error in main_task\nTraceback (most recent call last):\n File \"/root/pythonenv/enve/lib/python3.10/site-packages/livekit/agents/utils/log.py\", line 16, in async_fn_logs\n return await fn(*args, **kwargs)\n File \"/root/pythonenv/enve/lib/python3.10/site-packages/livekit/plugins/azure/tts.py\", line 90, in main_task\n raise ValueError(\nValueError: failed to synthesize audio:...

Crash while using- before_tts_cb

2

{"message": "Error in _str_synthesis_task\nTraceback (most recent call last):\n File \"/root/pythonenv/enve/lib/python3.10/site-packages/livekit/agents/utils/log.py\", line 16, in async_fn_logs\n return await fn(*args, **kwargs)\n File \"/root/pythonenv/enve/lib/python3.10/site-packages/livekit/agents/voice_assistant/agent_output.py\", line 195, in _str_synthesis_task\n handle.tts_forwarder.push_text(transcript)\n File \"/root/pythonenv/enve/lib/python3.10/site-packages/livekit/agents/transcription/tts_forwarder.py\", line 200, in...

JobRequest- req.room.metadata is null in livekit-agents==0.8.9 and 0.8.10 on self hosted cluster.

5

For LiveKit agent plugin versions livekit-agents==0.8.8, we get room metadata in async def request_fnc(req: JobRequest) -> None: in req.room.metadata as value what we set while creating room, but in version...

Function call issue: when using mistralai/Mixtral-8x7B-Instruct-v0.1 or mistralai/Mistral-7B-Instruct-v0.1 with together ai.

1

{"message": "Error in _stream_synthesis_task\nTraceback (most recent call last):\n File \"/root/pythonenv/enve/lib/python3.10/site-packages/livekit/agents/utils/log.py\", line 16, in async_fn_logs\n return await fn(*args, **kwargs)\n File \"/root/pythonenv/enve/lib/python3.10/site-packages/livekit/agents/pipeline/agent_output.py\", line 272, in _stream_synthesis_task\n async for seg in tts_source:\n File...

agent_playout.py giving exception.

3

{"message": "Error in _capture_task\nTraceback (most recent call last):\n File \"/root/pythonenv/enve/lib/python3.10/site-packages/livekit/agents/utils/log.py\", line 16, in async_fn_logs\n return await fn(*args, **kwargs)\n File \"/root/pythonenv/enve/lib/python3.10/site-packages/livekit/agents/pipeline/agent_playout.py\", line 148, in _capture_task\n await self._audio_source.capture_frame(frame)\n File \"/root/pythonenv/enve/lib/python3.10/site-packages/livekit/rtc/audio_source.py\", line 149,...