agents Multi User Simulation : RuntimeError: mark_audio_segment_end called after close , when trying to run multiple instances of https://agents-playground.livekit.io/

Multi User Simulation : RuntimeError: mark_audio_segment_end called after close , when trying to run multiple instances of https://agents-playground.livekit.io/

Open ksingh-scogo opened this issue 8 months ago • 0 comments

Error

Type of error-1

RuntimeError: mark_audio_segment_end called after close
	  job_id=AJ_E45krPbK2b2T pid=19160
2024-06-08 21:34:52,561 ERROR  livekit.agents  Error in _play_speech_if_validated_task

Type of error-2 (most frequent as per logs)

RuntimeError: mark_audio_segment_end called after close
	  job_id=AJ_E45krPbK2b2T pid=19160
2024-06-08 21:34:52,561 ERROR  livekit.agents  error while answering

How to reproduce

Simulate user-1 by starting the conversation with the AI Agent
(From a different device) simulate user-2 by starting the conversation with AI Agent
Monitor netstat -plunt for open ports, you will see as new user joins in their new rooms , new ports starts to show up ( this is expected)
Until user-2 started his conversation with AI Agent, the dialogue with user-1 were working fine no issues
As soon as user-2 established the connection and started to speak with AI , user-1 connection started to throw errors , while user-2 conversation was happening smoothly.

Setup

Frontend : https://agents-playground.livekit.io with Livkit Cloud Connected to a project in LiveKit Cloud account
Livkit Server : via LiveKit Cloud
Agent main.py file below

import asyncio
import logging

from livekit.agents import JobContext, JobRequest, WorkerOptions, cli, tokenize, tts
from livekit.agents.llm import (
    ChatContext,
    ChatMessage,
    ChatRole,
)
from livekit.agents.voice_assistant import VoiceAssistant
from livekit.plugins import deepgram, openai, silero, elevenlabs

#VOICE = elevenlabs.Voice(
#   id="xxxxxx",
#    name="xxxxxx",
#    category="professional"
#)

async def entrypoint(ctx: JobContext):
    # Create an initial chat context with a system prompt 
    initial_ctx = ChatContext(
        messages=[
            ChatMessage(
                role=ChatRole.SYSTEM,
                text='''
               You are a voice assistant created by LiveKit. Your interface with users will be voice. You should use short and concise responses, and avoiding usage of unpronouncable punctuation.  
                ''',
            )
        ]
    )

    openai_tts = tts.StreamAdapter(
        tts=openai.TTS(voice="nova", model="tts-1"),
        sentence_tokenizer=tokenize.basic.SentenceTokenizer(),
    )

    assistant = VoiceAssistant(
        vad=silero.VAD(),
        stt=deepgram.STT(),
        llm=openai.LLM(),
        tts=openai_tts,
        chat_ctx=initial_ctx,
    )
    assistant.start(ctx.room)

    await asyncio.sleep(1)
    await assistant.say("Hi, welcome to ACME Technical Support. I am Bro, your AI Assistant. How can I assist you today?", allow_interruptions=True)


async def request_fnc(req: JobRequest) -> None:
    logging.info("received request %s", req)
    await req.accept(entrypoint)


if __name__ == "__main__":
    cli.run_app(WorkerOptions(request_fnc))

Error Logs

2024-06-08 21:31:35,396 INFO  livekit.agents  Watching /mnt/sdd/naman/voice_agent_backend	
2024-06-08 21:31:37,059 INFO  livekit.agents  starting worker	  version=0.7.1
2024-06-08 21:31:37,248 INFO  livekit.agents  registered worker	  id=AW_HAzDrFsp7C32 server_info=edition: Cloud version: "1.6.1" protocol: 14 region: "India" node_id: "NC_DBLR1A_26E6yWEt2rzc"






2024-06-08 21:32:09,499 INFO  root  received request <livekit.agents.job_request.JobRequest object at 0x72c8a7fe6de0>	
2024-06-08 21:32:09,525 INFO  livekit.agents  accepted job AJ_E45krPbK2b2T	  job=id: "AJ_E45krPbK2b2T" room {   sid: "RM_GWJRvBWfZ6Yq"   name: "room-0TEf-MoUA"   empty_timeout: 300   creation_time: 1717882328   enabled_codecs {     mime: "video/H264"   }   enabled_codecs {     mime: "video/VP8"   }   enabled_codecs {     mime: "video/VP9"   }   enabled_codecs {     mime: "video/AV1"   }   enabled_codecs {     mime: "audio/red"   }   enabled_codecs {     mime: "audio/opus"   }   version {     unix_micro: 1717882328576784   }   departure_timeout: 20 } namespace: "default"
2024-06-08 21:32:11,186 INFO  livekit  livekit_ffi::server:125:livekit_ffi::server - initializing ffi server v0.5.0	  job_id=AJ_E45krPbK2b2T pid=19160
2024-06-08 21:32:11,187 INFO  livekit  livekit_ffi::cabi:27:livekit_ffi::cabi - initializing ffi server v0.5.0	  job_id=AJ_E45krPbK2b2T pid=19160
2024-06-08 21:32:11,189 INFO  livekit  livekit_api::signal_client::signal_stream:88:livekit_api::signal_client::signal_stream - connecting to wss://sia-5hbxjjlj.livekit.cloud/rtc?sdk=rust&protocol=9&auto_subscribe=1&adaptive_stream=0&access_token=...	  job_id=AJ_E45krPbK2b2T pid=19160
Using cache found in /mnt/sdd/naman/.cache/torch/hub/snakers4_silero-vad_master
2024-06-08 21:32:12.696758557 [W:onnxruntime:, graph.cc:3593 CleanUnusedInitializersAndNodeArgs] Removing initializer '131'. It is not used by any node and should be removed from the model.
2024-06-08 21:32:12.696890759 [W:onnxruntime:, graph.cc:3593 CleanUnusedInitializersAndNodeArgs] Removing initializer '136'. It is not used by any node and should be removed from the model.
2024-06-08 21:32:12.696953560 [W:onnxruntime:, graph.cc:3593 CleanUnusedInitializersAndNodeArgs] Removing initializer '139'. It is not used by any node and should be removed from the model.
2024-06-08 21:32:12.697014461 [W:onnxruntime:, graph.cc:3593 CleanUnusedInitializersAndNodeArgs] Removing initializer '140'. It is not used by any node and should be removed from the model.
2024-06-08 21:32:12.697066962 [W:onnxruntime:, graph.cc:3593 CleanUnusedInitializersAndNodeArgs] Removing initializer '134'. It is not used by any node and should be removed from the model.
2024-06-08 21:32:12.697188165 [W:onnxruntime:, graph.cc:3593 CleanUnusedInitializersAndNodeArgs] Removing initializer '628'. It is not used by any node and should be removed from the model.
2024-06-08 21:32:12.697265266 [W:onnxruntime:, graph.cc:3593 CleanUnusedInitializersAndNodeArgs] Removing initializer '623'. It is not used by any node and should be removed from the model.
2024-06-08 21:32:12.697345368 [W:onnxruntime:, graph.cc:3593 CleanUnusedInitializersAndNodeArgs] Removing initializer '629'. It is not used by any node and should be removed from the model.
2024-06-08 21:32:12.697407569 [W:onnxruntime:, graph.cc:3593 CleanUnusedInitializersAndNodeArgs] Removing initializer '620'. It is not used by any node and should be removed from the model.
2024-06-08 21:32:12.697458970 [W:onnxruntime:, graph.cc:3593 CleanUnusedInitializersAndNodeArgs] Removing initializer '625'. It is not used by any node and should be removed from the model.
2024-06-08 21:32:26,041 INFO  httpx  HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"	  job_id=AJ_E45krPbK2b2T pid=19160
2024-06-08 21:32:37,454 INFO  httpx  HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"	  job_id=AJ_E45krPbK2b2T pid=19160
2024-06-08 21:32:55,759 INFO  httpx  HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"	  job_id=AJ_E45krPbK2b2T pid=19160
2024-06-08 21:32:58,192 INFO  httpx  HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"	  job_id=AJ_E45krPbK2b2T pid=19160
2024-06-08 21:33:10,158 INFO  httpx  HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"	  job_id=AJ_E45krPbK2b2T pid=19160
2024-06-08 21:33:29,800 INFO  httpx  HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"	  job_id=AJ_E45krPbK2b2T pid=19160
2024-06-08 21:33:32,930 INFO  httpx  HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"	  job_id=AJ_E45krPbK2b2T pid=19160
2024-06-08 21:34:13,702 INFO  root  received request <livekit.agents.job_request.JobRequest object at 0x72c8a7fe7620>	
2024-06-08 21:34:13,728 INFO  livekit.agents  accepted job AJ_jx7uqXciNjVR	  job=id: "AJ_jx7uqXciNjVR" room {   sid: "RM_wd2qFgh8XjHp"   name: "room-vHIt-9Z93"   empty_timeout: 300   creation_time: 1717882452   enabled_codecs {     mime: "video/H264"   }   enabled_codecs {     mime: "video/VP8"   }   enabled_codecs {     mime: "video/VP9"   }   enabled_codecs {     mime: "video/AV1"   }   enabled_codecs {     mime: "audio/red"   }   enabled_codecs {     mime: "audio/opus"   }   version {     unix_micro: 1717882452706066   }   departure_timeout: 20 } namespace: "default"
2024-06-08 21:34:15,430 INFO  livekit  livekit_ffi::server:125:livekit_ffi::server - initializing ffi server v0.5.0	  job_id=AJ_jx7uqXciNjVR pid=19831
2024-06-08 21:34:15,431 INFO  livekit  livekit_ffi::cabi:27:livekit_ffi::cabi - initializing ffi server v0.5.0	  job_id=AJ_jx7uqXciNjVR pid=19831
2024-06-08 21:34:15,435 INFO  livekit  livekit_api::signal_client::signal_stream:88:livekit_api::signal_client::signal_stream - connecting to wss://sia-5hbxjjlj.livekit.cloud/rtc?sdk=rust&protocol=9&auto_subscribe=1&adaptive_stream=0&access_token=...	  job_id=AJ_jx7uqXciNjVR pid=19831
Using cache found in /mnt/sdd/naman/.cache/torch/hub/snakers4_silero-vad_master
2024-06-08 21:34:17.245325866 [W:onnxruntime:, graph.cc:3593 CleanUnusedInitializersAndNodeArgs] Removing initializer '131'. It is not used by any node and should be removed from the model.
2024-06-08 21:34:17.245427769 [W:onnxruntime:, graph.cc:3593 CleanUnusedInitializersAndNodeArgs] Removing initializer '136'. It is not used by any node and should be removed from the model.
2024-06-08 21:34:17.245477770 [W:onnxruntime:, graph.cc:3593 CleanUnusedInitializersAndNodeArgs] Removing initializer '139'. It is not used by any node and should be removed from the model.
2024-06-08 21:34:17.245520071 [W:onnxruntime:, graph.cc:3593 CleanUnusedInitializersAndNodeArgs] Removing initializer '140'. It is not used by any node and should be removed from the model.
2024-06-08 21:34:17.245556772 [W:onnxruntime:, graph.cc:3593 CleanUnusedInitializersAndNodeArgs] Removing initializer '134'. It is not used by any node and should be removed from the model.
2024-06-08 21:34:17.245659374 [W:onnxruntime:, graph.cc:3593 CleanUnusedInitializersAndNodeArgs] Removing initializer '628'. It is not used by any node and should be removed from the model.
2024-06-08 21:34:17.245705876 [W:onnxruntime:, graph.cc:3593 CleanUnusedInitializersAndNodeArgs] Removing initializer '623'. It is not used by any node and should be removed from the model.
2024-06-08 21:34:17.245750077 [W:onnxruntime:, graph.cc:3593 CleanUnusedInitializersAndNodeArgs] Removing initializer '629'. It is not used by any node and should be removed from the model.
2024-06-08 21:34:17.245792178 [W:onnxruntime:, graph.cc:3593 CleanUnusedInitializersAndNodeArgs] Removing initializer '620'. It is not used by any node and should be removed from the model.
2024-06-08 21:34:17.245854379 [W:onnxruntime:, graph.cc:3593 CleanUnusedInitializersAndNodeArgs] Removing initializer '625'. It is not used by any node and should be removed from the model.
2024-06-08 21:34:36,058 INFO  httpx  HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"	  job_id=AJ_E45krPbK2b2T pid=19160
2024-06-08 21:34:38,120 INFO  httpx  HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"	  job_id=AJ_E45krPbK2b2T pid=19160
2024-06-08 21:34:38,344 INFO  httpx  HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"	  job_id=AJ_jx7uqXciNjVR pid=19831
2024-06-08 21:34:49,370 INFO  httpx  HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"	  job_id=AJ_E45krPbK2b2T pid=19160
2024-06-08 21:34:50,699 INFO  httpx  HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"	  job_id=AJ_E45krPbK2b2T pid=19160
2024-06-08 21:34:52,560 ERROR  livekit.agents  Error in _synthesize_task
Traceback (most recent call last):
  File "/mnt/sdd/naman/miniconda3/envs/voice-support-3/lib/python3.12/site-packages/livekit/agents/utils/log.py", line 16, in async_fn_logs
    return await fn(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/mnt/sdd/naman/miniconda3/envs/voice-support-3/lib/python3.12/site-packages/livekit/agents/voice_assistant/assistant.py", line 809, in _synthesize_task
    await self._synthesize_streamed_speech_co(
  File "/mnt/sdd/naman/miniconda3/envs/voice-support-3/lib/python3.12/site-packages/livekit/agents/voice_assistant/assistant.py", line 785, in _synthesize_streamed_speech_co
    await forward_task
  File "/mnt/sdd/naman/miniconda3/envs/voice-support-3/lib/python3.12/site-packages/livekit/agents/voice_assistant/assistant.py", line 769, in _read_generated_audio_task
    tts_forwarder.mark_audio_segment_end()
  File "/mnt/sdd/naman/miniconda3/envs/voice-support-3/lib/python3.12/site-packages/livekit/agents/transcription/tts_forwarder.py", line 160, in mark_audio_segment_end
    raise RuntimeError("mark_audio_segment_end called after close")
RuntimeError: mark_audio_segment_end called after close
	  job_id=AJ_E45krPbK2b2T pid=19160
2024-06-08 21:34:52,561 ERROR  livekit.agents  Error in _play_speech_if_validated_task
Traceback (most recent call last):
  File "/mnt/sdd/naman/miniconda3/envs/voice-support-3/lib/python3.12/site-packages/livekit/agents/utils/log.py", line 16, in async_fn_logs
    return await fn(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/mnt/sdd/naman/miniconda3/envs/voice-support-3/lib/python3.12/site-packages/livekit/agents/voice_assistant/assistant.py", line 715, in _play_speech_if_validated_task
    await _synthesize_task
  File "/mnt/sdd/naman/miniconda3/envs/voice-support-3/lib/python3.12/site-packages/livekit/agents/utils/log.py", line 16, in async_fn_logs
    return await fn(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/mnt/sdd/naman/miniconda3/envs/voice-support-3/lib/python3.12/site-packages/livekit/agents/voice_assistant/assistant.py", line 809, in _synthesize_task
    await self._synthesize_streamed_speech_co(
  File "/mnt/sdd/naman/miniconda3/envs/voice-support-3/lib/python3.12/site-packages/livekit/agents/voice_assistant/assistant.py", line 785, in _synthesize_streamed_speech_co
    await forward_task
  File "/mnt/sdd/naman/miniconda3/envs/voice-support-3/lib/python3.12/site-packages/livekit/agents/voice_assistant/assistant.py", line 769, in _read_generated_audio_task
    tts_forwarder.mark_audio_segment_end()
  File "/mnt/sdd/naman/miniconda3/envs/voice-support-3/lib/python3.12/site-packages/livekit/agents/transcription/tts_forwarder.py", line 160, in mark_audio_segment_end
    raise RuntimeError("mark_audio_segment_end called after close")
RuntimeError: mark_audio_segment_end called after close
	  job_id=AJ_E45krPbK2b2T pid=19160
2024-06-08 21:34:52,561 ERROR  livekit.agents  error while answering
Traceback (most recent call last):
  File "/mnt/sdd/naman/miniconda3/envs/voice-support-3/lib/python3.12/site-packages/livekit/agents/voice_assistant/assistant.py", line 498, in _answer_task
    await self._start_speech(data, interrupt_current_if_possible=False)
  File "/mnt/sdd/naman/miniconda3/envs/voice-support-3/lib/python3.12/site-packages/livekit/agents/voice_assistant/assistant.py", line 645, in _start_speech
    await self._play_atask
  File "/mnt/sdd/naman/miniconda3/envs/voice-support-3/lib/python3.12/site-packages/livekit/agents/utils/log.py", line 16, in async_fn_logs
    return await fn(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/mnt/sdd/naman/miniconda3/envs/voice-support-3/lib/python3.12/site-packages/livekit/agents/voice_assistant/assistant.py", line 715, in _play_speech_if_validated_task
    await _synthesize_task
  File "/mnt/sdd/naman/miniconda3/envs/voice-support-3/lib/python3.12/site-packages/livekit/agents/utils/log.py", line 16, in async_fn_logs
    return await fn(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/mnt/sdd/naman/miniconda3/envs/voice-support-3/lib/python3.12/site-packages/livekit/agents/voice_assistant/assistant.py", line 809, in _synthesize_task
    await self._synthesize_streamed_speech_co(
  File "/mnt/sdd/naman/miniconda3/envs/voice-support-3/lib/python3.12/site-packages/livekit/agents/voice_assistant/assistant.py", line 785, in _synthesize_streamed_speech_co
    await forward_task
  File "/mnt/sdd/naman/miniconda3/envs/voice-support-3/lib/python3.12/site-packages/livekit/agents/voice_assistant/assistant.py", line 769, in _read_generated_audio_task
    tts_forwarder.mark_audio_segment_end()
  File "/mnt/sdd/naman/miniconda3/envs/voice-support-3/lib/python3.12/site-packages/livekit/agents/transcription/tts_forwarder.py", line 160, in mark_audio_segment_end
    raise RuntimeError("mark_audio_segment_end called after close")
RuntimeError: mark_audio_segment_end called after close
	  job_id=AJ_E45krPbK2b2T pid=19160
2024-06-08 21:34:53,360 INFO  httpx  HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"	  job_id=AJ_E45krPbK2b2T pid=19160
2024-06-08 21:34:53,360 ERROR  livekit.agents  error while answering
Traceback (most recent call last):
  File "/mnt/sdd/naman/miniconda3/envs/voice-support-3/lib/python3.12/site-packages/livekit/agents/voice_assistant/assistant.py", line 498, in _answer_task
    await self._start_speech(data, interrupt_current_if_possible=False)
  File "/mnt/sdd/naman/miniconda3/envs/voice-support-3/lib/python3.12/site-packages/livekit/agents/voice_assistant/assistant.py", line 645, in _start_speech
    await self._play_atask
RuntimeError: mark_audio_segment_end called after close
	  job_id=AJ_E45krPbK2b2T pid=19160
2024-06-08 21:35:07,770 INFO  httpx  HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"	  job_id=AJ_jx7uqXciNjVR pid=19831
2024-06-08 21:35:08,350 INFO  httpx  HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"	  job_id=AJ_E45krPbK2b2T pid=19160
2024-06-08 21:35:08,350 ERROR  livekit.agents  error while answering
Traceback (most recent call last):
  File "/mnt/sdd/naman/miniconda3/envs/voice-support-3/lib/python3.12/site-packages/livekit/agents/voice_assistant/assistant.py", line 498, in _answer_task
    await self._start_speech(data, interrupt_current_if_possible=False)
  File "/mnt/sdd/naman/miniconda3/envs/voice-support-3/lib/python3.12/site-packages/livekit/agents/voice_assistant/assistant.py", line 645, in _start_speech
    await self._play_atask
RuntimeError: mark_audio_segment_end called after close
	  job_id=AJ_E45krPbK2b2T pid=19160
2024-06-08 21:35:13,381 INFO  httpx  HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"	  job_id=AJ_E45krPbK2b2T pid=19160
2024-06-08 21:35:13,381 ERROR  livekit.agents  error while answering
Traceback (most recent call last):
  File "/mnt/sdd/naman/miniconda3/envs/voice-support-3/lib/python3.12/site-packages/livekit/agents/voice_assistant/assistant.py", line 498, in _answer_task
    await self._start_speech(data, interrupt_current_if_possible=False)
  File "/mnt/sdd/naman/miniconda3/envs/voice-support-3/lib/python3.12/site-packages/livekit/agents/voice_assistant/assistant.py", line 645, in _start_speech
    await self._play_atask
RuntimeError: mark_audio_segment_end called after close
	  job_id=AJ_E45krPbK2b2T pid=19160
2024-06-08 21:35:16,722 INFO  httpx  HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"	  job_id=AJ_E45krPbK2b2T pid=19160
2024-06-08 21:35:16,723 ERROR  livekit.agents  error while answering
Traceback (most recent call last):
  File "/mnt/sdd/naman/miniconda3/envs/voice-support-3/lib/python3.12/site-packages/livekit/agents/voice_assistant/assistant.py", line 498, in _answer_task
    await self._start_speech(data, interrupt_current_if_possible=False)
  File "/mnt/sdd/naman/miniconda3/envs/voice-support-3/lib/python3.12/site-packages/livekit/agents/voice_assistant/assistant.py", line 645, in _start_speech
    await self._play_atask
RuntimeError: mark_audio_segment_end called after close
	  job_id=AJ_E45krPbK2b2T pid=19160
2024-06-08 21:35:17,413 INFO  httpx  HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"	  job_id=AJ_E45krPbK2b2T pid=19160
2024-06-08 21:35:17,413 ERROR  livekit.agents  error while answering
Traceback (most recent call last):
  File "/mnt/sdd/naman/miniconda3/envs/voice-support-3/lib/python3.12/site-packages/livekit/agents/voice_assistant/assistant.py", line 498, in _answer_task
    await self._start_speech(data, interrupt_current_if_possible=False)
  File "/mnt/sdd/naman/miniconda3/envs/voice-support-3/lib/python3.12/site-packages/livekit/agents/voice_assistant/assistant.py", line 645, in _start_speech
    await self._play_atask
RuntimeError: mark_audio_segment_end called after close
	  job_id=AJ_E45krPbK2b2T pid=19160
2024-06-08 21:35:33,247 INFO  httpx  HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"	  job_id=AJ_jx7uqXciNjVR pid=19831
2024-06-08 21:35:33,409 INFO  httpx  HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"	  job_id=AJ_E45krPbK2b2T pid=19160
2024-06-08 21:35:33,410 ERROR  livekit.agents  error while answering
Traceback (most recent call last):
  File "/mnt/sdd/naman/miniconda3/envs/voice-support-3/lib/python3.12/site-packages/livekit/agents/voice_assistant/assistant.py", line 498, in _answer_task
    await self._start_speech(data, interrupt_current_if_possible=False)
  File "/mnt/sdd/naman/miniconda3/envs/voice-support-3/lib/python3.12/site-packages/livekit/agents/voice_assistant/assistant.py", line 645, in _start_speech
    await self._play_atask
RuntimeError: mark_audio_segment_end called after close
	  job_id=AJ_E45krPbK2b2T pid=19160
2024-06-08 21:35:36,953 INFO  httpx  HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"	  job_id=AJ_E45krPbK2b2T pid=19160
2024-06-08 21:35:36,954 ERROR  livekit.agents  error while answering
Traceback (most recent call last):
  File "/mnt/sdd/naman/miniconda3/envs/voice-support-3/lib/python3.12/site-packages/livekit/agents/voice_assistant/assistant.py", line 498, in _answer_task
    await self._start_speech(data, interrupt_current_if_possible=False)
  File "/mnt/sdd/naman/miniconda3/envs/voice-support-3/lib/python3.12/site-packages/livekit/agents/voice_assistant/assistant.py", line 645, in _start_speech
    await self._play_atask
RuntimeError: mark_audio_segment_end called after close
	  job_id=AJ_E45krPbK2b2T pid=19160
2024-06-08 21:35:38,538 INFO  httpx  HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"	  job_id=AJ_E45krPbK2b2T pid=19160
2024-06-08 21:35:38,543 ERROR  livekit.agents  error while answering
Traceback (most recent call last):
  File "/mnt/sdd/naman/miniconda3/envs/voice-support-3/lib/python3.12/site-packages/livekit/agents/voice_assistant/assistant.py", line 498, in _answer_task
    await self._start_speech(data, interrupt_current_if_possible=False)
  File "/mnt/sdd/naman/miniconda3/envs/voice-support-3/lib/python3.12/site-packages/livekit/agents/voice_assistant/assistant.py", line 645, in _start_speech
    await self._play_atask
RuntimeError: mark_audio_segment_end called after close
	  job_id=AJ_E45krPbK2b2T pid=19160
2024-06-08 21:35:40,120 INFO  httpx  HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"	  job_id=AJ_E45krPbK2b2T pid=19160
2024-06-08 21:35:40,121 ERROR  livekit.agents  error while answering
Traceback (most recent call last):
  File "/mnt/sdd/naman/miniconda3/envs/voice-support-3/lib/python3.12/site-packages/livekit/agents/voice_assistant/assistant.py", line 498, in _answer_task
    await self._start_speech(data, interrupt_current_if_possible=False)
  File "/mnt/sdd/naman/miniconda3/envs/voice-support-3/lib/python3.12/site-packages/livekit/agents/voice_assistant/assistant.py", line 645, in _start_speech
    await self._play_atask
RuntimeError: mark_audio_segment_end called after close
	  job_id=AJ_E45krPbK2b2T pid=19160
2024-06-08 21:35:41,927 INFO  httpx  HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"	  job_id=AJ_E45krPbK2b2T pid=19160
2024-06-08 21:35:41,928 ERROR  livekit.agents  error while answering
Traceback (most recent call last):
  File "/mnt/sdd/naman/miniconda3/envs/voice-support-3/lib/python3.12/site-packages/livekit/agents/voice_assistant/assistant.py", line 498, in _answer_task
    await self._start_speech(data, interrupt_current_if_possible=False)
  File "/mnt/sdd/naman/miniconda3/envs/voice-support-3/lib/python3.12/site-packages/livekit/agents/voice_assistant/assistant.py", line 645, in _start_speech
    await self._play_atask
RuntimeError: mark_audio_segment_end called after close
	  job_id=AJ_E45krPbK2b2T pid=19160
2024-06-08 21:35:42,989 INFO  httpx  HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"	  job_id=AJ_E45krPbK2b2T pid=19160
2024-06-08 21:35:42,990 ERROR  livekit.agents  error while answering
Traceback (most recent call last):
  File "/mnt/sdd/naman/miniconda3/envs/voice-support-3/lib/python3.12/site-packages/livekit/agents/voice_assistant/assistant.py", line 498, in _answer_task
    await self._start_speech(data, interrupt_current_if_possible=False)
  File "/mnt/sdd/naman/miniconda3/envs/voice-support-3/lib/python3.12/site-packages/livekit/agents/voice_assistant/assistant.py", line 645, in _start_speech
    await self._play_atask
RuntimeError: mark_audio_segment_end called after close
	  job_id=AJ_E45krPbK2b2T pid=19160
2024-06-08 21:35:45,104 INFO  httpx  HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"	  job_id=AJ_E45krPbK2b2T pid=19160
2024-06-08 21:35:45,105 ERROR  livekit.agents  error while answering
Traceback (most recent call last):
  File "/mnt/sdd/naman/miniconda3/envs/voice-support-3/lib/python3.12/site-packages/livekit/agents/voice_assistant/assistant.py", line 498, in _answer_task
    await self._start_speech(data, interrupt_current_if_possible=False)
  File "/mnt/sdd/naman/miniconda3/envs/voice-support-3/lib/python3.12/site-packages/livekit/agents/voice_assistant/assistant.py", line 645, in _start_speech
    await self._play_atask
RuntimeError: mark_audio_segment_end called after close
	  job_id=AJ_E45krPbK2b2T pid=19160
2024-06-08 21:36:03,595 INFO  httpx  HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"	  job_id=AJ_E45krPbK2b2T pid=19160
2024-06-08 21:36:03,595 ERROR  livekit.agents  error while answering
Traceback (most recent call last):
  File "/mnt/sdd/naman/miniconda3/envs/voice-support-3/lib/python3.12/site-packages/livekit/agents/voice_assistant/assistant.py", line 498, in _answer_task
    await self._start_speech(data, interrupt_current_if_possible=False)
  File "/mnt/sdd/naman/miniconda3/envs/voice-support-3/lib/python3.12/site-packages/livekit/agents/voice_assistant/assistant.py", line 645, in _start_speech
    await self._play_atask
RuntimeError: mark_audio_segment_end called after close
	  job_id=AJ_E45krPbK2b2T pid=19160
2024-06-08 21:36:14,404 INFO  httpx  HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"	  job_id=AJ_E45krPbK2b2T pid=19160
2024-06-08 21:36:14,404 ERROR  livekit.agents  error while answering
Traceback (most recent call last):
  File "/mnt/sdd/naman/miniconda3/envs/voice-support-3/lib/python3.12/site-packages/livekit/agents/voice_assistant/assistant.py", line 498, in _answer_task
    await self._start_speech(data, interrupt_current_if_possible=False)
  File "/mnt/sdd/naman/miniconda3/envs/voice-support-3/lib/python3.12/site-packages/livekit/agents/voice_assistant/assistant.py", line 645, in _start_speech
    await self._play_atask
RuntimeError: mark_audio_segment_end called after close
	  job_id=AJ_E45krPbK2b2T pid=19160




2024-06-08 21:36:33,279 INFO  httpx  HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"	  job_id=AJ_jx7uqXciNjVR pid=19831
2024-06-08 21:36:33,280 INFO  httpx  HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"	  job_id=AJ_E45krPbK2b2T pid=19160
2024-06-08 21:36:33,280 ERROR  livekit.agents  error while answering
Traceback (most recent call last):
  File "/mnt/sdd/naman/miniconda3/envs/voice-support-3/lib/python3.12/site-packages/livekit/agents/voice_assistant/assistant.py", line 498, in _answer_task
    await self._start_speech(data, interrupt_current_if_possible=False)
  File "/mnt/sdd/naman/miniconda3/envs/voice-support-3/lib/python3.12/site-packages/livekit/agents/voice_assistant/assistant.py", line 645, in _start_speech
    await self._play_atask
RuntimeError: mark_audio_segment_end called after close
	  job_id=AJ_E45krPbK2b2T pid=19160
2024-06-08 21:36:37,477 INFO  httpx  HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"	  job_id=AJ_E45krPbK2b2T pid=19160
2024-06-08 21:36:37,477 ERROR  livekit.agents  error while answering
Traceback (most recent call last):
  File "/mnt/sdd/naman/miniconda3/envs/voice-support-3/lib/python3.12/site-packages/livekit/agents/voice_assistant/assistant.py", line 498, in _answer_task
    await self._start_speech(data, interrupt_current_if_possible=False)
  File "/mnt/sdd/naman/miniconda3/envs/voice-support-3/lib/python3.12/site-packages/livekit/agents/voice_assistant/assistant.py", line 645, in _start_speech
    await self._play_atask
RuntimeError: mark_audio_segment_end called after close
	  job_id=AJ_E45krPbK2b2T pid=19160
2024-06-08 21:36:40,606 INFO  httpx  HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"	  job_id=AJ_E45krPbK2b2T pid=19160
2024-06-08 21:36:40,607 ERROR  livekit.agents  error while answering
Traceback (most recent call last):
  File "/mnt/sdd/naman/miniconda3/envs/voice-support-3/lib/python3.12/site-packages/livekit/agents/voice_assistant/assistant.py", line 498, in _answer_task
    await self._start_speech(data, interrupt_current_if_possible=False)
  File "/mnt/sdd/naman/miniconda3/envs/voice-support-3/lib/python3.12/site-packages/livekit/agents/voice_assistant/assistant.py", line 645, in _start_speech
    await self._play_atask
RuntimeError: mark_audio_segment_end called after close
	  job_id=AJ_E45krPbK2b2T pid=19160
2024-06-08 21:36:42,941 INFO  httpx  HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"	  job_id=AJ_E45krPbK2b2T pid=19160
2024-06-08 21:36:42,942 ERROR  livekit.agents  error while answering
Traceback (most recent call last):
  File "/mnt/sdd/naman/miniconda3/envs/voice-support-3/lib/python3.12/site-packages/livekit/agents/voice_assistant/assistant.py", line 498, in _answer_task
    await self._start_speech(data, interrupt_current_if_possible=False)
  File "/mnt/sdd/naman/miniconda3/envs/voice-support-3/lib/python3.12/site-packages/livekit/agents/voice_assistant/assistant.py", line 645, in _start_speech
    await self._play_atask
RuntimeError: mark_audio_segment_end called after close
	  job_id=AJ_E45krPbK2b2T pid=19160
2024-06-08 21:36:45,037 INFO  httpx  HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"	  job_id=AJ_E45krPbK2b2T pid=19160
2024-06-08 21:36:45,037 ERROR  livekit.agents  error while answering
Traceback (most recent call last):
  File "/mnt/sdd/naman/miniconda3/envs/voice-support-3/lib/python3.12/site-packages/livekit/agents/voice_assistant/assistant.py", line 498, in _answer_task
    await self._start_speech(data, interrupt_current_if_possible=False)
  File "/mnt/sdd/naman/miniconda3/envs/voice-support-3/lib/python3.12/site-packages/livekit/agents/voice_assistant/assistant.py", line 645, in _start_speech
    await self._play_atask
RuntimeError: mark_audio_segment_end called after close
	  job_id=AJ_E45krPbK2b2T pid=19160
2024-06-08 21:36:46,666 INFO  httpx  HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"	  job_id=AJ_E45krPbK2b2T pid=19160
2024-06-08 21:36:46,666 ERROR  livekit.agents  error while answering
Traceback (most recent call last):
  File "/mnt/sdd/naman/miniconda3/envs/voice-support-3/lib/python3.12/site-packages/livekit/agents/voice_assistant/assistant.py", line 498, in _answer_task
    await self._start_speech(data, interrupt_current_if_possible=False)
  File "/mnt/sdd/naman/miniconda3/envs/voice-support-3/lib/python3.12/site-packages/livekit/agents/voice_assistant/assistant.py", line 645, in _start_speech
    await self._play_atask
RuntimeError: mark_audio_segment_end called after close
	  job_id=AJ_E45krPbK2b2T pid=19160





2024-06-08 21:38:00,434 INFO  httpx  HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"	  job_id=AJ_jx7uqXciNjVR pid=19831
2024-06-08 21:38:01,506 INFO  httpx  HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"	  job_id=AJ_E45krPbK2b2T pid=19160
2024-06-08 21:38:01,507 ERROR  livekit.agents  error while answering
Traceback (most recent call last):
  File "/mnt/sdd/naman/miniconda3/envs/voice-support-3/lib/python3.12/site-packages/livekit/agents/voice_assistant/assistant.py", line 498, in _answer_task
    await self._start_speech(data, interrupt_current_if_possible=False)
  File "/mnt/sdd/naman/miniconda3/envs/voice-support-3/lib/python3.12/site-packages/livekit/agents/voice_assistant/assistant.py", line 645, in _start_speech
    await self._play_atask
RuntimeError: mark_audio_segment_end called after close
	  job_id=AJ_E45krPbK2b2T pid=19160
2024-06-08 21:38:06,257 INFO  httpx  HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"	  job_id=AJ_E45krPbK2b2T pid=19160
2024-06-08 21:38:06,257 ERROR  livekit.agents  error while answering
Traceback (most recent call last):
  File "/mnt/sdd/naman/miniconda3/envs/voice-support-3/lib/python3.12/site-packages/livekit/agents/voice_assistant/assistant.py", line 498, in _answer_task
    await self._start_speech(data, interrupt_current_if_possible=False)
  File "/mnt/sdd/naman/miniconda3/envs/voice-support-3/lib/python3.12/site-packages/livekit/agents/voice_assistant/assistant.py", line 645, in _start_speech
    await self._play_atask
RuntimeError: mark_audio_segment_end called after close
	  job_id=AJ_E45krPbK2b2T pid=19160
2024-06-08 21:38:09,154 INFO  httpx  HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"	  job_id=AJ_E45krPbK2b2T pid=19160
2024-06-08 21:38:09,154 ERROR  livekit.agents  error while answering
Traceback (most recent call last):
  File "/mnt/sdd/naman/miniconda3/envs/voice-support-3/lib/python3.12/site-packages/livekit/agents/voice_assistant/assistant.py", line 498, in _answer_task
    await self._start_speech(data, interrupt_current_if_possible=False)
  File "/mnt/sdd/naman/miniconda3/envs/voice-support-3/lib/python3.12/site-packages/livekit/agents/voice_assistant/assistant.py", line 645, in _start_speech
    await self._play_atask
RuntimeError: mark_audio_segment_end called after close
	  job_id=AJ_E45krPbK2b2T pid=19160
2024-06-08 21:38:10,799 INFO  httpx  HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"	  job_id=AJ_E45krPbK2b2T pid=19160
2024-06-08 21:38:10,800 ERROR  livekit.agents  error while answering
Traceback (most recent call last):
  File "/mnt/sdd/naman/miniconda3/envs/voice-support-3/lib/python3.12/site-packages/livekit/agents/voice_assistant/assistant.py", line 498, in _answer_task
    await self._start_speech(data, interrupt_current_if_possible=False)
  File "/mnt/sdd/naman/miniconda3/envs/voice-support-3/lib/python3.12/site-packages/livekit/agents/voice_assistant/assistant.py", line 645, in _start_speech
    await self._play_atask
RuntimeError: mark_audio_segment_end called after close
	  job_id=AJ_E45krPbK2b2T pid=19160
2024-06-08 21:38:13,774 INFO  httpx  HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"	  job_id=AJ_E45krPbK2b2T pid=19160
2024-06-08 21:38:13,774 ERROR  livekit.agents  error while answering
Traceback (most recent call last):
  File "/mnt/sdd/naman/miniconda3/envs/voice-support-3/lib/python3.12/site-packages/livekit/agents/voice_assistant/assistant.py", line 498, in _answer_task
    await self._start_speech(data, interrupt_current_if_possible=False)
  File "/mnt/sdd/naman/miniconda3/envs/voice-support-3/lib/python3.12/site-packages/livekit/agents/voice_assistant/assistant.py", line 645, in _start_speech
    await self._play_atask
RuntimeError: mark_audio_segment_end called after close
	  job_id=AJ_E45krPbK2b2T pid=19160
2024-06-08 21:38:14,555 INFO  httpx  HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"	  job_id=AJ_E45krPbK2b2T pid=19160
2024-06-08 21:38:14,555 ERROR  livekit.agents  error while answering
Traceback (most recent call last):
  File "/mnt/sdd/naman/miniconda3/envs/voice-support-3/lib/python3.12/site-packages/livekit/agents/voice_assistant/assistant.py", line 498, in _answer_task
    await self._start_speech(data, interrupt_current_if_possible=False)
  File "/mnt/sdd/naman/miniconda3/envs/voice-support-3/lib/python3.12/site-packages/livekit/agents/voice_assistant/assistant.py", line 645, in _start_speech
    await self._play_atask
RuntimeError: mark_audio_segment_end called after close
	  job_id=AJ_E45krPbK2b2T pid=19160
2024-06-08 21:38:16,471 INFO  httpx  HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"	  job_id=AJ_E45krPbK2b2T pid=19160
2024-06-08 21:38:16,471 ERROR  livekit.agents  error while answering
Traceback (most recent call last):
  File "/mnt/sdd/naman/miniconda3/envs/voice-support-3/lib/python3.12/site-packages/livekit/agents/voice_assistant/assistant.py", line 498, in _answer_task
    await self._start_speech(data, interrupt_current_if_possible=False)
  File "/mnt/sdd/naman/miniconda3/envs/voice-support-3/lib/python3.12/site-packages/livekit/agents/voice_assistant/assistant.py", line 645, in _start_speech
    await self._play_atask
RuntimeError: mark_audio_segment_end called after close
	  job_id=AJ_E45krPbK2b2T pid=19160
2024-06-08 21:38:18,848 INFO  httpx  HTTP Request: POST https://api.openai.com/v1/chat/completions "HTTP/1.1 200 OK"	  job_id=AJ_E45krPbK2b2T pid=19160
2024-06-08 21:38:18,851 ERROR  livekit.agents  error while answering
Traceback (most recent call last):
  File "/mnt/sdd/naman/miniconda3/envs/voice-support-3/lib/python3.12/site-packages/livekit/agents/voice_assistant/assistant.py", line 498, in _answer_task
    await self._start_speech(data, interrupt_current_if_possible=False)
  File "/mnt/sdd/naman/miniconda3/envs/voice-support-3/lib/python3.12/site-packages/livekit/agents/voice_assistant/assistant.py", line 645, in _start_speech
    await self._play_atask
RuntimeError: mark_audio_segment_end called after close
	  job_id=AJ_E45krPbK2b2T pid=19160




2024-06-08 21:38:42,472 INFO  livekit.agents  job exiting	  exit=UserExit(reason='room disconnected') job_id=AJ_jx7uqXciNjVR pid=19831
2024-06-08 21:38:42,472 INFO  livekit.agents  job process closed	  job_id=AJ_jx7uqXciNjVR pid=19831

Jun 08 '24 22:06 ksingh-scogo

agents agents copied to clipboard

Multi User Simulation : RuntimeError: mark_audio_segment_end called after close , when trying to run multiple instances of https://agents-playground.livekit.io/

agents
agents copied to clipboard