agents icon indicating copy to clipboard operation
agents copied to clipboard

[Livekit Cloud] Not all job requests are emitted to my agent worker with a certain Livekit Cloud project

Open devniel opened this issue 7 months ago • 0 comments

Hello Livekit team,

I have an issue related to a concurrency scenario and Livekit Cloud (this doesn't happens with a local Livekit server). Basically, when creating rooms and having a participant joining each room, not all the job requests are emitted to my worker.

My first approach to replicate this issue was by using the UI examples available in the docs, I created a monorepo with it, including the agent worker and instructions:

  • https://github.com/devniel/livekit-concurrency-example

But then, I used the new agent-load-test tool in the Livekit CLI as advised by @yepher in the Livekit Community Slack, getting the same results. To summarize:

  • 10 rooms created, 1 participant per room.
  • Worker only receives 7 events.

Surprisingly, I tested using another Livekit Cloud project and it worked 100% ok, so I'm assuming it's an issue of old Livekit Cloud projects or some sort of regions issues.

Another workaround, can be maybe to add retries based on timeout in the UI.

More info:

  • The problematic Livekit Cloud project (missing job requests): rounded-test-2-nixv6gpj.livekit.cloud
  • The new Livekit Cloud project (ok): rounded-stress-tests-foro8boz.livekit.cloud

Slack thread: https://livekit-users.slack.com/archives/C048FRL1N2C/p1744980267725499

Thank you!

devniel avatar Apr 18 '25 19:04 devniel