agents icon indicating copy to clipboard operation
agents copied to clipboard

Container / Deployment / Autoscaling Suggestions?

Open willsmanley opened this issue 1 year ago • 2 comments

Has anyone measured cpu/ram requirements for the minimal example?

Anyone done load testing or have recommendations for autoscaling plan?

It'd be good to also know where the sweet spot is: fewer beefy machines with lots of jobs each vs. more lighter machines with fewer jobs each.

I'm going to start testing and will provide any updates here. I believe 2gb ram is minimum required to run a single job.

willsmanley avatar Aug 29 '24 23:08 willsmanley

Definitely interested to see your results 🙏 I'm will be writing a best-practices guide soon and had similar plans to do this kind of benchmarking

keepingitneil avatar Sep 11 '24 20:09 keepingitneil

Hello, are there any update or recommendations for this ? Thank you : )

firattamurlc avatar Sep 16 '24 14:09 firattamurlc

Hi. Any updates on this? Thanks in advance

Kedaqusa1604 avatar Oct 30 '24 20:10 Kedaqusa1604

we've got some deployment docs up now: https://docs.livekit.io/agents/deployment/

as well as example configurations for Fly and ECS: https://github.com/livekit-examples/agent-deployment

davidzhao avatar Oct 30 '24 21:10 davidzhao