nebari icon indicating copy to clipboard operation
nebari copied to clipboard

[ENH] - Add kubernetes horizontal autoscaler for conda-store workers based on queue depth

Open dcmcand opened this issue 11 months ago • 14 comments

Feature description

Currently conda-store is set to allow 4 simultaneous builds at once. This is a bottleneck once multiple environments start getting built at once and presents a scaling challenge. If we set the simultaneous builds to 1 and autoscale based on queue depth then we should be able to handle scaling far more gracefully

Value and/or benefit

Having the conda-store workers autoscale based on queue depth will allow larger orgs to take advantage of Nebari without hitting scale bottlenecks.

Anything else?

https://learnk8s.io/scaling-celery-rabbitmq-kubernetes

dcmcand avatar Feb 29 '24 16:02 dcmcand