helm-charts icon indicating copy to clipboard operation
helm-charts copied to clipboard

Consider using nginx or vmauth for balancing read load to vmselects for cluster chart

Open hagen1778 opened this issue 3 years ago • 2 comments

Looks like balancing via default k8s service is not always optimal. During the benchmarks I found that vmselects are receving non equal number of queries. Especially, in cases when read queries have different execution time. This may result into excessive resource usage for some vmselects. Would be great to try using nginx for better balancing of the read load. Least-loaded strategy seems like a better fit here.

hagen1778 avatar Sep 09 '22 07:09 hagen1778

at least, Open source nginx can't aware resource consumption by backends. How can this be implemented ?

cloud-66 avatar Aug 10 '23 18:08 cloud-66

@cloud-66 we can try using vmauth instead, as it provides load-balancing feature out-of-box.

We can try to validate the assumption for vmauth to improve balancing by testing it on our playground.

hagen1778 avatar Dec 07 '23 13:12 hagen1778