unkey icon indicating copy to clipboard operation
unkey copied to clipboard

Improve ratelimit accuracy for stress test situations

Open Flo4604 opened this issue 2 months ago • 1 comments

We need to improve the accuracy of our distributed rate limiting system, as it currently fails under high node and RPS scenarios, exceeding the 20% tolerance threshold when running make test-stress

To resolve this, we should either increase the frequency of how often we read from the Redis counter or use a better method to sync between nodes to ensure they maintain more accurate limits.

Maybe we can use redis streams / pubsub to sync changes between nodes.

Flo4604 avatar Oct 22 '25 16:10 Flo4604

ENG-2139

linear[bot] avatar Oct 22 '25 16:10 linear[bot]