gloo
gloo copied to clipboard
Expose local rate limit filter in gloo
Version
1.10.x (latest stable)
Is your feature request related to a problem? Please describe.
A found a case with a customer that wants to implement RL based on capacity, not time.
Having a token approach is preferable on some use cases because it allows us to handle bursts regardless of how fast they show up, while still preventing resource exhaustion. We can then tune how much we let through, and how much we fail, unlike the normal rate limit which is a set amount per time unit.
Describe the solution you'd like
I would like to have Local rate limit exposed in gloo.
Describe alternatives you've considered
No response
Additional Context
No response
got a new demand for this capability, where the client is doing some sort of reverse exponential back-off and overflowing the gateway. Having a local rate-limiter would help protect the proxy and upstream services. +1 for exposing the Envoy local rate-limiter.
Local rate limit is a resource-efficient and performant mechanism for protection against client misbehavior (as opposed to global rate limiting with all of its requirements). I'm also interested in this capability. This filter can execute early in the HTTP filter chain.
Added as part of OSS gloo v1.16.0-beta8 Merged into enterprise and will be released as part of v1.16.0