gloo icon indicating copy to clipboard operation
gloo copied to clipboard

Expose local rate limit filter in gloo

Open jmunozro opened this issue 2 years ago • 1 comments

Version

1.10.x (latest stable)

Is your feature request related to a problem? Please describe.

A found a case with a customer that wants to implement RL based on capacity, not time.

Having a token approach is preferable on some use cases because it allows us to handle bursts regardless of how fast they show up, while still preventing resource exhaustion. We can then tune how much we let through, and how much we fail, unlike the normal rate limit which is a set amount per time unit.

Describe the solution you'd like

I would like to have Local rate limit exposed in gloo.

Describe alternatives you've considered

No response

Additional Context

No response

jmunozro avatar Mar 11 '22 15:03 jmunozro

got a new demand for this capability, where the client is doing some sort of reverse exponential back-off and overflowing the gateway. Having a local rate-limiter would help protect the proxy and upstream services. +1 for exposing the Envoy local rate-limiter.

bcollard avatar Sep 08 '22 08:09 bcollard

Local rate limit is a resource-efficient and performant mechanism for protection against client misbehavior (as opposed to global rate limiting with all of its requirements). I'm also interested in this capability. This filter can execute early in the HTTP filter chain.

guydc avatar Nov 15 '22 01:11 guydc

Added as part of OSS gloo v1.16.0-beta8 Merged into enterprise and will be released as part of v1.16.0

davidjumani avatar Sep 27 '23 13:09 davidjumani