aws-app-mesh-roadmap Feature Request: Rate Limiting

Tell us about your request App Mesh should support the ability to configure rate limiting for requests coming into or out of a Virtual Node. This could be enabled by using Envoy Proxy's Global Rate Limiting. With this setting, customers could define thresholds for how many transactions (i.e. requests) per time period to allow from a given caller before throttling further traffic.

This is similar to #6 (Circuit Breaker Policy) but solves additional use cases depending on the traffic characteristics being handled by the service.

Which integration(s) is this request for? All

Tell us about the problem you're trying to solve. What are you trying to do, and why is it hard?

Given a known set of clients calling my service, I would like to limit the amount of requests-per-second they may send before I fail the request with an error code, letting them know they have exceeded their rate limits.
Given a known egress destination, I would like to limit the amount of requests-per-second I send to the destination to keep from overwhelming them, in the case that they cannot rate limit me on the server side.

Sep 13 '19 22:09 bcelenza

Hi @shubharao, I've noticed that this feature request has been accepted but it's not in the roadmap project --> https://github.com/aws/aws-app-mesh-roadmap/projects/1

Any ideas of when you guys will start working on ti?

Jun 01 '20 21:06 isaac-mj

Hey @isaac-mj , fixed that. It is on our roadmap, but we're not actively working on it at the moment.

Is this one of interest to you? Have any requirements or thoughts you could share on what you'd want if so? :)

Jun 03 '20 20:06 bcelenza

When using Virtual Gateway as the Ingress, having API rate limiting is a very natural requirement since it's not fulfilled by NLB/ALB either. I really don't want to integrate WAF for the purpose, since in many cases calls come from internal services residing in another data centre or cloud provider.

Dec 03 '20 06:12 amanullah92

I am also interested in this. I will probably be potentially implementing this in the coming months. Is there any way to inject arbitrary envoy config into appMesh config? I see something like that for stats and tracing, but nothing else.

Thanks

May 25 '21 21:05 ghost

We are also not interested in rate limiting.

Jul 28 '21 06:07 jjacob27

+1

Sep 16 '21 18:09 alexbricepalo

@koresar, App Mesh does not configure any rate limitation for Envoy proxies, at does not allow for custom configuration of rate limiting at the moment. Please open a support case with the details of your environment / configuration and error logs, so our team can look into it.