spring-cloud-gateway icon indicating copy to clipboard operation
spring-cloud-gateway copied to clipboard

Gateway performance problem

Open sruby opened this issue 2 years ago • 0 comments

Describe the bug Version:

  • SCG version: 3.0.4
  • SpringBoot version: 2.5.8
  • SpringCloud version: 2020.0.4 Description:
  • Only 500 TPS during performance pressure testing, but 5000 TPS for SpringBoot services with the same resource configuration.
  • The SelfDuration of SpringCloudGateway/sendRequest span is observed by Skywalking to be longer than 1s. The corresponding class of SpringCloudGateway/sendRequest span is reactor.netty.http.client. HttpClientFinalizer.
  • fast request processing time for downstream services, only a few tens of ms, using an interface that does nothing to troubleshoot Gateway performance bottlenecks.
  • Gateway CPU usage of about 60%, JVM heap memory usage of about 40% and a small increase in the number of waiting threads (from 28 to 32).
  • absence of warn and error messages in the logs.
  • The trace logs of reactor-netty and gateway are turned on, and it is found that there are more inactive connections (max 700) during the test, but they are gradually closed after the test is over.

How can I troubleshoot this problem? Thanks.

sruby avatar Aug 03 '22 03:08 sruby