kong icon indicating copy to clipboard operation
kong copied to clipboard

perf(*) use ngx.req.set_header to set upstream_headers

Open fffonion opened this issue 4 years ago • 20 comments

Optimize performance by replacing ngx.var access with ngx.req.set_header to set x-forwarded-* headers. Those headers are not set until access.after so that plugins that terminates requests in access phase still functions as before.

Setting other headers through nginx variable are kept as is, some (like TE) are tricky to handle in Lua probably Nginx has special handling of it, others like Host, Connection and Upgrade are kept since ngx.req.set_header mutates the request headers directly, and plugins may then not be able to read the original request header.

fffonion avatar Aug 25 '21 18:08 fffonion

Note from dicussion with @bungle : removing of those variables may break for use cases like https://github.com/Kong/kong/issues/5559. Do we consider that a break considering using those variables are not officially supported? If so should we wait for 3.0?

fffonion avatar Aug 25 '21 18:08 fffonion

:rocket: Performance test result

Test Suite: 01-rps 02-flamegraph (baseline,single_route,simple)

Click to expand
Please see Github Actions artifacts for flamegraphs.

  ### Result for upstream directly (run 1):
Running 1m test @ http://10.88.145.17:8088/test
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   615.41us    1.17ms  28.10ms   88.06%
    Req/Sec    86.03k    21.04k  121.16k    67.10%
  25686180 requests in 1.00m, 3.35GB read
Requests/sec: 427729.66
Transfer/sec:     57.11MB
### Result for upstream directly (run 2):
Running 1m test @ http://10.88.145.17:8088/test
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   606.46us    1.16ms  28.31ms   88.20%
    Req/Sec    86.18k    20.06k  121.17k    66.57%
  25727592 requests in 1.00m, 3.35GB read
Requests/sec: 428404.12
Transfer/sec:     57.20MB
### Result for upstream directly (run 3):
Running 1m test @ http://10.88.145.17:8088/test
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   611.91us    1.17ms  28.18ms   88.30%
    Req/Sec    86.02k    20.45k  122.45k    67.13%
  25684623 requests in 1.00m, 3.35GB read
Requests/sec: 427544.65
Transfer/sec:     57.08MB
### Combined result for upstream directly:
RPS     Avg: 427892.81
Latency Avg: nanms    Max: nanms
  
### Test Suite: git:3b138c01750e036cdb57813c258c997c5c11fff5 #simple #no_plugins #single_route
### Result for Kong git:3b138c01750e036cdb57813c258c997c5c11fff5 (run 1):
Running 1m test @ http://10.88.145.15:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     3.17ms   21.96ms   1.02s    99.34%
    Req/Sec    13.31k     3.61k   24.90k    62.69%
  3976414 requests in 1.00m, 853.08MB read
Requests/sec:  66163.85
Transfer/sec:     14.19MB
### Result for Kong git:3b138c01750e036cdb57813c258c997c5c11fff5 (run 2):
Running 1m test @ http://10.88.145.15:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.59ms    4.30ms 118.98ms   91.55%
    Req/Sec    13.18k     3.62k   32.53k    63.01%
  3935082 requests in 1.00m, 844.21MB read
Requests/sec:  65476.51
Transfer/sec:     14.05MB
### Result for Kong git:3b138c01750e036cdb57813c258c997c5c11fff5 (run 3):
Running 1m test @ http://10.88.145.15:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.59ms    4.19ms  94.88ms   91.43%
    Req/Sec    13.19k     3.52k   38.04k    62.51%
  3937909 requests in 1.00m, 844.82MB read
Requests/sec:  65523.32
Transfer/sec:     14.06MB
### Combined result for Kong git:3b138c01750e036cdb57813c258c997c5c11fff5:
RPS     Avg: 65721.23
Latency Avg: 2.78ms    Max: 1020.00ms
  
### Test Suite: git:3b138c01750e036cdb57813c258c997c5c11fff5 #simple #no_plugins 10 services each has 10 routes
### Result for Kong git:3b138c01750e036cdb57813c258c997c5c11fff5 (run 1):
Running 1m test @ http://10.88.145.15:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.64ms    3.99ms  96.24ms   90.69%
    Req/Sec    12.60k     3.51k   23.47k    64.56%
  3767985 requests in 1.00m, 808.36MB read
Requests/sec:  62695.82
Transfer/sec:     13.45MB
### Result for Kong git:3b138c01750e036cdb57813c258c997c5c11fff5 (run 2):
Running 1m test @ http://10.88.145.15:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.68ms    4.23ms  90.63ms   91.51%
    Req/Sec    12.67k     3.53k   25.73k    63.69%
  3783521 requests in 1.00m, 811.70MB read
Requests/sec:  62953.83
Transfer/sec:     13.51MB
### Result for Kong git:3b138c01750e036cdb57813c258c997c5c11fff5 (run 3):
Running 1m test @ http://10.88.145.15:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.65ms    4.18ms  98.52ms   91.27%
    Req/Sec    12.71k     3.58k   23.87k    64.93%
  3795156 requests in 1.00m, 814.19MB read
Requests/sec:  63235.34
Transfer/sec:     13.57MB
### Combined result for Kong git:3b138c01750e036cdb57813c258c997c5c11fff5:
RPS     Avg: 62961.66
Latency Avg: 2.66ms    Max: 98.52ms
  
### Test Suite: git:3b138c01750e036cdb57813c258c997c5c11fff5 #simple #key-auth 10 services each has 10 routes with key-auth, 100 consumers
### Result for Kong git:3b138c01750e036cdb57813c258c997c5c11fff5 (run 1):
Running 1m test @ http://10.88.145.15:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.49ms    3.41ms 134.28ms   92.21%
    Req/Sec    10.98k     2.34k   19.10k    67.39%
  3280216 requests in 1.00m, 703.71MB read
Requests/sec:  54589.19
Transfer/sec:     11.71MB
### Result for Kong git:3b138c01750e036cdb57813c258c997c5c11fff5 (run 2):
Running 1m test @ http://10.88.145.15:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.55ms    3.57ms 102.79ms   92.65%
    Req/Sec    10.89k     2.40k   18.41k    66.87%
  3249391 requests in 1.00m, 697.10MB read
Requests/sec:  54102.31
Transfer/sec:     11.61MB
### Result for Kong git:3b138c01750e036cdb57813c258c997c5c11fff5 (run 3):
Running 1m test @ http://10.88.145.15:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.63ms    3.92ms  89.77ms   92.80%
    Req/Sec    10.92k     2.40k   19.64k    67.37%
  3259590 requests in 1.00m, 699.29MB read
Requests/sec:  54293.04
Transfer/sec:     11.65MB
### Combined result for Kong git:3b138c01750e036cdb57813c258c997c5c11fff5:
RPS     Avg: 54328.18
Latency Avg: 2.56ms    Max: 134.28ms
  
### Test Suite: git:master #simple #no_plugins #single_route
### Result for Kong git:master (run 1):
Running 1m test @ http://10.88.145.15:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.67ms    4.59ms 127.49ms   92.24%
    Req/Sec    13.02k     3.56k   22.72k    63.16%
  3888484 requests in 1.00m, 834.22MB read
Requests/sec:  64700.25
Transfer/sec:     13.88MB
### Result for Kong git:master (run 2):
Running 1m test @ http://10.88.145.15:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.78ms    4.95ms 155.54ms   92.63%
    Req/Sec    12.90k     3.64k   34.49k    64.71%
  3851854 requests in 1.00m, 826.36MB read
Requests/sec:  64091.10
Transfer/sec:     13.75MB
### Result for Kong git:master (run 3):
Running 1m test @ http://10.88.145.15:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.84ms    5.07ms 122.59ms   92.64%
    Req/Sec    12.83k     3.70k   38.45k    63.38%
  3830850 requests in 1.00m, 821.85MB read
Requests/sec:  63741.97
Transfer/sec:     13.67MB
### Combined result for Kong git:master:
RPS     Avg: 64177.77
Latency Avg: 2.76ms    Max: 155.54ms
  
### Test Suite: git:master #simple #no_plugins 10 services each has 10 routes
### Result for Kong git:master (run 1):
Running 1m test @ http://10.88.145.15:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.55ms    4.02ms  80.40ms   91.24%
    Req/Sec    12.88k     3.55k   24.52k    62.15%
  3851048 requests in 1.00m, 826.18MB read
Requests/sec:  64077.85
Transfer/sec:     13.75MB
### Result for Kong git:master (run 2):
Running 1m test @ http://10.88.145.15:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.71ms    4.78ms 114.33ms   92.50%
    Req/Sec    12.79k     3.53k   23.94k    64.52%
  3821145 requests in 1.00m, 819.77MB read
Requests/sec:  63580.20
Transfer/sec:     13.64MB
### Result for Kong git:master (run 3):
Running 1m test @ http://10.88.145.15:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.71ms    4.59ms  99.77ms   91.99%
    Req/Sec    12.81k     3.60k   23.44k    63.39%
  3831240 requests in 1.00m, 821.93MB read
Requests/sec:  63748.26
Transfer/sec:     13.68MB
### Combined result for Kong git:master:
RPS     Avg: 63802.10
Latency Avg: 2.66ms    Max: 114.33ms
  
### Test Suite: git:master #simple #key-auth 10 services each has 10 routes with key-auth, 100 consumers
### Result for Kong git:master (run 1):
Running 1m test @ http://10.88.145.15:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.82ms    4.25ms 107.37ms   92.16%
    Req/Sec    10.54k     2.53k   21.07k    67.82%
  3147196 requests in 1.00m, 675.18MB read
Requests/sec:  52389.21
Transfer/sec:     11.24MB
### Result for Kong git:master (run 2):
Running 1m test @ http://10.88.145.15:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.68ms    3.43ms  74.29ms   89.84%
    Req/Sec    10.47k     2.34k   18.85k    67.10%
  3126398 requests in 1.00m, 670.71MB read
Requests/sec:  52039.83
Transfer/sec:     11.16MB
### Result for Kong git:master (run 3):
Running 1m test @ http://10.88.145.15:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.80ms    3.95ms  98.61ms   91.12%
    Req/Sec    10.37k     2.39k   17.43k    67.70%
  3096219 requests in 1.00m, 664.24MB read
Requests/sec:  51553.34
Transfer/sec:     11.06MB
### Combined result for Kong git:master:
RPS     Avg: 51994.13
Latency Avg: 2.77ms    Max: 107.37ms
  

Kong error logs are also available in Github Actions artifacts.

Download Artifacts

github-actions[bot] avatar Aug 25 '21 18:08 github-actions[bot]

:rocket: Performance test result

Test Suite: 01-rps 02-flamegraph (baseline,single_route,simple)

Click to expand
Please see Github Actions artifacts for flamegraphs.

  ### Result for upstream directly (run 1):
Running 1m test @ http://10.88.145.17:8088/test
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   592.21us    1.14ms  28.14ms   88.22%
    Req/Sec    91.45k    22.44k  127.85k    66.70%
  27313169 requests in 1.00m, 3.56GB read
Requests/sec: 454638.38
Transfer/sec:     60.70MB
### Result for upstream directly (run 2):
Running 1m test @ http://10.88.145.17:8088/test
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   598.68us    1.17ms  28.22ms   88.54%
    Req/Sec    90.89k    21.53k  128.40k    67.83%
  27143747 requests in 1.00m, 3.54GB read
Requests/sec: 451808.65
Transfer/sec:     60.32MB
### Result for upstream directly (run 3):
Running 1m test @ http://10.88.145.17:8088/test
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   581.51us    1.12ms  28.14ms   88.38%
    Req/Sec    91.21k    22.14k  131.10k    67.67%
  27235154 requests in 1.00m, 3.55GB read
Requests/sec: 453364.93
Transfer/sec:     60.53MB
### Combined result for upstream directly:
RPS     Avg: 453270.65
Latency Avg: nanms    Max: nanms
  
### Test Suite: git:5b724d948d2b6462aa7277f4e936cd2d0412bb17 #simple #no_plugins #single_route
### Result for Kong git:5b724d948d2b6462aa7277f4e936cd2d0412bb17 (run 1):
Running 1m test @ http://10.88.145.15:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.96ms   18.06ms   1.01s    98.94%
    Req/Sec    14.10k     3.97k   29.63k    63.56%
  4212796 requests in 1.00m, 0.88GB read
Requests/sec:  70096.85
Transfer/sec:     15.04MB
### Result for Kong git:5b724d948d2b6462aa7277f4e936cd2d0412bb17 (run 2):
Running 1m test @ http://10.88.145.15:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.61ms    4.47ms 102.86ms   91.55%
    Req/Sec    13.89k     3.93k   25.25k    62.77%
  4146444 requests in 1.00m, 0.87GB read
Requests/sec:  69071.48
Transfer/sec:     14.82MB
### Result for Kong git:5b724d948d2b6462aa7277f4e936cd2d0412bb17 (run 3):
Running 1m test @ http://10.88.145.15:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.64ms    4.64ms  96.28ms   91.81%
    Req/Sec    13.82k     3.90k   26.52k    61.38%
  4125883 requests in 1.00m, 0.86GB read
Requests/sec:  68650.87
Transfer/sec:     14.73MB
### Combined result for Kong git:5b724d948d2b6462aa7277f4e936cd2d0412bb17:
RPS     Avg: 69273.07
Latency Avg: 2.74ms    Max: 1010.00ms
  
### Test Suite: git:5b724d948d2b6462aa7277f4e936cd2d0412bb17 #simple #no_plugins 10 services each has 10 routes
### Result for Kong git:5b724d948d2b6462aa7277f4e936cd2d0412bb17 (run 1):
Running 1m test @ http://10.88.145.15:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.56ms    4.14ms  95.51ms   91.50%
    Req/Sec    13.13k     3.48k   24.68k    63.64%
  3922112 requests in 1.00m, 841.43MB read
Requests/sec:  65259.83
Transfer/sec:     14.00MB
### Result for Kong git:5b724d948d2b6462aa7277f4e936cd2d0412bb17 (run 2):
Running 1m test @ http://10.88.145.15:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.65ms    4.44ms 111.20ms   91.44%
    Req/Sec    13.17k     3.64k   24.31k    61.76%
  3932970 requests in 1.00m, 843.76MB read
Requests/sec:  65441.63
Transfer/sec:     14.04MB
### Result for Kong git:5b724d948d2b6462aa7277f4e936cd2d0412bb17 (run 3):
Running 1m test @ http://10.88.145.15:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.61ms    4.27ms 126.32ms   91.46%
    Req/Sec    13.09k     3.68k   24.66k    63.89%
  3908780 requests in 1.00m, 838.57MB read
Requests/sec:  65038.88
Transfer/sec:     13.95MB
### Combined result for Kong git:5b724d948d2b6462aa7277f4e936cd2d0412bb17:
RPS     Avg: 65246.78
Latency Avg: 2.61ms    Max: 126.32ms
  
### Test Suite: git:5b724d948d2b6462aa7277f4e936cd2d0412bb17 #simple #key-auth 10 services each has 10 routes with key-auth, 100 consumers
### Result for Kong git:5b724d948d2b6462aa7277f4e936cd2d0412bb17 (run 1):
Running 1m test @ http://10.88.145.15:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.69ms    3.47ms 136.41ms   89.33%
    Req/Sec    10.59k     2.52k   19.95k    68.01%
  3165794 requests in 1.00m, 679.17MB read
Requests/sec:  52675.50
Transfer/sec:     11.30MB
### Result for Kong git:5b724d948d2b6462aa7277f4e936cd2d0412bb17 (run 2):
Running 1m test @ http://10.88.145.15:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.84ms    3.86ms 123.88ms   89.72%
    Req/Sec    10.40k     2.71k   20.32k    66.82%
  3107285 requests in 1.00m, 666.62MB read
Requests/sec:  51702.66
Transfer/sec:     11.09MB
### Result for Kong git:5b724d948d2b6462aa7277f4e936cd2d0412bb17 (run 3):
Running 1m test @ http://10.88.145.15:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.70ms    3.82ms 118.40ms   91.66%
    Req/Sec    10.60k     2.50k   18.97k    68.07%
  3164848 requests in 1.00m, 678.96MB read
Requests/sec:  52725.79
Transfer/sec:     11.31MB
### Combined result for Kong git:5b724d948d2b6462aa7277f4e936cd2d0412bb17:
RPS     Avg: 52367.98
Latency Avg: 2.74ms    Max: 136.41ms
  
### Test Suite: git:master #simple #no_plugins #single_route
### Result for Kong git:master (run 1):
Running 1m test @ http://10.88.145.15:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.52ms    4.04ms  94.08ms   91.60%
    Req/Sec    13.23k     3.61k   33.67k    63.25%
  3950949 requests in 1.00m, 847.62MB read
Requests/sec:  65739.93
Transfer/sec:     14.10MB
### Result for Kong git:master (run 2):
Running 1m test @ http://10.88.145.15:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.57ms    4.36ms 105.91ms   92.10%
    Req/Sec    13.17k     3.56k   25.23k    62.29%
  3932867 requests in 1.00m, 843.74MB read
Requests/sec:  65439.68
Transfer/sec:     14.04MB
### Result for Kong git:master (run 3):
Running 1m test @ http://10.88.145.15:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.61ms    4.34ms 109.59ms   91.80%
    Req/Sec    13.07k     3.59k   24.12k    62.66%
  3904371 requests in 1.00m, 837.62MB read
Requests/sec:  64965.39
Transfer/sec:     13.94MB
### Combined result for Kong git:master:
RPS     Avg: 65381.67
Latency Avg: 2.57ms    Max: 109.59ms
  
### Test Suite: git:master #simple #no_plugins 10 services each has 10 routes
### Result for Kong git:master (run 1):
Running 1m test @ http://10.88.145.15:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.91ms    4.18ms 107.96ms   88.52%
    Req/Sec    12.15k     3.54k   26.37k    65.50%
  3629260 requests in 1.00m, 778.60MB read
Requests/sec:  60387.08
Transfer/sec:     12.96MB
### Result for Kong git:master (run 2):
Running 1m test @ http://10.88.145.15:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.84ms    4.04ms  96.81ms   88.19%
    Req/Sec    12.17k     3.47k   25.10k    67.19%
  3638658 requests in 1.00m, 780.62MB read
Requests/sec:  60543.34
Transfer/sec:     12.99MB
### Result for Kong git:master (run 3):
Running 1m test @ http://10.88.145.15:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.86ms    4.39ms 113.33ms   90.00%
    Req/Sec    12.25k     3.40k   25.43k    64.55%
  3662680 requests in 1.00m, 785.77MB read
Requests/sec:  60943.12
Transfer/sec:     13.07MB
### Combined result for Kong git:master:
RPS     Avg: 60624.51
Latency Avg: 2.87ms    Max: 113.33ms
  
### Test Suite: git:master #simple #key-auth 10 services each has 10 routes with key-auth, 100 consumers
### Result for Kong git:master (run 1):
Running 1m test @ http://10.88.145.15:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.49ms    3.21ms  89.83ms   91.33%
    Req/Sec    10.78k     2.32k   20.07k    67.36%
  3220996 requests in 1.00m, 691.01MB read
Requests/sec:  53606.82
Transfer/sec:     11.50MB
### Result for Kong git:master (run 2):
Running 1m test @ http://10.88.145.15:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.48ms    3.25ms  87.63ms   92.35%
    Req/Sec    10.61k     2.26k   19.19k    67.10%
  3167273 requests in 1.00m, 679.48MB read
Requests/sec:  52726.83
Transfer/sec:     11.31MB
### Result for Kong git:master (run 3):
Running 1m test @ http://10.88.145.15:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.72ms    4.48ms 172.41ms   93.50%
    Req/Sec    10.45k     2.42k   19.07k    67.53%
  3119756 requests in 1.00m, 669.29MB read
Requests/sec:  51944.66
Transfer/sec:     11.14MB
### Combined result for Kong git:master:
RPS     Avg: 52759.44
Latency Avg: 2.56ms    Max: 172.41ms
  

Kong error logs are also available in Github Actions artifacts.

Download Artifacts

github-actions[bot] avatar Aug 26 '21 14:08 github-actions[bot]

:rocket: Performance test result

Test Suite: 01-rps 02-flamegraph (baseline,single_route,simple)

Click to expand
Please see Github Actions artifacts for flamegraphs.

  ### Result for upstream directly (run 1):
Running 1m test @ http://10.88.145.21:8088/test
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   609.93us    1.18ms  28.18ms   88.37%
    Req/Sec    86.27k    19.89k  119.03k    68.97%
  25759393 requests in 1.00m, 3.36GB read
Requests/sec: 428927.47
Transfer/sec:     57.27MB
### Result for upstream directly (run 2):
Running 1m test @ http://10.88.145.21:8088/test
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   617.64us    1.17ms  34.84ms   87.96%
    Req/Sec    86.26k    21.36k  121.68k    67.20%
  25757854 requests in 1.00m, 3.36GB read
Requests/sec: 428855.13
Transfer/sec:     57.26MB
### Result for upstream directly (run 3):
Running 1m test @ http://10.88.145.21:8088/test
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   605.68us    1.15ms  32.11ms   88.06%
    Req/Sec    86.82k    20.76k  121.62k    67.83%
  25922280 requests in 1.00m, 3.38GB read
Requests/sec: 431587.77
Transfer/sec:     57.62MB
### Combined result for upstream directly:
RPS     Avg: 429790.12
Latency Avg: nanms    Max: nanms
  
### Test Suite: git:736230c6b411c9e6ba88babf1819c8e337e2ff1d #simple #no_plugins #single_route
### Result for Kong git:736230c6b411c9e6ba88babf1819c8e337e2ff1d (run 1):
Running 1m test @ http://10.88.145.19:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.54ms    4.20ms  90.42ms   90.72%
    Req/Sec    14.03k     3.96k   25.12k    60.53%
  4189346 requests in 1.00m, 0.88GB read
Requests/sec:  69706.48
Transfer/sec:     14.95MB
### Result for Kong git:736230c6b411c9e6ba88babf1819c8e337e2ff1d (run 2):
Running 1m test @ http://10.88.145.19:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.67ms    4.59ms 105.89ms   91.23%
    Req/Sec    13.84k     4.01k   25.42k    62.16%
  4134867 requests in 1.00m, 0.87GB read
Requests/sec:  68800.72
Transfer/sec:     14.76MB
### Result for Kong git:736230c6b411c9e6ba88babf1819c8e337e2ff1d (run 3):
Running 1m test @ http://10.88.145.19:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.65ms    4.58ms 107.61ms   91.33%
    Req/Sec    13.78k     3.95k   24.18k    61.89%
  4116686 requests in 1.00m, 0.86GB read
Requests/sec:  68497.34
Transfer/sec:     14.70MB
### Combined result for Kong git:736230c6b411c9e6ba88babf1819c8e337e2ff1d:
RPS     Avg: 69001.51
Latency Avg: 2.62ms    Max: 107.61ms
  
### Test Suite: git:736230c6b411c9e6ba88babf1819c8e337e2ff1d #simple #no_plugins 10 services each has 10 routes
### Result for Kong git:736230c6b411c9e6ba88babf1819c8e337e2ff1d (run 1):
Running 1m test @ http://10.88.145.19:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.53ms    4.01ms 104.54ms   91.19%
    Req/Sec    12.88k     3.40k   24.81k    62.00%
  3847593 requests in 1.00m, 825.44MB read
Requests/sec:  64020.31
Transfer/sec:     13.73MB
### Result for Kong git:736230c6b411c9e6ba88babf1819c8e337e2ff1d (run 2):
Running 1m test @ http://10.88.145.19:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.66ms    4.60ms 126.02ms   91.97%
    Req/Sec    12.85k     3.42k   22.64k    64.15%
  3840690 requests in 1.00m, 823.96MB read
Requests/sec:  63905.35
Transfer/sec:     13.71MB
### Result for Kong git:736230c6b411c9e6ba88babf1819c8e337e2ff1d (run 3):
Running 1m test @ http://10.88.145.19:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.63ms    4.31ms 104.87ms   91.63%
    Req/Sec    12.80k     3.48k   23.25k    62.13%
  3827184 requests in 1.00m, 821.06MB read
Requests/sec:  63680.71
Transfer/sec:     13.66MB
### Combined result for Kong git:736230c6b411c9e6ba88babf1819c8e337e2ff1d:
RPS     Avg: 63868.79
Latency Avg: 2.61ms    Max: 126.02ms
  
### Test Suite: git:736230c6b411c9e6ba88babf1819c8e337e2ff1d #simple #key-auth 10 services each has 10 routes with key-auth, 100 consumers
### Result for Kong git:736230c6b411c9e6ba88babf1819c8e337e2ff1d (run 1):
Running 1m test @ http://10.88.145.19:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.50ms    3.50ms 132.38ms   92.00%
    Req/Sec    11.25k     2.54k   19.75k    67.18%
  3362867 requests in 1.00m, 721.45MB read
Requests/sec:  55955.22
Transfer/sec:     12.00MB
### Result for Kong git:736230c6b411c9e6ba88babf1819c8e337e2ff1d (run 2):
Running 1m test @ http://10.88.145.19:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.69ms    3.67ms  97.46ms   89.79%
    Req/Sec    11.08k     2.69k   20.42k    65.91%
  3310708 requests in 1.00m, 710.26MB read
Requests/sec:  55086.99
Transfer/sec:     11.82MB
### Result for Kong git:736230c6b411c9e6ba88babf1819c8e337e2ff1d (run 3):
Running 1m test @ http://10.88.145.19:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.74ms    4.09ms 100.96ms   92.45%
    Req/Sec    11.02k     2.75k   21.03k    67.42%
  3294119 requests in 1.00m, 706.70MB read
Requests/sec:  54811.02
Transfer/sec:     11.76MB
### Combined result for Kong git:736230c6b411c9e6ba88babf1819c8e337e2ff1d:
RPS     Avg: 55284.41
Latency Avg: 2.64ms    Max: 132.38ms
  
### Test Suite: git:master #simple #no_plugins #single_route
### Result for Kong git:master (run 1):
Running 1m test @ http://10.88.145.19:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.68ms    4.17ms  99.54ms   90.76%
    Req/Sec    12.93k     3.65k   36.49k    64.21%
  3861294 requests in 1.00m, 828.38MB read
Requests/sec:  64248.07
Transfer/sec:     13.78MB
### Result for Kong git:master (run 2):
Running 1m test @ http://10.88.145.19:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.73ms    4.36ms 131.64ms   91.29%
    Req/Sec    12.76k     3.63k   25.28k    63.82%
  3811475 requests in 1.00m, 817.69MB read
Requests/sec:  63419.59
Transfer/sec:     13.61MB
### Result for Kong git:master (run 3):
Running 1m test @ http://10.88.145.19:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.67ms    4.15ms  87.00ms   90.55%
    Req/Sec    12.82k     3.65k   31.42k    64.85%
  3827834 requests in 1.00m, 821.20MB read
Requests/sec:  63691.60
Transfer/sec:     13.66MB
### Combined result for Kong git:master:
RPS     Avg: 63786.42
Latency Avg: 2.69ms    Max: 131.64ms
  
### Test Suite: git:master #simple #no_plugins 10 services each has 10 routes
### Result for Kong git:master (run 1):
Running 1m test @ http://10.88.145.19:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.57ms    3.84ms  93.07ms   90.71%
    Req/Sec    12.54k     3.40k   24.97k    62.82%
  3746879 requests in 1.00m, 803.83MB read
Requests/sec:  62344.71
Transfer/sec:     13.38MB
### Result for Kong git:master (run 2):
Running 1m test @ http://10.88.145.19:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.62ms    4.14ms 106.86ms   91.78%
    Req/Sec    12.61k     3.41k   36.40k    63.95%
  3763920 requests in 1.00m, 807.49MB read
Requests/sec:  62627.99
Transfer/sec:     13.44MB
### Result for Kong git:master (run 3):
Running 1m test @ http://10.88.145.19:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.67ms    4.16ms  94.03ms   90.95%
    Req/Sec    12.48k     3.43k   23.32k    63.66%
  3726354 requests in 1.00m, 799.43MB read
Requests/sec:  62035.06
Transfer/sec:     13.31MB
### Combined result for Kong git:master:
RPS     Avg: 62335.92
Latency Avg: 2.62ms    Max: 106.86ms
  
### Test Suite: git:master #simple #key-auth 10 services each has 10 routes with key-auth, 100 consumers
### Result for Kong git:master (run 1):
Running 1m test @ http://10.88.145.19:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.55ms    3.73ms 134.02ms   93.11%
    Req/Sec    10.89k     2.43k   17.78k    67.54%
  3253832 requests in 1.00m, 698.05MB read
Requests/sec:  54140.74
Transfer/sec:     11.61MB
### Result for Kong git:master (run 2):
Running 1m test @ http://10.88.145.19:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.63ms    4.19ms 159.14ms   93.58%
    Req/Sec    10.77k     2.43k   20.80k    66.47%
  3213953 requests in 1.00m, 689.50MB read
Requests/sec:  53512.36
Transfer/sec:     11.48MB
### Result for Kong git:master (run 3):
Running 1m test @ http://10.88.145.19:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.46ms    3.12ms  93.62ms   91.59%
    Req/Sec    10.74k     2.39k   20.01k    66.60%
  3204821 requests in 1.00m, 687.54MB read
Requests/sec:  53379.62
Transfer/sec:     11.45MB
### Combined result for Kong git:master:
RPS     Avg: 53677.57
Latency Avg: 2.55ms    Max: 159.14ms
  

Kong error logs are also available in Github Actions artifacts.

Download Artifacts

github-actions[bot] avatar Aug 26 '21 14:08 github-actions[bot]

:rocket: Performance test result

Test Suite: 01-rps 02-flamegraph (baseline,single_route,simple)

Click to expand
Please see Github Actions artifacts for flamegraphs.

  ### Result for upstream directly (run 1):
Running 1m test @ http://10.88.145.23:8088/test
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   580.36us    1.12ms  28.22ms   88.44%
    Req/Sec    89.66k    21.18k  125.71k    66.80%
  26767603 requests in 1.00m, 3.49GB read
Requests/sec: 445705.68
Transfer/sec:     59.51MB
### Result for upstream directly (run 2):
Running 1m test @ http://10.88.145.23:8088/test
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   590.09us    1.12ms  28.16ms   88.24%
    Req/Sec    89.57k    22.30k  127.66k    66.13%
  26743448 requests in 1.00m, 3.49GB read
Requests/sec: 445189.94
Transfer/sec:     59.44MB
### Result for upstream directly (run 3):
Running 1m test @ http://10.88.145.23:8088/test
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   581.79us    1.12ms  28.26ms   88.39%
    Req/Sec    89.86k    21.85k  131.00k    65.97%
  26829320 requests in 1.00m, 3.50GB read
Requests/sec: 446855.46
Transfer/sec:     59.66MB
### Combined result for upstream directly:
RPS     Avg: 445917.03
Latency Avg: nanms    Max: nanms
  
### Test Suite: git:a81685f1e61d4cfa46a9eb89fe2dfbbdfe15349c #simple #no_plugins #single_route
### Result for Kong git:a81685f1e61d4cfa46a9eb89fe2dfbbdfe15349c (run 1):
Running 1m test @ http://10.88.145.25:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.55ms    4.21ms  92.24ms   91.52%
    Req/Sec    13.68k     3.79k   26.27k    61.69%
  4086010 requests in 1.00m, 0.86GB read
Requests/sec:  67986.98
Transfer/sec:     14.59MB
### Result for Kong git:a81685f1e61d4cfa46a9eb89fe2dfbbdfe15349c (run 2):
Running 1m test @ http://10.88.145.25:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.64ms    4.58ms 102.39ms   91.79%
    Req/Sec    13.63k     3.84k   25.06k    62.97%
  4068114 requests in 1.00m, 0.85GB read
Requests/sec:  67772.35
Transfer/sec:     14.54MB
### Result for Kong git:a81685f1e61d4cfa46a9eb89fe2dfbbdfe15349c (run 3):
Running 1m test @ http://10.88.145.25:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.55ms    4.26ms 116.11ms   91.36%
    Req/Sec    13.67k     3.82k   27.53k    62.82%
  4082770 requests in 1.00m, 0.86GB read
Requests/sec:  67933.75
Transfer/sec:     14.57MB
### Combined result for Kong git:a81685f1e61d4cfa46a9eb89fe2dfbbdfe15349c:
RPS     Avg: 67897.69
Latency Avg: 2.58ms    Max: 116.11ms
  
### Test Suite: git:a81685f1e61d4cfa46a9eb89fe2dfbbdfe15349c #simple #no_plugins 10 services each has 10 routes
### Result for Kong git:a81685f1e61d4cfa46a9eb89fe2dfbbdfe15349c (run 1):
Running 1m test @ http://10.88.145.25:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.61ms    4.46ms 115.70ms   91.42%
    Req/Sec    13.46k     3.70k   25.03k    61.80%
  4025082 requests in 1.00m, 863.52MB read
Requests/sec:  66973.47
Transfer/sec:     14.37MB
### Result for Kong git:a81685f1e61d4cfa46a9eb89fe2dfbbdfe15349c (run 2):
Running 1m test @ http://10.88.145.25:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.67ms    4.52ms 115.18ms   91.70%
    Req/Sec    13.36k     3.73k   32.39k    63.18%
  3990908 requests in 1.00m, 856.19MB read
Requests/sec:  66405.21
Transfer/sec:     14.25MB
### Result for Kong git:a81685f1e61d4cfa46a9eb89fe2dfbbdfe15349c (run 3):
Running 1m test @ http://10.88.145.25:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.64ms    4.29ms 125.46ms   91.26%
    Req/Sec    13.38k     3.75k   25.64k    62.40%
  4001661 requests in 1.00m, 858.50MB read
Requests/sec:  66583.80
Transfer/sec:     14.28MB
### Combined result for Kong git:a81685f1e61d4cfa46a9eb89fe2dfbbdfe15349c:
RPS     Avg: 66654.16
Latency Avg: 2.64ms    Max: 125.46ms
  
### Test Suite: git:a81685f1e61d4cfa46a9eb89fe2dfbbdfe15349c #simple #key-auth 10 services each has 10 routes with key-auth, 100 consumers
### Result for Kong git:a81685f1e61d4cfa46a9eb89fe2dfbbdfe15349c (run 1):
Running 1m test @ http://10.88.145.25:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.51ms    3.48ms  99.39ms   91.62%
    Req/Sec    11.30k     2.62k   21.09k    66.53%
  3375052 requests in 1.00m, 724.06MB read
Requests/sec:  56158.06
Transfer/sec:     12.05MB
### Result for Kong git:a81685f1e61d4cfa46a9eb89fe2dfbbdfe15349c (run 2):
Running 1m test @ http://10.88.145.25:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.59ms    3.80ms 117.16ms   92.38%
    Req/Sec    11.21k     2.63k   30.50k    67.01%
  3348183 requests in 1.00m, 718.30MB read
Requests/sec:  55710.43
Transfer/sec:     11.95MB
### Result for Kong git:a81685f1e61d4cfa46a9eb89fe2dfbbdfe15349c (run 3):
Running 1m test @ http://10.88.145.25:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.56ms    3.63ms  76.92ms   92.16%
    Req/Sec    11.19k     2.62k   20.84k    67.46%
  3343439 requests in 1.00m, 717.28MB read
Requests/sec:  55631.22
Transfer/sec:     11.93MB
### Combined result for Kong git:a81685f1e61d4cfa46a9eb89fe2dfbbdfe15349c:
RPS     Avg: 55833.24
Latency Avg: 2.55ms    Max: 117.16ms
  
### Test Suite: git:master #simple #no_plugins #single_route
### Result for Kong git:master (run 1):
Running 1m test @ http://10.88.145.25:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.50ms    4.07ms  86.99ms   91.31%
    Req/Sec    13.47k     3.66k   23.45k    62.43%
  4024252 requests in 1.00m, 863.34MB read
Requests/sec:  66960.20
Transfer/sec:     14.37MB
### Result for Kong git:master (run 2):
Running 1m test @ http://10.88.145.25:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.56ms    4.13ms  95.16ms   91.46%
    Req/Sec    13.35k     3.62k   25.39k    62.46%
  3987611 requests in 1.00m, 855.48MB read
Requests/sec:  66350.11
Transfer/sec:     14.23MB
### Result for Kong git:master (run 3):
Running 1m test @ http://10.88.145.25:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.66ms    4.54ms 126.36ms   92.04%
    Req/Sec    13.28k     3.70k   37.14k    63.51%
  3966718 requests in 1.00m, 851.00MB read
Requests/sec:  66002.67
Transfer/sec:     14.16MB
### Combined result for Kong git:master:
RPS     Avg: 66437.66
Latency Avg: 2.57ms    Max: 126.36ms
  
### Test Suite: git:master #simple #no_plugins 10 services each has 10 routes
### Result for Kong git:master (run 1):
Running 1m test @ http://10.88.145.25:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.56ms    4.22ms 101.86ms   91.48%
    Req/Sec    13.17k     3.58k   23.23k    61.63%
  3936290 requests in 1.00m, 844.47MB read
Requests/sec:  65496.12
Transfer/sec:     14.05MB
### Result for Kong git:master (run 2):
Running 1m test @ http://10.88.145.25:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.61ms    4.38ms 109.98ms   91.88%
    Req/Sec    13.03k     3.65k   22.57k    63.53%
  3897882 requests in 1.00m, 836.23MB read
Requests/sec:  64857.06
Transfer/sec:     13.91MB
### Result for Kong git:master (run 3):
Running 1m test @ http://10.88.145.25:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.61ms    4.37ms 101.33ms   91.76%
    Req/Sec    13.06k     3.58k   24.06k    63.15%
  3903954 requests in 1.00m, 837.53MB read
Requests/sec:  64958.06
Transfer/sec:     13.94MB
### Combined result for Kong git:master:
RPS     Avg: 65103.75
Latency Avg: 2.59ms    Max: 109.98ms
  
### Test Suite: git:master #simple #key-auth 10 services each has 10 routes with key-auth, 100 consumers
### Result for Kong git:master (run 1):
Running 1m test @ http://10.88.145.25:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.81ms    4.22ms 133.45ms   91.56%
    Req/Sec    10.70k     2.65k   20.87k    68.62%
  3197438 requests in 1.00m, 685.96MB read
Requests/sec:  53225.42
Transfer/sec:     11.42MB
### Result for Kong git:master (run 2):
Running 1m test @ http://10.88.145.25:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.69ms    4.08ms 138.31ms   93.19%
    Req/Sec    10.62k     2.55k   18.93k    69.63%
  3171177 requests in 1.00m, 680.32MB read
Requests/sec:  52800.00
Transfer/sec:     11.33MB
### Result for Kong git:master (run 3):
Running 1m test @ http://10.88.145.25:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.65ms    4.15ms 147.49ms   93.86%
    Req/Sec    10.68k     2.43k   19.64k    70.10%
  3188314 requests in 1.00m, 684.00MB read
Requests/sec:  53101.42
Transfer/sec:     11.39MB
### Combined result for Kong git:master:
RPS     Avg: 53042.28
Latency Avg: 2.72ms    Max: 147.49ms
  

Kong error logs are also available in Github Actions artifacts.

Download Artifacts

github-actions[bot] avatar Aug 26 '21 14:08 github-actions[bot]

:rocket: Performance test result

Test Suite: 01-rps 02-flamegraph (baseline,single_route,simple)

Click to expand
Please see Github Actions artifacts for flamegraphs.

  ### Result for upstream directly (run 1):
Running 1m test @ http://10.88.145.15:8088/test
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   610.40us    1.20ms  28.35ms   88.74%
    Req/Sec    85.48k    20.23k  123.18k    67.50%
  25528315 requests in 1.00m, 3.33GB read
Requests/sec: 425059.49
Transfer/sec:     56.75MB
### Result for upstream directly (run 2):
Running 1m test @ http://10.88.145.15:8088/test
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   598.20us    1.14ms  28.22ms   88.26%
    Req/Sec    85.20k    20.35k  120.61k    66.17%
  25439948 requests in 1.00m, 3.32GB read
Requests/sec: 423625.09
Transfer/sec:     56.56MB
### Result for upstream directly (run 3):
Running 1m test @ http://10.88.145.15:8088/test
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   597.35us    1.13ms  28.10ms   88.27%
    Req/Sec    85.56k    21.32k  119.89k    67.70%
  25545565 requests in 1.00m, 3.33GB read
Requests/sec: 425289.81
Transfer/sec:     56.78MB
### Combined result for upstream directly:
RPS     Avg: 424658.13
Latency Avg: nanms    Max: nanms
  
### Test Suite: git:295d30b2602c54500bea5c7c18bb82298a034010 #simple #no_plugins #single_route
### Result for Kong git:295d30b2602c54500bea5c7c18bb82298a034010 (run 1):
Running 1m test @ http://10.88.145.17:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     4.10ms   33.22ms   1.03s    99.55%
    Req/Sec    14.23k     3.97k   27.50k    61.06%
  4250840 requests in 1.00m, 0.89GB read
Requests/sec:  70730.43
Transfer/sec:     15.17MB
### Result for Kong git:295d30b2602c54500bea5c7c18bb82298a034010 (run 2):
Running 1m test @ http://10.88.145.17:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.59ms    4.47ms 101.30ms   91.14%
    Req/Sec    14.12k     4.01k   34.05k    61.81%
  4217113 requests in 1.00m, 0.88GB read
Requests/sec:  70168.90
Transfer/sec:     15.05MB
### Result for Kong git:295d30b2602c54500bea5c7c18bb82298a034010 (run 3):
Running 1m test @ http://10.88.145.17:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.62ms    4.45ms  98.00ms   91.08%
    Req/Sec    14.05k     3.97k   38.67k    61.71%
  4194289 requests in 1.00m, 0.88GB read
Requests/sec:  69789.15
Transfer/sec:     14.97MB
### Combined result for Kong git:295d30b2602c54500bea5c7c18bb82298a034010:
RPS     Avg: 70229.49
Latency Avg: 3.11ms    Max: 1030.00ms
  
### Test Suite: git:295d30b2602c54500bea5c7c18bb82298a034010 #simple #no_plugins 10 services each has 10 routes
### Result for Kong git:295d30b2602c54500bea5c7c18bb82298a034010 (run 1):
Running 1m test @ http://10.88.145.17:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.64ms    4.62ms 115.55ms   91.63%
    Req/Sec    13.57k     3.74k   24.38k    60.26%
  4053861 requests in 1.00m, 869.70MB read
Requests/sec:  67452.95
Transfer/sec:     14.47MB
### Result for Kong git:295d30b2602c54500bea5c7c18bb82298a034010 (run 2):
Running 1m test @ http://10.88.145.17:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.76ms    4.86ms 108.89ms   91.79%
    Req/Sec    13.47k     3.92k   25.26k    62.26%
  4027472 requests in 1.00m, 864.04MB read
Requests/sec:  67013.18
Transfer/sec:     14.38MB
### Result for Kong git:295d30b2602c54500bea5c7c18bb82298a034010 (run 3):
Running 1m test @ http://10.88.145.17:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.68ms    4.63ms 100.01ms   91.52%
    Req/Sec    13.48k     3.88k   25.31k    62.22%
  4028433 requests in 1.00m, 864.24MB read
Requests/sec:  67029.16
Transfer/sec:     14.38MB
### Combined result for Kong git:295d30b2602c54500bea5c7c18bb82298a034010:
RPS     Avg: 67165.10
Latency Avg: 2.69ms    Max: 115.55ms
  
### Test Suite: git:295d30b2602c54500bea5c7c18bb82298a034010 #simple #key-auth 10 services each has 10 routes with key-auth, 100 consumers
### Result for Kong git:295d30b2602c54500bea5c7c18bb82298a034010 (run 1):
Running 1m test @ http://10.88.145.17:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.53ms    3.51ms  81.60ms   91.87%
    Req/Sec    11.25k     2.56k   20.90k    67.17%
  3362909 requests in 1.00m, 721.46MB read
Requests/sec:  55955.84
Transfer/sec:     12.00MB
### Result for Kong git:295d30b2602c54500bea5c7c18bb82298a034010 (run 2):
Running 1m test @ http://10.88.145.17:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.55ms    3.65ms  94.82ms   92.05%
    Req/Sec    11.23k     2.54k   21.12k    66.89%
  3355313 requests in 1.00m, 719.83MB read
Requests/sec:  55829.34
Transfer/sec:     11.98MB
### Result for Kong git:295d30b2602c54500bea5c7c18bb82298a034010 (run 3):
Running 1m test @ http://10.88.145.17:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.61ms    3.92ms 104.77ms   92.71%
    Req/Sec    11.26k     2.61k   18.85k    66.39%
  3365746 requests in 1.00m, 722.07MB read
Requests/sec:  56002.67
Transfer/sec:     12.01MB
### Combined result for Kong git:295d30b2602c54500bea5c7c18bb82298a034010:
RPS     Avg: 55929.28
Latency Avg: 2.56ms    Max: 104.77ms
  
### Test Suite: git:master #simple #no_plugins #single_route
### Result for Kong git:master (run 1):
Running 1m test @ http://10.88.145.17:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.53ms    4.19ms 103.94ms   91.33%
    Req/Sec    13.60k     3.68k   24.39k    61.53%
  4062206 requests in 1.00m, 0.85GB read
Requests/sec:  67591.34
Transfer/sec:     14.50MB
### Result for Kong git:master (run 2):
Running 1m test @ http://10.88.145.17:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.62ms    4.52ms 133.90ms   92.02%
    Req/Sec    13.40k     3.72k   32.00k    62.45%
  4001632 requests in 1.00m, 858.49MB read
Requests/sec:  66583.92
Transfer/sec:     14.28MB
### Result for Kong git:master (run 3):
Running 1m test @ http://10.88.145.17:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.63ms    4.42ms  97.25ms   91.51%
    Req/Sec    13.44k     3.72k   32.11k    62.45%
  4014172 requests in 1.00m, 861.18MB read
Requests/sec:  66792.38
Transfer/sec:     14.33MB
### Combined result for Kong git:master:
RPS     Avg: 66989.21
Latency Avg: 2.59ms    Max: 133.90ms
  
### Test Suite: git:master #simple #no_plugins 10 services each has 10 routes
### Result for Kong git:master (run 1):
Running 1m test @ http://10.88.145.17:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.60ms    4.31ms 103.02ms   91.66%
    Req/Sec    13.05k     3.56k   24.78k    62.02%
  3901547 requests in 1.00m, 837.02MB read
Requests/sec:  64917.96
Transfer/sec:     13.93MB
### Result for Kong git:master (run 2):
Running 1m test @ http://10.88.145.17:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.54ms    4.16ms 116.10ms   91.52%
    Req/Sec    12.99k     3.53k   23.98k    62.52%
  3880398 requests in 1.00m, 832.48MB read
Requests/sec:  64565.69
Transfer/sec:     13.85MB
### Result for Kong git:master (run 3):
Running 1m test @ http://10.88.145.17:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.62ms    4.39ms 111.99ms   91.71%
    Req/Sec    12.94k     3.54k   24.02k    61.35%
  3867415 requests in 1.00m, 829.69MB read
Requests/sec:  64350.06
Transfer/sec:     13.81MB
### Combined result for Kong git:master:
RPS     Avg: 64611.24
Latency Avg: 2.59ms    Max: 116.10ms
  
### Test Suite: git:master #simple #key-auth 10 services each has 10 routes with key-auth, 100 consumers
### Result for Kong git:master (run 1):
Running 1m test @ http://10.88.145.17:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.54ms    3.65ms 133.65ms   92.01%
    Req/Sec    11.15k     2.51k   19.26k    66.44%
  3333924 requests in 1.00m, 715.24MB read
Requests/sec:  55473.33
Transfer/sec:     11.90MB
### Result for Kong git:master (run 2):
Running 1m test @ http://10.88.145.17:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.68ms    3.86ms 114.49ms   92.06%
    Req/Sec    10.85k     2.51k   19.68k    65.70%
  3238682 requests in 1.00m, 694.80MB read
Requests/sec:  53946.30
Transfer/sec:     11.57MB
### Result for Kong git:master (run 3):
Running 1m test @ http://10.88.145.17:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.52ms    3.37ms  91.95ms   91.52%
    Req/Sec    10.94k     2.50k   29.71k    68.11%
  3268442 requests in 1.00m, 701.19MB read
Requests/sec:  54383.50
Transfer/sec:     11.67MB
### Combined result for Kong git:master:
RPS     Avg: 54601.04
Latency Avg: 2.58ms    Max: 133.65ms
  

Kong error logs are also available in Github Actions artifacts.

Download Artifacts

github-actions[bot] avatar Aug 26 '21 15:08 github-actions[bot]

:rocket: Performance test result

Test Suite: 01-rps 02-flamegraph (baseline,single_route,simple)

Click to expand
Please see Github Actions artifacts for flamegraphs.

  ### Result for upstream directly (run 1):
Running 1m test @ http://10.88.145.21:8088/test
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   589.85us    1.12ms  28.17ms   88.34%
    Req/Sec    88.79k    22.31k  126.61k    67.63%
  26511653 requests in 1.00m, 3.46GB read
Requests/sec: 441521.71
Transfer/sec:     58.95MB
### Result for upstream directly (run 2):
Running 1m test @ http://10.88.145.21:8088/test
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   583.38us    1.13ms  28.25ms   88.58%
    Req/Sec    89.00k    21.78k  126.94k    65.87%
  26575503 requests in 1.00m, 3.47GB read
Requests/sec: 442455.26
Transfer/sec:     59.07MB
### Result for upstream directly (run 3):
Running 1m test @ http://10.88.145.21:8088/test
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   597.48us    1.16ms  28.11ms   88.56%
    Req/Sec    89.08k    22.75k  130.11k    66.83%
  26598270 requests in 1.00m, 3.47GB read
Requests/sec: 442928.91
Transfer/sec:     59.14MB
### Combined result for upstream directly:
RPS     Avg: 442301.96
Latency Avg: nanms    Max: nanms
  
### Test Suite: git:38a8abaaa199297e0bb7ce82b1d8f54ce2c1b2b9 #simple #no_plugins #single_route
### Result for Kong git:38a8abaaa199297e0bb7ce82b1d8f54ce2c1b2b9 (run 1):
Running 1m test @ http://10.88.145.19:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.77ms    4.18ms  98.12ms   90.02%
    Req/Sec    12.68k     3.54k   28.97k    65.02%
  3786498 requests in 1.00m, 812.34MB read
Requests/sec:  63020.92
Transfer/sec:     13.52MB
### Result for Kong git:38a8abaaa199297e0bb7ce82b1d8f54ce2c1b2b9 (run 2):
Running 1m test @ http://10.88.145.19:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.80ms    4.19ms  90.33ms   89.79%
    Req/Sec    12.89k     3.80k   35.53k    65.44%
  3849626 requests in 1.00m, 825.88MB read
Requests/sec:  64053.93
Transfer/sec:     13.74MB
### Result for Kong git:38a8abaaa199297e0bb7ce82b1d8f54ce2c1b2b9 (run 3):
Running 1m test @ http://10.88.145.19:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.85ms    4.50ms  96.60ms   90.71%
    Req/Sec    12.98k     3.88k   28.82k    65.38%
  3877069 requests in 1.00m, 831.77MB read
Requests/sec:  64511.11
Transfer/sec:     13.84MB
### Combined result for Kong git:38a8abaaa199297e0bb7ce82b1d8f54ce2c1b2b9:
RPS     Avg: 63861.99
Latency Avg: 2.81ms    Max: 98.12ms
  
### Test Suite: git:38a8abaaa199297e0bb7ce82b1d8f54ce2c1b2b9 #simple #no_plugins 10 services each has 10 routes
### Result for Kong git:38a8abaaa199297e0bb7ce82b1d8f54ce2c1b2b9 (run 1):
Running 1m test @ http://10.88.145.19:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.59ms    4.29ms  90.82ms   91.16%
    Req/Sec    13.37k     3.65k   26.03k    61.94%
  3993540 requests in 1.00m, 856.75MB read
Requests/sec:  66449.13
Transfer/sec:     14.26MB
### Result for Kong git:38a8abaaa199297e0bb7ce82b1d8f54ce2c1b2b9 (run 2):
Running 1m test @ http://10.88.145.19:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.69ms    4.74ms 124.11ms   91.71%
    Req/Sec    13.45k     3.84k   24.78k    61.86%
  4018686 requests in 1.00m, 862.15MB read
Requests/sec:  66867.35
Transfer/sec:     14.35MB
### Result for Kong git:38a8abaaa199297e0bb7ce82b1d8f54ce2c1b2b9 (run 3):
Running 1m test @ http://10.88.145.19:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.75ms    4.72ms  98.00ms   91.48%
    Req/Sec    13.28k     3.83k   24.08k    62.92%
  3966055 requests in 1.00m, 850.86MB read
Requests/sec:  65991.42
Transfer/sec:     14.16MB
### Combined result for Kong git:38a8abaaa199297e0bb7ce82b1d8f54ce2c1b2b9:
RPS     Avg: 66435.97
Latency Avg: 2.68ms    Max: 124.11ms
  
### Test Suite: git:38a8abaaa199297e0bb7ce82b1d8f54ce2c1b2b9 #simple #key-auth 10 services each has 10 routes with key-auth, 100 consumers
### Result for Kong git:38a8abaaa199297e0bb7ce82b1d8f54ce2c1b2b9 (run 1):
Running 1m test @ http://10.88.145.19:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.80ms    3.84ms  98.41ms   89.51%
    Req/Sec    10.69k     2.48k   21.66k    68.56%
  3194594 requests in 1.00m, 685.35MB read
Requests/sec:  53155.29
Transfer/sec:     11.40MB
### Result for Kong git:38a8abaaa199297e0bb7ce82b1d8f54ce2c1b2b9 (run 2):
Running 1m test @ http://10.88.145.19:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.85ms    3.86ms  94.09ms   89.11%
    Req/Sec    10.66k     2.57k   23.85k    68.08%
  3184155 requests in 1.00m, 683.11MB read
Requests/sec:  52981.25
Transfer/sec:     11.37MB
### Result for Kong git:38a8abaaa199297e0bb7ce82b1d8f54ce2c1b2b9 (run 3):
Running 1m test @ http://10.88.145.19:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.85ms    4.07ms 123.74ms   90.54%
    Req/Sec    10.66k     2.59k   23.41k    67.55%
  3184265 requests in 1.00m, 683.13MB read
Requests/sec:  52983.06
Transfer/sec:     11.37MB
### Combined result for Kong git:38a8abaaa199297e0bb7ce82b1d8f54ce2c1b2b9:
RPS     Avg: 53039.87
Latency Avg: 2.83ms    Max: 123.74ms
  
### Test Suite: git:master #simple #no_plugins #single_route
### Result for Kong git:master (run 1):
Running 1m test @ http://10.88.145.19:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.57ms    4.25ms 116.89ms   91.62%
    Req/Sec    13.17k     3.56k   28.03k    62.26%
  3934088 requests in 1.00m, 844.00MB read
Requests/sec:  65459.22
Transfer/sec:     14.04MB
### Result for Kong git:master (run 2):
Running 1m test @ http://10.88.145.19:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.71ms    4.84ms 113.20ms   92.37%
    Req/Sec    13.00k     3.64k   36.13k    64.15%
  3881867 requests in 1.00m, 832.80MB read
Requests/sec:  64590.73
Transfer/sec:     13.86MB
### Result for Kong git:master (run 3):
Running 1m test @ http://10.88.145.19:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.70ms    4.47ms  89.76ms   91.78%
    Req/Sec    12.90k     3.67k   24.61k    63.89%
  3854885 requests in 1.00m, 827.01MB read
Requests/sec:  64141.53
Transfer/sec:     13.76MB
### Combined result for Kong git:master:
RPS     Avg: 64730.49
Latency Avg: 2.66ms    Max: 116.89ms
  
### Test Suite: git:master #simple #no_plugins 10 services each has 10 routes
### Result for Kong git:master (run 1):
Running 1m test @ http://10.88.145.19:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.53ms    4.02ms 109.09ms   91.31%
    Req/Sec    12.82k     3.44k   22.45k    61.64%
  3829859 requests in 1.00m, 821.64MB read
Requests/sec:  63725.57
Transfer/sec:     13.67MB
### Result for Kong git:master (run 2):
Running 1m test @ http://10.88.145.19:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.62ms    4.31ms 113.24ms   91.86%
    Req/Sec    12.66k     3.49k   23.42k    63.16%
  3782061 requests in 1.00m, 811.38MB read
Requests/sec:  62963.79
Transfer/sec:     13.51MB
### Result for Kong git:master (run 3):
Running 1m test @ http://10.88.145.19:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.69ms    4.50ms 101.11ms   92.10%
    Req/Sec    12.63k     3.45k   32.60k    63.01%
  3769768 requests in 1.00m, 808.75MB read
Requests/sec:  62725.33
Transfer/sec:     13.46MB
### Combined result for Kong git:master:
RPS     Avg: 63138.23
Latency Avg: 2.61ms    Max: 113.24ms
  
### Test Suite: git:master #simple #key-auth 10 services each has 10 routes with key-auth, 100 consumers
### Result for Kong git:master (run 1):
Running 1m test @ http://10.88.145.19:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.74ms    3.87ms 137.17ms   90.77%
    Req/Sec    10.57k     2.46k   18.56k    67.37%
  3158047 requests in 1.00m, 677.50MB read
Requests/sec:  52546.60
Transfer/sec:     11.27MB
### Result for Kong git:master (run 2):
Running 1m test @ http://10.88.145.19:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.70ms    3.83ms 111.16ms   91.64%
    Req/Sec    10.51k     2.42k   18.55k    67.33%
  3137943 requests in 1.00m, 673.19MB read
Requests/sec:  52247.45
Transfer/sec:     11.21MB
### Result for Kong git:master (run 3):
Running 1m test @ http://10.88.145.19:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.66ms    3.54ms  89.16ms   91.04%
    Req/Sec    10.46k     2.43k   21.48k    67.80%
  3122793 requests in 1.00m, 669.94MB read
Requests/sec:  52023.20
Transfer/sec:     11.16MB
### Combined result for Kong git:master:
RPS     Avg: 52272.42
Latency Avg: 2.70ms    Max: 137.17ms
  

Kong error logs are also available in Github Actions artifacts.

Download Artifacts

github-actions[bot] avatar Aug 26 '21 17:08 github-actions[bot]

:rocket: Performance test result

Test Suite: 01-rps 02-flamegraph (baseline,single_route,simple)

Click to expand
Please see Github Actions artifacts for flamegraphs.

  ### Result for upstream directly (run 1):
Running 1m test @ http://10.88.145.23:8088/test
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   600.13us    1.18ms  36.46ms   88.51%
    Req/Sec    91.56k    21.97k  130.15k    67.13%
  27333545 requests in 1.00m, 3.56GB read
Requests/sec: 455091.18
Transfer/sec:     60.76MB
### Result for upstream directly (run 2):
Running 1m test @ http://10.88.145.23:8088/test
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   597.19us    1.14ms  28.10ms   88.04%
    Req/Sec    91.47k    22.74k  127.15k    68.80%
  27312818 requests in 1.00m, 3.56GB read
Requests/sec: 454824.14
Transfer/sec:     60.73MB
### Result for upstream directly (run 3):
Running 1m test @ http://10.88.145.23:8088/test
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   621.27us    1.19ms  44.14ms   87.92%
    Req/Sec    91.56k    24.02k  127.88k    69.37%
  27333834 requests in 1.00m, 3.56GB read
Requests/sec: 455203.67
Transfer/sec:     60.78MB
### Combined result for upstream directly:
RPS     Avg: 455039.66
Latency Avg: nanms    Max: nanms
  
### Test Suite: git:3acef6adf7148572425294d8e4b773c29ebb2885 #simple #no_plugins #single_route
### Result for Kong git:3acef6adf7148572425294d8e4b773c29ebb2885 (run 1):
Running 1m test @ http://10.88.145.25:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     3.14ms    4.66ms 139.05ms   88.72%
    Req/Sec    12.19k     3.83k   28.42k    66.76%
  3640251 requests in 1.00m, 780.96MB read
Requests/sec:  60570.86
Transfer/sec:     12.99MB
### Result for Kong git:3acef6adf7148572425294d8e4b773c29ebb2885 (run 2):
Running 1m test @ http://10.88.145.25:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.98ms    4.52ms 108.61ms   89.42%
    Req/Sec    12.41k     3.89k   38.10k    66.01%
  3705103 requests in 1.00m, 794.87MB read
Requests/sec:  61648.98
Transfer/sec:     13.23MB
### Result for Kong git:3acef6adf7148572425294d8e4b773c29ebb2885 (run 3):
Running 1m test @ http://10.88.145.25:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.99ms    4.70ms 121.31ms   90.38%
    Req/Sec    12.45k     3.70k   27.66k    65.44%
  3717559 requests in 1.00m, 797.55MB read
Requests/sec:  61857.06
Transfer/sec:     13.27MB
### Combined result for Kong git:3acef6adf7148572425294d8e4b773c29ebb2885:
RPS     Avg: 61358.97
Latency Avg: 3.04ms    Max: 139.05ms
  
### Test Suite: git:3acef6adf7148572425294d8e4b773c29ebb2885 #simple #no_plugins 10 services each has 10 routes
### Result for Kong git:3acef6adf7148572425294d8e4b773c29ebb2885 (run 1):
Running 1m test @ http://10.88.145.25:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.79ms    4.65ms 129.88ms   91.62%
    Req/Sec    12.81k     3.67k   29.02k    63.78%
  3825871 requests in 1.00m, 820.79MB read
Requests/sec:  63659.00
Transfer/sec:     13.66MB
### Result for Kong git:3acef6adf7148572425294d8e4b773c29ebb2885 (run 2):
Running 1m test @ http://10.88.145.25:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.92ms    5.26ms 120.22ms   92.13%
    Req/Sec    12.76k     3.77k   24.22k    64.90%
  3807778 requests in 1.00m, 816.90MB read
Requests/sec:  63441.52
Transfer/sec:     13.61MB
### Result for Kong git:3acef6adf7148572425294d8e4b773c29ebb2885 (run 3):
Running 1m test @ http://10.88.145.25:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.87ms    5.16ms 110.53ms   92.19%
    Req/Sec    12.79k     3.77k   23.54k    64.31%
  3818147 requests in 1.00m, 819.13MB read
Requests/sec:  63530.27
Transfer/sec:     13.63MB
### Combined result for Kong git:3acef6adf7148572425294d8e4b773c29ebb2885:
RPS     Avg: 63543.60
Latency Avg: 2.86ms    Max: 129.88ms
  
### Test Suite: git:3acef6adf7148572425294d8e4b773c29ebb2885 #simple #key-auth 10 services each has 10 routes with key-auth, 100 consumers
### Result for Kong git:3acef6adf7148572425294d8e4b773c29ebb2885 (run 1):
Running 1m test @ http://10.88.145.25:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.67ms    3.31ms  82.42ms   89.68%
    Req/Sec    10.27k     2.35k   19.68k    68.42%
  3071755 requests in 1.00m, 658.99MB read
Requests/sec:  51111.28
Transfer/sec:     10.97MB
### Result for Kong git:3acef6adf7148572425294d8e4b773c29ebb2885 (run 2):
Running 1m test @ http://10.88.145.25:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.64ms    3.27ms  81.49ms   90.14%
    Req/Sec    10.14k     2.27k   19.37k    68.57%
  3025872 requests in 1.00m, 649.15MB read
Requests/sec:  50404.10
Transfer/sec:     10.81MB
### Result for Kong git:3acef6adf7148572425294d8e4b773c29ebb2885 (run 3):
Running 1m test @ http://10.88.145.25:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.57ms    3.16ms  94.12ms   91.21%
    Req/Sec    10.08k     2.19k   19.52k    68.85%
  3011389 requests in 1.00m, 646.04MB read
Requests/sec:  50106.81
Transfer/sec:     10.75MB
### Combined result for Kong git:3acef6adf7148572425294d8e4b773c29ebb2885:
RPS     Avg: 50540.73
Latency Avg: 2.63ms    Max: 94.12ms
  
### Test Suite: git:master #simple #no_plugins #single_route
### Result for Kong git:master (run 1):
Running 1m test @ http://10.88.145.25:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.63ms    4.36ms 115.12ms   92.65%
    Req/Sec    12.36k     3.29k   34.70k    65.14%
  3690615 requests in 1.00m, 791.76MB read
Requests/sec:  61408.62
Transfer/sec:     13.17MB
### Result for Kong git:master (run 2):
Running 1m test @ http://10.88.145.25:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.70ms    5.15ms 184.34ms   93.64%
    Req/Sec    12.33k     3.18k   21.13k    64.70%
  3679176 requests in 1.00m, 789.31MB read
Requests/sec:  61270.13
Transfer/sec:     13.14MB
### Result for Kong git:master (run 3):
Running 1m test @ http://10.88.145.25:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.74ms    4.46ms 108.95ms   92.13%
    Req/Sec    12.09k     3.31k   21.24k    64.63%
  3609787 requests in 1.00m, 774.42MB read
Requests/sec:  60137.74
Transfer/sec:     12.90MB
### Combined result for Kong git:master:
RPS     Avg: 60938.83
Latency Avg: 2.69ms    Max: 184.34ms
  
### Test Suite: git:master #simple #no_plugins 10 services each has 10 routes
### Result for Kong git:master (run 1):
Running 1m test @ http://10.88.145.25:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.70ms    4.48ms 109.01ms   91.83%
    Req/Sec    12.64k     3.56k   22.80k    64.12%
  3776953 requests in 1.00m, 810.29MB read
Requests/sec:  62845.41
Transfer/sec:     13.48MB
### Result for Kong git:master (run 2):
Running 1m test @ http://10.88.145.25:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.76ms    4.73ms 108.27ms   92.19%
    Req/Sec    12.61k     3.54k   23.32k    64.57%
  3762876 requests in 1.00m, 807.27MB read
Requests/sec:  62683.53
Transfer/sec:     13.45MB
### Result for Kong git:master (run 3):
Running 1m test @ http://10.88.145.25:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.78ms    4.81ms 125.74ms   92.00%
    Req/Sec    12.64k     3.62k   22.99k    62.90%
  3777179 requests in 1.00m, 810.34MB read
Requests/sec:  62848.84
Transfer/sec:     13.48MB
### Combined result for Kong git:master:
RPS     Avg: 62792.59
Latency Avg: 2.75ms    Max: 125.74ms
  
### Test Suite: git:master #simple #key-auth 10 services each has 10 routes with key-auth, 100 consumers
### Result for Kong git:master (run 1):
Running 1m test @ http://10.88.145.25:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.61ms    3.57ms  81.40ms   91.32%
    Req/Sec    10.81k     2.55k   21.52k    67.26%
  3228975 requests in 1.00m, 692.72MB read
Requests/sec:  53747.75
Transfer/sec:     11.53MB
### Result for Kong git:master (run 2):
Running 1m test @ http://10.88.145.25:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.57ms    3.65ms  83.25ms   92.84%
    Req/Sec    10.77k     2.39k   18.16k    67.13%
  3215266 requests in 1.00m, 689.78MB read
Requests/sec:  53537.86
Transfer/sec:     11.49MB
### Result for Kong git:master (run 3):
Running 1m test @ http://10.88.145.25:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.73ms    4.34ms 124.99ms   93.69%
    Req/Sec    10.61k     2.61k   19.49k    69.67%
  3166329 requests in 1.00m, 679.28MB read
Requests/sec:  52727.09
Transfer/sec:     11.31MB
### Combined result for Kong git:master:
RPS     Avg: 53337.57
Latency Avg: 2.64ms    Max: 124.99ms
  

Kong error logs are also available in Github Actions artifacts.

Download Artifacts

github-actions[bot] avatar Aug 26 '21 18:08 github-actions[bot]

:rocket: Performance test result

Test Suite: 01-rps 02-flamegraph (baseline,single_route,simple)

Click to expand
Please see Github Actions artifacts for flamegraphs.

  ### Result for upstream directly (run 1):
Running 1m test @ http://10.88.145.17:8088/test
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   581.54us    1.11ms  28.08ms   88.31%
    Req/Sec    90.97k    21.51k  128.92k    68.27%
  27160824 requests in 1.00m, 3.54GB read
Requests/sec: 452185.44
Transfer/sec:     60.37MB
### Result for upstream directly (run 2):
Running 1m test @ http://10.88.145.17:8088/test
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   591.71us    1.16ms  39.97ms   88.58%
    Req/Sec    90.95k    21.35k  126.20k    66.77%
  27159428 requests in 1.00m, 3.54GB read
Requests/sec: 452143.47
Transfer/sec:     60.37MB
### Result for upstream directly (run 3):
Running 1m test @ http://10.88.145.17:8088/test
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   632.03us    1.21ms  28.11ms   87.94%
    Req/Sec    90.88k    22.49k  127.60k    66.50%
  27133028 requests in 1.00m, 3.54GB read
Requests/sec: 451851.11
Transfer/sec:     60.33MB
### Combined result for upstream directly:
RPS     Avg: 452060.01
Latency Avg: nanms    Max: nanms
  
### Test Suite: git:14a41bc47f2c8e4952e24d7acddfa7f33ac8af30 #simple #no_plugins #single_route
### Result for Kong git:14a41bc47f2c8e4952e24d7acddfa7f33ac8af30 (run 1):
Running 1m test @ http://10.88.145.15:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.56ms    4.19ms 120.51ms   91.26%
    Req/Sec    13.47k     3.60k   23.82k    61.53%
  4024065 requests in 1.00m, 863.30MB read
Requests/sec:  66956.47
Transfer/sec:     14.36MB
### Result for Kong git:14a41bc47f2c8e4952e24d7acddfa7f33ac8af30 (run 2):
Running 1m test @ http://10.88.145.15:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.70ms    4.37ms  89.33ms   91.46%
    Req/Sec    13.06k     3.78k   27.48k    62.99%
  3899516 requests in 1.00m, 836.58MB read
Requests/sec:  64883.86
Transfer/sec:     13.92MB
### Result for Kong git:14a41bc47f2c8e4952e24d7acddfa7f33ac8af30 (run 3):
Running 1m test @ http://10.88.145.15:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.75ms    4.62ms 110.53ms   91.91%
    Req/Sec    12.97k     3.73k   33.84k    63.81%
  3873783 requests in 1.00m, 831.06MB read
Requests/sec:  64456.40
Transfer/sec:     13.83MB
### Combined result for Kong git:14a41bc47f2c8e4952e24d7acddfa7f33ac8af30:
RPS     Avg: 65432.24
Latency Avg: 2.67ms    Max: 120.51ms
  
### Test Suite: git:14a41bc47f2c8e4952e24d7acddfa7f33ac8af30 #simple #no_plugins 10 services each has 10 routes
### Result for Kong git:14a41bc47f2c8e4952e24d7acddfa7f33ac8af30 (run 1):
Running 1m test @ http://10.88.145.15:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.55ms    4.10ms  90.11ms   90.85%
    Req/Sec    13.29k     3.62k   25.83k    62.50%
  3972655 requests in 1.00m, 852.27MB read
Requests/sec:  66100.93
Transfer/sec:     14.18MB
### Result for Kong git:14a41bc47f2c8e4952e24d7acddfa7f33ac8af30 (run 2):
Running 1m test @ http://10.88.145.15:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.70ms    4.55ms 102.27ms   91.62%
    Req/Sec    13.02k     3.75k   36.94k    63.55%
  3889124 requests in 1.00m, 834.35MB read
Requests/sec:  64711.68
Transfer/sec:     13.88MB
### Result for Kong git:14a41bc47f2c8e4952e24d7acddfa7f33ac8af30 (run 3):
Running 1m test @ http://10.88.145.15:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.76ms    4.79ms 154.60ms   91.57%
    Req/Sec    13.08k     3.71k   23.24k    61.60%
  3903296 requests in 1.00m, 837.40MB read
Requests/sec:  64996.92
Transfer/sec:     13.94MB
### Combined result for Kong git:14a41bc47f2c8e4952e24d7acddfa7f33ac8af30:
RPS     Avg: 65269.84
Latency Avg: 2.67ms    Max: 154.60ms
  
### Test Suite: git:14a41bc47f2c8e4952e24d7acddfa7f33ac8af30 #simple #key-auth 10 services each has 10 routes with key-auth, 100 consumers
### Result for Kong git:14a41bc47f2c8e4952e24d7acddfa7f33ac8af30 (run 1):
Running 1m test @ http://10.88.145.15:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.99ms    4.15ms 136.48ms   88.21%
    Req/Sec    10.92k     2.83k   21.31k    66.48%
  3263701 requests in 1.00m, 700.18MB read
Requests/sec:  54304.72
Transfer/sec:     11.65MB
### Result for Kong git:14a41bc47f2c8e4952e24d7acddfa7f33ac8af30 (run 2):
Running 1m test @ http://10.88.145.15:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     3.02ms    4.19ms  91.25ms   88.56%
    Req/Sec    10.71k     2.84k   21.67k    67.05%
  3201697 requests in 1.00m, 686.87MB read
Requests/sec:  53272.84
Transfer/sec:     11.43MB
### Result for Kong git:14a41bc47f2c8e4952e24d7acddfa7f33ac8af30 (run 3):
Running 1m test @ http://10.88.145.15:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     3.05ms    4.42ms 123.69ms   89.10%
    Req/Sec    10.57k     2.86k   27.36k    68.31%
  3155032 requests in 1.00m, 676.86MB read
Requests/sec:  52496.86
Transfer/sec:     11.26MB
### Combined result for Kong git:14a41bc47f2c8e4952e24d7acddfa7f33ac8af30:
RPS     Avg: 53358.14
Latency Avg: 3.02ms    Max: 136.48ms
  
### Test Suite: git:master #simple #no_plugins #single_route
### Result for Kong git:master (run 1):
Running 1m test @ http://10.88.145.15:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.87ms    4.32ms  92.19ms   89.55%
    Req/Sec    12.60k     3.69k   24.02k    63.69%
  3762848 requests in 1.00m, 807.26MB read
Requests/sec:  62610.05
Transfer/sec:     13.43MB
### Result for Kong git:master (run 2):
Running 1m test @ http://10.88.145.15:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.95ms    4.62ms 141.69ms   89.82%
    Req/Sec    12.34k     3.75k   31.97k    64.71%
  3684153 requests in 1.00m, 790.38MB read
Requests/sec:  61301.05
Transfer/sec:     13.15MB
### Result for Kong git:master (run 3):
Running 1m test @ http://10.88.145.15:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     3.07ms    4.92ms 159.42ms   90.10%
    Req/Sec    12.18k     3.82k   24.59k    66.27%
  3636548 requests in 1.00m, 780.17MB read
Requests/sec:  60587.59
Transfer/sec:     13.00MB
### Combined result for Kong git:master:
RPS     Avg: 61499.56
Latency Avg: 2.96ms    Max: 159.42ms
  
### Test Suite: git:master #simple #no_plugins 10 services each has 10 routes
### Result for Kong git:master (run 1):
Running 1m test @ http://10.88.145.15:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.80ms    4.81ms 112.48ms   91.84%
    Req/Sec    12.60k     3.74k   23.91k    64.76%
  3767997 requests in 1.00m, 808.37MB read
Requests/sec:  62695.56
Transfer/sec:     13.45MB
### Result for Kong git:master (run 2):
Running 1m test @ http://10.88.145.15:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.74ms    4.47ms 110.50ms   91.58%
    Req/Sec    12.63k     3.62k   24.22k    63.58%
  3775685 requests in 1.00m, 810.02MB read
Requests/sec:  62823.56
Transfer/sec:     13.48MB
### Result for Kong git:master (run 3):
Running 1m test @ http://10.88.145.15:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.74ms    4.65ms 109.39ms   91.78%
    Req/Sec    12.70k     3.51k   22.48k    63.16%
  3792949 requests in 1.00m, 813.72MB read
Requests/sec:  63111.72
Transfer/sec:     13.54MB
### Combined result for Kong git:master:
RPS     Avg: 62876.95
Latency Avg: 2.76ms    Max: 112.48ms
  
### Test Suite: git:master #simple #key-auth 10 services each has 10 routes with key-auth, 100 consumers
### Result for Kong git:master (run 1):
Running 1m test @ http://10.88.145.15:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.46ms    3.08ms 103.10ms   91.33%
    Req/Sec    10.74k     2.31k   18.95k    66.41%
  3209081 requests in 1.00m, 688.45MB read
Requests/sec:  53395.84
Transfer/sec:     11.46MB
### Result for Kong git:master (run 2):
Running 1m test @ http://10.88.145.15:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.71ms    4.05ms 108.28ms   92.48%
    Req/Sec    10.56k     2.41k   17.85k    69.00%
  3150999 requests in 1.00m, 675.99MB read
Requests/sec:  52487.92
Transfer/sec:     11.26MB
### Result for Kong git:master (run 3):
Running 1m test @ http://10.88.145.15:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.79ms    4.61ms 138.45ms   93.86%
    Req/Sec    10.44k     2.54k   23.29k    69.89%
  3119438 requests in 1.00m, 669.22MB read
Requests/sec:  51904.08
Transfer/sec:     11.14MB
### Combined result for Kong git:master:
RPS     Avg: 52595.95
Latency Avg: 2.65ms    Max: 138.45ms
  

Kong error logs are also available in Github Actions artifacts.

Download Artifacts

github-actions[bot] avatar Aug 27 '21 15:08 github-actions[bot]

Will this affect things like the log serializer so that those upstream headers are returned as request headers?

https://github.com/Kong/kong/blob/master/kong/pdk/log.lua#L677

dndx avatar Sep 01 '21 17:09 dndx

@dndx yes it will since log_serialzer is in log phase. how do you think for this caveats? maybe we just hide all x-forwarded- headers in log_serializer?

fffonion avatar Sep 02 '21 09:09 fffonion

:rocket: Performance test result

Test Suite: 01-rps 02-flamegraph (baseline,single_route,simple)

Click to expand
Please see Github Actions artifacts for flamegraphs.

  ### Result for upstream directly (run 1):
Running 1m test @ http://10.88.145.13:8088/test
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   550.61us    1.06ms  28.23ms   88.87%
    Req/Sec    89.11k    21.27k  127.38k    66.93%
  26608879 requests in 1.00m, 3.47GB read
Requests/sec: 443112.77
Transfer/sec:     59.16MB
### Result for upstream directly (run 2):
Running 1m test @ http://10.88.145.13:8088/test
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   555.57us    1.08ms  28.09ms   88.92%
    Req/Sec    89.12k    21.03k  128.73k    66.63%
  26609128 requests in 1.00m, 3.47GB read
Requests/sec: 442933.98
Transfer/sec:     59.14MB
### Result for upstream directly (run 3):
Running 1m test @ http://10.88.145.13:8088/test
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   557.50us    1.10ms  28.37ms   89.20%
    Req/Sec    89.34k    21.52k  128.75k    66.60%
  26678061 requests in 1.00m, 3.48GB read
Requests/sec: 444100.97
Transfer/sec:     59.29MB
### Combined result for upstream directly:
RPS     Avg: 443382.57
Latency Avg: nanms    Max: nanms
  
### Test Suite: git:7e151bf4afab3c3265673bca853d7c7db323829d #simple #no_plugins #single_route
### Result for Kong git:7e151bf4afab3c3265673bca853d7c7db323829d (run 1):
Running 1m test @ http://10.88.145.15:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     8.08ms    9.60ms   1.03s    91.56%
    Req/Sec     2.76k   653.74     5.85k    68.57%
  823914 requests in 1.00m, 176.80MB read
Requests/sec:  13724.76
Transfer/sec:      2.95MB
### Result for Kong git:7e151bf4afab3c3265673bca853d7c7db323829d (run 2):
Running 1m test @ http://10.88.145.15:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     8.73ms   10.00ms 253.69ms   90.61%
    Req/Sec     2.74k   658.76     6.06k    70.10%
  817777 requests in 1.00m, 175.49MB read
Requests/sec:  13620.33
Transfer/sec:      2.92MB
### Result for Kong git:7e151bf4afab3c3265673bca853d7c7db323829d (run 3):
Running 1m test @ http://10.88.145.15:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     8.04ms    6.48ms  97.57ms   68.97%
    Req/Sec     2.76k   621.45     6.64k    69.80%
  823509 requests in 1.00m, 176.71MB read
Requests/sec:  13717.84
Transfer/sec:      2.94MB
### Combined result for Kong git:7e151bf4afab3c3265673bca853d7c7db323829d:
RPS     Avg: 13687.64
Latency Avg: 8.28ms    Max: 1030.00ms
  
### Test Suite: git:7e151bf4afab3c3265673bca853d7c7db323829d #simple #no_plugins 10 services each has 10 routes
### Result for Kong git:7e151bf4afab3c3265673bca853d7c7db323829d (run 1):
Running 1m test @ http://10.88.145.15:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     7.33ms    6.85ms  91.37ms   84.58%
    Req/Sec     3.32k   762.66     6.84k    69.92%
  992058 requests in 1.00m, 212.88MB read
Requests/sec:  16513.20
Transfer/sec:      3.54MB
### Result for Kong git:7e151bf4afab3c3265673bca853d7c7db323829d (run 2):
Running 1m test @ http://10.88.145.15:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     6.42ms    4.83ms  66.26ms   71.00%
    Req/Sec     3.38k   665.32     6.34k    68.63%
  1008157 requests in 1.00m, 216.29MB read
Requests/sec:  16796.29
Transfer/sec:      3.60MB
### Result for Kong git:7e151bf4afab3c3265673bca853d7c7db323829d (run 3):
Running 1m test @ http://10.88.145.15:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     6.83ms    5.91ms 100.95ms   77.75%
    Req/Sec     3.35k   724.20     7.18k    71.42%
  1000194 requests in 1.00m, 214.60MB read
Requests/sec:  16648.39
Transfer/sec:      3.57MB
### Combined result for Kong git:7e151bf4afab3c3265673bca853d7c7db323829d:
RPS     Avg: 16652.63
Latency Avg: 6.86ms    Max: 100.95ms
  
### Test Suite: git:7e151bf4afab3c3265673bca853d7c7db323829d #simple #key-auth 10 services each has 10 routes with key-auth, 100 consumers
### Result for Kong git:7e151bf4afab3c3265673bca853d7c7db323829d (run 1):
Running 1m test @ http://10.88.145.15:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency    10.05ms   10.33ms 225.30ms   86.24%
    Req/Sec     2.53k   670.01     5.28k    71.15%
  756848 requests in 1.00m, 162.44MB read
Requests/sec:  12597.97
Transfer/sec:      2.70MB
### Result for Kong git:7e151bf4afab3c3265673bca853d7c7db323829d (run 2):
Running 1m test @ http://10.88.145.15:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     8.61ms    7.40ms  96.32ms   75.53%
    Req/Sec     2.68k   602.05     5.57k    68.10%
  799713 requests in 1.00m, 171.62MB read
Requests/sec:  13320.51
Transfer/sec:      2.86MB
### Result for Kong git:7e151bf4afab3c3265673bca853d7c7db323829d (run 3):
Running 1m test @ http://10.88.145.15:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency    10.02ms   10.23ms 118.06ms   84.34%
    Req/Sec     2.65k   707.89     5.66k    70.72%
  790311 requests in 1.00m, 169.63MB read
Requests/sec:  13154.83
Transfer/sec:      2.82MB
### Combined result for Kong git:7e151bf4afab3c3265673bca853d7c7db323829d:
RPS     Avg: 13024.44
Latency Avg: 9.55ms    Max: 225.30ms
  
### Test Suite: git:master #simple #no_plugins #single_route
### Result for Kong git:master (run 1):
Running 1m test @ http://10.88.145.15:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency    11.29ms   13.13ms 121.20ms   82.31%
    Req/Sec     2.99k     1.07k    7.18k    68.10%
  893950 requests in 1.00m, 191.88MB read
Requests/sec:  14891.49
Transfer/sec:      3.20MB
### Result for Kong git:master (run 2):
Running 1m test @ http://10.88.145.15:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency    10.93ms   12.58ms 119.60ms   81.94%
    Req/Sec     3.04k     0.99k    7.30k    69.30%
  906441 requests in 1.00m, 194.55MB read
Requests/sec:  15099.53
Transfer/sec:      3.24MB
### Result for Kong git:master (run 3):
Running 1m test @ http://10.88.145.15:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency    10.74ms   12.29ms 116.88ms   82.49%
    Req/Sec     3.03k     0.90k    6.57k    69.07%
  903337 requests in 1.00m, 193.89MB read
Requests/sec:  15048.56
Transfer/sec:      3.23MB
### Combined result for Kong git:master:
RPS     Avg: 15013.19
Latency Avg: 10.99ms    Max: 121.20ms
  
### Test Suite: git:master #simple #no_plugins 10 services each has 10 routes
### Result for Kong git:master (run 1):
Running 1m test @ http://10.88.145.15:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     6.83ms    5.45ms  66.86ms   71.10%
    Req/Sec     3.26k   703.75     7.08k    69.65%
  973843 requests in 1.00m, 208.95MB read
Requests/sec:  16211.38
Transfer/sec:      3.48MB
### Result for Kong git:master (run 2):
Running 1m test @ http://10.88.145.15:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     6.65ms    5.04ms  55.50ms   68.47%
    Req/Sec     3.28k   676.46     6.53k    70.45%
  978503 requests in 1.00m, 209.94MB read
Requests/sec:  16289.22
Transfer/sec:      3.49MB
### Result for Kong git:master (run 3):
Running 1m test @ http://10.88.145.15:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     6.75ms    5.34ms  80.53ms   71.37%
    Req/Sec     3.28k   691.66     7.62k    69.55%
  980122 requests in 1.00m, 210.29MB read
Requests/sec:  16316.47
Transfer/sec:      3.50MB
### Combined result for Kong git:master:
RPS     Avg: 16272.36
Latency Avg: 6.74ms    Max: 80.53ms
  
### Test Suite: git:master #simple #key-auth 10 services each has 10 routes with key-auth, 100 consumers
### Result for Kong git:master (run 1):
Running 1m test @ http://10.88.145.15:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     8.19ms    6.39ms 274.58ms   75.27%
    Req/Sec     2.60k   536.44     4.92k    70.33%
  777072 requests in 1.00m, 166.73MB read
Requests/sec:  12942.30
Transfer/sec:      2.78MB
### Result for Kong git:master (run 2):
Running 1m test @ http://10.88.145.15:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     8.65ms    7.18ms 130.50ms   75.94%
    Req/Sec     2.59k   573.43     5.12k    70.25%
  773871 requests in 1.00m, 166.06MB read
Requests/sec:  12882.89
Transfer/sec:      2.76MB
### Result for Kong git:master (run 3):
Running 1m test @ http://10.88.145.15:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     8.25ms    6.01ms  87.86ms   68.99%
    Req/Sec     2.60k   531.73     4.93k    69.09%
  775835 requests in 1.00m, 166.47MB read
Requests/sec:  12920.76
Transfer/sec:      2.77MB
### Combined result for Kong git:master:
RPS     Avg: 12915.32
Latency Avg: 8.36ms    Max: 274.58ms
  

Kong error logs are also available in Github Actions artifacts.

Download Artifacts

github-actions[bot] avatar Sep 02 '21 10:09 github-actions[bot]

:rocket: Performance test result

Test Suite: 01-rps 02-flamegraph (baseline,single_route,simple)

Click to expand
Please see Github Actions artifacts for flamegraphs.

  ### Result for upstream directly (run 1):
Running 1m test @ http://10.88.145.5:8088/test
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   560.53us    1.06ms  24.14ms   88.91%
    Req/Sec    84.61k    20.73k  119.73k    67.27%
  25262236 requests in 1.00m, 3.29GB read
Requests/sec: 420678.76
Transfer/sec:     56.17MB
### Result for upstream directly (run 2):
Running 1m test @ http://10.88.145.5:8088/test
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   549.63us    1.05ms  28.11ms   89.17%
    Req/Sec    84.63k    20.29k  119.90k    67.27%
  25269107 requests in 1.00m, 3.29GB read
Requests/sec: 420659.68
Transfer/sec:     56.16MB
### Result for upstream directly (run 3):
Running 1m test @ http://10.88.145.5:8088/test
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   536.03us    1.02ms  28.18ms   89.28%
    Req/Sec    84.60k    20.04k  123.38k    66.60%
  25257048 requests in 1.00m, 3.29GB read
Requests/sec: 420502.52
Transfer/sec:     56.14MB
### Combined result for upstream directly:
RPS     Avg: 420613.65
Latency Avg: nanms    Max: nanms
  
### Test Suite: git:7e151bf4afab3c3265673bca853d7c7db323829d #simple #no_plugins #single_route
### Result for Kong git:7e151bf4afab3c3265673bca853d7c7db323829d (run 1):
Running 1m test @ http://10.88.145.7:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.54ms    4.17ms 102.57ms   91.09%
    Req/Sec    13.58k     3.75k   26.53k    62.23%
  4057909 requests in 1.00m, 0.85GB read
Requests/sec:  67519.32
Transfer/sec:     14.49MB
### Result for Kong git:7e151bf4afab3c3265673bca853d7c7db323829d (run 2):
Running 1m test @ http://10.88.145.7:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.57ms    4.20ms  85.57ms   91.29%
    Req/Sec    13.41k     3.80k   36.94k    62.48%
  4005294 requests in 1.00m, 859.28MB read
Requests/sec:  66643.89
Transfer/sec:     14.30MB
### Result for Kong git:7e151bf4afab3c3265673bca853d7c7db323829d (run 3):
Running 1m test @ http://10.88.145.7:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.71ms    4.78ms 148.46ms   92.04%
    Req/Sec    13.35k     3.90k   36.28k    63.95%
  3985320 requests in 1.00m, 854.99MB read
Requests/sec:  66312.35
Transfer/sec:     14.23MB
### Combined result for Kong git:7e151bf4afab3c3265673bca853d7c7db323829d:
RPS     Avg: 66825.19
Latency Avg: 2.61ms    Max: 148.46ms
  
### Test Suite: git:7e151bf4afab3c3265673bca853d7c7db323829d #simple #no_plugins 10 services each has 10 routes
### Result for Kong git:7e151bf4afab3c3265673bca853d7c7db323829d (run 1):
Running 1m test @ http://10.88.145.7:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.70ms    4.21ms 123.76ms   91.50%
    Req/Sec    12.05k     3.31k   23.64k    64.86%
  3602100 requests in 1.00m, 772.77MB read
Requests/sec:  59935.17
Transfer/sec:     12.86MB
### Result for Kong git:7e151bf4afab3c3265673bca853d7c7db323829d (run 2):
Running 1m test @ http://10.88.145.7:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     3.07ms    5.39ms 137.20ms   93.09%
    Req/Sec    11.78k     3.52k   24.00k    66.47%
  3515800 requests in 1.00m, 754.26MB read
Requests/sec:  58560.08
Transfer/sec:     12.56MB
### Result for Kong git:7e151bf4afab3c3265673bca853d7c7db323829d (run 3):
Running 1m test @ http://10.88.145.7:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.84ms    4.87ms 133.65ms   92.74%
    Req/Sec    11.95k     3.34k   24.37k    66.12%
  3568277 requests in 1.00m, 765.52MB read
Requests/sec:  59372.28
Transfer/sec:     12.74MB
### Combined result for Kong git:7e151bf4afab3c3265673bca853d7c7db323829d:
RPS     Avg: 59289.18
Latency Avg: 2.87ms    Max: 137.20ms
  
### Test Suite: git:7e151bf4afab3c3265673bca853d7c7db323829d #simple #key-auth 10 services each has 10 routes with key-auth, 100 consumers
### Result for Kong git:7e151bf4afab3c3265673bca853d7c7db323829d (run 1):
Running 1m test @ http://10.88.145.7:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.43ms    3.22ms  77.62ms   92.70%
    Req/Sec    10.97k     2.40k   20.19k    68.59%
  3277047 requests in 1.00m, 703.03MB read
Requests/sec:  54527.00
Transfer/sec:     11.70MB
### Result for Kong git:7e151bf4afab3c3265673bca853d7c7db323829d (run 2):
Running 1m test @ http://10.88.145.7:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.54ms    3.59ms  95.14ms   92.53%
    Req/Sec    11.00k     2.48k   19.49k    68.11%
  3286692 requests in 1.00m, 705.10MB read
Requests/sec:  54687.21
Transfer/sec:     11.73MB
### Result for Kong git:7e151bf4afab3c3265673bca853d7c7db323829d (run 3):
Running 1m test @ http://10.88.145.7:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.61ms    3.58ms  87.24ms   91.12%
    Req/Sec    10.88k     2.57k   19.25k    66.26%
  3253420 requests in 1.00m, 697.97MB read
Requests/sec:  54133.53
Transfer/sec:     11.61MB
### Combined result for Kong git:7e151bf4afab3c3265673bca853d7c7db323829d:
RPS     Avg: 54449.25
Latency Avg: 2.53ms    Max: 95.14ms
  
### Test Suite: git:master #simple #no_plugins #single_route
### Result for Kong git:master (run 1):
Running 1m test @ http://10.88.145.7:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.63ms    4.25ms  92.93ms   91.57%
    Req/Sec    12.88k     3.55k   23.82k    63.09%
  3848712 requests in 1.00m, 825.68MB read
Requests/sec:  64038.50
Transfer/sec:     13.74MB
### Result for Kong git:master (run 2):
Running 1m test @ http://10.88.145.7:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.56ms    4.15ms 122.23ms   91.74%
    Req/Sec    12.89k     3.57k   34.06k    62.85%
  3849344 requests in 1.00m, 825.82MB read
Requests/sec:  64049.04
Transfer/sec:     13.74MB
### Result for Kong git:master (run 3):
Running 1m test @ http://10.88.145.7:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.72ms    4.54ms 113.50ms   91.99%
    Req/Sec    12.76k     3.53k   23.85k    63.82%
  3812602 requests in 1.00m, 817.94MB read
Requests/sec:  63438.44
Transfer/sec:     13.61MB
### Combined result for Kong git:master:
RPS     Avg: 63841.99
Latency Avg: 2.64ms    Max: 122.23ms
  
### Test Suite: git:master #simple #no_plugins 10 services each has 10 routes
### Result for Kong git:master (run 1):
Running 1m test @ http://10.88.145.7:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.57ms    4.22ms  88.58ms   91.64%
    Req/Sec    12.87k     3.44k   22.94k    62.50%
  3847022 requests in 1.00m, 825.32MB read
Requests/sec:  64010.52
Transfer/sec:     13.73MB
### Result for Kong git:master (run 2):
Running 1m test @ http://10.88.145.7:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.71ms    4.65ms 136.01ms   92.25%
    Req/Sec    12.70k     3.49k   23.79k    64.09%
  3798901 requests in 1.00m, 815.00MB read
Requests/sec:  63209.93
Transfer/sec:     13.56MB
### Result for Kong git:master (run 3):
Running 1m test @ http://10.88.145.7:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.64ms    4.34ms 131.47ms   91.70%
    Req/Sec    12.69k     3.57k   23.82k    63.02%
  3791577 requests in 1.00m, 813.43MB read
Requests/sec:  63088.75
Transfer/sec:     13.53MB
### Combined result for Kong git:master:
RPS     Avg: 63436.40
Latency Avg: 2.64ms    Max: 136.01ms
  
### Test Suite: git:master #simple #key-auth 10 services each has 10 routes with key-auth, 100 consumers
### Result for Kong git:master (run 1):
Running 1m test @ http://10.88.145.7:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.49ms    3.46ms 135.14ms   92.90%
    Req/Sec    10.91k     2.41k   20.10k    67.09%
  3258910 requests in 1.00m, 699.14MB read
Requests/sec:  54246.06
Transfer/sec:     11.64MB
### Result for Kong git:master (run 2):
Running 1m test @ http://10.88.145.7:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.56ms    4.16ms 106.72ms   94.44%
    Req/Sec    10.83k     2.32k   18.44k    68.80%
  3231643 requests in 1.00m, 693.29MB read
Requests/sec:  53789.99
Transfer/sec:     11.54MB
### Result for Kong git:master (run 3):
Running 1m test @ http://10.88.145.7:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.61ms    4.24ms 144.65ms   94.21%
    Req/Sec    10.70k     2.37k   19.96k    68.40%
  3195414 requests in 1.00m, 685.52MB read
Requests/sec:  53219.14
Transfer/sec:     11.42MB
### Combined result for Kong git:master:
RPS     Avg: 53751.73
Latency Avg: 2.55ms    Max: 144.65ms
  

Kong error logs are also available in Github Actions artifacts.

Download Artifacts

github-actions[bot] avatar Sep 02 '21 14:09 github-actions[bot]

:rocket: Performance test result

Test Suite: 01-rps 02-flamegraph (baseline,single_route,simple)

Click to expand
Please see Github Actions artifacts for flamegraphs.

  ### Result for upstream directly (run 1):
Running 1m test @ http://10.88.145.15:8088/test
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   556.79us    1.06ms  28.21ms   89.09%
    Req/Sec    84.30k    19.74k  121.87k    68.27%
  25171233 requests in 1.00m, 3.28GB read
Requests/sec: 419145.08
Transfer/sec:     55.96MB
### Result for upstream directly (run 2):
Running 1m test @ http://10.88.145.15:8088/test
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   568.93us    1.09ms  28.10ms   88.97%
    Req/Sec    83.73k    19.51k  120.86k    66.50%
  24997380 requests in 1.00m, 3.26GB read
Requests/sec: 416341.10
Transfer/sec:     55.59MB
### Result for upstream directly (run 3):
Running 1m test @ http://10.88.145.15:8088/test
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   556.57us    1.07ms  28.18ms   89.14%
    Req/Sec    84.47k    20.16k  121.53k    67.73%
  25216499 requests in 1.00m, 3.29GB read
Requests/sec: 419845.01
Transfer/sec:     56.06MB
### Combined result for upstream directly:
RPS     Avg: 418443.73
Latency Avg: nanms    Max: nanms
  
### Test Suite: git:57d3f1dc8fd0fa80e73ccc98c2c0f8a45c7fbc3c #simple #no_plugins #single_route
### Result for Kong git:57d3f1dc8fd0fa80e73ccc98c2c0f8a45c7fbc3c (run 1):
Running 1m test @ http://10.88.145.13:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.78ms    4.75ms 114.70ms   92.84%
    Req/Sec    11.92k     3.21k   20.97k    66.23%
  3557468 requests in 1.00m, 763.20MB read
Requests/sec:  59264.66
Transfer/sec:     12.71MB
### Result for Kong git:57d3f1dc8fd0fa80e73ccc98c2c0f8a45c7fbc3c (run 2):
Running 1m test @ http://10.88.145.13:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.63ms    4.23ms 106.86ms   92.69%
    Req/Sec    11.82k     3.09k   21.08k    66.07%
  3527081 requests in 1.00m, 756.68MB read
Requests/sec:  58712.77
Transfer/sec:     12.60MB
### Result for Kong git:57d3f1dc8fd0fa80e73ccc98c2c0f8a45c7fbc3c (run 3):
Running 1m test @ http://10.88.145.13:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.69ms    4.87ms 164.99ms   93.42%
    Req/Sec    11.87k     3.11k   21.02k    66.30%
  3543910 requests in 1.00m, 760.29MB read
Requests/sec:  59028.01
Transfer/sec:     12.66MB
### Combined result for Kong git:57d3f1dc8fd0fa80e73ccc98c2c0f8a45c7fbc3c:
RPS     Avg: 59001.81
Latency Avg: 2.70ms    Max: 164.99ms
  
### Test Suite: git:57d3f1dc8fd0fa80e73ccc98c2c0f8a45c7fbc3c #simple #no_plugins 10 services each has 10 routes
### Result for Kong git:57d3f1dc8fd0fa80e73ccc98c2c0f8a45c7fbc3c (run 1):
Running 1m test @ http://10.88.145.13:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.56ms    4.10ms 126.60ms   91.27%
    Req/Sec    13.02k     3.65k   32.54k    63.01%
  3888783 requests in 1.00m, 834.28MB read
Requests/sec:  64705.82
Transfer/sec:     13.88MB
### Result for Kong git:57d3f1dc8fd0fa80e73ccc98c2c0f8a45c7fbc3c (run 2):
Running 1m test @ http://10.88.145.13:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.70ms    4.44ms 115.36ms   91.56%
    Req/Sec    12.96k     3.68k   31.86k    63.81%
  3869950 requests in 1.00m, 830.24MB read
Requests/sec:  64392.62
Transfer/sec:     13.81MB
### Result for Kong git:57d3f1dc8fd0fa80e73ccc98c2c0f8a45c7fbc3c (run 3):
Running 1m test @ http://10.88.145.13:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.72ms    4.50ms 111.11ms   91.74%
    Req/Sec    12.89k     3.69k   36.34k    64.55%
  3850198 requests in 1.00m, 826.00MB read
Requests/sec:  64063.19
Transfer/sec:     13.74MB
### Combined result for Kong git:57d3f1dc8fd0fa80e73ccc98c2c0f8a45c7fbc3c:
RPS     Avg: 64387.21
Latency Avg: 2.66ms    Max: 126.60ms
  
### Test Suite: git:57d3f1dc8fd0fa80e73ccc98c2c0f8a45c7fbc3c #simple #key-auth 10 services each has 10 routes with key-auth, 100 consumers
### Result for Kong git:57d3f1dc8fd0fa80e73ccc98c2c0f8a45c7fbc3c (run 1):
Running 1m test @ http://10.88.145.13:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.53ms    3.60ms  88.17ms   91.77%
    Req/Sec    11.32k     2.61k   20.92k    66.09%
  3385097 requests in 1.00m, 726.22MB read
Requests/sec:  56324.59
Transfer/sec:     12.08MB
### Result for Kong git:57d3f1dc8fd0fa80e73ccc98c2c0f8a45c7fbc3c (run 2):
Running 1m test @ http://10.88.145.13:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.58ms    3.76ms 107.73ms   91.79%
    Req/Sec    11.25k     2.65k   21.19k    66.52%
  3359014 requests in 1.00m, 720.62MB read
Requests/sec:  55890.50
Transfer/sec:     11.99MB
### Result for Kong git:57d3f1dc8fd0fa80e73ccc98c2c0f8a45c7fbc3c (run 3):
Running 1m test @ http://10.88.145.13:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.59ms    3.88ms 109.25ms   92.61%
    Req/Sec    11.17k     2.65k   21.14k    67.65%
  3337910 requests in 1.00m, 716.09MB read
Requests/sec:  55568.72
Transfer/sec:     11.92MB
### Combined result for Kong git:57d3f1dc8fd0fa80e73ccc98c2c0f8a45c7fbc3c:
RPS     Avg: 55927.94
Latency Avg: 2.57ms    Max: 109.25ms
  
### Test Suite: git:master #simple #no_plugins #single_route
### Result for Kong git:master (run 1):
Running 1m test @ http://10.88.145.13:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.65ms    3.91ms  94.18ms   90.50%
    Req/Sec    12.50k     3.49k   25.94k    65.39%
  3734308 requests in 1.00m, 801.14MB read
Requests/sec:  62135.30
Transfer/sec:     13.33MB
### Result for Kong git:master (run 2):
Running 1m test @ http://10.88.145.13:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.83ms    4.79ms 141.37ms   92.53%
    Req/Sec    12.26k     3.54k   26.11k    64.27%
  3660381 requests in 1.00m, 785.28MB read
Requests/sec:  60984.98
Transfer/sec:     13.08MB
### Result for Kong git:master (run 3):
Running 1m test @ http://10.88.145.13:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.82ms    4.66ms 114.82ms   92.20%
    Req/Sec    12.34k     3.58k   25.10k    64.82%
  3686491 requests in 1.00m, 790.88MB read
Requests/sec:  61339.53
Transfer/sec:     13.16MB
### Combined result for Kong git:master:
RPS     Avg: 61486.60
Latency Avg: 2.77ms    Max: 141.37ms
  
### Test Suite: git:master #simple #no_plugins 10 services each has 10 routes
### Result for Kong git:master (run 1):
Running 1m test @ http://10.88.145.13:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.51ms    3.82ms  88.55ms   91.70%
    Req/Sec    12.46k     3.30k   30.13k    63.77%
  3723995 requests in 1.00m, 798.92MB read
Requests/sec:  61964.17
Transfer/sec:     13.29MB
### Result for Kong git:master (run 2):
Running 1m test @ http://10.88.145.13:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.59ms    4.18ms 104.72ms   92.19%
    Req/Sec    12.34k     3.31k   25.58k    64.52%
  3686980 requests in 1.00m, 790.98MB read
Requests/sec:  61348.09
Transfer/sec:     13.16MB
### Result for Kong git:master (run 3):
Running 1m test @ http://10.88.145.13:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.71ms    4.62ms 124.98ms   92.36%
    Req/Sec    12.38k     3.45k   31.37k    65.34%
  3695736 requests in 1.00m, 792.86MB read
Requests/sec:  61493.27
Transfer/sec:     13.19MB
### Combined result for Kong git:master:
RPS     Avg: 61601.84
Latency Avg: 2.60ms    Max: 124.98ms
  
### Test Suite: git:master #simple #key-auth 10 services each has 10 routes with key-auth, 100 consumers
### Result for Kong git:master (run 1):
Running 1m test @ http://10.88.145.13:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.64ms    4.19ms 102.05ms   94.04%
    Req/Sec    10.74k     2.34k   18.41k    67.55%
  3207307 requests in 1.00m, 688.07MB read
Requests/sec:  53378.70
Transfer/sec:     11.45MB
### Result for Kong git:master (run 2):
Running 1m test @ http://10.88.145.13:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.50ms    3.60ms 100.02ms   93.92%
    Req/Sec    10.60k     2.18k   18.39k    68.20%
  3163488 requests in 1.00m, 678.67MB read
Requests/sec:  52647.49
Transfer/sec:     11.29MB
### Result for Kong git:master (run 3):
Running 1m test @ http://10.88.145.13:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.49ms    3.39ms 126.65ms   93.09%
    Req/Sec    10.49k     2.14k   17.85k    68.30%
  3132714 requests in 1.00m, 672.07MB read
Requests/sec:  52151.57
Transfer/sec:     11.19MB
### Combined result for Kong git:master:
RPS     Avg: 52725.92
Latency Avg: 2.54ms    Max: 126.65ms
  

Kong error logs are also available in Github Actions artifacts.

Download Artifacts

github-actions[bot] avatar Sep 13 '21 14:09 github-actions[bot]

As discussed offline with @fffonion, let's hold off this PR until we can figure out a way to fix the serializer change. Otherwise it will be user visible impact when we release it.

dndx avatar Sep 14 '21 16:09 dndx

We need to add changelog entry for this.

bungle avatar Jun 22 '22 11:06 bungle

:rocket: Performance test result

Test Suite: 01-rps 02-flamegraph (baseline,single_route,simple)

["Imgur Images","Imgur Images","Imgur Images"]

Click to expand
Please see Github Actions artifacts for flamegraphs.

  ### Result for upstream directly (run 1):
Running 30s test @ http://10.67.35.129:8088/test
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   575.02us    1.27ms  12.08ms   87.18%
    Req/Sec   169.36k    11.65k  217.93k    68.80%
  25273992 requests in 30.03s, 3.30GB read
Requests/sec: 841508.65
Transfer/sec:    112.35MB
### Result for upstream directly (run 2):
Running 30s test @ http://10.67.35.129:8088/test
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   565.99us    1.25ms  12.10ms   87.41%
    Req/Sec   157.15k     8.85k  215.13k    78.01%
  23468586 requests in 30.10s, 3.06GB read
Requests/sec: 779703.02
Transfer/sec:    104.10MB
### Result for upstream directly (run 3):
Running 30s test @ http://10.67.35.129:8088/test
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   580.63us    1.28ms  12.10ms   87.16%
    Req/Sec   155.95k     8.70k  200.95k    77.27%
  23271786 requests in 30.03s, 3.03GB read
Requests/sec: 774901.45
Transfer/sec:    103.46MB
### Combined result for upstream directly:
RPS     Avg: 798704.37
Latency Avg: nanms    Max: nanms
  
### Test Suite: git:6ea658912e04bd83a6dfea8fbb8aaa5c68abb6fc #simple #no_plugins #single_route
### Result for Kong git:6ea658912e04bd83a6dfea8fbb8aaa5c68abb6fc (run 1):
Running 30s test @ http://10.67.35.131:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.28ms    2.08ms  38.26ms   88.95%
    Req/Sec    30.86k     8.36k   52.73k    60.92%
  4612002 requests in 30.10s, 0.97GB read
Requests/sec: 153226.60
Transfer/sec:     32.88MB
### Result for Kong git:6ea658912e04bd83a6dfea8fbb8aaa5c68abb6fc (run 2):
Running 30s test @ http://10.67.35.131:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.21ms    1.89ms  37.01ms   88.39%
    Req/Sec    31.25k     7.96k   66.04k    58.89%
  4667361 requests in 30.10s, 0.98GB read
Requests/sec: 155066.75
Transfer/sec:     33.27MB
### Result for Kong git:6ea658912e04bd83a6dfea8fbb8aaa5c68abb6fc (run 3):
Running 30s test @ http://10.67.35.131:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.21ms    1.90ms  35.36ms   88.51%
    Req/Sec    31.22k     7.72k   51.41k    59.85%
  4666153 requests in 30.10s, 0.98GB read
Requests/sec: 155022.85
Transfer/sec:     33.26MB
### Combined result for Kong git:6ea658912e04bd83a6dfea8fbb8aaa5c68abb6fc:
RPS     Avg: 154438.73
Latency Avg: 1.23ms    Max: 38.26ms
  
### Test Suite: git:6ea658912e04bd83a6dfea8fbb8aaa5c68abb6fc #simple #no_plugins 10 services each has 10 routes
### Result for Kong git:6ea658912e04bd83a6dfea8fbb8aaa5c68abb6fc (run 1):
Running 30s test @ http://10.67.35.131:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.25ms    1.95ms  27.65ms   89.02%
    Req/Sec    29.11k     7.77k   47.89k    59.19%
  4350066 requests in 30.10s, 0.91GB read
Requests/sec: 144521.99
Transfer/sec:     31.01MB
### Result for Kong git:6ea658912e04bd83a6dfea8fbb8aaa5c68abb6fc (run 2):
Running 30s test @ http://10.67.35.131:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.26ms    2.03ms  43.65ms   89.41%
    Req/Sec    29.10k     7.33k   48.96k    60.72%
  4347815 requests in 30.10s, 0.91GB read
Requests/sec: 144447.72
Transfer/sec:     30.99MB
### Result for Kong git:6ea658912e04bd83a6dfea8fbb8aaa5c68abb6fc (run 3):
Running 30s test @ http://10.67.35.131:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.27ms    2.04ms  36.96ms   89.35%
    Req/Sec    28.94k     7.46k   55.63k    58.87%
  4333559 requests in 30.10s, 0.91GB read
Requests/sec: 143975.22
Transfer/sec:     30.89MB
### Combined result for Kong git:6ea658912e04bd83a6dfea8fbb8aaa5c68abb6fc:
RPS     Avg: 144314.98
Latency Avg: 1.26ms    Max: 43.65ms
  
### Test Suite: git:6ea658912e04bd83a6dfea8fbb8aaa5c68abb6fc #simple #key-auth 10 services each has 10 routes with key-auth, 100 consumers
### Result for Kong git:6ea658912e04bd83a6dfea8fbb8aaa5c68abb6fc (run 1):
Running 30s test @ http://10.67.35.131:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.32ms    2.27ms 127.57ms   91.05%
    Req/Sec    25.79k     6.64k   40.53k    60.40%
  3862116 requests in 30.10s, 828.71MB read
Requests/sec: 128312.22
Transfer/sec:     27.53MB
### Result for Kong git:6ea658912e04bd83a6dfea8fbb8aaa5c68abb6fc (run 2):
Running 30s test @ http://10.67.35.131:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.30ms    2.01ms  41.22ms   90.54%
    Req/Sec    25.69k     6.14k   42.96k    63.06%
  3847544 requests in 30.10s, 825.58MB read
Requests/sec: 127828.41
Transfer/sec:     27.43MB
### Result for Kong git:6ea658912e04bd83a6dfea8fbb8aaa5c68abb6fc (run 3):
Running 30s test @ http://10.67.35.131:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.34ms    2.15ms  52.88ms   90.70%
    Req/Sec    25.72k     6.37k   43.45k    60.20%
  3851810 requests in 30.10s, 826.50MB read
Requests/sec: 127969.98
Transfer/sec:     27.46MB
### Combined result for Kong git:6ea658912e04bd83a6dfea8fbb8aaa5c68abb6fc:
RPS     Avg: 128036.87
Latency Avg: 1.32ms    Max: 127.57ms
  
### Test Suite: git:master #simple #no_plugins #single_route
### Result for Kong git:master (run 1):
Running 30s test @ http://10.67.35.131:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.24ms    1.97ms  36.78ms   88.02%
    Req/Sec    32.37k     8.53k   55.54k    59.92%
  4837888 requests in 30.10s, 1.01GB read
Requests/sec: 160729.55
Transfer/sec:     34.49MB
### Result for Kong git:master (run 2):
Running 30s test @ http://10.67.35.131:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.21ms    1.91ms  34.15ms   88.15%
    Req/Sec    32.19k     8.02k   56.54k    59.19%
  4810701 requests in 30.10s, 1.01GB read
Requests/sec: 159826.35
Transfer/sec:     34.29MB
### Result for Kong git:master (run 3):
Running 30s test @ http://10.67.35.131:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.24ms    1.99ms  32.90ms   88.31%
    Req/Sec    32.16k     8.20k   52.31k    59.05%
  4805251 requests in 30.10s, 1.01GB read
Requests/sec: 159645.58
Transfer/sec:     34.26MB
### Combined result for Kong git:master:
RPS     Avg: 160067.16
Latency Avg: 1.23ms    Max: 36.78ms
  
### Test Suite: git:master #simple #no_plugins 10 services each has 10 routes
### Result for Kong git:master (run 1):
Running 30s test @ http://10.67.35.131:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.23ms    1.94ms  31.92ms   88.79%
    Req/Sec    29.78k     7.77k   46.27k    58.92%
  4451076 requests in 30.10s, 0.93GB read
Requests/sec: 147877.35
Transfer/sec:     31.73MB
### Result for Kong git:master (run 2):
Running 30s test @ http://10.67.35.131:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.23ms    1.94ms  37.69ms   88.88%
    Req/Sec    29.88k     7.27k   48.70k    57.58%
  4470216 requests in 30.10s, 0.94GB read
Requests/sec: 148515.45
Transfer/sec:     31.87MB
### Result for Kong git:master (run 3):
Running 30s test @ http://10.67.35.131:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.26ms    2.03ms  32.10ms   88.93%
    Req/Sec    29.69k     7.72k   52.71k    60.97%
  4442538 requests in 30.10s, 0.93GB read
Requests/sec: 147596.42
Transfer/sec:     31.67MB
### Combined result for Kong git:master:
RPS     Avg: 147996.41
Latency Avg: 1.24ms    Max: 37.69ms
  
### Test Suite: git:master #simple #key-auth 10 services each has 10 routes with key-auth, 100 consumers
### Result for Kong git:master (run 1):
Running 30s test @ http://10.67.35.131:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.31ms    2.20ms 126.89ms   91.12%
    Req/Sec    25.53k     6.35k   40.48k    61.53%
  3822351 requests in 30.10s, 820.17MB read
Requests/sec: 126991.13
Transfer/sec:     27.25MB
### Result for Kong git:master (run 2):
Running 30s test @ http://10.67.35.131:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.31ms    1.99ms  33.35ms   90.58%
    Req/Sec    25.53k     6.53k   43.17k    62.92%
  3822454 requests in 30.10s, 820.20MB read
Requests/sec: 126994.74
Transfer/sec:     27.25MB
### Result for Kong git:master (run 3):
Running 30s test @ http://10.67.35.131:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.34ms    2.10ms  33.58ms   90.70%
    Req/Sec    25.36k     6.66k   49.53k    61.26%
  3797077 requests in 30.10s, 814.75MB read
Requests/sec: 126151.68
Transfer/sec:     27.07MB
### Combined result for Kong git:master:
RPS     Avg: 126712.52
Latency Avg: 1.32ms    Max: 126.89ms
  

Kong error logs are also available in Github Actions artifacts.

Download Artifacts for detailed results and interactive SVG flamegraphs.

github-actions[bot] avatar Jun 22 '22 12:06 github-actions[bot]

This will probably require some updates to EE for WebSocket services since we deviate from the regular runloop handler code path in several places (not a problem--just making note it for my future self).

flrgh avatar Jun 22 '22 17:06 flrgh

This will probably require some updates to EE for WebSocket services since we deviate from the regular runloop handler code path in several places (not a problem--just making note it for my future self).

@flrgh we are most probably not doing this for 3.0.

bungle avatar Jun 23 '22 11:06 bungle

:rocket: Performance test result

Test Suite: 01-rps 02-flamegraph (baseline,single_route,simple)

["Imgur Images","Imgur Images","Imgur Images"]

Click to expand
Please see Github Actions artifacts for flamegraphs.

  ### Result for upstream directly (run 1):
Running 30s test @ http://10.67.35.133:8088/test
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   573.63us    1.27ms  12.11ms   87.26%
    Req/Sec   168.43k    14.95k  221.03k    64.29%
  25153739 requests in 30.10s, 3.28GB read
Requests/sec: 835702.79
Transfer/sec:    111.58MB
### Result for upstream directly (run 2):
Running 30s test @ http://10.67.35.133:8088/test
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   567.11us    1.26ms  12.14ms   87.35%
    Req/Sec   154.97k     8.73k  219.23k    74.02%
  23145352 requests in 30.10s, 3.02GB read
Requests/sec: 768958.00
Transfer/sec:    102.67MB
### Result for upstream directly (run 3):
Running 30s test @ http://10.67.35.133:8088/test
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   571.25us    1.26ms  12.11ms   87.28%
    Req/Sec   154.94k     8.22k  207.09k    71.29%
  23138529 requests in 30.10s, 3.02GB read
Requests/sec: 768731.73
Transfer/sec:    102.64MB
### Combined result for upstream directly:
RPS     Avg: 791130.84
Latency Avg: nanms    Max: nanms
  
### Test Suite: git:4077442daf0f8c05825880f2ff625ec0cafe19ef #simple #no_plugins #single_route
### Result for Kong git:4077442daf0f8c05825880f2ff625ec0cafe19ef (run 1):
Running 30s test @ http://10.67.35.131:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.15ms    1.79ms  36.01ms   89.07%
    Req/Sec    30.85k     8.20k   52.15k    63.87%
  4604941 requests in 30.04s, 0.96GB read
Requests/sec: 153281.03
Transfer/sec:     32.89MB
### Result for Kong git:4077442daf0f8c05825880f2ff625ec0cafe19ef (run 2):
Running 30s test @ http://10.67.35.131:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.19ms    1.88ms  32.39ms   89.20%
    Req/Sec    30.64k     8.00k   53.91k    58.52%
  4580206 requests in 30.10s, 0.96GB read
Requests/sec: 152169.95
Transfer/sec:     32.65MB
### Result for Kong git:4077442daf0f8c05825880f2ff625ec0cafe19ef (run 3):
Running 30s test @ http://10.67.35.131:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.16ms    1.81ms  33.29ms   88.89%
    Req/Sec    31.07k     8.05k   50.99k    58.79%
  4643545 requests in 30.10s, 0.97GB read
Requests/sec: 154273.41
Transfer/sec:     33.10MB
### Combined result for Kong git:4077442daf0f8c05825880f2ff625ec0cafe19ef:
RPS     Avg: 153241.46
Latency Avg: 1.17ms    Max: 36.01ms
  
### Test Suite: git:4077442daf0f8c05825880f2ff625ec0cafe19ef #simple #no_plugins 10 services each has 10 routes
### Result for Kong git:4077442daf0f8c05825880f2ff625ec0cafe19ef (run 1):
Running 30s test @ http://10.67.35.131:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.19ms    1.86ms  39.87ms   89.80%
    Req/Sec    28.81k     7.28k   48.27k    59.14%
  4314753 requests in 30.10s, 0.90GB read
Requests/sec: 143346.82
Transfer/sec:     30.76MB
### Result for Kong git:4077442daf0f8c05825880f2ff625ec0cafe19ef (run 2):
Running 30s test @ http://10.67.35.131:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.17ms    1.80ms  43.93ms   89.74%
    Req/Sec    29.17k     7.09k   52.48k    61.01%
  4361893 requests in 30.10s, 0.91GB read
Requests/sec: 144917.62
Transfer/sec:     31.10MB
### Result for Kong git:4077442daf0f8c05825880f2ff625ec0cafe19ef (run 3):
Running 30s test @ http://10.67.35.131:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.17ms    1.76ms  30.89ms   89.46%
    Req/Sec    29.18k     7.26k   52.64k    62.30%
  4366696 requests in 30.10s, 0.92GB read
Requests/sec: 145072.50
Transfer/sec:     31.13MB
### Combined result for Kong git:4077442daf0f8c05825880f2ff625ec0cafe19ef:
RPS     Avg: 144445.65
Latency Avg: 1.18ms    Max: 43.93ms
  
### Test Suite: git:4077442daf0f8c05825880f2ff625ec0cafe19ef #simple #key-auth 10 services each has 10 routes with key-auth, 100 consumers
### Result for Kong git:4077442daf0f8c05825880f2ff625ec0cafe19ef (run 1):
Running 30s test @ http://10.67.35.131:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.21ms    1.81ms  64.00ms   91.22%
    Req/Sec    25.64k     5.91k   41.31k    61.44%
  3838034 requests in 30.10s, 823.54MB read
Requests/sec: 127509.05
Transfer/sec:     27.36MB
### Result for Kong git:4077442daf0f8c05825880f2ff625ec0cafe19ef (run 2):
Running 30s test @ http://10.67.35.131:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.24ms    1.87ms  33.84ms   91.04%
    Req/Sec    25.73k     6.52k   45.33k    61.38%
  3845209 requests in 30.10s, 825.08MB read
Requests/sec: 127750.79
Transfer/sec:     27.41MB
### Result for Kong git:4077442daf0f8c05825880f2ff625ec0cafe19ef (run 3):
Running 30s test @ http://10.67.35.131:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.19ms    1.74ms  37.02ms   91.03%
    Req/Sec    25.80k     6.18k   43.25k    62.12%
  3856379 requests in 30.10s, 827.47MB read
Requests/sec: 128122.19
Transfer/sec:     27.49MB
### Combined result for Kong git:4077442daf0f8c05825880f2ff625ec0cafe19ef:
RPS     Avg: 127794.01
Latency Avg: 1.21ms    Max: 64.00ms
  
### Test Suite: git:master #simple #no_plugins #single_route
### Result for Kong git:master (run 1):
Running 30s test @ http://10.67.35.131:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.18ms    1.85ms  34.68ms   88.54%
    Req/Sec    31.86k     8.24k   51.73k    59.65%
  4762473 requests in 30.10s, 1.00GB read
Requests/sec: 158226.65
Transfer/sec:     33.95MB
### Result for Kong git:master (run 2):
Running 30s test @ http://10.67.35.131:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.17ms    1.86ms  35.15ms   88.62%
    Req/Sec    31.92k     8.20k   56.45k    61.05%
  4769758 requests in 30.10s, 1.00GB read
Requests/sec: 158467.31
Transfer/sec:     34.00MB
### Result for Kong git:master (run 3):
Running 30s test @ http://10.67.35.131:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.19ms    1.87ms  40.37ms   88.52%
    Req/Sec    32.01k     8.49k   53.91k    58.79%
  4784706 requests in 30.10s, 1.00GB read
Requests/sec: 158965.50
Transfer/sec:     34.11MB
### Combined result for Kong git:master:
RPS     Avg: 158553.15
Latency Avg: 1.18ms    Max: 40.37ms
  
### Test Suite: git:master #simple #no_plugins 10 services each has 10 routes
### Result for Kong git:master (run 1):
Running 30s test @ http://10.67.35.131:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.18ms    1.82ms  37.94ms   89.12%
    Req/Sec    29.89k     7.81k   48.46k    59.93%
  4476141 requests in 30.10s, 0.94GB read
Requests/sec: 148708.92
Transfer/sec:     31.91MB
### Result for Kong git:master (run 2):
Running 30s test @ http://10.67.35.131:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.16ms    1.77ms  28.39ms   88.97%
    Req/Sec    30.28k     7.51k   56.18k    60.45%
  4524666 requests in 30.10s, 0.95GB read
Requests/sec: 150324.16
Transfer/sec:     32.26MB
### Result for Kong git:master (run 3):
Running 30s test @ http://10.67.35.131:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.18ms    1.80ms  30.99ms   89.01%
    Req/Sec    29.98k     7.66k   50.77k    57.87%
  4489817 requests in 30.10s, 0.94GB read
Requests/sec: 149162.90
Transfer/sec:     32.01MB
### Combined result for Kong git:master:
RPS     Avg: 149398.66
Latency Avg: 1.17ms    Max: 37.94ms
  
### Test Suite: git:master #simple #key-auth 10 services each has 10 routes with key-auth, 100 consumers
### Result for Kong git:master (run 1):
Running 30s test @ http://10.67.35.131:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.19ms    1.79ms  65.15ms   91.14%
    Req/Sec    25.83k     6.00k   39.89k    61.13%
  3868476 requests in 30.10s, 830.07MB read
Requests/sec: 128520.55
Transfer/sec:     27.58MB
### Result for Kong git:master (run 2):
Running 30s test @ http://10.67.35.131:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.24ms    1.91ms  44.18ms   91.12%
    Req/Sec    25.65k     6.41k   42.60k    63.03%
  3838905 requests in 30.10s, 823.73MB read
Requests/sec: 127537.96
Transfer/sec:     27.37MB
### Result for Kong git:master (run 3):
Running 30s test @ http://10.67.35.131:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.19ms    1.70ms  29.30ms   90.75%
    Req/Sec    26.00k     6.19k   49.95k    62.99%
  3893230 requests in 30.10s, 835.38MB read
Requests/sec: 129342.73
Transfer/sec:     27.75MB
### Combined result for Kong git:master:
RPS     Avg: 128467.08
Latency Avg: 1.21ms    Max: 65.15ms
  

Kong error logs are also available in Github Actions artifacts.

Download Artifacts for detailed results and interactive SVG flamegraphs.

github-actions[bot] avatar Jul 06 '22 10:07 github-actions[bot]

@fffonion Is this still required?

hbagdi avatar Oct 25 '22 21:10 hbagdi

this need some rethink, closing this and record it with CT-22

fffonion avatar Oct 26 '22 05:10 fffonion