kong icon indicating copy to clipboard operation
kong copied to clipboard

perf(clustering): use privileged worker for control plane connection

Open bungle opened this issue 3 years ago • 1 comments

Summary

Data plane's connection to control plane is moved to a privileged worker process, including:

  • maintaining websocket (wrpc) connection and data transfer
  • decompression of received data
  • json decoding of the received data
  • validation and flattening of received data
  • inserting data to lmdb

(so that these won't affect latencies / rps on proxy workers)

bungle avatar Sep 14 '22 09:09 bungle

Can we measure the performance gain of this change @ADD-SP ?

dndx avatar Sep 21 '22 00:09 dndx

:rocket: Performance test result

Test Suite: 01-rps 02-flamegraph (baseline,single_route,simple)

Imgur Images Imgur Images Imgur Images Imgur Images

Click to expand
Please see Github Actions artifacts for flamegraphs.

  ### Result for upstream directly (run 1):
Running 30s test @ http://10.68.128.7:8088/test
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   566.56us    1.25ms  20.02ms   87.26%
    Req/Sec   165.30k    15.15k  248.37k    68.75%
  Latency Distribution
     50%   57.00us
     75%   99.00us
     90%    2.39ms
     99%    6.26ms
  24690151 requests in 30.10s, 3.22GB read
Requests/sec: 820288.92
Transfer/sec:    109.52MB
### Result for upstream directly (run 2):
Running 30s test @ http://10.68.128.7:8088/test
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   585.56us    1.28ms  12.18ms   87.18%
    Req/Sec   152.47k     7.67k  191.98k    73.42%
  Latency Distribution
     50%   60.00us
     75%  106.00us
     90%    2.47ms
     99%    6.40ms
  22769914 requests in 30.10s, 2.97GB read
Requests/sec: 756474.64
Transfer/sec:    101.00MB
### Result for upstream directly (run 3):
Running 30s test @ http://10.68.128.7:8088/test
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   575.67us    1.28ms  12.12ms   87.39%
    Req/Sec   152.88k     8.96k  207.23k    76.08%
  Latency Distribution
     50%   61.00us
     75%  106.00us
     90%    2.39ms
     99%    6.45ms
  22830695 requests in 30.10s, 2.98GB read
Requests/sec: 758514.56
Transfer/sec:    101.27MB
### Combined result for upstream directly:
RPS     Avg: 778426.04
Latency Avg: 0.58ms    Max: 20.02ms
   P90 (ms): 2.39, 2.47, 2.39
   P99 (ms): 6.26, 6.4, 6.45
  
### Test Suite: git:feat/privileged-dp-connection #simple #no_plugins #single_route
### Result for Kong git:feat/privileged-dp-connection (run 1):
Running 30s test @ http://10.68.128.5:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.13ms    1.76ms  33.44ms   88.57%
    Req/Sec    32.97k     8.55k   58.04k    61.19%
  Latency Distribution
     50%  466.00us
     75%    1.02ms
     90%    3.28ms
     99%    8.75ms
  4926333 requests in 30.10s, 1.03GB read
Requests/sec: 163667.44
Transfer/sec:     35.12MB
### Result for Kong git:feat/privileged-dp-connection (run 2):
Running 30s test @ http://10.68.128.5:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.14ms    1.81ms  38.78ms   88.68%
    Req/Sec    32.78k     8.77k   75.90k    61.36%
  Latency Distribution
     50%  470.00us
     75%    1.00ms
     90%    3.32ms
     99%    8.99ms
  4896014 requests in 30.10s, 1.03GB read
Requests/sec: 162660.63
Transfer/sec:     34.90MB
### Result for Kong git:feat/privileged-dp-connection (run 3):
Running 30s test @ http://10.68.128.5:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.16ms    1.83ms  26.40ms   88.66%
    Req/Sec    32.78k     9.03k   59.36k    61.32%
  Latency Distribution
     50%  463.00us
     75%    1.04ms
     90%    3.36ms
     99%    9.12ms
  4898546 requests in 30.10s, 1.03GB read
Requests/sec: 162747.26
Transfer/sec:     34.92MB
### Combined result for Kong git:feat/privileged-dp-connection:
RPS     Avg: 163025.11
Latency Avg: 1.14ms    Max: 38.78ms
   P90 (ms): 3.28, 3.32, 3.36
   P99 (ms): 8.75, 8.99, 9.12
  
### Test Suite: git:feat/privileged-dp-connection #simple #no_plugins 10 services each has 10 routes
### Result for Kong git:feat/privileged-dp-connection (run 1):
Running 30s test @ http://10.68.128.5:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.20ms    1.91ms  33.94ms   89.31%
    Req/Sec    30.53k     8.04k   50.11k    58.19%
  Latency Distribution
     50%  509.00us
     75%    1.06ms
     90%    3.33ms
     99%    9.66ms
  4562499 requests in 30.10s, 0.96GB read
Requests/sec: 151583.47
Transfer/sec:     32.53MB
### Result for Kong git:feat/privileged-dp-connection (run 2):
Running 30s test @ http://10.68.128.5:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.15ms    1.78ms  29.48ms   89.19%
    Req/Sec    30.82k     7.60k   55.67k    59.67%
  Latency Distribution
     50%  501.00us
     75%    1.05ms
     90%    3.18ms
     99%    8.95ms
  4615830 requests in 30.10s, 0.97GB read
Requests/sec: 153352.10
Transfer/sec:     32.91MB
### Result for Kong git:feat/privileged-dp-connection (run 3):
Running 30s test @ http://10.68.128.5:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.17ms    1.84ms  32.45ms   89.16%
    Req/Sec    30.91k     7.90k   56.10k    61.65%
  Latency Distribution
     50%  499.00us
     75%    1.04ms
     90%    3.27ms
     99%    9.27ms
  4619901 requests in 30.10s, 0.97GB read
Requests/sec: 153490.17
Transfer/sec:     32.93MB
### Combined result for Kong git:feat/privileged-dp-connection:
RPS     Avg: 152808.58
Latency Avg: 1.17ms    Max: 33.94ms
   P90 (ms): 3.33, 3.18, 3.27
   P99 (ms): 9.66, 8.95, 9.27
  
### Test Suite: git:feat/privileged-dp-connection #simple #key-auth 10 services each has 10 routes with key-auth, 100 consumers
### Result for Kong git:feat/privileged-dp-connection (run 1):
Running 30s test @ http://10.68.128.5:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.18ms    1.69ms  27.85ms   90.71%
    Req/Sec    26.45k     6.27k   44.67k    62.26%
  Latency Distribution
     50%  614.00us
     75%    1.18ms
     90%    2.65ms
     99%    8.46ms
  3960821 requests in 30.10s, 849.89MB read
Requests/sec: 131590.36
Transfer/sec:     28.24MB
### Result for Kong git:feat/privileged-dp-connection (run 2):
Running 30s test @ http://10.68.128.5:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.16ms    1.69ms  32.35ms   90.91%
    Req/Sec    26.55k     6.31k   43.11k    62.66%
  Latency Distribution
     50%  611.00us
     75%    1.18ms
     90%    2.54ms
     99%    8.56ms
  3976039 requests in 30.10s, 853.15MB read
Requests/sec: 132096.20
Transfer/sec:     28.34MB
### Result for Kong git:feat/privileged-dp-connection (run 3):
Running 30s test @ http://10.68.128.5:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.16ms    1.68ms  29.57ms   90.70%
    Req/Sec    26.63k     6.46k   47.09k    64.05%
  Latency Distribution
     50%  618.00us
     75%    1.15ms
     90%    2.58ms
     99%    8.56ms
  3987461 requests in 30.10s, 855.60MB read
Requests/sec: 132475.62
Transfer/sec:     28.43MB
### Combined result for Kong git:feat/privileged-dp-connection:
RPS     Avg: 132054.06
Latency Avg: 1.17ms    Max: 32.35ms
   P90 (ms): 2.65, 2.54, 2.58
   P99 (ms): 8.46, 8.56, 8.56
  
### Test Suite: git:master #simple #no_plugins #single_route
### Result for Kong git:master (run 1):
Running 30s test @ http://10.68.128.5:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.14ms    1.78ms  29.81ms   88.63%
    Req/Sec    32.80k     8.41k   77.09k    62.16%
  Latency Distribution
     50%  476.00us
     75%    1.01ms
     90%    3.30ms
     99%    8.89ms
  4897614 requests in 30.10s, 1.03GB read
Requests/sec: 162712.46
Transfer/sec:     34.91MB
### Result for Kong git:master (run 2):
Running 30s test @ http://10.68.128.5:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.14ms    1.78ms  32.88ms   88.67%
    Req/Sec    32.81k     8.52k   64.63k    63.05%
  Latency Distribution
     50%  463.00us
     75%    1.03ms
     90%    3.30ms
     99%    8.89ms
  4903125 requests in 30.10s, 1.03GB read
Requests/sec: 162898.69
Transfer/sec:     34.95MB
### Result for Kong git:master (run 3):
Running 30s test @ http://10.68.128.5:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.15ms    1.79ms  33.45ms   88.39%
    Req/Sec    32.96k     8.70k   59.21k    60.72%
  Latency Distribution
     50%  475.00us
     75%    0.99ms
     90%    3.37ms
     99%    8.93ms
  4925445 requests in 30.10s, 1.03GB read
Requests/sec: 163638.16
Transfer/sec:     35.11MB
### Combined result for Kong git:master:
RPS     Avg: 163083.10
Latency Avg: 1.14ms    Max: 33.45ms
   P90 (ms): 3.3, 3.3, 3.37
   P99 (ms): 8.89, 8.89, 8.93
  
### Test Suite: git:master #simple #no_plugins 10 services each has 10 routes
### Result for Kong git:master (run 1):
Running 30s test @ http://10.68.128.5:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.17ms    1.84ms  32.98ms   89.16%
    Req/Sec    30.76k     7.97k   52.87k    62.92%
  Latency Distribution
     50%  507.00us
     75%    1.04ms
     90%    3.29ms
     99%    9.24ms
  4605635 requests in 30.10s, 0.97GB read
Requests/sec: 153013.33
Transfer/sec:     32.83MB
### Result for Kong git:master (run 2):
Running 30s test @ http://10.68.128.5:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.14ms    1.75ms  28.54ms   88.80%
    Req/Sec    31.19k     7.72k   58.27k    61.66%
  Latency Distribution
     50%  511.00us
     75%    0.98ms
     90%    3.27ms
     99%    8.72ms
  4669529 requests in 30.10s, 0.98GB read
Requests/sec: 155136.26
Transfer/sec:     33.29MB
### Result for Kong git:master (run 3):
Running 30s test @ http://10.68.128.5:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.14ms    1.75ms  31.91ms   88.86%
    Req/Sec    30.96k     7.79k   52.47k    59.87%
  Latency Distribution
     50%  510.00us
     75%    1.02ms
     90%    3.24ms
     99%    8.79ms
  4636967 requests in 30.10s, 0.97GB read
Requests/sec: 154054.56
Transfer/sec:     33.06MB
### Combined result for Kong git:master:
RPS     Avg: 154068.05
Latency Avg: 1.15ms    Max: 32.98ms
   P90 (ms): 3.29, 3.27, 3.24
   P99 (ms): 9.24, 8.72, 8.79
  
### Test Suite: git:master #simple #key-auth 10 services each has 10 routes with key-auth, 100 consumers
### Result for Kong git:master (run 1):
Running 30s test @ http://10.68.128.5:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.17ms    1.71ms  33.93ms   90.90%
    Req/Sec    26.52k     6.41k   43.90k    64.92%
  Latency Distribution
     50%  626.00us
     75%    1.16ms
     90%    2.57ms
     99%    8.71ms
  3970336 requests in 30.10s, 851.93MB read
Requests/sec: 131906.61
Transfer/sec:     28.30MB
### Result for Kong git:master (run 2):
Running 30s test @ http://10.68.128.5:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.17ms    1.68ms  30.62ms   90.70%
    Req/Sec    26.52k     6.32k   46.09k    60.53%
  Latency Distribution
     50%  613.00us
     75%    1.17ms
     90%    2.62ms
     99%    8.33ms
  3970878 requests in 30.10s, 852.04MB read
Requests/sec: 131925.07
Transfer/sec:     28.31MB
### Result for Kong git:master (run 3):
Running 30s test @ http://10.68.128.5:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.19ms    1.79ms  34.53ms   90.81%
    Req/Sec    26.62k     6.51k   48.30k    62.46%
  Latency Distribution
     50%  612.00us
     75%    1.16ms
     90%    2.69ms
     99%    9.12ms
  3986159 requests in 30.10s, 855.32MB read
Requests/sec: 132433.02
Transfer/sec:     28.42MB
### Combined result for Kong git:master:
RPS     Avg: 132088.23
Latency Avg: 1.18ms    Max: 34.53ms
   P90 (ms): 2.57, 2.62, 2.69
   P99 (ms): 8.71, 8.33, 9.12
  
### Test Suite: git:feat/privileged-dp-connection #simple #hybrid #no_plugins #single_route
### Result for Kong git:feat/privileged-dp-connection (run 1):
Running 30s test @ http://10.68.128.5:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.19ms    1.93ms  40.28ms   88.92%
    Req/Sec    32.68k     8.70k   58.16k    62.65%
  Latency Distribution
     50%  465.00us
     75%    1.05ms
     90%    3.42ms
     99%    9.49ms
  4884131 requests in 30.10s, 1.02GB read
Requests/sec: 162267.40
Transfer/sec:     34.82MB
### Result for Kong git:feat/privileged-dp-connection (run 2):
Running 30s test @ http://10.68.128.5:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.13ms    1.74ms  27.88ms   88.23%
    Req/Sec    33.36k     8.40k   57.92k    61.19%
  Latency Distribution
     50%  466.00us
     75%    0.96ms
     90%    3.34ms
     99%    8.64ms
  4984845 requests in 30.10s, 1.04GB read
Requests/sec: 165616.02
Transfer/sec:     35.54MB
### Result for Kong git:feat/privileged-dp-connection (run 3):
Running 30s test @ http://10.68.128.5:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.14ms    1.77ms  29.90ms   88.58%
    Req/Sec    32.90k     8.60k   58.81k    62.12%
  Latency Distribution
     50%  458.00us
     75%    1.03ms
     90%    3.30ms
     99%    8.78ms
  4915848 requests in 30.10s, 1.03GB read
Requests/sec: 163321.08
Transfer/sec:     35.04MB
### Combined result for Kong git:feat/privileged-dp-connection:
RPS     Avg: 163734.83
Latency Avg: 1.15ms    Max: 40.28ms
   P90 (ms): 3.42, 3.34, 3.3
   P99 (ms): 9.49, 8.64, 8.78
  
### Test Suite: git:feat/privileged-dp-connection #simple #hybrid #no_plugins 10 services each has 10 routes
### Result for Kong git:feat/privileged-dp-connection (run 1):
Running 30s test @ http://10.68.128.5:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.20ms    1.91ms  30.79ms   89.15%
    Req/Sec    30.74k     8.21k   51.36k    60.93%
  Latency Distribution
     50%  505.00us
     75%    1.05ms
     90%    3.38ms
     99%    9.62ms
  4603558 requests in 30.10s, 0.96GB read
Requests/sec: 152944.55
Transfer/sec:     32.82MB
### Result for Kong git:feat/privileged-dp-connection (run 2):
Running 30s test @ http://10.68.128.5:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.16ms    1.81ms  34.40ms   88.96%
    Req/Sec    31.03k     7.95k   54.65k    61.06%
  Latency Distribution
     50%  505.00us
     75%    1.01ms
     90%    3.29ms
     99%    9.03ms
  4646100 requests in 30.10s, 0.97GB read
Requests/sec: 154358.13
Transfer/sec:     33.12MB
### Result for Kong git:feat/privileged-dp-connection (run 3):
Running 30s test @ http://10.68.128.5:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.13ms    1.73ms  30.56ms   89.17%
    Req/Sec    30.75k     7.67k   58.89k    61.37%
  Latency Distribution
     50%  510.00us
     75%    1.04ms
     90%    3.12ms
     99%    8.69ms
  4601847 requests in 30.10s, 0.96GB read
Requests/sec: 152888.44
Transfer/sec:     32.81MB
### Combined result for Kong git:feat/privileged-dp-connection:
RPS     Avg: 153397.04
Latency Avg: 1.16ms    Max: 34.40ms
   P90 (ms): 3.38, 3.29, 3.12
   P99 (ms): 9.62, 9.03, 8.69
  
### Test Suite: git:feat/privileged-dp-connection #simple #hybrid #key-auth 10 services each has 10 routes with key-auth, 100 consumers
### Result for Kong git:feat/privileged-dp-connection (run 1):
Running 30s test @ http://10.68.128.5:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.16ms    1.69ms  31.25ms   90.76%
    Req/Sec    26.82k     6.30k   44.26k    62.46%
  Latency Distribution
     50%  597.00us
     75%    1.17ms
     90%    2.58ms
     99%    8.49ms
  4016728 requests in 30.10s, 861.88MB read
Requests/sec: 133447.46
Transfer/sec:     28.63MB
### Result for Kong git:feat/privileged-dp-connection (run 2):
Running 30s test @ http://10.68.128.5:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.19ms    1.73ms  33.20ms   90.70%
    Req/Sec    26.64k     6.58k   47.53k    60.93%
  Latency Distribution
     50%  598.00us
     75%    1.18ms
     90%    2.71ms
     99%    8.70ms
  3989058 requests in 30.10s, 855.94MB read
Requests/sec: 132528.93
Transfer/sec:     28.44MB
### Result for Kong git:feat/privileged-dp-connection (run 3):
Running 30s test @ http://10.68.128.5:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.18ms    1.71ms  37.29ms   90.52%
    Req/Sec    26.49k     6.60k   46.48k    63.26%
  Latency Distribution
     50%  599.00us
     75%    1.23ms
     90%    2.77ms
     99%    8.62ms
  3967175 requests in 30.10s, 851.25MB read
Requests/sec: 131801.95
Transfer/sec:     28.28MB
### Combined result for Kong git:feat/privileged-dp-connection:
RPS     Avg: 132592.78
Latency Avg: 1.18ms    Max: 37.29ms
   P90 (ms): 2.58, 2.71, 2.77
   P99 (ms): 8.49, 8.7, 8.62
  
### Test Suite: git:master #simple #hybrid #no_plugins #single_route
### Result for Kong git:master (run 1):
Running 30s test @ http://10.68.128.5:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.18ms    1.91ms  39.49ms   88.67%
    Req/Sec    32.94k     8.98k   56.21k    58.99%
  Latency Distribution
     50%  478.00us
     75%    0.99ms
     90%    3.46ms
     99%    9.47ms
  4922897 requests in 30.10s, 1.03GB read
Requests/sec: 163554.82
Transfer/sec:     35.09MB
### Result for Kong git:master (run 2):
Running 30s test @ http://10.68.128.5:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.15ms    1.81ms  27.90ms   88.43%
    Req/Sec    33.13k     8.62k   56.79k    60.93%
  Latency Distribution
     50%  463.00us
     75%    1.00ms
     90%    3.38ms
     99%    9.02ms
  4960519 requests in 30.10s, 1.04GB read
Requests/sec: 164804.60
Transfer/sec:     35.36MB
### Result for Kong git:master (run 3):
Running 30s test @ http://10.68.128.5:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.17ms    1.88ms  33.29ms   88.72%
    Req/Sec    33.00k     8.61k   54.49k    60.52%
  Latency Distribution
     50%  463.00us
     75%    1.01ms
     90%    3.40ms
     99%    9.31ms
  4930653 requests in 30.10s, 1.03GB read
Requests/sec: 163810.96
Transfer/sec:     35.15MB
### Combined result for Kong git:master:
RPS     Avg: 164056.79
Latency Avg: 1.17ms    Max: 39.49ms
   P90 (ms): 3.46, 3.38, 3.4
   P99 (ms): 9.47, 9.02, 9.31
  
### Test Suite: git:master #simple #hybrid #no_plugins 10 services each has 10 routes
### Result for Kong git:master (run 1):
Running 30s test @ http://10.68.128.5:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.17ms    1.82ms  34.82ms   89.04%
    Req/Sec    30.80k     8.18k   50.99k    58.27%
  Latency Distribution
     50%  509.00us
     75%    1.03ms
     90%    3.29ms
     99%    9.09ms
  4612267 requests in 30.10s, 0.97GB read
Requests/sec: 153233.63
Transfer/sec:     32.88MB
### Result for Kong git:master (run 2):
Running 30s test @ http://10.68.128.5:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.17ms    1.82ms  32.15ms   88.99%
    Req/Sec    31.03k     8.14k   58.69k    59.53%
  Latency Distribution
     50%  493.00us
     75%    1.05ms
     90%    3.31ms
     99%    9.12ms
  4646483 requests in 30.10s, 0.97GB read
Requests/sec: 154370.64
Transfer/sec:     33.12MB
### Result for Kong git:master (run 3):
Running 30s test @ http://10.68.128.5:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.22ms    2.02ms  48.22ms   89.55%
    Req/Sec    30.80k     8.15k   54.45k    62.50%
  Latency Distribution
     50%  503.00us
     75%    1.05ms
     90%    3.38ms
     99%    9.97ms
  4609924 requests in 30.10s, 0.97GB read
Requests/sec: 153156.99
Transfer/sec:     32.86MB
### Combined result for Kong git:master:
RPS     Avg: 153587.09
Latency Avg: 1.19ms    Max: 48.22ms
   P90 (ms): 3.29, 3.31, 3.38
   P99 (ms): 9.09, 9.12, 9.97
  
### Test Suite: git:master #simple #hybrid #key-auth 10 services each has 10 routes with key-auth, 100 consumers
### Result for Kong git:master (run 1):
Running 30s test @ http://10.68.128.5:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.21ms    1.85ms  41.90ms   91.05%
    Req/Sec    26.57k     6.50k   42.47k    63.25%
  Latency Distribution
     50%  608.00us
     75%    1.21ms
     90%    2.72ms
     99%    9.42ms
  3971041 requests in 30.10s, 852.08MB read
Requests/sec: 131934.55
Transfer/sec:     28.31MB
### Result for Kong git:master (run 2):
Running 30s test @ http://10.68.128.5:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.18ms    1.74ms  35.48ms   90.48%
    Req/Sec    26.93k     6.62k   47.63k    61.40%
  Latency Distribution
     50%  619.00us
     75%    1.11ms
     90%    2.72ms
     99%    8.82ms
  4032632 requests in 30.10s, 865.29MB read
Requests/sec: 133976.59
Transfer/sec:     28.75MB
### Result for Kong git:master (run 3):
Running 30s test @ http://10.68.128.5:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.16ms    1.70ms  37.12ms   90.85%
    Req/Sec    26.68k     6.29k   51.67k    62.92%
  Latency Distribution
     50%  613.00us
     75%    1.18ms
     90%    2.60ms
     99%    8.48ms
  3995713 requests in 30.10s, 857.37MB read
Requests/sec: 132749.96
Transfer/sec:     28.48MB
### Combined result for Kong git:master:
RPS     Avg: 132887.03
Latency Avg: 1.18ms    Max: 41.90ms
   P90 (ms): 2.72, 2.72, 2.6
   P99 (ms): 9.42, 8.82, 8.48
  

Kong error logs are also available in Github Actions artifacts.

Download Artifacts for detailed results and interactive SVG flamegraphs.

github-actions[bot] avatar Sep 28 '22 10:09 github-actions[bot]

:rocket: Performance test result

Test Suite: 01-rps 02-flamegraph (baseline,single_route,simple)

Imgur Images Imgur Images Imgur Images Imgur Images

Click to expand
Please see Github Actions artifacts for flamegraphs.

  ### Result for upstream directly (run 1):
Running 30s test @ http://10.68.128.13:8088/test
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   577.84us    1.27ms  12.15ms   87.06%
    Req/Sec   163.81k    12.87k  218.87k    63.20%
  Latency Distribution
     50%   57.00us
     75%  100.00us
     90%    2.45ms
     99%    6.36ms
  24446487 requests in 30.02s, 3.19GB read
Requests/sec: 814303.06
Transfer/sec:    108.72MB
### Result for upstream directly (run 2):
Running 30s test @ http://10.68.128.13:8088/test
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   578.73us    1.28ms  12.14ms   87.38%
    Req/Sec   153.53k     8.36k  208.47k    75.48%
  Latency Distribution
     50%   61.00us
     75%  106.00us
     90%    2.41ms
     99%    6.47ms
  22926892 requests in 30.10s, 2.99GB read
Requests/sec: 761725.18
Transfer/sec:    101.70MB
### Result for upstream directly (run 3):
Running 30s test @ http://10.68.128.13:8088/test
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   579.63us    1.28ms  12.13ms   87.39%
    Req/Sec   152.61k     8.07k  196.69k    74.33%
  Latency Distribution
     50%   61.00us
     75%  107.00us
     90%    2.41ms
     99%    6.47ms
  22775523 requests in 30.04s, 2.97GB read
Requests/sec: 758244.96
Transfer/sec:    101.24MB
### Combined result for upstream directly:
RPS     Avg: 778091.07
Latency Avg: 0.58ms    Max: 12.15ms
   P90 (ms): 2.45, 2.41, 2.41
   P99 (ms): 6.36, 6.47, 6.47
  
### Test Suite: git:feat/privileged-dp-connection #simple #no_plugins #single_route
### Result for Kong git:feat/privileged-dp-connection (run 1):
Running 30s test @ http://10.68.128.15:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.16ms    1.82ms  29.34ms   88.40%
    Req/Sec    32.70k     8.22k   52.11k    61.65%
  Latency Distribution
     50%  468.00us
     75%    0.98ms
     90%    3.43ms
     99%    9.03ms
  4886583 requests in 30.10s, 1.02GB read
Requests/sec: 162346.69
Transfer/sec:     34.84MB
### Result for Kong git:feat/privileged-dp-connection (run 2):
Running 30s test @ http://10.68.128.15:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.24ms    2.00ms  31.04ms   88.19%
    Req/Sec    32.74k     9.02k   61.28k    62.52%
  Latency Distribution
     50%  466.00us
     75%    0.97ms
     90%    3.76ms
     99%    9.90ms
  4891965 requests in 30.10s, 1.03GB read
Requests/sec: 162526.86
Transfer/sec:     34.87MB
### Result for Kong git:feat/privileged-dp-connection (run 3):
Running 30s test @ http://10.68.128.15:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.19ms    1.87ms  30.31ms   88.17%
    Req/Sec    32.64k     8.72k   54.15k    61.19%
  Latency Distribution
     50%  470.00us
     75%    0.97ms
     90%    3.58ms
     99%    9.32ms
  4878396 requests in 30.10s, 1.02GB read
Requests/sec: 162079.46
Transfer/sec:     34.78MB
### Combined result for Kong git:feat/privileged-dp-connection:
RPS     Avg: 162317.67
Latency Avg: 1.20ms    Max: 31.04ms
   P90 (ms): 3.43, 3.76, 3.58
   P99 (ms): 9.03, 9.9, 9.32
  
### Test Suite: git:feat/privileged-dp-connection #simple #no_plugins 10 services each has 10 routes
### Result for Kong git:feat/privileged-dp-connection (run 1):
Running 30s test @ http://10.68.128.15:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.23ms    1.96ms  33.74ms   89.08%
    Req/Sec    30.18k     8.30k   51.34k    62.99%
  Latency Distribution
     50%  494.00us
     75%    1.09ms
     90%    3.50ms
     99%    9.82ms
  4519742 requests in 30.10s, 0.95GB read
Requests/sec: 150157.28
Transfer/sec:     32.22MB
### Result for Kong git:feat/privileged-dp-connection (run 2):
Running 30s test @ http://10.68.128.15:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.24ms    2.01ms  33.94ms   88.95%
    Req/Sec    30.60k     8.18k   52.38k    58.34%
  Latency Distribution
     50%  495.00us
     75%    1.03ms
     90%    3.59ms
     99%   10.01ms
  4582572 requests in 30.10s, 0.96GB read
Requests/sec: 152244.77
Transfer/sec:     32.67MB
### Result for Kong git:feat/privileged-dp-connection (run 3):
Running 30s test @ http://10.68.128.15:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.22ms    1.93ms  33.57ms   88.85%
    Req/Sec    30.36k     8.00k   48.81k    59.07%
  Latency Distribution
     50%  515.00us
     75%    1.01ms
     90%    3.52ms
     99%    9.69ms
  4546097 requests in 30.10s, 0.95GB read
Requests/sec: 151032.93
Transfer/sec:     32.41MB
### Combined result for Kong git:feat/privileged-dp-connection:
RPS     Avg: 151144.99
Latency Avg: 1.23ms    Max: 33.94ms
   P90 (ms): 3.5, 3.59, 3.52
   P99 (ms): 9.82, 10.01, 9.69
  
### Test Suite: git:feat/privileged-dp-connection #simple #key-auth 10 services each has 10 routes with key-auth, 100 consumers
### Result for Kong git:feat/privileged-dp-connection (run 1):
Running 30s test @ http://10.68.128.15:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.25ms    1.86ms  41.32ms   90.75%
    Req/Sec    26.08k     6.66k   45.13k    62.77%
  Latency Distribution
     50%  592.00us
     75%    1.23ms
     90%    2.88ms
     99%    9.41ms
  3902583 requests in 30.10s, 837.39MB read
Requests/sec: 129653.56
Transfer/sec:     27.82MB
### Result for Kong git:feat/privileged-dp-connection (run 2):
Running 30s test @ http://10.68.128.15:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.34ms    2.12ms  40.02ms   90.31%
    Req/Sec    26.12k     6.71k   44.85k    61.66%
  Latency Distribution
     50%  606.00us
     75%    1.18ms
     90%    3.34ms
     99%   10.91ms
  3910947 requests in 30.10s, 839.18MB read
Requests/sec: 129931.43
Transfer/sec:     27.88MB
### Result for Kong git:feat/privileged-dp-connection (run 3):
Running 30s test @ http://10.68.128.15:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.20ms    1.76ms  39.16ms   90.81%
    Req/Sec    26.12k     6.39k   45.70k    62.94%
  Latency Distribution
     50%  617.00us
     75%    1.18ms
     90%    2.64ms
     99%    8.83ms
  3906115 requests in 30.10s, 838.15MB read
Requests/sec: 129774.96
Transfer/sec:     27.85MB
### Combined result for Kong git:feat/privileged-dp-connection:
RPS     Avg: 129786.65
Latency Avg: 1.26ms    Max: 41.32ms
   P90 (ms): 2.88, 3.34, 2.64
   P99 (ms): 9.41, 10.91, 8.83
  
### Test Suite: git:master #simple #no_plugins #single_route
### Result for Kong git:master (run 1):
Running 30s test @ http://10.68.128.15:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.18ms    1.89ms  33.10ms   88.57%
    Req/Sec    32.51k     8.17k   51.63k    61.65%
  Latency Distribution
     50%  468.00us
     75%    1.01ms
     90%    3.49ms
     99%    9.34ms
  4858651 requests in 30.10s, 1.02GB read
Requests/sec: 161419.52
Transfer/sec:     34.64MB
### Result for Kong git:master (run 2):
Running 30s test @ http://10.68.128.15:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.25ms    2.03ms  34.04ms   88.41%
    Req/Sec    32.53k     9.02k   58.44k    59.65%
  Latency Distribution
     50%  458.00us
     75%    1.02ms
     90%    3.75ms
     99%   10.04ms
  4860793 requests in 30.10s, 1.02GB read
Requests/sec: 161492.47
Transfer/sec:     34.65MB
### Result for Kong git:master (run 3):
Running 30s test @ http://10.68.128.15:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.21ms    1.94ms  37.28ms   88.38%
    Req/Sec    32.68k     8.76k   54.95k    60.19%
  Latency Distribution
     50%  466.00us
     75%    0.99ms
     90%    3.61ms
     99%    9.61ms
  4883610 requests in 30.10s, 1.02GB read
Requests/sec: 162251.54
Transfer/sec:     34.81MB
### Combined result for Kong git:master:
RPS     Avg: 161721.18
Latency Avg: 1.21ms    Max: 37.28ms
   P90 (ms): 3.49, 3.75, 3.61
   P99 (ms): 9.34, 10.04, 9.61
  
### Test Suite: git:master #simple #no_plugins 10 services each has 10 routes
### Result for Kong git:master (run 1):
Running 30s test @ http://10.68.128.15:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.25ms    2.03ms  35.44ms   89.01%
    Req/Sec    30.14k     8.16k   48.68k    59.53%
  Latency Distribution
     50%  521.00us
     75%    1.03ms
     90%    3.61ms
     99%   10.16ms
  4513498 requests in 30.10s, 0.95GB read
Requests/sec: 149949.65
Transfer/sec:     32.18MB
### Result for Kong git:master (run 2):
Running 30s test @ http://10.68.128.15:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.20ms    1.85ms  32.28ms   88.81%
    Req/Sec    30.41k     7.97k   50.74k    59.07%
  Latency Distribution
     50%  498.00us
     75%    1.04ms
     90%    3.43ms
     99%    9.24ms
  4553277 requests in 30.10s, 0.95GB read
Requests/sec: 151271.64
Transfer/sec:     32.46MB
### Result for Kong git:master (run 3):
Running 30s test @ http://10.68.128.15:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.21ms    1.90ms  33.79ms   88.82%
    Req/Sec    30.26k     7.90k   55.05k    59.80%
  Latency Distribution
     50%  523.00us
     75%    1.01ms
     90%    3.50ms
     99%    9.60ms
  4531541 requests in 30.10s, 0.95GB read
Requests/sec: 150549.70
Transfer/sec:     32.30MB
### Combined result for Kong git:master:
RPS     Avg: 150590.33
Latency Avg: 1.22ms    Max: 35.44ms
   P90 (ms): 3.61, 3.43, 3.5
   P99 (ms): 10.16, 9.24, 9.6
  
### Test Suite: git:master #simple #key-auth 10 services each has 10 routes with key-auth, 100 consumers
### Result for Kong git:master (run 1):
Running 30s test @ http://10.68.128.15:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.21ms    1.82ms  37.87ms   90.74%
    Req/Sec    26.17k     6.27k   43.64k    61.61%
  Latency Distribution
     50%  627.00us
     75%    1.16ms
     90%    2.73ms
     99%    9.18ms
  3911990 requests in 30.10s, 839.41MB read
Requests/sec: 129970.29
Transfer/sec:     27.89MB
### Result for Kong git:master (run 2):
Running 30s test @ http://10.68.128.15:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.27ms    1.95ms  36.85ms   90.35%
    Req/Sec    25.97k     6.59k   47.84k    61.01%
  Latency Distribution
     50%  615.00us
     75%    1.17ms
     90%    3.10ms
     99%    9.79ms
  3884099 requests in 30.10s, 833.42MB read
Requests/sec: 129043.83
Transfer/sec:     27.69MB
### Result for Kong git:master (run 3):
Running 30s test @ http://10.68.128.15:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.24ms    1.91ms  38.70ms   90.91%
    Req/Sec    26.12k     6.19k   47.75k    60.61%
  Latency Distribution
     50%  634.00us
     75%    1.13ms
     90%    2.79ms
     99%    9.71ms
  3906112 requests in 30.10s, 838.15MB read
Requests/sec: 129775.23
Transfer/sec:     27.85MB
### Combined result for Kong git:master:
RPS     Avg: 129596.45
Latency Avg: 1.24ms    Max: 38.70ms
   P90 (ms): 2.73, 3.1, 2.79
   P99 (ms): 9.18, 9.79, 9.71
  
### Test Suite: git:feat/privileged-dp-connection #simple #hybrid #no_plugins #single_route
### Result for Kong git:feat/privileged-dp-connection (run 1):
Running 30s test @ http://10.68.128.15:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.20ms    1.90ms  31.39ms   88.53%
    Req/Sec    32.33k     8.48k   52.34k    58.85%
  Latency Distribution
     50%  461.00us
     75%    1.03ms
     90%    3.53ms
     99%    9.46ms
  4831582 requests in 30.10s, 1.01GB read
Requests/sec: 160521.94
Transfer/sec:     34.44MB
### Result for Kong git:feat/privileged-dp-connection (run 2):
Running 30s test @ http://10.68.128.15:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.27ms    2.20ms  53.28ms   89.18%
    Req/Sec    32.45k     9.02k   61.75k    59.39%
  Latency Distribution
     50%  469.00us
     75%    1.01ms
     90%    3.71ms
     99%   10.42ms
  4850433 requests in 30.10s, 1.02GB read
Requests/sec: 161148.61
Transfer/sec:     34.58MB
### Result for Kong git:feat/privileged-dp-connection (run 3):
Running 30s test @ http://10.68.128.15:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.21ms    1.94ms  30.32ms   88.39%
    Req/Sec    32.39k     8.83k   58.11k    58.19%
  Latency Distribution
     50%  478.00us
     75%    0.99ms
     90%    3.61ms
     99%    9.65ms
  4840960 requests in 30.10s, 1.01GB read
Requests/sec: 160833.20
Transfer/sec:     34.51MB
### Combined result for Kong git:feat/privileged-dp-connection:
RPS     Avg: 160834.58
Latency Avg: 1.23ms    Max: 53.28ms
   P90 (ms): 3.53, 3.71, 3.61
   P99 (ms): 9.46, 10.42, 9.65
  
### Test Suite: git:feat/privileged-dp-connection #simple #hybrid #no_plugins 10 services each has 10 routes
### Result for Kong git:feat/privileged-dp-connection (run 1):
Running 30s test @ http://10.68.128.15:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.21ms    1.91ms  31.80ms   88.83%
    Req/Sec    30.26k     8.04k   49.90k    59.44%
  Latency Distribution
     50%  516.00us
     75%    1.02ms
     90%    3.51ms
     99%    9.49ms
  4528598 requests in 30.10s, 0.95GB read
Requests/sec: 150451.32
Transfer/sec:     32.28MB
### Result for Kong git:feat/privileged-dp-connection (run 2):
Running 30s test @ http://10.68.128.15:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.20ms    1.89ms  36.36ms   88.90%
    Req/Sec    30.54k     7.77k   48.65k    60.27%
  Latency Distribution
     50%  506.00us
     75%    1.00ms
     90%    3.45ms
     99%    9.43ms
  4573614 requests in 30.10s, 0.96GB read
Requests/sec: 151947.17
Transfer/sec:     32.60MB
### Result for Kong git:feat/privileged-dp-connection (run 3):
Running 30s test @ http://10.68.128.15:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.22ms    1.93ms  33.33ms   88.99%
    Req/Sec    30.10k     7.91k   50.43k    60.73%
  Latency Distribution
     50%  521.00us
     75%    1.03ms
     90%    3.49ms
     99%    9.81ms
  4506640 requests in 30.10s, 0.94GB read
Requests/sec: 149722.02
Transfer/sec:     32.13MB
### Combined result for Kong git:feat/privileged-dp-connection:
RPS     Avg: 150706.84
Latency Avg: 1.21ms    Max: 36.36ms
   P90 (ms): 3.51, 3.45, 3.49
   P99 (ms): 9.49, 9.43, 9.81
  
### Test Suite: git:feat/privileged-dp-connection #simple #hybrid #key-auth 10 services each has 10 routes with key-auth, 100 consumers
### Result for Kong git:feat/privileged-dp-connection (run 1):
Running 30s test @ http://10.68.128.15:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.20ms    1.75ms  32.92ms   90.73%
    Req/Sec    26.24k     6.11k   42.10k    61.40%
  Latency Distribution
     50%  606.00us
     75%    1.18ms
     90%    2.69ms
     99%    8.81ms
  3929154 requests in 30.10s, 843.09MB read
Requests/sec: 130536.32
Transfer/sec:     28.01MB
### Result for Kong git:feat/privileged-dp-connection (run 2):
Running 30s test @ http://10.68.128.15:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.24ms    1.88ms  41.29ms   90.70%
    Req/Sec    26.26k     6.61k   43.87k    59.85%
  Latency Distribution
     50%  613.00us
     75%    1.13ms
     90%    2.90ms
     99%    9.38ms
  3923905 requests in 30.10s, 841.96MB read
Requests/sec: 130365.75
Transfer/sec:     27.97MB
### Result for Kong git:feat/privileged-dp-connection (run 3):
Running 30s test @ http://10.68.128.15:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.23ms    1.88ms  42.53ms   91.01%
    Req/Sec    26.03k     6.43k   45.69k    61.46%
  Latency Distribution
     50%  620.00us
     75%    1.19ms
     90%    2.78ms
     99%    9.54ms
  3898567 requests in 30.10s, 836.53MB read
Requests/sec: 129520.49
Transfer/sec:     27.79MB
### Combined result for Kong git:feat/privileged-dp-connection:
RPS     Avg: 130140.85
Latency Avg: 1.22ms    Max: 42.53ms
   P90 (ms): 2.69, 2.9, 2.78
   P99 (ms): 8.81, 9.38, 9.54
  
### Test Suite: git:master #simple #hybrid #no_plugins #single_route
### Result for Kong git:master (run 1):
Running 30s test @ http://10.68.128.15:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.19ms    1.88ms  34.07ms   88.19%
    Req/Sec    32.50k     8.58k   54.28k    58.39%
  Latency Distribution
     50%  479.00us
     75%    0.96ms
     90%    3.58ms
     99%    9.27ms
  4857577 requests in 30.10s, 1.02GB read
Requests/sec: 161387.56
Transfer/sec:     34.63MB
### Result for Kong git:master (run 2):
Running 30s test @ http://10.68.128.15:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.21ms    1.93ms  40.34ms   88.36%
    Req/Sec    32.72k     8.69k   56.79k    58.79%
  Latency Distribution
     50%  465.00us
     75%    0.98ms
     90%    3.60ms
     99%    9.46ms
  4890608 requests in 30.10s, 1.02GB read
Requests/sec: 162484.44
Transfer/sec:     34.86MB
### Result for Kong git:master (run 3):
Running 30s test @ http://10.68.128.15:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.20ms    1.90ms  40.59ms   88.26%
    Req/Sec    32.39k     8.59k   72.22k    61.03%
  Latency Distribution
     50%  482.00us
     75%    0.97ms
     90%    3.60ms
     99%    9.44ms
  4837709 requests in 30.10s, 1.01GB read
Requests/sec: 160726.88
Transfer/sec:     34.49MB
### Combined result for Kong git:master:
RPS     Avg: 161532.96
Latency Avg: 1.20ms    Max: 40.59ms
   P90 (ms): 3.58, 3.6, 3.6
   P99 (ms): 9.27, 9.46, 9.44
  
### Test Suite: git:master #simple #hybrid #no_plugins 10 services each has 10 routes
### Result for Kong git:master (run 1):
Running 30s test @ http://10.68.128.15:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.20ms    1.90ms  38.51ms   88.87%
    Req/Sec    30.47k     7.76k   49.12k    59.48%
  Latency Distribution
     50%  501.00us
     75%    1.02ms
     90%    3.48ms
     99%    9.43ms
  4557063 requests in 30.10s, 0.95GB read
Requests/sec: 151401.89
Transfer/sec:     32.49MB
### Result for Kong git:master (run 2):
Running 30s test @ http://10.68.128.15:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.21ms    1.88ms  36.02ms   88.77%
    Req/Sec    30.57k     7.91k   50.38k    58.74%
  Latency Distribution
     50%  503.00us
     75%    1.01ms
     90%    3.47ms
     99%    9.39ms
  4578299 requests in 30.10s, 0.96GB read
Requests/sec: 152102.42
Transfer/sec:     32.64MB
### Result for Kong git:master (run 3):
Running 30s test @ http://10.68.128.15:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.23ms    1.96ms  37.23ms   88.91%
    Req/Sec    30.44k     8.11k   53.21k    60.73%
  Latency Distribution
     50%  513.00us
     75%    1.00ms
     90%    3.54ms
     99%    9.86ms
  4557188 requests in 30.10s, 0.95GB read
Requests/sec: 151401.22
Transfer/sec:     32.49MB
### Combined result for Kong git:master:
RPS     Avg: 151635.18
Latency Avg: 1.21ms    Max: 38.51ms
   P90 (ms): 3.48, 3.47, 3.54
   P99 (ms): 9.43, 9.39, 9.86
  
### Test Suite: git:master #simple #hybrid #key-auth 10 services each has 10 routes with key-auth, 100 consumers
### Result for Kong git:master (run 1):
Running 30s test @ http://10.68.128.15:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.22ms    1.88ms  48.74ms   90.87%
    Req/Sec    26.28k     6.37k   42.09k    60.66%
  Latency Distribution
     50%  623.00us
     75%    1.16ms
     90%    2.73ms
     99%    9.49ms
  3935159 requests in 30.10s, 844.38MB read
Requests/sec: 130735.70
Transfer/sec:     28.05MB
### Result for Kong git:master (run 2):
Running 30s test @ http://10.68.128.15:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.24ms    1.85ms  37.51ms   90.41%
    Req/Sec    26.12k     6.63k   45.67k    59.73%
  Latency Distribution
     50%  623.00us
     75%    1.13ms
     90%    2.96ms
     99%    9.21ms
  3911274 requests in 30.10s, 839.25MB read
Requests/sec: 129942.78
Transfer/sec:     27.88MB
### Result for Kong git:master (run 3):
Running 30s test @ http://10.68.128.15:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.24ms    1.88ms  37.94ms   90.76%
    Req/Sec    26.03k     6.54k   46.98k    61.34%
  Latency Distribution
     50%  626.00us
     75%    1.17ms
     90%    2.84ms
     99%    9.56ms
  3892894 requests in 30.10s, 835.31MB read
Requests/sec: 129335.90
Transfer/sec:     27.75MB
### Combined result for Kong git:master:
RPS     Avg: 130004.79
Latency Avg: 1.23ms    Max: 48.74ms
   P90 (ms): 2.73, 2.96, 2.84
   P99 (ms): 9.49, 9.21, 9.56
  

Kong error logs are also available in Github Actions artifacts.

Download Artifacts for detailed results and interactive SVG flamegraphs.

github-actions[bot] avatar Sep 28 '22 11:09 github-actions[bot]

:rocket: Performance test result

Test Suite: 01-rps 02-flamegraph (baseline,single_route,simple)

Imgur Images Imgur Images Imgur Images Imgur Images

Click to expand
Please see Github Actions artifacts for flamegraphs.

  ### Result for upstream directly (run 1):
Running 30s test @ http://10.68.128.9:8088/test
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   572.24us    1.26ms  12.15ms   87.10%
    Req/Sec   166.50k    12.18k  219.95k    69.02%
  Latency Distribution
     50%   58.00us
     75%   98.00us
     90%    2.41ms
     99%    6.26ms
  24866275 requests in 30.10s, 3.24GB read
Requests/sec: 826125.25
Transfer/sec:    110.30MB
### Result for upstream directly (run 2):
Running 30s test @ http://10.68.128.9:8088/test
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   578.05us    1.28ms  12.12ms   87.24%
    Req/Sec   154.62k     8.09k  196.18k    72.82%
  Latency Distribution
     50%   61.00us
     75%  105.00us
     90%    2.41ms
     99%    6.43ms
  23090787 requests in 30.10s, 3.01GB read
Requests/sec: 767142.71
Transfer/sec:    102.42MB
### Result for upstream directly (run 3):
Running 30s test @ http://10.68.128.9:8088/test
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   580.54us    1.28ms  12.12ms   87.31%
    Req/Sec   154.90k     7.97k  186.87k    73.50%
  Latency Distribution
     50%   61.00us
     75%  105.00us
     90%    2.42ms
     99%    6.48ms
  23147903 requests in 30.10s, 3.02GB read
Requests/sec: 769034.88
Transfer/sec:    102.68MB
### Combined result for upstream directly:
RPS     Avg: 787434.28
Latency Avg: 0.58ms    Max: 12.15ms
   P90 (ms): 2.41, 2.41, 2.42
   P99 (ms): 6.26, 6.43, 6.48
  
### Test Suite: git:feat/privileged-dp-connection #simple #no_plugins #single_route
### Result for Kong git:feat/privileged-dp-connection (run 1):
Running 30s test @ http://10.68.128.11:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.14ms    1.78ms  28.44ms   88.58%
    Req/Sec    32.87k     8.62k   54.32k    59.12%
  Latency Distribution
     50%  458.00us
     75%    1.00ms
     90%    3.30ms
     99%    8.90ms
  4912338 requests in 30.10s, 1.03GB read
Requests/sec: 163202.38
Transfer/sec:     35.02MB
### Result for Kong git:feat/privileged-dp-connection (run 2):
Running 30s test @ http://10.68.128.11:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.15ms    1.77ms  27.39ms   88.44%
    Req/Sec    32.71k     8.86k   56.82k    59.32%
  Latency Distribution
     50%  478.00us
     75%    0.93ms
     90%    3.36ms
     99%    8.87ms
  4888772 requests in 30.10s, 1.02GB read
Requests/sec: 162420.43
Transfer/sec:     34.85MB
### Result for Kong git:feat/privileged-dp-connection (run 3):
Running 30s test @ http://10.68.128.11:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.12ms    1.71ms  25.52ms   88.15%
    Req/Sec    32.90k     8.33k   54.37k    59.45%
  Latency Distribution
     50%  478.00us
     75%    0.93ms
     90%    3.33ms
     99%    8.47ms
  4917281 requests in 30.10s, 1.03GB read
Requests/sec: 163372.03
Transfer/sec:     35.06MB
### Combined result for Kong git:feat/privileged-dp-connection:
RPS     Avg: 162998.28
Latency Avg: 1.14ms    Max: 28.44ms
   P90 (ms): 3.3, 3.36, 3.33
   P99 (ms): 8.9, 8.87, 8.47
  
### Test Suite: git:feat/privileged-dp-connection #simple #no_plugins 10 services each has 10 routes
### Result for Kong git:feat/privileged-dp-connection (run 1):
Running 30s test @ http://10.68.128.11:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.17ms    1.83ms  39.52ms   89.10%
    Req/Sec    30.83k     8.10k   50.75k    60.11%
  Latency Distribution
     50%  495.00us
     75%    1.01ms
     90%    3.28ms
     99%    9.05ms
  4613686 requests in 30.10s, 0.97GB read
Requests/sec: 153283.14
Transfer/sec:     32.89MB
### Result for Kong git:feat/privileged-dp-connection (run 2):
Running 30s test @ http://10.68.128.11:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.16ms    1.79ms  31.37ms   88.81%
    Req/Sec    30.81k     8.28k   49.05k    57.94%
  Latency Distribution
     50%  508.00us
     75%    0.98ms
     90%    3.33ms
     99%    8.96ms
  4614380 requests in 30.10s, 0.97GB read
Requests/sec: 153301.36
Transfer/sec:     32.89MB
### Result for Kong git:feat/privileged-dp-connection (run 3):
Running 30s test @ http://10.68.128.11:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.15ms    1.78ms  30.51ms   88.80%
    Req/Sec    30.89k     7.94k   59.38k    59.84%
  Latency Distribution
     50%  510.00us
     75%    0.96ms
     90%    3.31ms
     99%    8.82ms
  4622503 requests in 30.10s, 0.97GB read
Requests/sec: 153575.64
Transfer/sec:     32.95MB
### Combined result for Kong git:feat/privileged-dp-connection:
RPS     Avg: 153386.71
Latency Avg: 1.16ms    Max: 39.52ms
   P90 (ms): 3.28, 3.33, 3.31
   P99 (ms): 9.05, 8.96, 8.82
  
### Test Suite: git:feat/privileged-dp-connection #simple #key-auth 10 services each has 10 routes with key-auth, 100 consumers
### Result for Kong git:feat/privileged-dp-connection (run 1):
Running 30s test @ http://10.68.128.11:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.27ms    1.92ms  40.46ms   90.26%
    Req/Sec    26.18k     6.64k   44.73k    64.16%
  Latency Distribution
     50%  598.00us
     75%    1.21ms
     90%    3.11ms
     99%    9.69ms
  3918441 requests in 30.10s, 840.79MB read
Requests/sec: 130184.06
Transfer/sec:     27.93MB
### Result for Kong git:feat/privileged-dp-connection (run 2):
Running 30s test @ http://10.68.128.11:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.28ms    2.00ms  39.72ms   90.60%
    Req/Sec    26.20k     6.91k   40.99k    60.70%
  Latency Distribution
     50%  627.00us
     75%    1.14ms
     90%    3.07ms
     99%   10.30ms
  3920853 requests in 30.10s, 841.31MB read
Requests/sec: 130264.37
Transfer/sec:     27.95MB
### Result for Kong git:feat/privileged-dp-connection (run 3):
Running 30s test @ http://10.68.128.11:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.17ms    1.70ms  35.98ms   90.92%
    Req/Sec    26.15k     6.29k   45.65k    60.31%
  Latency Distribution
     50%  618.00us
     75%    1.17ms
     90%    2.53ms
     99%    8.49ms
  3913761 requests in 30.10s, 839.79MB read
Requests/sec: 130028.78
Transfer/sec:     27.90MB
### Combined result for Kong git:feat/privileged-dp-connection:
RPS     Avg: 130159.07
Latency Avg: 1.24ms    Max: 40.46ms
   P90 (ms): 3.11, 3.07, 2.53
   P99 (ms): 9.69, 10.3, 8.49
  
### Test Suite: git:master #simple #no_plugins #single_route
### Result for Kong git:master (run 1):
Running 30s test @ http://10.68.128.11:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.15ms    1.77ms  29.53ms   88.42%
    Req/Sec    32.66k     8.80k   54.80k    59.05%
  Latency Distribution
     50%  465.00us
     75%    0.99ms
     90%    3.36ms
     99%    8.85ms
  4881318 requests in 30.10s, 1.02GB read
Requests/sec: 162175.18
Transfer/sec:     34.80MB
### Result for Kong git:master (run 2):
Running 30s test @ http://10.68.128.11:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.23ms    2.04ms  38.36ms   89.18%
    Req/Sec    32.44k     9.03k   52.81k    59.32%
  Latency Distribution
     50%  457.00us
     75%    1.05ms
     90%    3.50ms
     99%   10.12ms
  4848713 requests in 30.10s, 1.02GB read
Requests/sec: 161090.99
Transfer/sec:     34.57MB
### Result for Kong git:master (run 3):
Running 30s test @ http://10.68.128.11:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.12ms    1.72ms  25.22ms   88.34%
    Req/Sec    32.82k     8.35k   63.98k    61.63%
  Latency Distribution
     50%  469.00us
     75%    0.95ms
     90%    3.30ms
     99%    8.53ms
  4901272 requests in 30.10s, 1.03GB read
Requests/sec: 162836.58
Transfer/sec:     34.94MB
### Combined result for Kong git:master:
RPS     Avg: 162034.25
Latency Avg: 1.17ms    Max: 38.36ms
   P90 (ms): 3.36, 3.5, 3.3
   P99 (ms): 8.85, 10.12, 8.53
  
### Test Suite: git:master #simple #no_plugins 10 services each has 10 routes
### Result for Kong git:master (run 1):
Running 30s test @ http://10.68.128.11:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.14ms    1.75ms  29.47ms   88.93%
    Req/Sec    30.76k     7.89k   50.53k    60.84%
  Latency Distribution
     50%  513.00us
     75%    0.98ms
     90%    3.23ms
     99%    8.74ms
  4602273 requests in 30.10s, 0.96GB read
Requests/sec: 152903.62
Transfer/sec:     32.81MB
### Result for Kong git:master (run 2):
Running 30s test @ http://10.68.128.11:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.15ms    1.74ms  28.96ms   88.80%
    Req/Sec    30.68k     7.89k   52.19k    59.97%
  Latency Distribution
     50%  515.00us
     75%    0.97ms
     90%    3.27ms
     99%    8.75ms
  4590476 requests in 30.10s, 0.96GB read
Requests/sec: 152506.86
Transfer/sec:     32.72MB
### Result for Kong git:master (run 3):
Running 30s test @ http://10.68.128.11:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.13ms    1.72ms  29.60ms   88.82%
    Req/Sec    30.86k     7.66k   52.89k    60.86%
  Latency Distribution
     50%  495.00us
     75%    0.99ms
     90%    3.22ms
     99%    8.57ms
  4620882 requests in 30.10s, 0.97GB read
Requests/sec: 153517.20
Transfer/sec:     32.94MB
### Combined result for Kong git:master:
RPS     Avg: 152975.89
Latency Avg: 1.14ms    Max: 29.60ms
   P90 (ms): 3.23, 3.27, 3.22
   P99 (ms): 8.74, 8.75, 8.57
  
### Test Suite: git:master #simple #key-auth 10 services each has 10 routes with key-auth, 100 consumers
### Result for Kong git:master (run 1):
Running 30s test @ http://10.68.128.11:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.16ms    1.66ms  32.53ms   90.75%
    Req/Sec    26.50k     6.10k   43.51k    61.70%
  Latency Distribution
     50%  622.00us
     75%    1.12ms
     90%    2.53ms
     99%    8.24ms
  3965334 requests in 30.10s, 850.85MB read
Requests/sec: 131742.17
Transfer/sec:     28.27MB
### Result for Kong git:master (run 2):
Running 30s test @ http://10.68.128.11:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.24ms    1.91ms  43.49ms   90.95%
    Req/Sec    26.30k     6.63k   48.85k    61.74%
  Latency Distribution
     50%  594.00us
     75%    1.17ms
     90%    2.82ms
     99%    9.67ms
  3933558 requests in 30.10s, 844.04MB read
Requests/sec: 130686.61
Transfer/sec:     28.04MB
### Result for Kong git:master (run 3):
Running 30s test @ http://10.68.128.11:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.18ms    1.72ms  33.47ms   90.81%
    Req/Sec    26.34k     6.25k   49.51k    63.07%
  Latency Distribution
     50%  631.00us
     75%    1.13ms
     90%    2.61ms
     99%    8.67ms
  3940037 requests in 30.10s, 845.43MB read
Requests/sec: 130901.98
Transfer/sec:     28.09MB
### Combined result for Kong git:master:
RPS     Avg: 131110.25
Latency Avg: 1.19ms    Max: 43.49ms
   P90 (ms): 2.53, 2.82, 2.61
   P99 (ms): 8.24, 9.67, 8.67
  
### Test Suite: git:feat/privileged-dp-connection #simple #hybrid #no_plugins #single_route
### Result for Kong git:feat/privileged-dp-connection (run 1):
Running 30s test @ http://10.68.128.11:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.17ms    1.86ms  36.77ms   88.69%
    Req/Sec    32.74k     8.93k   56.22k    59.79%
  Latency Distribution
     50%  465.00us
     75%    0.98ms
     90%    3.40ms
     99%    9.24ms
  4893309 requests in 30.10s, 1.03GB read
Requests/sec: 162574.50
Transfer/sec:     34.88MB
### Result for Kong git:feat/privileged-dp-connection (run 2):
Running 30s test @ http://10.68.128.11:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.14ms    1.76ms  30.23ms   88.03%
    Req/Sec    32.99k     8.85k   60.88k    59.52%
  Latency Distribution
     50%  478.00us
     75%    0.92ms
     90%    3.42ms
     99%    8.69ms
  4930280 requests in 30.10s, 1.03GB read
Requests/sec: 163799.51
Transfer/sec:     35.15MB
### Result for Kong git:feat/privileged-dp-connection (run 3):
Running 30s test @ http://10.68.128.11:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.13ms    1.75ms  31.18ms   88.24%
    Req/Sec    32.94k     8.26k   52.89k    59.32%
  Latency Distribution
     50%  463.00us
     75%    0.95ms
     90%    3.37ms
     99%    8.66ms
  4923171 requests in 30.10s, 1.03GB read
Requests/sec: 163566.44
Transfer/sec:     35.10MB
### Combined result for Kong git:feat/privileged-dp-connection:
RPS     Avg: 163313.48
Latency Avg: 1.15ms    Max: 36.77ms
   P90 (ms): 3.4, 3.42, 3.37
   P99 (ms): 9.24, 8.69, 8.66
  
### Test Suite: git:feat/privileged-dp-connection #simple #hybrid #no_plugins 10 services each has 10 routes
### Result for Kong git:feat/privileged-dp-connection (run 1):
Running 30s test @ http://10.68.128.11:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.16ms    1.78ms  31.06ms   88.88%
    Req/Sec    30.74k     7.71k   51.35k    59.15%
  Latency Distribution
     50%  507.00us
     75%    0.99ms
     90%    3.29ms
     99%    8.81ms
  4597867 requests in 30.10s, 0.96GB read
Requests/sec: 152757.32
Transfer/sec:     32.78MB
### Result for Kong git:feat/privileged-dp-connection (run 2):
Running 30s test @ http://10.68.128.11:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.15ms    1.78ms  29.54ms   89.03%
    Req/Sec    30.67k     7.84k   50.69k    59.77%
  Latency Distribution
     50%  506.00us
     75%    1.00ms
     90%    3.24ms
     99%    8.93ms
  4589018 requests in 30.10s, 0.96GB read
Requests/sec: 152463.86
Transfer/sec:     32.71MB
### Result for Kong git:feat/privileged-dp-connection (run 3):
Running 30s test @ http://10.68.128.11:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.17ms    1.84ms  40.97ms   88.82%
    Req/Sec    30.97k     8.17k   48.17k    57.85%
  Latency Distribution
     50%  512.00us
     75%    0.95ms
     90%    3.37ms
     99%    9.07ms
  4635702 requests in 30.10s, 0.97GB read
Requests/sec: 154014.39
Transfer/sec:     33.05MB
### Combined result for Kong git:feat/privileged-dp-connection:
RPS     Avg: 153078.52
Latency Avg: 1.16ms    Max: 40.97ms
   P90 (ms): 3.29, 3.24, 3.37
   P99 (ms): 8.81, 8.93, 9.07
  
### Test Suite: git:feat/privileged-dp-connection #simple #hybrid #key-auth 10 services each has 10 routes with key-auth, 100 consumers
### Result for Kong git:feat/privileged-dp-connection (run 1):
Running 30s test @ http://10.68.128.11:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.17ms    1.70ms  33.71ms   90.77%
    Req/Sec    26.64k     6.31k   45.34k    63.03%
  Latency Distribution
     50%  595.00us
     75%    1.16ms
     90%    2.61ms
     99%    8.65ms
  3986257 requests in 30.10s, 855.34MB read
Requests/sec: 132437.38
Transfer/sec:     28.42MB
### Result for Kong git:feat/privileged-dp-connection (run 2):
Running 30s test @ http://10.68.128.11:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.18ms    1.73ms  36.87ms   90.74%
    Req/Sec    26.43k     6.59k   44.39k    59.08%
  Latency Distribution
     50%  619.00us
     75%    1.12ms
     90%    2.65ms
     99%    8.69ms
  3952018 requests in 30.10s, 848.00MB read
Requests/sec: 131300.13
Transfer/sec:     28.17MB
### Result for Kong git:feat/privileged-dp-connection (run 3):
Running 30s test @ http://10.68.128.11:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.17ms    1.72ms  34.01ms   90.77%
    Req/Sec    26.69k     6.53k   46.63k    61.08%
  Latency Distribution
     50%  614.00us
     75%    1.09ms
     90%    2.60ms
     99%    8.60ms
  3991583 requests in 30.10s, 856.49MB read
Requests/sec: 132614.41
Transfer/sec:     28.46MB
### Combined result for Kong git:feat/privileged-dp-connection:
RPS     Avg: 132117.31
Latency Avg: 1.17ms    Max: 36.87ms
   P90 (ms): 2.61, 2.65, 2.6
   P99 (ms): 8.65, 8.69, 8.6
  
### Test Suite: git:master #simple #hybrid #no_plugins #single_route
### Result for Kong git:master (run 1):
Running 30s test @ http://10.68.128.11:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.13ms    1.72ms  29.19ms   88.29%
    Req/Sec    32.82k     8.41k   56.40k    61.85%
  Latency Distribution
     50%  468.00us
     75%    0.97ms
     90%    3.31ms
     99%    8.46ms
  4904095 requests in 30.10s, 1.03GB read
Requests/sec: 162929.09
Transfer/sec:     34.96MB
### Result for Kong git:master (run 2):
Running 30s test @ http://10.68.128.11:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.16ms    1.79ms  30.41ms   88.24%
    Req/Sec    32.45k     8.83k   51.82k    59.65%
  Latency Distribution
     50%  473.00us
     75%    0.98ms
     90%    3.44ms
     99%    8.85ms
  4849488 requests in 30.10s, 1.02GB read
Requests/sec: 161116.31
Transfer/sec:     34.57MB
### Result for Kong git:master (run 3):
Running 30s test @ http://10.68.128.11:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.16ms    1.84ms  28.80ms   88.26%
    Req/Sec    33.06k     8.80k   54.23k    58.59%
  Latency Distribution
     50%  472.00us
     75%    0.91ms
     90%    3.48ms
     99%    9.19ms
  4941178 requests in 30.10s, 1.04GB read
Requests/sec: 164163.19
Transfer/sec:     35.23MB
### Combined result for Kong git:master:
RPS     Avg: 162736.20
Latency Avg: 1.15ms    Max: 30.41ms
   P90 (ms): 3.31, 3.44, 3.48
   P99 (ms): 8.46, 8.85, 9.19
  
### Test Suite: git:master #simple #hybrid #no_plugins 10 services each has 10 routes
### Result for Kong git:master (run 1):
Running 30s test @ http://10.68.128.11:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.19ms    1.90ms  35.55ms   89.14%
    Req/Sec    30.77k     8.06k   50.19k    60.51%
  Latency Distribution
     50%  501.00us
     75%    1.00ms
     90%    3.36ms
     99%    9.58ms
  4604101 requests in 30.10s, 0.96GB read
Requests/sec: 152964.53
Transfer/sec:     32.82MB
### Result for Kong git:master (run 2):
Running 30s test @ http://10.68.128.11:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.16ms    1.79ms  32.60ms   89.04%
    Req/Sec    30.43k     7.85k   51.33k    61.04%
  Latency Distribution
     50%  502.00us
     75%    1.03ms
     90%    3.25ms
     99%    8.99ms
  4553855 requests in 30.10s, 0.95GB read
Requests/sec: 151290.47
Transfer/sec:     32.46MB
### Result for Kong git:master (run 3):
Running 30s test @ http://10.68.128.11:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.16ms    1.80ms  31.06ms   88.84%
    Req/Sec    30.81k     8.12k   53.04k    61.78%
  Latency Distribution
     50%  514.00us
     75%    0.96ms
     90%    3.33ms
     99%    9.05ms
  4605369 requests in 30.10s, 0.97GB read
Requests/sec: 153006.08
Transfer/sec:     32.83MB
### Combined result for Kong git:master:
RPS     Avg: 152420.36
Latency Avg: 1.17ms    Max: 35.55ms
   P90 (ms): 3.36, 3.25, 3.33
   P99 (ms): 9.58, 8.99, 9.05
  
### Test Suite: git:master #simple #hybrid #key-auth 10 services each has 10 routes with key-auth, 100 consumers
### Result for Kong git:master (run 1):
Running 30s test @ http://10.68.128.11:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.16ms    1.68ms  30.34ms   90.59%
    Req/Sec    26.89k     6.49k   42.37k    59.44%
  Latency Distribution
     50%  611.00us
     75%    1.09ms
     90%    2.61ms
     99%    8.39ms
  4024689 requests in 30.10s, 863.59MB read
Requests/sec: 133710.26
Transfer/sec:     28.69MB
### Result for Kong git:master (run 2):
Running 30s test @ http://10.68.128.11:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.19ms    1.75ms  36.96ms   90.87%
    Req/Sec    26.42k     6.47k   48.69k    60.55%
  Latency Distribution
     50%  595.00us
     75%    1.16ms
     90%    2.66ms
     99%    8.78ms
  3950879 requests in 30.10s, 847.75MB read
Requests/sec: 131262.13
Transfer/sec:     28.17MB
### Result for Kong git:master (run 3):
Running 30s test @ http://10.68.128.11:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.20ms    1.82ms  30.89ms   90.62%
    Req/Sec    26.75k     6.52k   44.25k    62.06%
  Latency Distribution
     50%  613.00us
     75%    1.10ms
     90%    2.79ms
     99%    9.32ms
  4005518 requests in 30.10s, 859.48MB read
Requests/sec: 133073.25
Transfer/sec:     28.55MB
### Combined result for Kong git:master:
RPS     Avg: 132681.88
Latency Avg: 1.18ms    Max: 36.96ms
   P90 (ms): 2.61, 2.66, 2.79
   P99 (ms): 8.39, 8.78, 9.32
  

Kong error logs are also available in Github Actions artifacts.

Download Artifacts for detailed results and interactive SVG flamegraphs.

github-actions[bot] avatar Oct 03 '22 09:10 github-actions[bot]

:rocket: Performance test result

Test Suite: 01-rps 02-flamegraph (baseline,single_route,simple)

Imgur Images Imgur Images Imgur Images Imgur Images

Click to expand
Please see Github Actions artifacts for flamegraphs.

  ### Result for upstream directly (run 1):
Running 30s test @ http://10.68.128.5:8088/test
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   570.01us    1.25ms  16.06ms   87.11%
    Req/Sec   165.27k    15.72k  246.76k    66.02%
  Latency Distribution
     50%   60.00us
     75%  101.00us
     90%    2.40ms
     99%    6.20ms
  24678601 requests in 30.10s, 3.22GB read
Requests/sec: 819910.80
Transfer/sec:    109.47MB
### Result for upstream directly (run 2):
Running 30s test @ http://10.68.128.5:8088/test
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   572.77us    1.26ms  12.17ms   87.37%
    Req/Sec   149.96k     7.84k  191.71k    73.62%
  Latency Distribution
     50%   64.00us
     75%  108.00us
     90%    2.39ms
     99%    6.31ms
  22395610 requests in 30.10s, 2.92GB read
Requests/sec: 744062.74
Transfer/sec:     99.34MB
### Result for upstream directly (run 3):
Running 30s test @ http://10.68.128.5:8088/test
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   576.87us    1.28ms  15.90ms   87.45%
    Req/Sec   150.53k     7.27k  195.58k    71.93%
  Latency Distribution
     50%   64.00us
     75%  108.00us
     90%    2.40ms
     99%    6.44ms
  22467666 requests in 30.04s, 2.93GB read
Requests/sec: 747985.95
Transfer/sec:     99.87MB
### Combined result for upstream directly:
RPS     Avg: 770653.16
Latency Avg: 0.57ms    Max: 16.06ms
   P90 (ms): 2.4, 2.39, 2.4
   P99 (ms): 6.2, 6.31, 6.44
  
### Test Suite: git:feat/privileged-dp-connection #simple #no_plugins #single_route
### Result for Kong git:feat/privileged-dp-connection (run 1):
Running 30s test @ http://10.68.128.7:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.20ms    1.94ms  35.52ms   88.73%
    Req/Sec    33.10k     9.02k   57.09k    61.65%
  Latency Distribution
     50%  464.00us
     75%    1.02ms
     90%    3.48ms
     99%    9.60ms
  4945688 requests in 30.10s, 1.04GB read
Requests/sec: 164311.15
Transfer/sec:     35.26MB
### Result for Kong git:feat/privileged-dp-connection (run 2):
Running 30s test @ http://10.68.128.7:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.22ms    2.00ms  35.58ms   88.78%
    Req/Sec    32.92k     8.89k   55.02k    60.39%
  Latency Distribution
     50%  467.00us
     75%    1.02ms
     90%    3.56ms
     99%    9.95ms
  4920034 requests in 30.10s, 1.03GB read
Requests/sec: 163462.95
Transfer/sec:     35.07MB
### Result for Kong git:feat/privileged-dp-connection (run 3):
Running 30s test @ http://10.68.128.7:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.13ms    1.76ms  30.57ms   88.41%
    Req/Sec    33.14k     8.56k   55.46k    60.19%
  Latency Distribution
     50%  462.00us
     75%    1.01ms
     90%    3.33ms
     99%    8.74ms
  4952436 requests in 30.10s, 1.04GB read
Requests/sec: 164539.48
Transfer/sec:     35.31MB
### Combined result for Kong git:feat/privileged-dp-connection:
RPS     Avg: 164104.53
Latency Avg: 1.18ms    Max: 35.58ms
   P90 (ms): 3.48, 3.56, 3.33
   P99 (ms): 9.6, 9.95, 8.74
  
### Test Suite: git:feat/privileged-dp-connection #simple #no_plugins 10 services each has 10 routes
### Result for Kong git:feat/privileged-dp-connection (run 1):
Running 30s test @ http://10.68.128.7:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.16ms    1.82ms  34.30ms   89.11%
    Req/Sec    30.97k     8.00k   52.94k    62.06%
  Latency Distribution
     50%  506.00us
     75%    1.03ms
     90%    3.25ms
     99%    9.13ms
  4637475 requests in 30.10s, 0.97GB read
Requests/sec: 154071.84
Transfer/sec:     33.06MB
### Result for Kong git:feat/privileged-dp-connection (run 2):
Running 30s test @ http://10.68.128.7:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.16ms    1.83ms  43.51ms   89.01%
    Req/Sec    31.23k     8.09k   54.03k    58.74%
  Latency Distribution
     50%  503.00us
     75%    0.99ms
     90%    3.30ms
     99%    9.14ms
  4676504 requests in 30.10s, 0.98GB read
Requests/sec: 155368.75
Transfer/sec:     33.34MB
### Result for Kong git:feat/privileged-dp-connection (run 3):
Running 30s test @ http://10.68.128.7:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.14ms    1.75ms  28.25ms   88.90%
    Req/Sec    31.10k     7.96k   56.22k    61.13%
  Latency Distribution
     50%  507.00us
     75%    1.01ms
     90%    3.22ms
     99%    8.72ms
  4657699 requests in 30.10s, 0.98GB read
Requests/sec: 154743.71
Transfer/sec:     33.20MB
### Combined result for Kong git:feat/privileged-dp-connection:
RPS     Avg: 154728.10
Latency Avg: 1.15ms    Max: 43.51ms
   P90 (ms): 3.25, 3.3, 3.22
   P99 (ms): 9.13, 9.14, 8.72
  
### Test Suite: git:feat/privileged-dp-connection #simple #key-auth 10 services each has 10 routes with key-auth, 100 consumers
### Result for Kong git:feat/privileged-dp-connection (run 1):
Running 30s test @ http://10.68.128.7:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.18ms    1.70ms  35.43ms   90.91%
    Req/Sec    26.17k     6.66k   46.48k    64.45%
  Latency Distribution
     50%  630.00us
     75%    1.21ms
     90%    2.61ms
     99%    8.47ms
  3918516 requests in 30.10s, 840.81MB read
Requests/sec: 130185.26
Transfer/sec:     27.93MB
### Result for Kong git:feat/privileged-dp-connection (run 2):
Running 30s test @ http://10.68.128.7:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.22ms    1.84ms  38.09ms   90.59%
    Req/Sec    26.48k     6.73k   46.84k    63.46%
  Latency Distribution
     50%  625.00us
     75%    1.16ms
     90%    2.87ms
     99%    9.39ms
  3965919 requests in 30.10s, 850.98MB read
Requests/sec: 131760.42
Transfer/sec:     28.27MB
### Result for Kong git:feat/privileged-dp-connection (run 3):
Running 30s test @ http://10.68.128.7:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.21ms    1.81ms  37.33ms   90.99%
    Req/Sec    26.33k     6.65k   43.58k    62.06%
  Latency Distribution
     50%  611.00us
     75%    1.21ms
     90%    2.74ms
     99%    9.13ms
  3942341 requests in 30.10s, 845.92MB read
Requests/sec: 130977.81
Transfer/sec:     28.10MB
### Combined result for Kong git:feat/privileged-dp-connection:
RPS     Avg: 130974.50
Latency Avg: 1.20ms    Max: 38.09ms
   P90 (ms): 2.61, 2.87, 2.74
   P99 (ms): 8.47, 9.39, 9.13
  
### Test Suite: git:master #simple #no_plugins #single_route
### Result for Kong git:master (run 1):
Running 30s test @ http://10.68.128.7:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.21ms    1.97ms  34.62ms   88.73%
    Req/Sec    32.96k     9.00k   55.50k    61.12%
  Latency Distribution
     50%  475.00us
     75%    1.01ms
     90%    3.54ms
     99%    9.82ms
  4925010 requests in 30.10s, 1.03GB read
Requests/sec: 163627.20
Transfer/sec:     35.11MB
### Result for Kong git:master (run 2):
Running 30s test @ http://10.68.128.7:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.22ms    2.01ms  39.77ms   88.70%
    Req/Sec    33.24k     8.99k   56.25k    59.05%
  Latency Distribution
     50%  453.00us
     75%    1.02ms
     90%    3.60ms
     99%    9.93ms
  4968379 requests in 30.10s, 1.04GB read
Requests/sec: 165064.16
Transfer/sec:     35.42MB
### Result for Kong git:master (run 3):
Running 30s test @ http://10.68.128.7:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.14ms    1.76ms  27.24ms   88.17%
    Req/Sec    33.26k     8.46k   58.09k    60.79%
  Latency Distribution
     50%  479.00us
     75%    0.94ms
     90%    3.39ms
     99%    8.76ms
  4970569 requests in 30.10s, 1.04GB read
Requests/sec: 165136.99
Transfer/sec:     35.43MB
### Combined result for Kong git:master:
RPS     Avg: 164609.45
Latency Avg: 1.19ms    Max: 39.77ms
   P90 (ms): 3.54, 3.6, 3.39
   P99 (ms): 9.82, 9.93, 8.76
  
### Test Suite: git:master #simple #no_plugins 10 services each has 10 routes
### Result for Kong git:master (run 1):
Running 30s test @ http://10.68.128.7:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.17ms    1.81ms  30.19ms   88.99%
    Req/Sec    30.75k     8.12k   51.71k    62.39%
  Latency Distribution
     50%  501.00us
     75%    1.07ms
     90%    3.29ms
     99%    9.04ms
  4603905 requests in 30.10s, 0.96GB read
Requests/sec: 152956.28
Transfer/sec:     32.82MB
### Result for Kong git:master (run 2):
Running 30s test @ http://10.68.128.7:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.17ms    1.81ms  52.64ms   88.95%
    Req/Sec    31.14k     7.93k   54.47k    61.93%
  Latency Distribution
     50%  489.00us
     75%    1.05ms
     90%    3.27ms
     99%    8.89ms
  4663433 requests in 30.10s, 0.98GB read
Requests/sec: 154934.33
Transfer/sec:     33.24MB
### Result for Kong git:master (run 3):
Running 30s test @ http://10.68.128.7:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.16ms    1.81ms  38.54ms   89.06%
    Req/Sec    31.02k     7.99k   54.72k    60.33%
  Latency Distribution
     50%  500.00us
     75%    1.03ms
     90%    3.26ms
     99%    9.08ms
  4645361 requests in 30.10s, 0.97GB read
Requests/sec: 154333.80
Transfer/sec:     33.12MB
### Combined result for Kong git:master:
RPS     Avg: 154074.80
Latency Avg: 1.17ms    Max: 52.64ms
   P90 (ms): 3.29, 3.27, 3.26
   P99 (ms): 9.04, 8.89, 9.08
  
### Test Suite: git:master #simple #key-auth 10 services each has 10 routes with key-auth, 100 consumers
### Result for Kong git:master (run 1):
Running 30s test @ http://10.68.128.7:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.26ms    1.87ms  37.94ms   89.72%
    Req/Sec    26.25k     6.51k   45.03k    62.06%
  Latency Distribution
     50%  596.00us
     75%    1.27ms
     90%    3.20ms
     99%    9.25ms
  3931242 requests in 30.10s, 843.54MB read
Requests/sec: 130608.29
Transfer/sec:     28.03MB
### Result for Kong git:master (run 2):
Running 30s test @ http://10.68.128.7:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.22ms    1.85ms  34.67ms   90.61%
    Req/Sec    26.68k     6.53k   44.41k    60.07%
  Latency Distribution
     50%  604.00us
     75%    1.18ms
     90%    2.87ms
     99%    9.42ms
  3995129 requests in 30.10s, 857.25MB read
Requests/sec: 132731.09
Transfer/sec:     28.48MB
### Result for Kong git:master (run 3):
Running 30s test @ http://10.68.128.7:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.18ms    1.74ms  40.99ms   91.01%
    Req/Sec    26.27k     6.47k   48.47k    66.31%
  Latency Distribution
     50%  614.00us
     75%    1.22ms
     90%    2.60ms
     99%    8.78ms
  3933831 requests in 30.10s, 844.09MB read
Requests/sec: 130694.47
Transfer/sec:     28.04MB
### Combined result for Kong git:master:
RPS     Avg: 131344.62
Latency Avg: 1.22ms    Max: 40.99ms
   P90 (ms): 3.2, 2.87, 2.6
   P99 (ms): 9.25, 9.42, 8.78
  
### Test Suite: git:feat/privileged-dp-connection #simple #hybrid #no_plugins #single_route
### Result for Kong git:feat/privileged-dp-connection (run 1):
Running 30s test @ http://10.68.128.7:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.13ms    1.73ms  28.40ms   88.53%
    Req/Sec    32.82k     8.31k   55.13k    62.32%
  Latency Distribution
     50%  469.00us
     75%    1.02ms
     90%    3.27ms
     99%    8.62ms
  4904130 requests in 30.10s, 1.03GB read
Requests/sec: 162933.76
Transfer/sec:     34.96MB
### Result for Kong git:feat/privileged-dp-connection (run 2):
Running 30s test @ http://10.68.128.7:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.15ms    1.83ms  37.22ms   88.50%
    Req/Sec    33.22k     8.69k   54.59k    60.72%
  Latency Distribution
     50%  456.00us
     75%    1.02ms
     90%    3.40ms
     99%    9.06ms
  4964474 requests in 30.10s, 1.04GB read
Requests/sec: 164937.85
Transfer/sec:     35.39MB
### Result for Kong git:feat/privileged-dp-connection (run 3):
Running 30s test @ http://10.68.128.7:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.14ms    1.77ms  34.99ms   88.42%
    Req/Sec    32.84k     8.77k   59.35k    61.98%
  Latency Distribution
     50%  471.00us
     75%    1.01ms
     90%    3.34ms
     99%    8.81ms
  4908729 requests in 30.10s, 1.03GB read
Requests/sec: 163085.61
Transfer/sec:     34.99MB
### Combined result for Kong git:feat/privileged-dp-connection:
RPS     Avg: 163652.41
Latency Avg: 1.14ms    Max: 37.22ms
   P90 (ms): 3.27, 3.4, 3.34
   P99 (ms): 8.62, 9.06, 8.81
  
### Test Suite: git:feat/privileged-dp-connection #simple #hybrid #no_plugins 10 services each has 10 routes
### Result for Kong git:feat/privileged-dp-connection (run 1):
Running 30s test @ http://10.68.128.7:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.17ms    1.84ms  45.60ms   89.11%
    Req/Sec    30.95k     8.12k   52.78k    61.53%
  Latency Distribution
     50%  501.00us
     75%    1.04ms
     90%    3.29ms
     99%    9.23ms
  4633922 requests in 30.10s, 0.97GB read
Requests/sec: 153953.54
Transfer/sec:     33.03MB
### Result for Kong git:feat/privileged-dp-connection (run 2):
Running 30s test @ http://10.68.128.7:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.15ms    1.74ms  28.81ms   89.00%
    Req/Sec    30.88k     8.07k   56.29k    63.39%
  Latency Distribution
     50%  500.00us
     75%    1.05ms
     90%    3.18ms
     99%    8.64ms
  4623856 requests in 30.10s, 0.97GB read
Requests/sec: 153619.55
Transfer/sec:     32.96MB
### Result for Kong git:feat/privileged-dp-connection (run 3):
Running 30s test @ http://10.68.128.7:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.22ms    2.01ms  41.66ms   89.38%
    Req/Sec    30.90k     8.22k   51.11k    59.71%
  Latency Distribution
     50%  502.00us
     75%    1.04ms
     90%    3.43ms
     99%   10.05ms
  4624129 requests in 30.10s, 0.97GB read
Requests/sec: 153628.87
Transfer/sec:     32.96MB
### Combined result for Kong git:feat/privileged-dp-connection:
RPS     Avg: 153733.99
Latency Avg: 1.18ms    Max: 45.60ms
   P90 (ms): 3.29, 3.18, 3.43
   P99 (ms): 9.23, 8.64, 10.05
  
### Test Suite: git:feat/privileged-dp-connection #simple #hybrid #key-auth 10 services each has 10 routes with key-auth, 100 consumers
### Result for Kong git:feat/privileged-dp-connection (run 1):
Running 30s test @ http://10.68.128.7:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.18ms    1.69ms  34.28ms   90.37%
    Req/Sec    26.50k     6.11k   44.46k    62.13%
  Latency Distribution
     50%  585.00us
     75%    1.24ms
     90%    2.77ms
     99%    8.31ms
  3968261 requests in 30.10s, 851.48MB read
Requests/sec: 131838.02
Transfer/sec:     28.29MB
### Result for Kong git:feat/privileged-dp-connection (run 2):
Running 30s test @ http://10.68.128.7:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.19ms    1.73ms  34.23ms   90.67%
    Req/Sec    26.48k     6.89k   43.97k    63.59%
  Latency Distribution
     50%  610.00us
     75%    1.17ms
     90%    2.72ms
     99%    8.77ms
  3966076 requests in 30.10s, 851.01MB read
Requests/sec: 131765.87
Transfer/sec:     28.27MB
### Result for Kong git:feat/privileged-dp-connection (run 3):
Running 30s test @ http://10.68.128.7:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.17ms    1.71ms  29.56ms   90.74%
    Req/Sec    26.64k     6.35k   48.53k    62.33%
  Latency Distribution
     50%  609.00us
     75%    1.17ms
     90%    2.62ms
     99%    8.61ms
  3988190 requests in 30.10s, 855.76MB read
Requests/sec: 132500.88
Transfer/sec:     28.43MB
### Combined result for Kong git:feat/privileged-dp-connection:
RPS     Avg: 132034.92
Latency Avg: 1.18ms    Max: 34.28ms
   P90 (ms): 2.77, 2.72, 2.62
   P99 (ms): 8.31, 8.77, 8.61
  
### Test Suite: git:master #simple #hybrid #no_plugins #single_route
### Result for Kong git:master (run 1):
Running 30s test @ http://10.68.128.7:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.16ms    1.83ms  29.44ms   88.46%
    Req/Sec    33.08k     8.74k   56.16k    61.45%
  Latency Distribution
     50%  470.00us
     75%    1.00ms
     90%    3.42ms
     99%    9.12ms
  4944410 requests in 30.10s, 1.04GB read
Requests/sec: 164267.40
Transfer/sec:     35.25MB
### Result for Kong git:master (run 2):
Running 30s test @ http://10.68.128.7:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.14ms    1.78ms  28.64ms   88.31%
    Req/Sec    33.30k     8.66k   57.86k    61.52%
  Latency Distribution
     50%  464.00us
     75%    0.98ms
     90%    3.38ms
     99%    8.85ms
  4976824 requests in 30.10s, 1.04GB read
Requests/sec: 165346.24
Transfer/sec:     35.48MB
### Result for Kong git:master (run 3):
Running 30s test @ http://10.68.128.7:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.23ms    2.08ms  37.93ms   89.00%
    Req/Sec    33.28k     9.14k   57.53k    58.32%
  Latency Distribution
     50%  469.00us
     75%    0.97ms
     90%    3.59ms
     99%   10.17ms
  4972589 requests in 30.10s, 1.04GB read
Requests/sec: 165204.07
Transfer/sec:     35.45MB
### Combined result for Kong git:master:
RPS     Avg: 164939.24
Latency Avg: 1.18ms    Max: 37.93ms
   P90 (ms): 3.42, 3.38, 3.59
   P99 (ms): 9.12, 8.85, 10.17
  
### Test Suite: git:master #simple #hybrid #no_plugins 10 services each has 10 routes
### Result for Kong git:master (run 1):
Running 30s test @ http://10.68.128.7:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.21ms    1.99ms  36.87ms   89.60%
    Req/Sec    30.84k     7.98k   50.93k    60.80%
  Latency Distribution
     50%  499.00us
     75%    1.08ms
     90%    3.32ms
     99%    9.89ms
  4617838 requests in 30.10s, 0.97GB read
Requests/sec: 153419.57
Transfer/sec:     32.92MB
### Result for Kong git:master (run 2):
Running 30s test @ http://10.68.128.7:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.14ms    1.74ms  32.46ms   88.98%
    Req/Sec    31.04k     7.94k   55.33k    60.47%
  Latency Distribution
     50%  497.00us
     75%    1.02ms
     90%    3.20ms
     99%    8.72ms
  4647590 requests in 30.10s, 0.97GB read
Requests/sec: 154407.97
Transfer/sec:     33.13MB
### Result for Kong git:master (run 3):
Running 30s test @ http://10.68.128.7:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.17ms    1.84ms  38.03ms   89.04%
    Req/Sec    30.94k     8.04k   61.10k    58.80%
  Latency Distribution
     50%  502.00us
     75%    1.04ms
     90%    3.31ms
     99%    9.24ms
  4632764 requests in 30.10s, 0.97GB read
Requests/sec: 153915.27
Transfer/sec:     33.03MB
### Combined result for Kong git:master:
RPS     Avg: 153914.27
Latency Avg: 1.17ms    Max: 38.03ms
   P90 (ms): 3.32, 3.2, 3.31
   P99 (ms): 9.89, 8.72, 9.24
  
### Test Suite: git:master #simple #hybrid #key-auth 10 services each has 10 routes with key-auth, 100 consumers
### Result for Kong git:master (run 1):
Running 30s test @ http://10.68.128.7:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.48ms    2.50ms  43.15ms   90.53%
    Req/Sec    26.08k     7.62k   45.24k    65.38%
  Latency Distribution
     50%  583.00us
     75%    1.36ms
     90%    3.81ms
     99%   12.72ms
  3905823 requests in 30.10s, 838.09MB read
Requests/sec: 129763.86
Transfer/sec:     27.84MB
### Result for Kong git:master (run 2):
Running 30s test @ http://10.68.128.7:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.18ms    1.71ms  32.78ms   90.87%
    Req/Sec    26.49k     6.38k   47.65k    62.06%
  Latency Distribution
     50%  617.00us
     75%    1.18ms
     90%    2.61ms
     99%    8.70ms
  3967252 requests in 30.10s, 851.27MB read
Requests/sec: 131805.00
Transfer/sec:     28.28MB
### Result for Kong git:master (run 3):
Running 30s test @ http://10.68.128.7:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.26ms    1.94ms  36.10ms   90.30%
    Req/Sec    26.60k     6.66k   44.98k    62.52%
  Latency Distribution
     50%  617.00us
     75%    1.17ms
     90%    3.10ms
     99%   10.03ms
  3983244 requests in 30.10s, 854.70MB read
Requests/sec: 132335.98
Transfer/sec:     28.40MB
### Combined result for Kong git:master:
RPS     Avg: 131301.61
Latency Avg: 1.31ms    Max: 43.15ms
   P90 (ms): 3.81, 2.61, 3.1
   P99 (ms): 12.72, 8.7, 10.03
  

Kong error logs are also available in Github Actions artifacts.

Download Artifacts for detailed results and interactive SVG flamegraphs.

github-actions[bot] avatar Oct 04 '22 12:10 github-actions[bot]

:rocket: Performance test result

Test Suite: 01-rps 02-flamegraph (baseline,single_route,simple)

Imgur Images Imgur Images Imgur Images Imgur Images

Click to expand
Please see Github Actions artifacts for flamegraphs.

  ### Result for upstream directly (run 1):
Running 30s test @ http://10.68.128.3:8088/test
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   575.05us    1.25ms  16.05ms   86.97%
    Req/Sec   166.26k    13.21k  232.17k    67.09%
  Latency Distribution
     50%   57.00us
     75%   98.00us
     90%    2.44ms
     99%    6.22ms
  24827044 requests in 30.10s, 3.24GB read
Requests/sec: 824846.25
Transfer/sec:    110.13MB
### Result for upstream directly (run 2):
Running 30s test @ http://10.68.128.3:8088/test
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   572.38us    1.26ms  16.03ms   87.21%
    Req/Sec   155.08k     8.99k  204.47k    76.48%
  Latency Distribution
     50%   61.00us
     75%  105.00us
     90%    2.40ms
     99%    6.34ms
  23158686 requests in 30.10s, 3.02GB read
Requests/sec: 769410.94
Transfer/sec:    102.73MB
### Result for upstream directly (run 3):
Running 30s test @ http://10.68.128.3:8088/test
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   572.97us    1.26ms  16.06ms   87.18%
    Req/Sec   155.49k     9.55k  207.40k    78.60%
  Latency Distribution
     50%   61.00us
     75%  104.00us
     90%    2.40ms
     99%    6.32ms
  23206838 requests in 30.05s, 3.03GB read
Requests/sec: 772164.40
Transfer/sec:    103.09MB
### Combined result for upstream directly:
RPS     Avg: 788807.20
Latency Avg: 0.57ms    Max: 16.06ms
   P90 (ms): 2.44, 2.4, 2.4
   P99 (ms): 6.22, 6.34, 6.32
  
### Test Suite: git:feat/privileged-dp-connection #simple #no_plugins #single_route
### Result for Kong git:feat/privileged-dp-connection (run 1):
Running 30s test @ http://10.68.128.1:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.18ms    1.90ms  36.94ms   88.17%
    Req/Sec    33.37k     8.44k   56.56k    59.59%
  Latency Distribution
     50%  470.00us
     75%    0.97ms
     90%    3.59ms
     99%    9.39ms
  4986664 requests in 30.10s, 1.04GB read
Requests/sec: 165673.60
Transfer/sec:     35.55MB
### Result for Kong git:feat/privileged-dp-connection (run 2):
Running 30s test @ http://10.68.128.1:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.19ms    1.88ms  30.95ms   88.03%
    Req/Sec    33.02k     8.70k   60.58k    61.72%
  Latency Distribution
     50%  480.00us
     75%    0.95ms
     90%    3.61ms
     99%    9.24ms
  4934152 requests in 30.10s, 1.03GB read
Requests/sec: 163930.20
Transfer/sec:     35.18MB
### Result for Kong git:feat/privileged-dp-connection (run 3):
Running 30s test @ http://10.68.128.1:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.20ms    1.93ms  40.60ms   88.18%
    Req/Sec    32.99k     8.94k   66.69k    60.85%
  Latency Distribution
     50%  479.00us
     75%    0.96ms
     90%    3.65ms
     99%    9.51ms
  4930691 requests in 30.10s, 1.03GB read
Requests/sec: 163816.64
Transfer/sec:     35.15MB
### Combined result for Kong git:feat/privileged-dp-connection:
RPS     Avg: 164473.48
Latency Avg: 1.19ms    Max: 40.60ms
   P90 (ms): 3.59, 3.61, 3.65
   P99 (ms): 9.39, 9.24, 9.51
  
### Test Suite: git:feat/privileged-dp-connection #simple #no_plugins 10 services each has 10 routes
### Result for Kong git:feat/privileged-dp-connection (run 1):
Running 30s test @ http://10.68.128.1:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.19ms    1.89ms  34.24ms   88.78%
    Req/Sec    31.03k     8.27k   52.67k    62.72%
  Latency Distribution
     50%  496.00us
     75%    1.04ms
     90%    3.47ms
     99%    9.44ms
  4636689 requests in 30.10s, 0.97GB read
Requests/sec: 154047.01
Transfer/sec:     33.05MB
### Result for Kong git:feat/privileged-dp-connection (run 2):
Running 30s test @ http://10.68.128.1:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.20ms    1.91ms  35.99ms   88.71%
    Req/Sec    30.97k     8.08k   55.69k    59.31%
  Latency Distribution
     50%  516.00us
     75%    1.01ms
     90%    3.51ms
     99%    9.55ms
  4634345 requests in 30.10s, 0.97GB read
Requests/sec: 153968.85
Transfer/sec:     33.04MB
### Result for Kong git:feat/privileged-dp-connection (run 3):
Running 30s test @ http://10.68.128.1:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.18ms    1.83ms  27.94ms   88.55%
    Req/Sec    31.22k     8.08k   53.60k    58.91%
  Latency Distribution
     50%  510.00us
     75%    0.98ms
     90%    3.45ms
     99%    9.18ms
  4672306 requests in 30.10s, 0.98GB read
Requests/sec: 155229.95
Transfer/sec:     33.31MB
### Combined result for Kong git:feat/privileged-dp-connection:
RPS     Avg: 154415.27
Latency Avg: 1.19ms    Max: 35.99ms
   P90 (ms): 3.47, 3.51, 3.45
   P99 (ms): 9.44, 9.55, 9.18
  
### Test Suite: git:feat/privileged-dp-connection #simple #key-auth 10 services each has 10 routes with key-auth, 100 consumers
### Result for Kong git:feat/privileged-dp-connection (run 1):
Running 30s test @ http://10.68.128.1:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.20ms    1.79ms  41.91ms   90.53%
    Req/Sec    26.65k     6.21k   44.79k    61.79%
  Latency Distribution
     50%  624.00us
     75%    1.13ms
     90%    2.79ms
     99%    8.98ms
  3990029 requests in 30.10s, 856.15MB read
Requests/sec: 132561.99
Transfer/sec:     28.44MB
### Result for Kong git:feat/privileged-dp-connection (run 2):
Running 30s test @ http://10.68.128.1:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.23ms    1.88ms  44.00ms   90.59%
    Req/Sec    26.33k     6.71k   46.04k    62.06%
  Latency Distribution
     50%  625.00us
     75%    1.16ms
     90%    2.86ms
     99%    9.44ms
  3943238 requests in 30.10s, 846.11MB read
Requests/sec: 131007.78
Transfer/sec:     28.11MB
### Result for Kong git:feat/privileged-dp-connection (run 3):
Running 30s test @ http://10.68.128.1:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.21ms    1.82ms  34.28ms   90.46%
    Req/Sec    26.57k     6.45k   47.18k    61.73%
  Latency Distribution
     50%  637.00us
     75%    1.11ms
     90%    2.86ms
     99%    9.15ms
  3977831 requests in 30.10s, 853.54MB read
Requests/sec: 132156.70
Transfer/sec:     28.36MB
### Combined result for Kong git:feat/privileged-dp-connection:
RPS     Avg: 131908.82
Latency Avg: 1.21ms    Max: 44.00ms
   P90 (ms): 2.79, 2.86, 2.86
   P99 (ms): 8.98, 9.44, 9.15
  
### Test Suite: git:master #simple #no_plugins #single_route
### Result for Kong git:master (run 1):
Running 30s test @ http://10.68.128.1:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.20ms    1.92ms  45.66ms   88.13%
    Req/Sec    33.12k     8.50k   57.83k    59.99%
  Latency Distribution
     50%  469.00us
     75%    0.98ms
     90%    3.63ms
     99%    9.45ms
  4948548 requests in 30.10s, 1.04GB read
Requests/sec: 164405.72
Transfer/sec:     35.28MB
### Result for Kong git:master (run 2):
Running 30s test @ http://10.68.128.1:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.19ms    1.88ms  31.84ms   87.85%
    Req/Sec    32.96k     8.83k   55.40k    58.59%
  Latency Distribution
     50%  485.00us
     75%    0.95ms
     90%    3.66ms
     99%    9.26ms
  4925157 requests in 30.10s, 1.03GB read
Requests/sec: 163629.03
Transfer/sec:     35.11MB
### Result for Kong git:master (run 3):
Running 30s test @ http://10.68.128.1:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.18ms    1.87ms  36.77ms   88.16%
    Req/Sec    33.23k     8.47k   56.15k    61.12%
  Latency Distribution
     50%  480.00us
     75%    0.94ms
     90%    3.55ms
     99%    9.23ms
  4965342 requests in 30.10s, 1.04GB read
Requests/sec: 164966.19
Transfer/sec:     35.40MB
### Combined result for Kong git:master:
RPS     Avg: 164333.65
Latency Avg: 1.19ms    Max: 45.66ms
   P90 (ms): 3.63, 3.66, 3.55
   P99 (ms): 9.45, 9.26, 9.23
  
### Test Suite: git:master #simple #no_plugins 10 services each has 10 routes
### Result for Kong git:master (run 1):
Running 30s test @ http://10.68.128.1:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.19ms    1.88ms  37.15ms   88.95%
    Req/Sec    30.74k     7.77k   55.14k    61.20%
  Latency Distribution
     50%  503.00us
     75%    1.06ms
     90%    3.41ms
     99%    9.38ms
  4603579 requests in 30.10s, 0.96GB read
Requests/sec: 152946.45
Transfer/sec:     32.82MB
### Result for Kong git:master (run 2):
Running 30s test @ http://10.68.128.1:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.19ms    1.89ms  39.32ms   88.81%
    Req/Sec    30.97k     7.83k   59.64k    60.04%
  Latency Distribution
     50%  498.00us
     75%    1.04ms
     90%    3.45ms
     99%    9.35ms
  4635216 requests in 30.10s, 0.97GB read
Requests/sec: 153997.69
Transfer/sec:     33.04MB
### Result for Kong git:master (run 3):
Running 30s test @ http://10.68.128.1:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.20ms    1.90ms  29.28ms   88.72%
    Req/Sec    30.88k     7.90k   53.27k    61.20%
  Latency Distribution
     50%  506.00us
     75%    1.03ms
     90%    3.50ms
     99%    9.47ms
  4624424 requests in 30.10s, 0.97GB read
Requests/sec: 153638.84
Transfer/sec:     32.97MB
### Combined result for Kong git:master:
RPS     Avg: 153527.66
Latency Avg: 1.19ms    Max: 39.32ms
   P90 (ms): 3.41, 3.45, 3.5
   P99 (ms): 9.38, 9.35, 9.47
  
### Test Suite: git:master #simple #key-auth 10 services each has 10 routes with key-auth, 100 consumers
### Result for Kong git:master (run 1):
Running 30s test @ http://10.68.128.1:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.20ms    1.74ms  41.38ms   90.26%
    Req/Sec    26.65k     6.31k   45.43k    61.73%
  Latency Distribution
     50%  611.00us
     75%    1.16ms
     90%    2.87ms
     99%    8.69ms
  3990513 requests in 30.10s, 856.26MB read
Requests/sec: 132577.77
Transfer/sec:     28.45MB
### Result for Kong git:master (run 2):
Running 30s test @ http://10.68.128.1:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.24ms    1.95ms  46.56ms   91.00%
    Req/Sec    26.44k     6.32k   49.80k    62.70%
  Latency Distribution
     50%  618.00us
     75%    1.19ms
     90%    2.83ms
     99%    9.73ms
  3956060 requests in 30.10s, 848.86MB read
Requests/sec: 131433.73
Transfer/sec:     28.20MB
### Result for Kong git:master (run 3):
Running 30s test @ http://10.68.128.1:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.20ms    1.80ms  37.38ms   90.62%
    Req/Sec    26.58k     6.44k   44.69k    60.31%
  Latency Distribution
     50%  627.00us
     75%    1.16ms
     90%    2.75ms
     99%    9.11ms
  3977087 requests in 30.10s, 853.38MB read
Requests/sec: 132132.31
Transfer/sec:     28.35MB
### Combined result for Kong git:master:
RPS     Avg: 132047.94
Latency Avg: 1.21ms    Max: 46.56ms
   P90 (ms): 2.87, 2.83, 2.75
   P99 (ms): 8.69, 9.73, 9.11
  
### Test Suite: git:feat/privileged-dp-connection #simple #hybrid #no_plugins #single_route
### Result for Kong git:feat/privileged-dp-connection (run 1):
Running 30s test @ http://10.68.128.1:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.17ms    1.83ms  29.27ms   88.29%
    Req/Sec    33.06k     8.41k   54.81k    61.58%
  Latency Distribution
     50%  464.00us
     75%    1.03ms
     90%    3.46ms
     99%    9.09ms
  4940020 requests in 30.10s, 1.04GB read
Requests/sec: 164123.42
Transfer/sec:     35.22MB
### Result for Kong git:feat/privileged-dp-connection (run 2):
Running 30s test @ http://10.68.128.1:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.21ms    1.98ms  38.89ms   88.56%
    Req/Sec    32.86k     8.77k   58.38k    62.72%
  Latency Distribution
     50%  469.00us
     75%    1.02ms
     90%    3.61ms
     99%    9.75ms
  4911316 requests in 30.10s, 1.03GB read
Requests/sec: 163173.26
Transfer/sec:     35.01MB
### Result for Kong git:feat/privileged-dp-connection (run 3):
Running 30s test @ http://10.68.128.1:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.20ms    1.92ms  33.36ms   88.20%
    Req/Sec    33.13k     8.61k   53.03k    60.25%
  Latency Distribution
     50%  475.00us
     75%    0.98ms
     90%    3.62ms
     99%    9.48ms
  4950264 requests in 30.10s, 1.04GB read
Requests/sec: 164464.76
Transfer/sec:     35.29MB
### Combined result for Kong git:feat/privileged-dp-connection:
RPS     Avg: 163920.48
Latency Avg: 1.19ms    Max: 38.89ms
   P90 (ms): 3.46, 3.61, 3.62
   P99 (ms): 9.09, 9.75, 9.48
  
### Test Suite: git:feat/privileged-dp-connection #simple #hybrid #no_plugins 10 services each has 10 routes
### Result for Kong git:feat/privileged-dp-connection (run 1):
Running 30s test @ http://10.68.128.1:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.18ms    1.83ms  33.93ms   88.59%
    Req/Sec    31.04k     7.77k   51.09k    59.00%
  Latency Distribution
     50%  516.00us
     75%    0.99ms
     90%    3.45ms
     99%    9.11ms
  4647409 requests in 30.10s, 0.97GB read
Requests/sec: 154402.58
Transfer/sec:     33.13MB
### Result for Kong git:feat/privileged-dp-connection (run 2):
Running 30s test @ http://10.68.128.1:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.21ms    1.92ms  32.71ms   89.08%
    Req/Sec    30.68k     7.79k   55.46k    62.63%
  Latency Distribution
     50%  501.00us
     75%    1.08ms
     90%    3.42ms
     99%    9.62ms
  4590750 requests in 30.10s, 0.96GB read
Requests/sec: 152520.19
Transfer/sec:     32.73MB
### Result for Kong git:feat/privileged-dp-connection (run 3):
Running 30s test @ http://10.68.128.1:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.20ms    1.91ms  35.13ms   88.91%
    Req/Sec    30.87k     7.94k   51.16k    60.70%
  Latency Distribution
     50%  512.00us
     75%    1.03ms
     90%    3.47ms
     99%    9.61ms
  4620098 requests in 30.10s, 0.97GB read
Requests/sec: 153495.49
Transfer/sec:     32.94MB
### Combined result for Kong git:feat/privileged-dp-connection:
RPS     Avg: 153472.75
Latency Avg: 1.20ms    Max: 35.13ms
   P90 (ms): 3.45, 3.42, 3.47
   P99 (ms): 9.11, 9.62, 9.61
  
### Test Suite: git:feat/privileged-dp-connection #simple #hybrid #key-auth 10 services each has 10 routes with key-auth, 100 consumers
### Result for Kong git:feat/privileged-dp-connection (run 1):
Running 30s test @ http://10.68.128.1:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.20ms    1.77ms  35.67ms   90.51%
    Req/Sec    26.57k     6.16k   43.31k    62.33%
  Latency Distribution
     50%  600.00us
     75%    1.20ms
     90%    2.81ms
     99%    8.86ms
  3979107 requests in 30.10s, 853.81MB read
Requests/sec: 132199.55
Transfer/sec:     28.37MB
### Result for Kong git:feat/privileged-dp-connection (run 2):
Running 30s test @ http://10.68.128.1:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.22ms    1.84ms  33.86ms   90.64%
    Req/Sec    26.46k     6.63k   46.13k    62.79%
  Latency Distribution
     50%  614.00us
     75%    1.19ms
     90%    2.80ms
     99%    9.34ms
  3961599 requests in 30.10s, 850.05MB read
Requests/sec: 131617.84
Transfer/sec:     28.24MB
### Result for Kong git:feat/privileged-dp-connection (run 3):
Running 30s test @ http://10.68.128.1:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.23ms    1.89ms  38.38ms   90.63%
    Req/Sec    26.53k     6.50k   46.46k    62.39%
  Latency Distribution
     50%  629.00us
     75%    1.15ms
     90%    2.86ms
     99%    9.63ms
  3972749 requests in 30.10s, 852.45MB read
Requests/sec: 131988.40
Transfer/sec:     28.32MB
### Combined result for Kong git:feat/privileged-dp-connection:
RPS     Avg: 131935.26
Latency Avg: 1.22ms    Max: 38.38ms
   P90 (ms): 2.81, 2.8, 2.86
   P99 (ms): 8.86, 9.34, 9.63
  
### Test Suite: git:master #simple #hybrid #no_plugins #single_route
### Result for Kong git:master (run 1):
Running 30s test @ http://10.68.128.1:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.18ms    1.87ms  30.57ms   88.06%
    Req/Sec    33.18k     8.65k   58.20k    60.65%
  Latency Distribution
     50%  470.00us
     75%    0.97ms
     90%    3.59ms
     99%    9.29ms
  4958153 requests in 30.10s, 1.04GB read
Requests/sec: 164728.10
Transfer/sec:     35.35MB
### Result for Kong git:master (run 2):
Running 30s test @ http://10.68.128.1:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.20ms    1.91ms  31.98ms   88.25%
    Req/Sec    33.05k     8.81k   66.06k    62.45%
  Latency Distribution
     50%  463.00us
     75%    1.01ms
     90%    3.60ms
     99%    9.49ms
  4938716 requests in 30.10s, 1.03GB read
Requests/sec: 164078.16
Transfer/sec:     35.21MB
### Result for Kong git:master (run 3):
Running 30s test @ http://10.68.128.1:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.21ms    1.96ms  35.04ms   88.18%
    Req/Sec    33.21k     8.92k   54.03k    60.12%
  Latency Distribution
     50%  476.00us
     75%    0.96ms
     90%    3.67ms
     99%    9.65ms
  4963851 requests in 30.10s, 1.04GB read
Requests/sec: 164918.31
Transfer/sec:     35.39MB
### Combined result for Kong git:master:
RPS     Avg: 164574.86
Latency Avg: 1.20ms    Max: 35.04ms
   P90 (ms): 3.59, 3.6, 3.67
   P99 (ms): 9.29, 9.49, 9.65
  
### Test Suite: git:master #simple #hybrid #no_plugins 10 services each has 10 routes
### Result for Kong git:master (run 1):
Running 30s test @ http://10.68.128.1:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.20ms    1.91ms  31.90ms   88.86%
    Req/Sec    30.71k     7.91k   48.43k    60.37%
  Latency Distribution
     50%  500.00us
     75%    1.06ms
     90%    3.47ms
     99%    9.53ms
  4596079 requests in 30.10s, 0.96GB read
Requests/sec: 152697.36
Transfer/sec:     32.76MB
### Result for Kong git:master (run 2):
Running 30s test @ http://10.68.128.1:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.20ms    1.89ms  34.51ms   88.55%
    Req/Sec    30.95k     7.90k   53.13k    56.91%
  Latency Distribution
     50%  520.00us
     75%    1.00ms
     90%    3.55ms
     99%    9.38ms
  4630292 requests in 30.10s, 0.97GB read
Requests/sec: 153833.84
Transfer/sec:     33.01MB
### Result for Kong git:master (run 3):
Running 30s test @ http://10.68.128.1:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.21ms    1.94ms  34.98ms   88.69%
    Req/Sec    31.02k     8.09k   56.72k    59.64%
  Latency Distribution
     50%  512.00us
     75%    1.00ms
     90%    3.57ms
     99%    9.66ms
  4642426 requests in 30.10s, 0.97GB read
Requests/sec: 154237.70
Transfer/sec:     33.10MB
### Combined result for Kong git:master:
RPS     Avg: 153589.63
Latency Avg: 1.20ms    Max: 34.98ms
   P90 (ms): 3.47, 3.55, 3.57
   P99 (ms): 9.53, 9.38, 9.66
  
### Test Suite: git:master #simple #hybrid #key-auth 10 services each has 10 routes with key-auth, 100 consumers
### Result for Kong git:master (run 1):
Running 30s test @ http://10.68.128.1:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.20ms    1.78ms  36.69ms   90.65%
    Req/Sec    26.49k     6.35k   44.93k    62.33%
  Latency Distribution
     50%  630.00us
     75%    1.16ms
     90%    2.73ms
     99%    9.05ms
  3966747 requests in 30.10s, 851.16MB read
Requests/sec: 131788.94
Transfer/sec:     28.28MB
### Result for Kong git:master (run 2):
Running 30s test @ http://10.68.128.1:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.22ms    1.82ms  33.90ms   90.45%
    Req/Sec    26.51k     6.69k   49.90k    60.64%
  Latency Distribution
     50%  620.00us
     75%    1.16ms
     90%    2.87ms
     99%    9.22ms
  3966590 requests in 30.10s, 851.12MB read
Requests/sec: 131783.98
Transfer/sec:     28.28MB
### Result for Kong git:master (run 3):
Running 30s test @ http://10.68.128.1:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.22ms    1.85ms  36.05ms   90.68%
    Req/Sec    26.55k     6.41k   45.13k    61.50%
  Latency Distribution
     50%  620.00us
     75%    1.16ms
     90%    2.79ms
     99%    9.39ms
  3973772 requests in 30.10s, 852.66MB read
Requests/sec: 132022.00
Transfer/sec:     28.33MB
### Combined result for Kong git:master:
RPS     Avg: 131864.97
Latency Avg: 1.21ms    Max: 36.69ms
   P90 (ms): 2.73, 2.87, 2.79
   P99 (ms): 9.05, 9.22, 9.39
  

Kong error logs are also available in Github Actions artifacts.

Download Artifacts for detailed results and interactive SVG flamegraphs.

github-actions[bot] avatar Oct 04 '22 12:10 github-actions[bot]

:rocket: Performance test result

Test Suite: 01-rps 02-flamegraph (baseline,single_route,simple)

Imgur Images Imgur Images Imgur Images Imgur Images

Click to expand
Please see Github Actions artifacts for flamegraphs.

  ### Result for upstream directly (run 1):
Running 30s test @ http://10.68.128.1:8088/test
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   567.46us    1.25ms  19.98ms   87.17%
    Req/Sec   164.74k    13.49k  216.19k    63.89%
  Latency Distribution
     50%   59.00us
     75%  100.00us
     90%    2.38ms
     99%    6.23ms
  24600452 requests in 30.10s, 3.21GB read
Requests/sec: 817304.86
Transfer/sec:    109.12MB
### Result for upstream directly (run 2):
Running 30s test @ http://10.68.128.1:8088/test
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   570.61us    1.25ms  12.15ms   87.17%
    Req/Sec   152.59k     9.03k  204.71k    79.01%
  Latency Distribution
     50%   63.00us
     75%  106.00us
     90%    2.38ms
     99%    6.26ms
  22786993 requests in 30.10s, 2.97GB read
Requests/sec: 757062.00
Transfer/sec:    101.08MB
### Result for upstream directly (run 3):
Running 30s test @ http://10.68.128.1:8088/test
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   571.83us    1.25ms  12.13ms   87.11%
    Req/Sec   153.78k     8.50k  188.80k    75.00%
  Latency Distribution
     50%   63.00us
     75%  106.00us
     90%    2.40ms
     99%    6.23ms
  22951080 requests in 30.03s, 2.99GB read
Requests/sec: 764153.30
Transfer/sec:    102.03MB
### Combined result for upstream directly:
RPS     Avg: 779506.72
Latency Avg: 0.57ms    Max: 19.98ms
   P90 (ms): 2.38, 2.38, 2.4
   P99 (ms): 6.23, 6.26, 6.23
  
### Test Suite: git:feat/privileged-dp-connection #simple #no_plugins #single_route
### Result for Kong git:feat/privileged-dp-connection (run 1):
Running 30s test @ http://10.68.128.3:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.29ms    2.13ms  48.74ms   88.22%
    Req/Sec    32.02k     9.48k   54.21k    58.59%
  Latency Distribution
     50%  479.00us
     75%    1.04ms
     90%    3.97ms
     99%   10.46ms
  4784949 requests in 30.10s, 1.00GB read
Requests/sec: 158970.39
Transfer/sec:     34.11MB
### Result for Kong git:feat/privileged-dp-connection (run 2):
Running 30s test @ http://10.68.128.3:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.30ms    2.13ms  38.49ms   88.51%
    Req/Sec    31.04k     8.92k   55.63k    62.38%
  Latency Distribution
     50%  503.00us
     75%    1.07ms
     90%    3.91ms
     99%   10.57ms
  4638472 requests in 30.10s, 0.97GB read
Requests/sec: 154102.78
Transfer/sec:     33.07MB
### Result for Kong git:feat/privileged-dp-connection (run 3):
Running 30s test @ http://10.68.128.3:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.30ms    2.11ms  43.34ms   88.22%
    Req/Sec    31.37k     9.43k   58.16k    59.32%
  Latency Distribution
     50%  493.00us
     75%    1.05ms
     90%    3.97ms
     99%   10.46ms
  4687612 requests in 30.10s, 0.98GB read
Requests/sec: 155739.09
Transfer/sec:     33.42MB
### Combined result for Kong git:feat/privileged-dp-connection:
RPS     Avg: 156270.75
Latency Avg: 1.30ms    Max: 48.74ms
   P90 (ms): 3.97, 3.91, 3.97
   P99 (ms): 10.46, 10.57, 10.46
  
### Test Suite: git:feat/privileged-dp-connection #simple #no_plugins 10 services each has 10 routes
### Result for Kong git:feat/privileged-dp-connection (run 1):
Running 30s test @ http://10.68.128.3:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.27ms    2.04ms  36.74ms   89.00%
    Req/Sec    29.15k     7.93k   54.21k    59.93%
  Latency Distribution
     50%  549.00us
     75%    1.05ms
     90%    3.68ms
     99%   10.27ms
  4365429 requests in 30.10s, 0.91GB read
Requests/sec: 145032.16
Transfer/sec:     31.12MB
### Result for Kong git:feat/privileged-dp-connection (run 2):
Running 30s test @ http://10.68.128.3:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.29ms    2.07ms  37.15ms   89.09%
    Req/Sec    29.18k     8.25k   59.35k    61.26%
  Latency Distribution
     50%  529.00us
     75%    1.11ms
     90%    3.70ms
     99%   10.39ms
  4369806 requests in 30.10s, 0.92GB read
Requests/sec: 145177.91
Transfer/sec:     31.15MB
### Result for Kong git:feat/privileged-dp-connection (run 3):
Running 30s test @ http://10.68.128.3:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.31ms    2.17ms  39.71ms   88.90%
    Req/Sec    29.52k     8.58k   59.39k    60.00%
  Latency Distribution
     50%  538.00us
     75%    1.04ms
     90%    3.88ms
     99%   10.83ms
  4420151 requests in 30.10s, 0.93GB read
Requests/sec: 146850.25
Transfer/sec:     31.51MB
### Combined result for Kong git:feat/privileged-dp-connection:
RPS     Avg: 145686.77
Latency Avg: 1.29ms    Max: 39.71ms
   P90 (ms): 3.68, 3.7, 3.88
   P99 (ms): 10.27, 10.39, 10.83
  
### Test Suite: git:feat/privileged-dp-connection #simple #key-auth 10 services each has 10 routes with key-auth, 100 consumers
### Result for Kong git:feat/privileged-dp-connection (run 1):
Running 30s test @ http://10.68.128.3:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.28ms    1.99ms  44.92ms   91.14%
    Req/Sec    25.17k     6.61k   42.45k    59.40%
  Latency Distribution
     50%  648.00us
     75%    1.24ms
     90%    2.82ms
     99%    9.89ms
  3769395 requests in 30.10s, 808.81MB read
Requests/sec: 125230.19
Transfer/sec:     26.87MB
### Result for Kong git:feat/privileged-dp-connection (run 2):
Running 30s test @ http://10.68.128.3:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.26ms    1.86ms  37.79ms   91.25%
    Req/Sec    24.80k     6.01k   49.93k    62.06%
  Latency Distribution
     50%  670.00us
     75%    1.21ms
     90%    2.59ms
     99%    9.40ms
  3713668 requests in 30.10s, 796.85MB read
Requests/sec: 123379.06
Transfer/sec:     26.47MB
### Result for Kong git:feat/privileged-dp-connection (run 3):
Running 30s test @ http://10.68.128.3:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.27ms    1.95ms  38.55ms   91.29%
    Req/Sec    24.90k     6.26k   44.48k    63.72%
  Latency Distribution
     50%  677.00us
     75%    1.19ms
     90%    2.61ms
     99%    9.78ms
  3729335 requests in 30.10s, 800.21MB read
Requests/sec: 123899.74
Transfer/sec:     26.59MB
### Combined result for Kong git:feat/privileged-dp-connection:
RPS     Avg: 124169.66
Latency Avg: 1.27ms    Max: 44.92ms
   P90 (ms): 2.82, 2.59, 2.61
   P99 (ms): 9.89, 9.4, 9.78
  
### Test Suite: git:master #simple #no_plugins #single_route
### Result for Kong git:master (run 1):
Running 30s test @ http://10.68.128.3:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.29ms    2.08ms  32.18ms   88.19%
    Req/Sec    31.46k     9.26k   55.35k    61.05%
  Latency Distribution
     50%  502.00us
     75%    1.02ms
     90%    3.94ms
     99%   10.32ms
  4701753 requests in 30.10s, 0.99GB read
Requests/sec: 156209.64
Transfer/sec:     33.52MB
### Result for Kong git:master (run 2):
Running 30s test @ http://10.68.128.3:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.29ms    2.10ms  33.17ms   88.39%
    Req/Sec    30.75k     9.05k   61.53k    61.65%
  Latency Distribution
     50%  513.00us
     75%    1.05ms
     90%    3.91ms
     99%   10.39ms
  4596398 requests in 30.10s, 0.96GB read
Requests/sec: 152705.73
Transfer/sec:     32.77MB
### Result for Kong git:master (run 3):
Running 30s test @ http://10.68.128.3:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.29ms    2.11ms  38.51ms   88.19%
    Req/Sec    31.30k     9.22k   61.28k    59.79%
  Latency Distribution
     50%  514.00us
     75%    0.98ms
     90%    3.97ms
     99%   10.38ms
  4676943 requests in 30.10s, 0.98GB read
Requests/sec: 155381.64
Transfer/sec:     33.34MB
### Combined result for Kong git:master:
RPS     Avg: 154765.67
Latency Avg: 1.29ms    Max: 38.51ms
   P90 (ms): 3.94, 3.91, 3.97
   P99 (ms): 10.32, 10.39, 10.38
  
### Test Suite: git:master #simple #no_plugins 10 services each has 10 routes
### Result for Kong git:master (run 1):
Running 30s test @ http://10.68.128.3:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.37ms    2.36ms  55.56ms   89.41%
    Req/Sec    29.33k     8.75k   49.16k    59.47%
  Latency Distribution
     50%  519.00us
     75%    1.13ms
     90%    3.95ms
     99%   11.60ms
  4391446 requests in 30.10s, 0.92GB read
Requests/sec: 145897.31
Transfer/sec:     31.31MB
### Result for Kong git:master (run 2):
Running 30s test @ http://10.68.128.3:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.29ms    2.08ms  35.25ms   88.81%
    Req/Sec    29.41k     8.41k   53.18k    60.73%
  Latency Distribution
     50%  537.00us
     75%    1.07ms
     90%    3.81ms
     99%   10.39ms
  4404112 requests in 30.10s, 0.92GB read
Requests/sec: 146317.83
Transfer/sec:     31.40MB
### Result for Kong git:master (run 3):
Running 30s test @ http://10.68.128.3:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.30ms    2.13ms  35.02ms   88.84%
    Req/Sec    29.52k     8.49k   55.01k    58.67%
  Latency Distribution
     50%  539.00us
     75%    1.04ms
     90%    3.84ms
     99%   10.56ms
  4420310 requests in 30.10s, 0.93GB read
Requests/sec: 146855.61
Transfer/sec:     31.51MB
### Combined result for Kong git:master:
RPS     Avg: 146356.92
Latency Avg: 1.32ms    Max: 55.56ms
   P90 (ms): 3.95, 3.81, 3.84
   P99 (ms): 11.6, 10.39, 10.56
  
### Test Suite: git:master #simple #key-auth 10 services each has 10 routes with key-auth, 100 consumers
### Result for Kong git:master (run 1):
Running 30s test @ http://10.68.128.3:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.28ms    1.97ms  35.27ms   90.66%
    Req/Sec    25.72k     6.84k   43.21k    60.20%
  Latency Distribution
     50%  644.00us
     75%    1.19ms
     90%    2.96ms
     99%    9.88ms
  3850971 requests in 30.10s, 826.31MB read
Requests/sec: 127940.81
Transfer/sec:     27.45MB
### Result for Kong git:master (run 2):
Running 30s test @ http://10.68.128.3:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.27ms    1.90ms  35.32ms   91.34%
    Req/Sec    24.83k     6.42k   50.76k    62.79%
  Latency Distribution
     50%  660.00us
     75%    1.25ms
     90%    2.68ms
     99%    9.59ms
  3717492 requests in 30.10s, 797.67MB read
Requests/sec: 123506.08
Transfer/sec:     26.50MB
### Result for Kong git:master (run 3):
Running 30s test @ http://10.68.128.3:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.27ms    1.92ms  49.10ms   91.21%
    Req/Sec    24.88k     6.32k   43.56k    62.79%
  Latency Distribution
     50%  656.00us
     75%    1.28ms
     90%    2.76ms
     99%    9.59ms
  3724702 requests in 30.10s, 799.22MB read
Requests/sec: 123745.57
Transfer/sec:     26.55MB
### Combined result for Kong git:master:
RPS     Avg: 125064.15
Latency Avg: 1.27ms    Max: 49.10ms
   P90 (ms): 2.96, 2.68, 2.76
   P99 (ms): 9.88, 9.59, 9.59
  
### Test Suite: git:feat/privileged-dp-connection #simple #hybrid #no_plugins #single_route
### Result for Kong git:feat/privileged-dp-connection (run 1):
Running 30s test @ http://10.68.128.3:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.27ms    2.06ms  41.72ms   88.36%
    Req/Sec    31.16k     9.06k   51.61k    58.19%
  Latency Distribution
     50%  505.00us
     75%    1.03ms
     90%    3.85ms
     99%   10.13ms
  4656060 requests in 30.10s, 0.98GB read
Requests/sec: 154689.08
Transfer/sec:     33.19MB
### Result for Kong git:feat/privileged-dp-connection (run 2):
Running 30s test @ http://10.68.128.3:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.30ms    2.11ms  32.26ms   88.07%
    Req/Sec    31.54k     9.64k   69.36k    60.89%
  Latency Distribution
     50%  503.00us
     75%    1.01ms
     90%    4.01ms
     99%   10.42ms
  4710219 requests in 30.10s, 0.99GB read
Requests/sec: 156491.23
Transfer/sec:     33.58MB
### Result for Kong git:feat/privileged-dp-connection (run 3):
Running 30s test @ http://10.68.128.3:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.29ms    2.09ms  43.22ms   88.25%
    Req/Sec    31.17k     9.45k   62.33k    60.85%
  Latency Distribution
     50%  504.00us
     75%    1.04ms
     90%    3.93ms
     99%   10.30ms
  4659107 requests in 30.10s, 0.98GB read
Requests/sec: 154790.92
Transfer/sec:     33.21MB
### Combined result for Kong git:feat/privileged-dp-connection:
RPS     Avg: 155323.74
Latency Avg: 1.29ms    Max: 43.22ms
   P90 (ms): 3.85, 4.01, 3.93
   P99 (ms): 10.13, 10.42, 10.3
  
### Test Suite: git:feat/privileged-dp-connection #simple #hybrid #no_plugins 10 services each has 10 routes
### Result for Kong git:feat/privileged-dp-connection (run 1):
Running 30s test @ http://10.68.128.3:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.30ms    2.11ms  48.47ms   89.22%
    Req/Sec    28.72k     8.04k   46.95k    58.80%
  Latency Distribution
     50%  551.00us
     75%    1.10ms
     90%    3.70ms
     99%   10.57ms
  4300989 requests in 30.10s, 0.90GB read
Requests/sec: 142891.45
Transfer/sec:     30.66MB
### Result for Kong git:feat/privileged-dp-connection (run 2):
Running 30s test @ http://10.68.128.3:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.29ms    2.10ms  38.02ms   89.04%
    Req/Sec    29.00k     8.24k   51.43k    60.93%
  Latency Distribution
     50%  552.00us
     75%    1.07ms
     90%    3.74ms
     99%   10.44ms
  4343388 requests in 30.10s, 0.91GB read
Requests/sec: 144300.76
Transfer/sec:     30.96MB
### Result for Kong git:feat/privileged-dp-connection (run 3):
Running 30s test @ http://10.68.128.3:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.30ms    2.12ms  46.37ms   88.96%
    Req/Sec    29.23k     8.36k   55.11k    60.94%
  Latency Distribution
     50%  537.00us
     75%    1.07ms
     90%    3.80ms
     99%   10.62ms
  4371459 requests in 30.10s, 0.92GB read
Requests/sec: 145233.15
Transfer/sec:     31.16MB
### Combined result for Kong git:feat/privileged-dp-connection:
RPS     Avg: 144141.79
Latency Avg: 1.30ms    Max: 48.47ms
   P90 (ms): 3.7, 3.74, 3.8
   P99 (ms): 10.57, 10.44, 10.62
  
### Test Suite: git:feat/privileged-dp-connection #simple #hybrid #key-auth 10 services each has 10 routes with key-auth, 100 consumers
### Result for Kong git:feat/privileged-dp-connection (run 1):
Running 30s test @ http://10.68.128.3:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.30ms    1.96ms  37.49ms   90.33%
    Req/Sec    25.42k     6.70k   47.27k    60.73%
  Latency Distribution
     50%  619.00us
     75%    1.28ms
     90%    3.15ms
     99%    9.73ms
  3806326 requests in 30.10s, 816.73MB read
Requests/sec: 126457.26
Transfer/sec:     27.13MB
### Result for Kong git:feat/privileged-dp-connection (run 2):
Running 30s test @ http://10.68.128.3:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.26ms    1.91ms  39.59ms   91.31%
    Req/Sec    24.91k     6.22k   41.84k    61.70%
  Latency Distribution
     50%  661.00us
     75%    1.25ms
     90%    2.62ms
     99%    9.62ms
  3727408 requests in 30.10s, 799.80MB read
Requests/sec: 123835.84
Transfer/sec:     26.57MB
### Result for Kong git:feat/privileged-dp-connection (run 3):
Running 30s test @ http://10.68.128.3:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.26ms    1.90ms  37.28ms   91.14%
    Req/Sec    25.10k     6.55k   48.44k    61.92%
  Latency Distribution
     50%  665.00us
     75%    1.20ms
     90%    2.71ms
     99%    9.51ms
  3750810 requests in 30.10s, 804.82MB read
Requests/sec: 124612.81
Transfer/sec:     26.74MB
### Combined result for Kong git:feat/privileged-dp-connection:
RPS     Avg: 124968.64
Latency Avg: 1.27ms    Max: 39.59ms
   P90 (ms): 3.15, 2.62, 2.71
   P99 (ms): 9.73, 9.62, 9.51
  
### Test Suite: git:master #simple #hybrid #no_plugins #single_route
### Result for Kong git:master (run 1):
Running 30s test @ http://10.68.128.3:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.30ms    2.14ms  37.54ms   88.45%
    Req/Sec    31.14k     9.56k   68.81k    59.63%
  Latency Distribution
     50%  491.00us
     75%    1.09ms
     90%    3.94ms
     99%   10.58ms
  4649961 requests in 30.10s, 0.97GB read
Requests/sec: 154488.41
Transfer/sec:     33.15MB
### Result for Kong git:master (run 2):
Running 30s test @ http://10.68.128.3:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.29ms    2.07ms  34.56ms   88.32%
    Req/Sec    30.95k     9.19k   71.96k    61.98%
  Latency Distribution
     50%  507.00us
     75%    1.04ms
     90%    3.90ms
     99%   10.31ms
  4625078 requests in 30.10s, 0.97GB read
Requests/sec: 153658.49
Transfer/sec:     32.97MB
### Result for Kong git:master (run 3):
Running 30s test @ http://10.68.128.3:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.31ms    2.14ms  34.17ms   88.18%
    Req/Sec    31.35k     9.86k   55.34k    58.59%
  Latency Distribution
     50%  499.00us
     75%    1.02ms
     90%    4.01ms
     99%   10.56ms
  4684879 requests in 30.10s, 0.98GB read
Requests/sec: 155649.87
Transfer/sec:     33.40MB
### Combined result for Kong git:master:
RPS     Avg: 154598.92
Latency Avg: 1.30ms    Max: 37.54ms
   P90 (ms): 3.94, 3.9, 4.01
   P99 (ms): 10.58, 10.31, 10.56
  
### Test Suite: git:master #simple #hybrid #no_plugins 10 services each has 10 routes
### Result for Kong git:master (run 1):
Running 30s test @ http://10.68.128.3:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.31ms    2.13ms  38.25ms   89.16%
    Req/Sec    28.79k     8.46k   52.54k    58.85%
  Latency Distribution
     50%  533.00us
     75%    1.13ms
     90%    3.75ms
     99%   10.70ms
  4301638 requests in 30.10s, 0.90GB read
Requests/sec: 142912.70
Transfer/sec:     30.67MB
### Result for Kong git:master (run 2):
Running 30s test @ http://10.68.128.3:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.30ms    2.12ms  37.35ms   89.18%
    Req/Sec    29.07k     8.07k   54.39k    59.12%
  Latency Distribution
     50%  545.00us
     75%    1.07ms
     90%    3.74ms
     99%   10.71ms
  4343754 requests in 30.10s, 0.91GB read
Requests/sec: 144315.28
Transfer/sec:     30.97MB
### Result for Kong git:master (run 3):
Running 30s test @ http://10.68.128.3:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.27ms    2.01ms  34.62ms   89.12%
    Req/Sec    28.92k     8.05k   58.31k    61.46%
  Latency Distribution
     50%  538.00us
     75%    1.11ms
     90%    3.61ms
     99%   10.06ms
  4330247 requests in 30.10s, 0.91GB read
Requests/sec: 143863.52
Transfer/sec:     30.87MB
### Combined result for Kong git:master:
RPS     Avg: 143697.17
Latency Avg: 1.29ms    Max: 38.25ms
   P90 (ms): 3.75, 3.74, 3.61
   P99 (ms): 10.7, 10.71, 10.06
  
### Test Suite: git:master #simple #hybrid #key-auth 10 services each has 10 routes with key-auth, 100 consumers
### Result for Kong git:master (run 1):
Running 30s test @ http://10.68.128.3:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.27ms    1.94ms  38.52ms   90.86%
    Req/Sec    25.46k     6.75k   41.72k    61.86%
  Latency Distribution
     50%  656.00us
     75%    1.18ms
     90%    2.84ms
     99%    9.74ms
  3812388 requests in 30.10s, 818.04MB read
Requests/sec: 126658.58
Transfer/sec:     27.18MB
### Result for Kong git:master (run 2):
Running 30s test @ http://10.68.128.3:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.26ms    1.90ms  35.87ms   91.13%
    Req/Sec    24.93k     6.34k   47.88k    64.32%
  Latency Distribution
     50%  691.00us
     75%    1.18ms
     90%    2.63ms
     99%    9.64ms
  3732913 requests in 30.10s, 800.98MB read
Requests/sec: 124018.52
Transfer/sec:     26.61MB
### Result for Kong git:master (run 3):
Running 30s test @ http://10.68.128.3:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.29ms    2.03ms  44.48ms   91.44%
    Req/Sec    24.94k     6.61k   46.85k    62.79%
  Latency Distribution
     50%  648.00us
     75%    1.27ms
     90%    2.77ms
     99%   10.21ms
  3735684 requests in 30.10s, 801.58MB read
Requests/sec: 124110.75
Transfer/sec:     26.63MB
### Combined result for Kong git:master:
RPS     Avg: 124929.28
Latency Avg: 1.27ms    Max: 44.48ms
   P90 (ms): 2.84, 2.63, 2.77
   P99 (ms): 9.74, 9.64, 10.21
  

Kong error logs are also available in Github Actions artifacts.

Download Artifacts for detailed results and interactive SVG flamegraphs.

github-actions[bot] avatar Oct 07 '22 14:10 github-actions[bot]

:rocket: Performance test result

Test Suite: 01-rps 02-flamegraph (baseline,single_route,simple)

Imgur Images Imgur Images Imgur Images Imgur Images

Click to expand
Please see Github Actions artifacts for flamegraphs.

  ### Result for upstream directly (run 1):
Running 30s test @ http://10.68.128.1:8088/test
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   569.60us    1.24ms  20.00ms   87.03%
    Req/Sec   166.03k    12.06k  212.02k    67.16%
  Latency Distribution
     50%   59.00us
     75%   99.00us
     90%    2.40ms
     99%    6.10ms
  24798060 requests in 30.10s, 3.23GB read
Requests/sec: 823863.61
Transfer/sec:    110.00MB
### Result for upstream directly (run 2):
Running 30s test @ http://10.68.128.1:8088/test
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   574.35us    1.25ms  12.11ms   87.11%
    Req/Sec   156.83k     7.88k  195.10k    72.27%
  Latency Distribution
     50%   62.00us
     75%  104.00us
     90%    2.42ms
     99%    6.24ms
  23406482 requests in 30.03s, 3.05GB read
Requests/sec: 779368.37
Transfer/sec:    104.06MB
### Result for upstream directly (run 3):
Running 30s test @ http://10.68.128.1:8088/test
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   573.70us    1.25ms  12.17ms   87.09%
    Req/Sec   156.92k     8.24k  205.69k    73.73%
  Latency Distribution
     50%   63.00us
     75%  104.00us
     90%    2.41ms
     99%    6.20ms
  23421199 requests in 30.05s, 3.05GB read
Requests/sec: 779450.45
Transfer/sec:    104.07MB
### Combined result for upstream directly:
RPS     Avg: 794227.48
Latency Avg: 0.57ms    Max: 20.00ms
   P90 (ms): 2.4, 2.42, 2.41
   P99 (ms): 6.1, 6.24, 6.2
  
### Test Suite: git:feat/privileged-dp-connection #simple #no_plugins #single_route
### Result for Kong git:feat/privileged-dp-connection (run 1):
Running 30s test @ http://10.68.128.3:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.23ms    1.96ms  26.84ms   87.75%
    Req/Sec    32.88k     9.09k   55.20k    59.72%
  Latency Distribution
     50%  485.00us
     75%    0.95ms
     90%    3.83ms
     99%    9.63ms
  4914190 requests in 30.10s, 1.03GB read
Requests/sec: 163265.03
Transfer/sec:     35.03MB
### Result for Kong git:feat/privileged-dp-connection (run 2):
Running 30s test @ http://10.68.128.3:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.37ms    2.31ms  34.60ms   88.87%
    Req/Sec    31.80k     9.77k   60.13k    62.18%
  Latency Distribution
     50%  453.00us
     75%    1.21ms
     90%    4.04ms
     99%   11.52ms
  4752388 requests in 30.10s, 1.00GB read
Requests/sec: 157887.53
Transfer/sec:     33.88MB
### Result for Kong git:feat/privileged-dp-connection (run 3):
Running 30s test @ http://10.68.128.3:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.23ms    1.96ms  39.33ms   87.85%
    Req/Sec    32.90k     8.93k   57.45k    60.52%
  Latency Distribution
     50%  478.00us
     75%    0.96ms
     90%    3.81ms
     99%    9.60ms
  4916759 requests in 30.10s, 1.03GB read
Requests/sec: 163350.15
Transfer/sec:     35.05MB
### Combined result for Kong git:feat/privileged-dp-connection:
RPS     Avg: 161500.90
Latency Avg: 1.28ms    Max: 39.33ms
   P90 (ms): 3.83, 4.04, 3.81
   P99 (ms): 9.63, 11.52, 9.6
  
### Test Suite: git:feat/privileged-dp-connection #simple #no_plugins 10 services each has 10 routes
### Result for Kong git:feat/privileged-dp-connection (run 1):
Running 30s test @ http://10.68.128.3:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.32ms    2.20ms  37.39ms   88.94%
    Req/Sec    30.31k     8.64k   50.04k    59.80%
  Latency Distribution
     50%  507.00us
     75%    1.09ms
     90%    3.88ms
     99%   10.94ms
  4539885 requests in 30.10s, 0.95GB read
Requests/sec: 150826.31
Transfer/sec:     32.36MB
### Result for Kong git:feat/privileged-dp-connection (run 2):
Running 30s test @ http://10.68.128.3:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.30ms    2.16ms  37.97ms   88.75%
    Req/Sec    30.55k     8.76k   54.66k    56.21%
  Latency Distribution
     50%  516.00us
     75%    1.04ms
     90%    3.88ms
     99%   10.73ms
  4575607 requests in 30.10s, 0.96GB read
Requests/sec: 152013.43
Transfer/sec:     32.62MB
### Result for Kong git:feat/privileged-dp-connection (run 3):
Running 30s test @ http://10.68.128.3:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.26ms    2.03ms  31.11ms   88.50%
    Req/Sec    30.60k     8.38k   55.27k    59.07%
  Latency Distribution
     50%  525.00us
     75%    1.01ms
     90%    3.78ms
     99%   10.12ms
  4582056 requests in 30.10s, 0.96GB read
Requests/sec: 152227.78
Transfer/sec:     32.66MB
### Combined result for Kong git:feat/privileged-dp-connection:
RPS     Avg: 151689.17
Latency Avg: 1.29ms    Max: 37.97ms
   P90 (ms): 3.88, 3.88, 3.78
   P99 (ms): 10.94, 10.73, 10.12
  
### Test Suite: git:feat/privileged-dp-connection #simple #key-auth 10 services each has 10 routes with key-auth, 100 consumers
### Result for Kong git:feat/privileged-dp-connection (run 1):
Running 30s test @ http://10.68.128.3:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.29ms    2.05ms  40.16ms   90.84%
    Req/Sec    25.81k     6.91k   46.03k    60.00%
  Latency Distribution
     50%  621.00us
     75%    1.23ms
     90%    2.96ms
     99%   10.34ms
  3864672 requests in 30.10s, 829.25MB read
Requests/sec: 128394.27
Transfer/sec:     27.55MB
### Result for Kong git:feat/privileged-dp-connection (run 2):
Running 30s test @ http://10.68.128.3:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.28ms    2.03ms  41.72ms   90.72%
    Req/Sec    26.01k     6.73k   45.33k    59.20%
  Latency Distribution
     50%  634.00us
     75%    1.17ms
     90%    2.98ms
     99%   10.26ms
  3894250 requests in 30.10s, 835.60MB read
Requests/sec: 129377.67
Transfer/sec:     27.76MB
### Result for Kong git:feat/privileged-dp-connection (run 3):
Running 30s test @ http://10.68.128.3:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.27ms    1.94ms  50.95ms   90.70%
    Req/Sec    25.87k     6.81k   43.93k    60.97%
  Latency Distribution
     50%  624.00us
     75%    1.21ms
     90%    2.92ms
     99%    9.55ms
  3871445 requests in 30.10s, 830.71MB read
Requests/sec: 128619.26
Transfer/sec:     27.60MB
### Combined result for Kong git:feat/privileged-dp-connection:
RPS     Avg: 128797.07
Latency Avg: 1.28ms    Max: 50.95ms
   P90 (ms): 2.96, 2.98, 2.92
   P99 (ms): 10.34, 10.26, 9.55
  
### Test Suite: git:master #simple #no_plugins #single_route
### Result for Kong git:master (run 1):
Running 30s test @ http://10.68.128.3:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.26ms    2.04ms  36.82ms   88.08%
    Req/Sec    32.37k     9.14k   61.17k    60.79%
  Latency Distribution
     50%  482.00us
     75%    1.01ms
     90%    3.86ms
     99%   10.00ms
  4837505 requests in 30.10s, 1.01GB read
Requests/sec: 160718.84
Transfer/sec:     34.49MB
### Result for Kong git:master (run 2):
Running 30s test @ http://10.68.128.3:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.25ms    2.02ms  35.89ms   88.14%
    Req/Sec    32.34k     9.31k   61.14k    60.96%
  Latency Distribution
     50%  482.00us
     75%    1.02ms
     90%    3.82ms
     99%   10.02ms
  4829198 requests in 30.10s, 1.01GB read
Requests/sec: 160445.15
Transfer/sec:     34.43MB
### Result for Kong git:master (run 3):
Running 30s test @ http://10.68.128.3:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.25ms    2.01ms  30.74ms   87.83%
    Req/Sec    32.52k     9.22k   63.48k    61.52%
  Latency Distribution
     50%  487.00us
     75%    0.98ms
     90%    3.89ms
     99%    9.92ms
  4859346 requests in 30.10s, 1.02GB read
Requests/sec: 161442.78
Transfer/sec:     34.64MB
### Combined result for Kong git:master:
RPS     Avg: 160868.92
Latency Avg: 1.25ms    Max: 36.82ms
   P90 (ms): 3.86, 3.82, 3.89
   P99 (ms): 10, 10.02, 9.92
  
### Test Suite: git:master #simple #no_plugins 10 services each has 10 routes
### Result for Kong git:master (run 1):
Running 30s test @ http://10.68.128.3:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.27ms    2.06ms  41.83ms   88.48%
    Req/Sec    30.73k     8.52k   49.81k    57.34%
  Latency Distribution
     50%  508.00us
     75%    1.01ms
     90%    3.83ms
     99%   10.26ms
  4600977 requests in 30.10s, 0.96GB read
Requests/sec: 152856.24
Transfer/sec:     32.80MB
### Result for Kong git:master (run 2):
Running 30s test @ http://10.68.128.3:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.28ms    2.10ms  39.12ms   88.74%
    Req/Sec    30.48k     8.46k   54.98k    59.60%
  Latency Distribution
     50%  508.00us
     75%    1.05ms
     90%    3.80ms
     99%   10.40ms
  4563848 requests in 30.10s, 0.96GB read
Requests/sec: 151622.85
Transfer/sec:     32.53MB
### Result for Kong git:master (run 3):
Running 30s test @ http://10.68.128.3:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.26ms    2.01ms  32.70ms   88.42%
    Req/Sec    30.64k     8.42k   50.93k    60.33%
  Latency Distribution
     50%  519.00us
     75%    1.01ms
     90%    3.79ms
     99%    9.98ms
  4587563 requests in 30.10s, 0.96GB read
Requests/sec: 152410.76
Transfer/sec:     32.70MB
### Combined result for Kong git:master:
RPS     Avg: 152296.62
Latency Avg: 1.27ms    Max: 41.83ms
   P90 (ms): 3.83, 3.8, 3.79
   P99 (ms): 10.26, 10.4, 9.98
  
### Test Suite: git:master #simple #key-auth 10 services each has 10 routes with key-auth, 100 consumers
### Result for Kong git:master (run 1):
Running 30s test @ http://10.68.128.3:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.25ms    1.93ms  45.19ms   90.79%
    Req/Sec    25.91k     6.36k   42.02k    60.97%
  Latency Distribution
     50%  647.00us
     75%    1.18ms
     90%    2.84ms
     99%    9.73ms
  3877886 requests in 30.10s, 832.09MB read
Requests/sec: 128833.59
Transfer/sec:     27.64MB
### Result for Kong git:master (run 2):
Running 30s test @ http://10.68.128.3:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.29ms    2.03ms  48.10ms   90.92%
    Req/Sec    25.88k     6.59k   43.51k    62.97%
  Latency Distribution
     50%  626.00us
     75%    1.22ms
     90%    2.94ms
     99%   10.11ms
  3873692 requests in 30.10s, 831.19MB read
Requests/sec: 128693.83
Transfer/sec:     27.61MB
### Result for Kong git:master (run 3):
Running 30s test @ http://10.68.128.3:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.29ms    2.01ms  35.53ms   90.70%
    Req/Sec    25.86k     6.74k   45.26k    62.19%
  Latency Distribution
     50%  622.00us
     75%    1.22ms
     90%    3.00ms
     99%   10.23ms
  3873580 requests in 30.10s, 831.17MB read
Requests/sec: 128690.46
Transfer/sec:     27.61MB
### Combined result for Kong git:master:
RPS     Avg: 128739.29
Latency Avg: 1.28ms    Max: 48.10ms
   P90 (ms): 2.84, 2.94, 3
   P99 (ms): 9.73, 10.11, 10.23
  
### Test Suite: git:feat/privileged-dp-connection #simple #hybrid #no_plugins #single_route
### Result for Kong git:feat/privileged-dp-connection (run 1):
Running 30s test @ http://10.68.128.3:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.24ms    1.98ms  34.81ms   87.81%
    Req/Sec    33.02k     9.09k   58.68k    61.12%
  Latency Distribution
     50%  471.00us
     75%    0.97ms
     90%    3.84ms
     99%    9.75ms
  4934431 requests in 30.10s, 1.03GB read
Requests/sec: 163935.86
Transfer/sec:     35.18MB
### Result for Kong git:feat/privileged-dp-connection (run 2):
Running 30s test @ http://10.68.128.3:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.29ms    2.12ms  37.68ms   88.25%
    Req/Sec    32.56k     9.47k   69.26k    59.96%
  Latency Distribution
     50%  477.00us
     75%    1.02ms
     90%    3.91ms
     99%   10.46ms
  4861904 requests in 30.10s, 1.02GB read
Requests/sec: 161529.65
Transfer/sec:     34.66MB
### Result for Kong git:feat/privileged-dp-connection (run 3):
Running 30s test @ http://10.68.128.3:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.25ms    2.00ms  31.67ms   87.71%
    Req/Sec    32.88k     9.07k   60.16k    61.45%
  Latency Distribution
     50%  477.00us
     75%    0.97ms
     90%    3.90ms
     99%    9.83ms
  4914821 requests in 30.10s, 1.03GB read
Requests/sec: 163285.70
Transfer/sec:     35.04MB
### Combined result for Kong git:feat/privileged-dp-connection:
RPS     Avg: 162917.07
Latency Avg: 1.26ms    Max: 37.68ms
   P90 (ms): 3.84, 3.91, 3.9
   P99 (ms): 9.75, 10.46, 9.83
  
### Test Suite: git:feat/privileged-dp-connection #simple #hybrid #no_plugins 10 services each has 10 routes
### Result for Kong git:feat/privileged-dp-connection (run 1):
Running 30s test @ http://10.68.128.3:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.27ms    2.07ms  35.57ms   88.54%
    Req/Sec    30.68k     8.78k   57.29k    59.27%
  Latency Distribution
     50%  506.00us
     75%    1.03ms
     90%    3.82ms
     99%   10.30ms
  4593976 requests in 30.10s, 0.96GB read
Requests/sec: 152624.26
Transfer/sec:     32.75MB
### Result for Kong git:feat/privileged-dp-connection (run 2):
Running 30s test @ http://10.68.128.3:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.28ms    2.10ms  52.59ms   88.67%
    Req/Sec    30.69k     8.67k   53.40k    59.87%
  Latency Distribution
     50%  505.00us
     75%    1.04ms
     90%    3.82ms
     99%   10.27ms
  4596172 requests in 30.10s, 0.96GB read
Requests/sec: 152697.02
Transfer/sec:     32.76MB
### Result for Kong git:feat/privileged-dp-connection (run 3):
Running 30s test @ http://10.68.128.3:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.25ms    1.99ms  36.71ms   88.30%
    Req/Sec    30.74k     8.44k   50.79k    59.47%
  Latency Distribution
     50%  506.00us
     75%    1.02ms
     90%    3.78ms
     99%    9.86ms
  4603654 requests in 30.10s, 0.96GB read
Requests/sec: 152945.39
Transfer/sec:     32.82MB
### Combined result for Kong git:feat/privileged-dp-connection:
RPS     Avg: 152755.56
Latency Avg: 1.27ms    Max: 52.59ms
   P90 (ms): 3.82, 3.82, 3.78
   P99 (ms): 10.3, 10.27, 9.86
  
### Test Suite: git:feat/privileged-dp-connection #simple #hybrid #key-auth 10 services each has 10 routes with key-auth, 100 consumers
### Result for Kong git:feat/privileged-dp-connection (run 1):
Running 30s test @ http://10.68.128.3:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.28ms    1.98ms  33.08ms   90.23%
    Req/Sec    26.47k     7.04k   41.85k    59.53%
  Latency Distribution
     50%  611.00us
     75%    1.16ms
     90%    3.15ms
     99%   10.01ms
  3964228 requests in 30.10s, 850.62MB read
Requests/sec: 131701.83
Transfer/sec:     28.26MB
### Result for Kong git:feat/privileged-dp-connection (run 2):
Running 30s test @ http://10.68.128.3:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.29ms    2.04ms  38.08ms   90.35%
    Req/Sec    26.52k     7.10k   49.00k    61.13%
  Latency Distribution
     50%  601.00us
     75%    1.18ms
     90%    3.18ms
     99%   10.32ms
  3971453 requests in 30.10s, 852.17MB read
Requests/sec: 131942.00
Transfer/sec:     28.31MB
### Result for Kong git:feat/privileged-dp-connection (run 3):
Running 30s test @ http://10.68.128.3:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.26ms    1.94ms  32.64ms   90.43%
    Req/Sec    26.29k     6.78k   43.02k    60.53%
  Latency Distribution
     50%  632.00us
     75%    1.17ms
     90%    3.04ms
     99%    9.81ms
  3937688 requests in 30.10s, 844.92MB read
Requests/sec: 130820.17
Transfer/sec:     28.07MB
### Combined result for Kong git:feat/privileged-dp-connection:
RPS     Avg: 131488.00
Latency Avg: 1.28ms    Max: 38.08ms
   P90 (ms): 3.15, 3.18, 3.04
   P99 (ms): 10.01, 10.32, 9.81
  
### Test Suite: git:master #simple #hybrid #no_plugins #single_route
### Result for Kong git:master (run 1):
Running 30s test @ http://10.68.128.3:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.28ms    2.08ms  37.19ms   88.15%
    Req/Sec    32.28k     9.39k   57.29k    61.25%
  Latency Distribution
     50%  474.00us
     75%    1.04ms
     90%    3.91ms
     99%   10.20ms
  4823190 requests in 30.10s, 1.01GB read
Requests/sec: 160243.20
Transfer/sec:     34.38MB
### Result for Kong git:master (run 2):
Running 30s test @ http://10.68.128.3:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.27ms    2.08ms  37.46ms   88.20%
    Req/Sec    32.45k     9.15k   58.64k    59.59%
  Latency Distribution
     50%  473.00us
     75%    1.03ms
     90%    3.88ms
     99%   10.26ms
  4849499 requests in 30.10s, 1.02GB read
Requests/sec: 161115.73
Transfer/sec:     34.57MB
### Result for Kong git:master (run 3):
Running 30s test @ http://10.68.128.3:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.27ms    2.05ms  30.13ms   87.94%
    Req/Sec    32.48k     9.58k   75.72k    58.29%
  Latency Distribution
     50%  481.00us
     75%    1.00ms
     90%    3.92ms
     99%   10.15ms
  4851303 requests in 30.10s, 1.02GB read
Requests/sec: 161175.32
Transfer/sec:     34.58MB
### Combined result for Kong git:master:
RPS     Avg: 160844.75
Latency Avg: 1.27ms    Max: 37.46ms
   P90 (ms): 3.91, 3.88, 3.92
   P99 (ms): 10.2, 10.26, 10.15
  
### Test Suite: git:master #simple #hybrid #no_plugins 10 services each has 10 routes
### Result for Kong git:master (run 1):
Running 30s test @ http://10.68.128.3:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.27ms    2.06ms  48.67ms   88.59%
    Req/Sec    30.16k     8.60k   50.90k    56.68%
  Latency Distribution
     50%  518.00us
     75%    1.07ms
     90%    3.80ms
     99%   10.11ms
  4516324 requests in 30.10s, 0.95GB read
Requests/sec: 150043.75
Transfer/sec:     32.20MB
### Result for Kong git:master (run 2):
Running 30s test @ http://10.68.128.3:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.31ms    2.19ms  42.02ms   88.71%
    Req/Sec    30.57k     8.72k   50.41k    59.31%
  Latency Distribution
     50%  511.00us
     75%    1.03ms
     90%    3.93ms
     99%   10.89ms
  4573641 requests in 30.10s, 0.96GB read
Requests/sec: 151948.09
Transfer/sec:     32.60MB
### Result for Kong git:master (run 3):
Running 30s test @ http://10.68.128.3:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.26ms    2.01ms  37.05ms   88.41%
    Req/Sec    30.71k     8.75k   53.22k    57.72%
  Latency Distribution
     50%  518.00us
     75%    1.00ms
     90%    3.79ms
     99%    9.99ms
  4590309 requests in 30.10s, 0.96GB read
Requests/sec: 152504.63
Transfer/sec:     32.72MB
### Combined result for Kong git:master:
RPS     Avg: 151498.82
Latency Avg: 1.28ms    Max: 48.67ms
   P90 (ms): 3.8, 3.93, 3.79
   P99 (ms): 10.11, 10.89, 9.99
  
### Test Suite: git:master #simple #hybrid #key-auth 10 services each has 10 routes with key-auth, 100 consumers
### Result for Kong git:master (run 1):
Running 30s test @ http://10.68.128.3:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.32ms    1.97ms  48.45ms   89.54%
    Req/Sec    25.83k     7.03k   45.81k    62.59%
  Latency Distribution
     50%  600.00us
     75%    1.31ms
     90%    3.42ms
     99%    9.66ms
  3867966 requests in 30.10s, 829.96MB read
Requests/sec: 128503.77
Transfer/sec:     27.57MB
### Result for Kong git:master (run 2):
Running 30s test @ http://10.68.128.3:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.27ms    1.96ms  40.21ms   90.34%
    Req/Sec    26.45k     6.79k   45.85k    59.80%
  Latency Distribution
     50%  613.00us
     75%    1.15ms
     90%    3.07ms
     99%    9.90ms
  3960767 requests in 30.10s, 849.87MB read
Requests/sec: 131586.81
Transfer/sec:     28.23MB
### Result for Kong git:master (run 3):
Running 30s test @ http://10.68.128.3:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.29ms    2.03ms  51.92ms   90.53%
    Req/Sec    26.34k     6.86k   50.51k    61.93%
  Latency Distribution
     50%  614.00us
     75%    1.18ms
     90%    3.09ms
     99%   10.16ms
  3944465 requests in 30.10s, 846.38MB read
Requests/sec: 131045.27
Transfer/sec:     28.12MB
### Combined result for Kong git:master:
RPS     Avg: 130378.62
Latency Avg: 1.29ms    Max: 51.92ms
   P90 (ms): 3.42, 3.07, 3.09
   P99 (ms): 9.66, 9.9, 10.16
  

Kong error logs are also available in Github Actions artifacts.

Download Artifacts for detailed results and interactive SVG flamegraphs.

github-actions[bot] avatar Oct 12 '22 20:10 github-actions[bot]

Great work! I think the privileged worker process is something we should utilize more and more in the future for these types of tasks.

Yes, next obvious target is Kong EE Vitals.

bungle avatar Oct 14 '22 10:10 bungle