kong icon indicating copy to clipboard operation
kong copied to clipboard

perf(balancer) reduce table resizes and table creation

Open bungle opened this issue 2 years ago • 9 comments

Summary

Reduces table creation and table resizes on balancer by utilizing a tablepool.

bungle avatar Jul 01 '22 10:07 bungle

:rocket: Performance test result

Test Suite: 01-rps 02-flamegraph (baseline,single_route,simple)

["Imgur Images","Imgur Images","Imgur Images"]

Click to expand
Please see Github Actions artifacts for flamegraphs.

  ### Result for upstream directly (run 1):
Running 30s test @ http://10.67.35.133:8088/test
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   582.29us    1.28ms  16.10ms   87.14%
    Req/Sec   170.87k    13.64k  245.76k    66.49%
  25520760 requests in 30.10s, 3.33GB read
Requests/sec: 847890.88
Transfer/sec:    113.21MB
### Result for upstream directly (run 2):
Running 30s test @ http://10.67.35.133:8088/test
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   583.50us    1.29ms  12.15ms   87.21%
    Req/Sec   156.09k     8.75k  213.73k    77.68%
  23309581 requests in 30.10s, 3.04GB read
Requests/sec: 774412.20
Transfer/sec:    103.39MB
### Result for upstream directly (run 3):
Running 30s test @ http://10.67.35.133:8088/test
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   573.83us    1.27ms  12.12ms   87.33%
    Req/Sec   156.65k     8.58k  209.99k    73.35%
  23395391 requests in 30.10s, 3.05GB read
Requests/sec: 777258.67
Transfer/sec:    103.77MB
### Combined result for upstream directly:
RPS     Avg: 799853.92
Latency Avg: nanms    Max: nanms
  
### Test Suite: git:696531d912e78b573103e984fdc6b6e5b666b498 #simple #no_plugins #single_route
### Result for Kong git:696531d912e78b573103e984fdc6b6e5b666b498 (run 1):
Running 30s test @ http://10.67.35.129:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.11ms    1.72ms  34.15ms   88.14%
    Req/Sec    33.71k     8.83k   59.80k    59.99%
  5038007 requests in 30.10s, 1.06GB read
Requests/sec: 167380.19
Transfer/sec:     35.92MB
### Result for Kong git:696531d912e78b573103e984fdc6b6e5b666b498 (run 2):
Running 30s test @ http://10.67.35.129:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.14ms    1.79ms  37.06ms   88.38%
    Req/Sec    33.36k     9.30k   58.32k    61.92%
  4986133 requests in 30.10s, 1.04GB read
Requests/sec: 165656.11
Transfer/sec:     35.55MB
### Result for Kong git:696531d912e78b573103e984fdc6b6e5b666b498 (run 3):
Running 30s test @ http://10.67.35.129:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.12ms    1.72ms  27.36ms   88.20%
    Req/Sec    33.61k     9.08k   58.34k    62.58%
  5022449 requests in 30.10s, 1.05GB read
Requests/sec: 166864.53
Transfer/sec:     35.80MB
### Combined result for Kong git:696531d912e78b573103e984fdc6b6e5b666b498:
RPS     Avg: 166633.61
Latency Avg: 1.12ms    Max: 37.06ms
  
### Test Suite: git:696531d912e78b573103e984fdc6b6e5b666b498 #simple #no_plugins 10 services each has 10 routes
### Result for Kong git:696531d912e78b573103e984fdc6b6e5b666b498 (run 1):
Running 30s test @ http://10.67.35.129:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.14ms    1.76ms  33.72ms   88.90%
    Req/Sec    31.13k     8.41k   51.73k    57.25%
  4657410 requests in 30.10s, 0.98GB read
Requests/sec: 154735.51
Transfer/sec:     33.20MB
### Result for Kong git:696531d912e78b573103e984fdc6b6e5b666b498 (run 2):
Running 30s test @ http://10.67.35.129:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.13ms    1.72ms  30.32ms   89.00%
    Req/Sec    30.96k     7.98k   53.66k    59.38%
  4632796 requests in 30.10s, 0.97GB read
Requests/sec: 153918.07
Transfer/sec:     33.03MB
### Result for Kong git:696531d912e78b573103e984fdc6b6e5b666b498 (run 3):
Running 30s test @ http://10.67.35.129:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.15ms    1.81ms  39.14ms   89.01%
    Req/Sec    31.00k     8.48k   55.56k    60.04%
  4640078 requests in 30.10s, 0.97GB read
Requests/sec: 154159.75
Transfer/sec:     33.08MB
### Combined result for Kong git:696531d912e78b573103e984fdc6b6e5b666b498:
RPS     Avg: 154271.11
Latency Avg: 1.14ms    Max: 39.14ms
  
### Test Suite: git:696531d912e78b573103e984fdc6b6e5b666b498 #simple #key-auth 10 services each has 10 routes with key-auth, 100 consumers
### Result for Kong git:696531d912e78b573103e984fdc6b6e5b666b498 (run 1):
Running 30s test @ http://10.67.35.129:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.17ms    2.06ms 127.71ms   91.68%
    Req/Sec    27.20k     6.65k   44.70k    62.30%
  4070714 requests in 30.10s, 0.85GB read
Requests/sec: 135243.29
Transfer/sec:     29.02MB
### Result for Kong git:696531d912e78b573103e984fdc6b6e5b666b498 (run 2):
Running 30s test @ http://10.67.35.129:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.17ms    1.71ms  30.14ms   90.69%
    Req/Sec    26.84k     6.88k   49.88k    60.60%
  4020185 requests in 30.10s, 862.62MB read
Requests/sec: 133560.61
Transfer/sec:     28.66MB
### Result for Kong git:696531d912e78b573103e984fdc6b6e5b666b498 (run 3):
Running 30s test @ http://10.67.35.129:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.21ms    1.83ms  31.76ms   90.51%
    Req/Sec    27.14k     7.19k   50.88k    63.05%
  4056325 requests in 30.10s, 870.38MB read
Requests/sec: 134764.92
Transfer/sec:     28.92MB
### Combined result for Kong git:696531d912e78b573103e984fdc6b6e5b666b498:
RPS     Avg: 134522.94
Latency Avg: 1.18ms    Max: 127.71ms
  
### Test Suite: git:master #simple #no_plugins #single_route
### Result for Kong git:master (run 1):
Running 30s test @ http://10.67.35.129:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.14ms    1.74ms  31.91ms   88.80%
    Req/Sec    32.31k     8.59k   52.62k    61.25%
  4827576 requests in 30.10s, 1.01GB read
Requests/sec: 160387.37
Transfer/sec:     34.41MB
### Result for Kong git:master (run 2):
Running 30s test @ http://10.67.35.129:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.14ms    1.79ms  33.95ms   88.60%
    Req/Sec    32.56k     8.88k   61.98k    61.72%
  4865448 requests in 30.10s, 1.02GB read
Requests/sec: 161647.18
Transfer/sec:     34.69MB
### Result for Kong git:master (run 3):
Running 30s test @ http://10.67.35.129:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.16ms    1.84ms  32.17ms   88.75%
    Req/Sec    32.49k     9.05k   60.34k    60.52%
  4855675 requests in 30.10s, 1.02GB read
Requests/sec: 161324.91
Transfer/sec:     34.62MB
### Combined result for Kong git:master:
RPS     Avg: 161119.82
Latency Avg: 1.15ms    Max: 33.95ms
  
### Test Suite: git:master #simple #no_plugins 10 services each has 10 routes
### Result for Kong git:master (run 1):
Running 30s test @ http://10.67.35.129:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.16ms    1.80ms  27.51ms   89.32%
    Req/Sec    30.05k     8.02k   48.45k    60.79%
  4490693 requests in 30.10s, 0.94GB read
Requests/sec: 149194.10
Transfer/sec:     32.01MB
### Result for Kong git:master (run 2):
Running 30s test @ http://10.67.35.129:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.15ms    1.74ms  31.86ms   89.42%
    Req/Sec    29.92k     7.87k   55.68k    60.37%
  4476992 requests in 30.10s, 0.94GB read
Requests/sec: 148741.32
Transfer/sec:     31.92MB
### Result for Kong git:master (run 3):
Running 30s test @ http://10.67.35.129:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.14ms    1.72ms  27.70ms   89.23%
    Req/Sec    30.06k     8.10k   60.60k    60.88%
  4495751 requests in 30.10s, 0.94GB read
Requests/sec: 149364.76
Transfer/sec:     32.05MB
### Combined result for Kong git:master:
RPS     Avg: 149100.06
Latency Avg: 1.15ms    Max: 31.86ms
  
### Test Suite: git:master #simple #key-auth 10 services each has 10 routes with key-auth, 100 consumers
### Result for Kong git:master (run 1):
Running 30s test @ http://10.67.35.129:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.23ms    2.32ms 130.54ms   92.55%
    Req/Sec    25.76k     6.56k   43.56k    63.06%
  3857182 requests in 30.10s, 827.65MB read
Requests/sec: 128146.31
Transfer/sec:     27.50MB
### Result for Kong git:master (run 2):
Running 30s test @ http://10.67.35.129:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.18ms    1.70ms  35.86ms   91.28%
    Req/Sec    25.45k     6.63k   47.41k    62.17%
  3808705 requests in 30.10s, 817.25MB read
Requests/sec: 126538.58
Transfer/sec:     27.15MB
### Result for Kong git:master (run 3):
Running 30s test @ http://10.67.35.129:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.19ms    1.70ms  35.24ms   90.98%
    Req/Sec    25.78k     6.73k   47.84k    61.28%
  3855605 requests in 30.10s, 827.31MB read
Requests/sec: 128096.82
Transfer/sec:     27.49MB
### Combined result for Kong git:master:
RPS     Avg: 127593.90
Latency Avg: 1.20ms    Max: 130.54ms
  

Kong error logs are also available in Github Actions artifacts.

Download Artifacts for detailed results and interactive SVG flamegraphs.

github-actions[bot] avatar Jul 01 '22 11:07 github-actions[bot]

:rocket: Performance test result

Test Suite: 01-rps 02-flamegraph (baseline,single_route,simple)

["Imgur Images","Imgur Images","Imgur Images"]

Click to expand
Please see Github Actions artifacts for flamegraphs.

  ### Result for upstream directly (run 1):
Running 30s test @ http://10.67.35.129:8088/test
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   575.55us    1.27ms  12.12ms   87.18%
    Req/Sec   169.60k    15.20k  222.44k    61.47%
  25312810 requests in 30.08s, 3.30GB read
Requests/sec: 841566.51
Transfer/sec:    112.36MB
### Result for upstream directly (run 2):
Running 30s test @ http://10.67.35.129:8088/test
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   579.85us    1.27ms  16.07ms   87.19%
    Req/Sec   153.93k     8.39k  215.34k    76.22%
  22986565 requests in 30.10s, 3.00GB read
Requests/sec: 763690.51
Transfer/sec:    101.96MB
### Result for upstream directly (run 3):
Running 30s test @ http://10.67.35.129:8088/test
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   573.94us    1.27ms  12.13ms   87.28%
    Req/Sec   154.64k     8.58k  210.08k    76.15%
  23094327 requests in 30.10s, 3.01GB read
Requests/sec: 767265.90
Transfer/sec:    102.44MB
### Combined result for upstream directly:
RPS     Avg: 790840.97
Latency Avg: nanms    Max: nanms
  
### Test Suite: git:800c5c2d5749b64e8877182d3fe9e91ecae2a835 #simple #no_plugins #single_route
### Result for Kong git:800c5c2d5749b64e8877182d3fe9e91ecae2a835 (run 1):
Running 30s test @ http://10.67.35.131:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.15ms    1.82ms  31.27ms   88.02%
    Req/Sec    33.33k     8.53k   54.61k    60.05%
  4980769 requests in 30.10s, 1.04GB read
Requests/sec: 165479.16
Transfer/sec:     35.51MB
### Result for Kong git:800c5c2d5749b64e8877182d3fe9e91ecae2a835 (run 2):
Running 30s test @ http://10.67.35.131:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.17ms    1.85ms  30.95ms   88.17%
    Req/Sec    33.08k     8.40k   56.13k    59.92%
  4943503 requests in 30.10s, 1.04GB read
Requests/sec: 164238.76
Transfer/sec:     35.24MB
### Result for Kong git:800c5c2d5749b64e8877182d3fe9e91ecae2a835 (run 3):
Running 30s test @ http://10.67.35.131:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.18ms    1.87ms  34.98ms   88.16%
    Req/Sec    33.18k     8.77k   55.78k    60.12%
  4958296 requests in 30.10s, 1.04GB read
Requests/sec: 164730.61
Transfer/sec:     35.35MB
### Combined result for Kong git:800c5c2d5749b64e8877182d3fe9e91ecae2a835:
RPS     Avg: 164816.18
Latency Avg: 1.17ms    Max: 34.98ms
  
### Test Suite: git:800c5c2d5749b64e8877182d3fe9e91ecae2a835 #simple #no_plugins 10 services each has 10 routes
### Result for Kong git:800c5c2d5749b64e8877182d3fe9e91ecae2a835 (run 1):
Running 30s test @ http://10.67.35.131:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.19ms    1.86ms  32.31ms   88.69%
    Req/Sec    30.92k     8.27k   53.26k    58.54%
  4629797 requests in 30.10s, 0.97GB read
Requests/sec: 153814.20
Transfer/sec:     33.00MB
### Result for Kong git:800c5c2d5749b64e8877182d3fe9e91ecae2a835 (run 2):
Running 30s test @ http://10.67.35.131:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.22ms    1.94ms  32.44ms   88.89%
    Req/Sec    30.85k     8.08k   53.71k    58.27%
  4619844 requests in 30.10s, 0.97GB read
Requests/sec: 153483.36
Transfer/sec:     32.93MB
### Result for Kong git:800c5c2d5749b64e8877182d3fe9e91ecae2a835 (run 3):
Running 30s test @ http://10.67.35.131:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.19ms    1.88ms  36.19ms   88.64%
    Req/Sec    30.95k     8.22k   52.28k    57.54%
  4634653 requests in 30.10s, 0.97GB read
Requests/sec: 153975.44
Transfer/sec:     33.04MB
### Combined result for Kong git:800c5c2d5749b64e8877182d3fe9e91ecae2a835:
RPS     Avg: 153757.67
Latency Avg: 1.20ms    Max: 36.19ms
  
### Test Suite: git:800c5c2d5749b64e8877182d3fe9e91ecae2a835 #simple #key-auth 10 services each has 10 routes with key-auth, 100 consumers
### Result for Kong git:800c5c2d5749b64e8877182d3fe9e91ecae2a835 (run 1):
Running 30s test @ http://10.67.35.131:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.20ms    1.91ms 127.51ms   90.93%
    Req/Sec    26.64k     6.46k   44.27k    61.00%
  3989156 requests in 30.10s, 855.97MB read
Requests/sec: 132530.33
Transfer/sec:     28.44MB
### Result for Kong git:800c5c2d5749b64e8877182d3fe9e91ecae2a835 (run 2):
Running 30s test @ http://10.67.35.131:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.26ms    1.98ms  45.71ms   90.82%
    Req/Sec    26.32k     6.78k   46.67k    61.33%
  3941762 requests in 30.10s, 845.80MB read
Requests/sec: 130955.27
Transfer/sec:     28.10MB
### Result for Kong git:800c5c2d5749b64e8877182d3fe9e91ecae2a835 (run 3):
Running 30s test @ http://10.67.35.131:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.21ms    1.79ms  34.54ms   90.64%
    Req/Sec    26.37k     6.53k   42.31k    63.59%
  3948334 requests in 30.10s, 847.21MB read
Requests/sec: 131174.09
Transfer/sec:     28.15MB
### Combined result for Kong git:800c5c2d5749b64e8877182d3fe9e91ecae2a835:
RPS     Avg: 131553.23
Latency Avg: 1.22ms    Max: 127.51ms
  
### Test Suite: git:master #simple #no_plugins #single_route
### Result for Kong git:master (run 1):
Running 30s test @ http://10.67.35.131:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.17ms    1.83ms  35.56ms   88.19%
    Req/Sec    32.79k     8.58k   52.92k    58.19%
  4900381 requests in 30.10s, 1.03GB read
Requests/sec: 162807.63
Transfer/sec:     34.93MB
### Result for Kong git:master (run 2):
Running 30s test @ http://10.67.35.131:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.19ms    1.89ms  31.89ms   88.27%
    Req/Sec    32.68k     8.62k   52.94k    59.32%
  4883753 requests in 30.10s, 1.02GB read
Requests/sec: 162256.04
Transfer/sec:     34.82MB
### Result for Kong git:master (run 3):
Running 30s test @ http://10.67.35.131:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.19ms    1.90ms  34.37ms   88.22%
    Req/Sec    32.83k     8.68k   57.44k    59.32%
  4906136 requests in 30.10s, 1.03GB read
Requests/sec: 162996.78
Transfer/sec:     34.97MB
### Combined result for Kong git:master:
RPS     Avg: 162686.82
Latency Avg: 1.18ms    Max: 35.56ms
  
### Test Suite: git:master #simple #no_plugins 10 services each has 10 routes
### Result for Kong git:master (run 1):
Running 30s test @ http://10.67.35.131:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.20ms    1.90ms  42.22ms   88.92%
    Req/Sec    30.68k     8.05k   50.72k    58.60%
  4594566 requests in 30.10s, 0.96GB read
Requests/sec: 152643.52
Transfer/sec:     32.75MB
### Result for Kong git:master (run 2):
Running 30s test @ http://10.67.35.131:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.19ms    1.86ms  28.24ms   88.79%
    Req/Sec    30.65k     7.85k   54.79k    59.47%
  4589997 requests in 30.10s, 0.96GB read
Requests/sec: 152491.87
Transfer/sec:     32.72MB
### Result for Kong git:master (run 3):
Running 30s test @ http://10.67.35.131:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.17ms    1.80ms  28.07ms   88.57%
    Req/Sec    30.83k     7.81k   56.53k    58.14%
  4617075 requests in 30.10s, 0.97GB read
Requests/sec: 153391.72
Transfer/sec:     32.91MB
### Combined result for Kong git:master:
RPS     Avg: 152842.37
Latency Avg: 1.19ms    Max: 42.22ms
  
### Test Suite: git:master #simple #key-auth 10 services each has 10 routes with key-auth, 100 consumers
### Result for Kong git:master (run 1):
Running 30s test @ http://10.67.35.131:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.23ms    2.02ms 127.61ms   90.75%
    Req/Sec    27.06k     6.54k   43.24k    59.00%
  4053101 requests in 30.10s, 869.69MB read
Requests/sec: 134654.31
Transfer/sec:     28.89MB
### Result for Kong git:master (run 2):
Running 30s test @ http://10.67.35.131:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.23ms    1.86ms  34.52ms   90.42%
    Req/Sec    26.76k     6.73k   42.53k    60.53%
  4007200 requests in 30.10s, 859.84MB read
Requests/sec: 133130.01
Transfer/sec:     28.57MB
### Result for Kong git:master (run 3):
Running 30s test @ http://10.67.35.131:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.22ms    1.85ms  37.68ms   90.38%
    Req/Sec    26.86k     6.73k   46.03k    60.40%
  4021557 requests in 30.10s, 862.92MB read
Requests/sec: 133606.80
Transfer/sec:     28.67MB
### Combined result for Kong git:master:
RPS     Avg: 133797.04
Latency Avg: 1.23ms    Max: 127.61ms
  

Kong error logs are also available in Github Actions artifacts.

Download Artifacts for detailed results and interactive SVG flamegraphs.

github-actions[bot] avatar Jul 06 '22 17:07 github-actions[bot]

:rocket: Performance test result

Test Suite: 01-rps 02-flamegraph (baseline,single_route,simple)

Imgur Images Imgur Images Imgur Images Imgur Images

Click to expand
Please see Github Actions artifacts for flamegraphs.

  ### Test Suite: git:perf/balancer-enhancements #simple #hybrid #no_plugins #single_route
### Result for Kong git:perf/balancer-enhancements (run 1):
Running 30s test @ http://10.68.128.11:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.12ms    1.73ms  29.01ms   88.28%
    Req/Sec    33.80k     8.13k   54.42k    61.19%
  Latency Distribution
     50%  449.00us
     75%    0.95ms
     90%    3.31ms
     99%    8.60ms
  5050238 requests in 30.10s, 1.06GB read
Requests/sec: 167787.76
Transfer/sec:     36.00MB
### Result for Kong git:perf/balancer-enhancements (run 2):
Running 30s test @ http://10.68.128.11:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.14ms    1.76ms  28.86ms   87.94%
    Req/Sec    33.51k     8.75k   58.36k    58.85%
  Latency Distribution
     50%  472.00us
     75%    0.89ms
     90%    3.45ms
     99%    8.72ms
  5007613 requests in 30.10s, 1.05GB read
Requests/sec: 166366.69
Transfer/sec:     35.70MB
### Result for Kong git:perf/balancer-enhancements (run 3):
Running 30s test @ http://10.68.128.11:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.14ms    1.79ms  33.53ms   88.12%
    Req/Sec    33.45k     8.42k   69.07k    60.09%
  Latency Distribution
     50%  463.00us
     75%    0.93ms
     90%    3.44ms
     99%    8.86ms
  4995600 requests in 30.10s, 1.05GB read
Requests/sec: 165972.67
Transfer/sec:     35.61MB
### Combined result for Kong git:perf/balancer-enhancements:
RPS     Avg: 166709.04
Latency Avg: 1.13ms    Max: 33.53ms
   P90 (ms): 3.31, 3.45, 3.44
   P99 (ms): 8.6, 8.72, 8.86
  
### Test Suite: git:perf/balancer-enhancements #simple #hybrid #no_plugins 10 services each has 10 routes
### Result for Kong git:perf/balancer-enhancements (run 1):
Running 30s test @ http://10.68.128.11:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.14ms    1.76ms  33.33ms   88.70%
    Req/Sec    31.32k     7.71k   48.98k    59.07%
  Latency Distribution
     50%  495.00us
     75%    0.96ms
     90%    3.30ms
     99%    8.79ms
  4690558 requests in 30.10s, 0.98GB read
Requests/sec: 155832.87
Transfer/sec:     33.44MB
### Result for Kong git:perf/balancer-enhancements (run 2):
Running 30s test @ http://10.68.128.11:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.13ms    1.72ms  27.10ms   88.57%
    Req/Sec    31.38k     7.59k   51.20k    60.47%
  Latency Distribution
     50%  500.00us
     75%    0.95ms
     90%    3.29ms
     99%    8.62ms
  4697706 requests in 30.10s, 0.98GB read
Requests/sec: 156070.21
Transfer/sec:     33.49MB
### Result for Kong git:perf/balancer-enhancements (run 3):
Running 30s test @ http://10.68.128.11:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.17ms    1.83ms  31.07ms   88.95%
    Req/Sec    31.08k     7.57k   49.61k    60.73%
  Latency Distribution
     50%  493.00us
     75%    1.00ms
     90%    3.33ms
     99%    9.18ms
  4653693 requests in 30.10s, 0.98GB read
Requests/sec: 154607.78
Transfer/sec:     33.17MB
### Combined result for Kong git:perf/balancer-enhancements:
RPS     Avg: 155503.62
Latency Avg: 1.15ms    Max: 33.33ms
   P90 (ms): 3.3, 3.29, 3.33
   P99 (ms): 8.79, 8.62, 9.18
  
### Test Suite: git:perf/balancer-enhancements #simple #hybrid #key-auth 10 services each has 10 routes with key-auth, 100 consumers
### Result for Kong git:perf/balancer-enhancements (run 1):
Running 30s test @ http://10.68.128.11:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.17ms    1.75ms  28.41ms   90.07%
    Req/Sec    27.73k     6.58k   43.22k    60.60%
  Latency Distribution
     50%  592.00us
     75%    1.07ms
     90%    2.90ms
     99%    8.94ms
  4153375 requests in 30.10s, 0.87GB read
Requests/sec: 137985.56
Transfer/sec:     29.61MB
### Result for Kong git:perf/balancer-enhancements (run 2):
Running 30s test @ http://10.68.128.11:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.17ms    1.74ms  33.22ms   90.23%
    Req/Sec    27.46k     6.69k   50.54k    60.40%
  Latency Distribution
     50%  585.00us
     75%    1.11ms
     90%    2.83ms
     99%    8.80ms
  4112391 requests in 30.10s, 0.86GB read
Requests/sec: 136624.77
Transfer/sec:     29.32MB
### Result for Kong git:perf/balancer-enhancements (run 3):
Running 30s test @ http://10.68.128.11:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.18ms    1.76ms  33.01ms   90.24%
    Req/Sec    27.59k     6.42k   45.00k    61.86%
  Latency Distribution
     50%  562.00us
     75%    1.13ms
     90%    2.86ms
     99%    8.79ms
  4130582 requests in 30.10s, 0.87GB read
Requests/sec: 137228.27
Transfer/sec:     29.45MB
### Combined result for Kong git:perf/balancer-enhancements:
RPS     Avg: 137279.53
Latency Avg: 1.17ms    Max: 33.22ms
   P90 (ms): 2.9, 2.83, 2.86
   P99 (ms): 8.94, 8.8, 8.79
  
### Test Suite: git:master #simple #hybrid #no_plugins #single_route
### Result for Kong git:master (run 1):
Running 30s test @ http://10.68.128.11:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.14ms    1.77ms  33.18ms   88.16%
    Req/Sec    33.19k     8.33k   64.60k    59.45%
  Latency Distribution
     50%  467.00us
     75%    0.93ms
     90%    3.40ms
     99%    8.73ms
  4960035 requests in 30.10s, 1.04GB read
Requests/sec: 164788.91
Transfer/sec:     35.36MB
### Result for Kong git:master (run 2):
Running 30s test @ http://10.68.128.11:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.15ms    1.79ms  33.56ms   88.01%
    Req/Sec    33.14k     8.47k   56.75k    61.52%
  Latency Distribution
     50%  480.00us
     75%    0.90ms
     90%    3.49ms
     99%    8.89ms
  4952849 requests in 30.10s, 1.04GB read
Requests/sec: 164549.71
Transfer/sec:     35.31MB
### Result for Kong git:master (run 3):
Running 30s test @ http://10.68.128.11:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.15ms    1.78ms  31.95ms   88.03%
    Req/Sec    33.35k     8.41k   54.64k    60.92%
  Latency Distribution
     50%  467.00us
     75%    0.91ms
     90%    3.46ms
     99%    8.83ms
  4983325 requests in 30.10s, 1.04GB read
Requests/sec: 165563.59
Transfer/sec:     35.53MB
### Combined result for Kong git:master:
RPS     Avg: 164967.40
Latency Avg: 1.15ms    Max: 33.56ms
   P90 (ms): 3.4, 3.49, 3.46
   P99 (ms): 8.73, 8.89, 8.83
  
### Test Suite: git:master #simple #hybrid #no_plugins 10 services each has 10 routes
### Result for Kong git:master (run 1):
Running 30s test @ http://10.68.128.11:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.16ms    1.82ms  38.75ms   88.87%
    Req/Sec    31.06k     7.68k   53.68k    61.59%
  Latency Distribution
     50%  507.00us
     75%    0.96ms
     90%    3.34ms
     99%    9.08ms
  4652136 requests in 30.10s, 0.97GB read
Requests/sec: 154555.92
Transfer/sec:     33.16MB
### Result for Kong git:master (run 2):
Running 30s test @ http://10.68.128.11:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.17ms    1.82ms  31.22ms   88.75%
    Req/Sec    30.80k     7.97k   55.83k    61.66%
  Latency Distribution
     50%  508.00us
     75%    0.99ms
     90%    3.38ms
     99%    9.14ms
  4611833 requests in 30.10s, 0.97GB read
Requests/sec: 153216.98
Transfer/sec:     32.88MB
### Result for Kong git:master (run 3):
Running 30s test @ http://10.68.128.11:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.17ms    1.82ms  34.27ms   88.86%
    Req/Sec    30.86k     7.91k   52.67k    59.67%
  Latency Distribution
     50%  493.00us
     75%    1.02ms
     90%    3.35ms
     99%    9.08ms
  4621090 requests in 30.10s, 0.97GB read
Requests/sec: 153524.51
Transfer/sec:     32.94MB
### Combined result for Kong git:master:
RPS     Avg: 153765.80
Latency Avg: 1.17ms    Max: 38.75ms
   P90 (ms): 3.34, 3.38, 3.35
   P99 (ms): 9.08, 9.14, 9.08
  
### Test Suite: git:master #simple #hybrid #key-auth 10 services each has 10 routes with key-auth, 100 consumers
### Result for Kong git:master (run 1):
Running 30s test @ http://10.68.128.11:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.17ms    1.72ms  31.04ms   90.59%
    Req/Sec    26.94k     6.37k   45.68k    62.46%
  Latency Distribution
     50%  597.00us
     75%    1.16ms
     90%    2.69ms
     99%    8.61ms
  4034274 requests in 30.10s, 865.65MB read
Requests/sec: 134028.92
Transfer/sec:     28.76MB
### Result for Kong git:master (run 2):
Running 30s test @ http://10.68.128.11:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.22ms    1.84ms  37.49ms   90.28%
    Req/Sec    26.97k     6.66k   47.31k    60.60%
  Latency Distribution
     50%  618.00us
     75%    1.08ms
     90%    2.94ms
     99%    9.31ms
  4038537 requests in 30.10s, 866.56MB read
Requests/sec: 134170.58
Transfer/sec:     28.79MB
### Result for Kong git:master (run 3):
Running 30s test @ http://10.68.128.11:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.20ms    1.80ms  31.63ms   90.48%
    Req/Sec    27.02k     6.31k   47.54k    63.99%
  Latency Distribution
     50%  599.00us
     75%    1.12ms
     90%    2.82ms
     99%    9.19ms
  4046682 requests in 30.10s, 868.31MB read
Requests/sec: 134441.24
Transfer/sec:     28.85MB
### Combined result for Kong git:master:
RPS     Avg: 134213.58
Latency Avg: 1.20ms    Max: 37.49ms
   P90 (ms): 2.69, 2.94, 2.82
   P99 (ms): 8.61, 9.31, 9.19
  
### Result for upstream directly (run 1):
Running 30s test @ http://10.68.128.9:8088/test
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   562.87us    1.26ms  15.99ms   87.25%
    Req/Sec   171.70k    14.54k  236.46k    66.56%
  Latency Distribution
     50%   57.00us
     75%   95.00us
     90%    2.40ms
     99%    6.31ms
  25644726 requests in 30.10s, 3.34GB read
Requests/sec: 851988.24
Transfer/sec:    113.75MB
### Result for upstream directly (run 2):
Running 30s test @ http://10.68.128.9:8088/test
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   576.67us    1.27ms  16.10ms   87.18%
    Req/Sec   154.43k     7.98k  194.65k    75.17%
  Latency Distribution
     50%   63.00us
     75%  105.00us
     90%    2.40ms
     99%    6.37ms
  23078923 requests in 30.10s, 3.01GB read
Requests/sec: 766766.69
Transfer/sec:    102.37MB
### Result for upstream directly (run 3):
Running 30s test @ http://10.68.128.9:8088/test
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   569.53us    1.26ms  12.12ms   87.33%
    Req/Sec   154.48k     8.06k  204.63k    74.82%
  Latency Distribution
     50%   63.00us
     75%  106.00us
     90%    2.39ms
     99%    6.37ms
  23072115 requests in 30.10s, 3.01GB read
Requests/sec: 766537.20
Transfer/sec:    102.34MB
### Combined result for upstream directly:
RPS     Avg: 795097.38
Latency Avg: 0.57ms    Max: 16.10ms
   P90 (ms): 2.4, 2.4, 2.39
   P99 (ms): 6.31, 6.37, 6.37
  
### Test Suite: git:perf/balancer-enhancements #simple #no_plugins #single_route
### Result for Kong git:perf/balancer-enhancements (run 1):
Running 30s test @ http://10.68.128.11:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.14ms    1.78ms  32.79ms   88.10%
    Req/Sec    33.56k     8.46k   73.42k    59.83%
  Latency Distribution
     50%  458.00us
     75%    0.94ms
     90%    3.43ms
     99%    8.79ms
  5012567 requests in 30.10s, 1.05GB read
Requests/sec: 166535.24
Transfer/sec:     35.73MB
### Result for Kong git:perf/balancer-enhancements (run 2):
Running 30s test @ http://10.68.128.11:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.18ms    1.89ms  32.31ms   88.15%
    Req/Sec    33.32k     9.03k   59.64k    56.79%
  Latency Distribution
     50%  466.00us
     75%    0.93ms
     90%    3.57ms
     99%    9.37ms
  4979278 requests in 30.10s, 1.04GB read
Requests/sec: 165427.01
Transfer/sec:     35.50MB
### Result for Kong git:perf/balancer-enhancements (run 3):
Running 30s test @ http://10.68.128.11:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.16ms    1.82ms  32.43ms   88.04%
    Req/Sec    33.62k     8.53k   57.82k    60.25%
  Latency Distribution
     50%  462.00us
     75%    0.91ms
     90%    3.50ms
     99%    8.98ms
  5024498 requests in 30.10s, 1.05GB read
Requests/sec: 166930.66
Transfer/sec:     35.82MB
### Combined result for Kong git:perf/balancer-enhancements:
RPS     Avg: 166297.64
Latency Avg: 1.16ms    Max: 32.79ms
   P90 (ms): 3.43, 3.57, 3.5
   P99 (ms): 8.79, 9.37, 8.98
  
### Test Suite: git:perf/balancer-enhancements #simple #no_plugins 10 services each has 10 routes
### Result for Kong git:perf/balancer-enhancements (run 1):
Running 30s test @ http://10.68.128.11:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.17ms    1.83ms  36.46ms   88.57%
    Req/Sec    31.12k     7.92k   49.08k    59.07%
  Latency Distribution
     50%  518.00us
     75%    0.94ms
     90%    3.44ms
     99%    9.15ms
  4660023 requests in 30.10s, 0.98GB read
Requests/sec: 154818.06
Transfer/sec:     33.22MB
### Result for Kong git:perf/balancer-enhancements (run 2):
Running 30s test @ http://10.68.128.11:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.17ms    1.84ms  35.08ms   88.86%
    Req/Sec    31.04k     7.63k   50.73k    61.20%
  Latency Distribution
     50%  499.00us
     75%    0.98ms
     90%    3.37ms
     99%    9.23ms
  4648200 requests in 30.10s, 0.97GB read
Requests/sec: 154425.20
Transfer/sec:     33.14MB
### Result for Kong git:perf/balancer-enhancements (run 3):
Running 30s test @ http://10.68.128.11:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.15ms    1.77ms  30.86ms   88.72%
    Req/Sec    31.24k     7.56k   51.80k    58.14%
  Latency Distribution
     50%  495.00us
     75%    0.97ms
     90%    3.32ms
     99%    8.90ms
  4678103 requests in 30.10s, 0.98GB read
Requests/sec: 155418.94
Transfer/sec:     33.35MB
### Combined result for Kong git:perf/balancer-enhancements:
RPS     Avg: 154887.40
Latency Avg: 1.16ms    Max: 36.46ms
   P90 (ms): 3.44, 3.37, 3.32
   P99 (ms): 9.15, 9.23, 8.9
  
### Test Suite: git:perf/balancer-enhancements #simple #key-auth 10 services each has 10 routes with key-auth, 100 consumers
### Result for Kong git:perf/balancer-enhancements (run 1):
Running 30s test @ http://10.68.128.11:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.16ms    1.70ms  34.05ms   90.35%
    Req/Sec    27.27k     6.14k   41.88k    59.52%
  Latency Distribution
     50%  599.00us
     75%    1.10ms
     90%    2.73ms
     99%    8.45ms
  4074715 requests in 30.10s, 0.85GB read
Requests/sec: 135375.99
Transfer/sec:     29.05MB
### Result for Kong git:perf/balancer-enhancements (run 2):
Running 30s test @ http://10.68.128.11:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.19ms    1.77ms  33.50ms   90.46%
    Req/Sec    27.16k     6.23k   47.24k    61.99%
  Latency Distribution
     50%  580.00us
     75%    1.14ms
     90%    2.80ms
     99%    8.95ms
  4065715 requests in 30.10s, 0.85GB read
Requests/sec: 135073.56
Transfer/sec:     28.98MB
### Result for Kong git:perf/balancer-enhancements (run 3):
Running 30s test @ http://10.68.128.11:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.18ms    1.75ms  33.10ms   90.22%
    Req/Sec    27.38k     6.33k   44.98k    60.37%
  Latency Distribution
     50%  594.00us
     75%    1.07ms
     90%    2.84ms
     99%    8.79ms
  4097273 requests in 30.10s, 0.86GB read
Requests/sec: 136122.12
Transfer/sec:     29.21MB
### Combined result for Kong git:perf/balancer-enhancements:
RPS     Avg: 135523.89
Latency Avg: 1.18ms    Max: 34.05ms
   P90 (ms): 2.73, 2.8, 2.84
   P99 (ms): 8.45, 8.95, 8.79
  
### Test Suite: git:master #simple #no_plugins #single_route
### Result for Kong git:master (run 1):
Running 30s test @ http://10.68.128.11:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.15ms    1.81ms  35.64ms   88.41%
    Req/Sec    32.88k     8.08k   51.03k    60.72%
  Latency Distribution
     50%  468.00us
     75%    0.98ms
     90%    3.41ms
     99%    8.95ms
  4914100 requests in 30.10s, 1.03GB read
Requests/sec: 163262.47
Transfer/sec:     35.03MB
### Result for Kong git:master (run 2):
Running 30s test @ http://10.68.128.11:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.14ms    1.76ms  27.66ms   88.30%
    Req/Sec    32.94k     8.05k   63.16k    61.19%
  Latency Distribution
     50%  462.00us
     75%    0.98ms
     90%    3.38ms
     99%    8.78ms
  4922686 requests in 30.10s, 1.03GB read
Requests/sec: 163548.61
Transfer/sec:     35.09MB
### Result for Kong git:master (run 3):
Running 30s test @ http://10.68.128.11:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.15ms    1.80ms  32.05ms   88.06%
    Req/Sec    33.23k     8.32k   62.90k    60.65%
  Latency Distribution
     50%  468.00us
     75%    0.92ms
     90%    3.48ms
     99%    8.93ms
  4965633 requests in 30.10s, 1.04GB read
Requests/sec: 164974.15
Transfer/sec:     35.40MB
### Combined result for Kong git:master:
RPS     Avg: 163928.41
Latency Avg: 1.15ms    Max: 35.64ms
   P90 (ms): 3.41, 3.38, 3.48
   P99 (ms): 8.95, 8.78, 8.93
  
### Test Suite: git:master #simple #no_plugins 10 services each has 10 routes
### Result for Kong git:master (run 1):
Running 30s test @ http://10.68.128.11:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.16ms    1.79ms  29.09ms   88.66%
    Req/Sec    30.96k     7.62k   49.62k    60.27%
  Latency Distribution
     50%  506.00us
     75%    0.98ms
     90%    3.38ms
     99%    8.93ms
  4635512 requests in 30.10s, 0.97GB read
Requests/sec: 154003.57
Transfer/sec:     33.05MB
### Result for Kong git:master (run 2):
Running 30s test @ http://10.68.128.11:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.16ms    1.78ms  30.39ms   88.74%
    Req/Sec    30.89k     7.72k   50.16k    59.67%
  Latency Distribution
     50%  503.00us
     75%    0.99ms
     90%    3.33ms
     99%    8.85ms
  4625431 requests in 30.10s, 0.97GB read
Requests/sec: 153669.23
Transfer/sec:     32.97MB
### Result for Kong git:master (run 3):
Running 30s test @ http://10.68.128.11:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.17ms    1.82ms  37.92ms   88.78%
    Req/Sec    31.06k     7.72k   57.32k    59.73%
  Latency Distribution
     50%  501.00us
     75%    0.98ms
     90%    3.37ms
     99%    9.11ms
  4651306 requests in 30.10s, 0.97GB read
Requests/sec: 154528.34
Transfer/sec:     33.16MB
### Combined result for Kong git:master:
RPS     Avg: 154067.05
Latency Avg: 1.16ms    Max: 37.92ms
   P90 (ms): 3.38, 3.33, 3.37
   P99 (ms): 8.93, 8.85, 9.11
  
### Test Suite: git:master #simple #key-auth 10 services each has 10 routes with key-auth, 100 consumers
### Result for Kong git:master (run 1):
Running 30s test @ http://10.68.128.11:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.17ms    1.72ms  32.84ms   90.46%
    Req/Sec    27.12k     6.32k   47.00k    60.92%
  Latency Distribution
     50%  595.00us
     75%    1.12ms
     90%    2.74ms
     99%    8.60ms
  4053088 requests in 30.10s, 869.68MB read
Requests/sec: 134659.03
Transfer/sec:     28.89MB
### Result for Kong git:master (run 2):
Running 30s test @ http://10.68.128.11:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.20ms    1.78ms  34.78ms   90.40%
    Req/Sec    26.91k     6.54k   49.70k    61.73%
  Latency Distribution
     50%  592.00us
     75%    1.14ms
     90%    2.82ms
     99%    8.90ms
  4030764 requests in 30.10s, 864.89MB read
Requests/sec: 133912.53
Transfer/sec:     28.73MB
### Result for Kong git:master (run 3):
Running 30s test @ http://10.68.128.11:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.18ms    1.73ms  33.22ms   90.33%
    Req/Sec    27.07k     6.30k   42.67k    61.26%
  Latency Distribution
     50%  595.00us
     75%    1.11ms
     90%    2.80ms
     99%    8.62ms
  4052445 requests in 30.10s, 869.55MB read
Requests/sec: 134632.48
Transfer/sec:     28.89MB
### Combined result for Kong git:master:
RPS     Avg: 134401.35
Latency Avg: 1.18ms    Max: 34.78ms
   P90 (ms): 2.74, 2.82, 2.8
   P99 (ms): 8.6, 8.9, 8.62
  

Kong error logs are also available in Github Actions artifacts.

Download Artifacts for detailed results and interactive SVG flamegraphs.

github-actions[bot] avatar Aug 08 '22 09:08 github-actions[bot]

:rocket: Performance test result

Test Suite: 01-rps 02-flamegraph (baseline,single_route,simple)

Imgur Images Imgur Images Imgur Images Imgur Images

Click to expand
Please see Github Actions artifacts for flamegraphs.

  ### Test Suite: git:perf/balancer-enhancements #simple #hybrid #no_plugins #single_route
### Result for Kong git:perf/balancer-enhancements (run 1):
Running 30s test @ http://10.68.128.11:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.87ms   21.60ms   1.02s    99.83%
    Req/Sec    33.63k     8.79k   58.09k    63.72%
  Latency Distribution
     50%  459.00us
     75%    0.98ms
     90%    3.51ms
     99%    9.45ms
  5025747 requests in 30.10s, 1.05GB read
Requests/sec: 166973.91
Transfer/sec:     35.83MB
### Result for Kong git:perf/balancer-enhancements (run 2):
Running 30s test @ http://10.68.128.11:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.23ms    2.03ms  35.80ms   88.77%
    Req/Sec    32.97k     9.30k   59.04k    59.79%
  Latency Distribution
     50%  452.00us
     75%    1.08ms
     90%    3.62ms
     99%   10.03ms
  4926710 requests in 30.10s, 1.03GB read
Requests/sec: 163683.04
Transfer/sec:     35.12MB
### Result for Kong git:perf/balancer-enhancements (run 3):
Running 30s test @ http://10.68.128.11:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.19ms    1.91ms  42.52ms   88.22%
    Req/Sec    33.23k     8.99k   55.00k    58.46%
  Latency Distribution
     50%  467.00us
     75%    0.99ms
     90%    3.59ms
     99%    9.35ms
  4966002 requests in 30.10s, 1.04GB read
Requests/sec: 164989.61
Transfer/sec:     35.40MB
### Combined result for Kong git:perf/balancer-enhancements:
RPS     Avg: 165215.52
Latency Avg: 1.43ms    Max: 1020.00ms
   P90 (ms): 3.51, 3.62, 3.59
   P99 (ms): 9.45, 10.03, 9.35
  
### Test Suite: git:perf/balancer-enhancements #simple #hybrid #no_plugins 10 services each has 10 routes
### Result for Kong git:perf/balancer-enhancements (run 1):
Running 30s test @ http://10.68.128.11:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.18ms    1.84ms  33.09ms   88.56%
    Req/Sec    31.00k     8.33k   50.67k    59.64%
  Latency Distribution
     50%  518.00us
     75%    0.99ms
     90%    3.47ms
     99%    9.18ms
  4639601 requests in 30.10s, 0.97GB read
Requests/sec: 154142.97
Transfer/sec:     33.07MB
### Result for Kong git:perf/balancer-enhancements (run 2):
Running 30s test @ http://10.68.128.11:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.24ms    2.00ms  32.64ms   89.15%
    Req/Sec    30.83k     8.47k   63.29k    60.76%
  Latency Distribution
     50%  489.00us
     75%    1.09ms
     90%    3.52ms
     99%   10.10ms
  4605181 requests in 30.10s, 0.96GB read
Requests/sec: 152998.41
Transfer/sec:     32.83MB
### Result for Kong git:perf/balancer-enhancements (run 3):
Running 30s test @ http://10.68.128.11:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.20ms    1.89ms  33.85ms   88.97%
    Req/Sec    30.69k     8.25k   50.69k    60.20%
  Latency Distribution
     50%  505.00us
     75%    1.04ms
     90%    3.42ms
     99%    9.45ms
  4595499 requests in 30.10s, 0.96GB read
Requests/sec: 152677.64
Transfer/sec:     32.76MB
### Combined result for Kong git:perf/balancer-enhancements:
RPS     Avg: 153273.01
Latency Avg: 1.21ms    Max: 33.85ms
   P90 (ms): 3.47, 3.52, 3.42
   P99 (ms): 9.18, 10.1, 9.45
  
### Test Suite: git:perf/balancer-enhancements #simple #hybrid #key-auth 10 services each has 10 routes with key-auth, 100 consumers
### Result for Kong git:perf/balancer-enhancements (run 1):
Running 30s test @ http://10.68.128.11:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.18ms    1.77ms  32.56ms   90.13%
    Req/Sec    27.50k     6.95k   49.99k    62.39%
  Latency Distribution
     50%  595.00us
     75%    1.11ms
     90%    2.90ms
     99%    8.87ms
  4118469 requests in 30.10s, 0.86GB read
Requests/sec: 136829.08
Transfer/sec:     29.36MB
### Result for Kong git:perf/balancer-enhancements (run 2):
Running 30s test @ http://10.68.128.11:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.24ms    1.91ms  36.39ms   90.41%
    Req/Sec    27.13k     7.11k   49.44k    61.00%
  Latency Distribution
     50%  578.00us
     75%    1.19ms
     90%    2.99ms
     99%    9.63ms
  4062658 requests in 30.10s, 0.85GB read
Requests/sec: 134975.13
Transfer/sec:     28.96MB
### Result for Kong git:perf/balancer-enhancements (run 3):
Running 30s test @ http://10.68.128.11:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.20ms    1.81ms  29.29ms   90.15%
    Req/Sec    27.48k     7.10k   47.69k    60.73%
  Latency Distribution
     50%  598.00us
     75%    1.10ms
     90%    2.96ms
     99%    9.18ms
  4114792 requests in 30.10s, 0.86GB read
Requests/sec: 136707.02
Transfer/sec:     29.33MB
### Combined result for Kong git:perf/balancer-enhancements:
RPS     Avg: 136170.41
Latency Avg: 1.21ms    Max: 36.39ms
   P90 (ms): 2.9, 2.99, 2.96
   P99 (ms): 8.87, 9.63, 9.18
  
### Test Suite: git:master #simple #hybrid #no_plugins #single_route
### Result for Kong git:master (run 1):
Running 30s test @ http://10.68.128.11:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.17ms    1.85ms  31.41ms   88.11%
    Req/Sec    33.15k     8.91k   55.01k    59.12%
  Latency Distribution
     50%  483.00us
     75%    0.94ms
     90%    3.53ms
     99%    9.18ms
  4955116 requests in 30.10s, 1.04GB read
Requests/sec: 164623.77
Transfer/sec:     35.32MB
### Result for Kong git:master (run 2):
Running 30s test @ http://10.68.128.11:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.17ms    1.85ms  36.29ms   88.16%
    Req/Sec    33.09k     8.89k   62.53k    60.52%
  Latency Distribution
     50%  471.00us
     75%    0.97ms
     90%    3.55ms
     99%    9.19ms
  4944076 requests in 30.10s, 1.04GB read
Requests/sec: 164257.97
Transfer/sec:     35.25MB
### Result for Kong git:master (run 3):
Running 30s test @ http://10.68.128.11:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.18ms    1.87ms  32.83ms   88.08%
    Req/Sec    33.09k     9.11k   58.84k    60.52%
  Latency Distribution
     50%  469.00us
     75%    0.98ms
     90%    3.58ms
     99%    9.20ms
  4945270 requests in 30.10s, 1.04GB read
Requests/sec: 164296.11
Transfer/sec:     35.25MB
### Combined result for Kong git:master:
RPS     Avg: 164392.62
Latency Avg: 1.17ms    Max: 36.29ms
   P90 (ms): 3.53, 3.55, 3.58
   P99 (ms): 9.18, 9.19, 9.2
  
### Test Suite: git:master #simple #hybrid #no_plugins 10 services each has 10 routes
### Result for Kong git:master (run 1):
Running 30s test @ http://10.68.128.11:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.21ms    1.93ms  38.56ms   88.95%
    Req/Sec    30.84k     8.17k   50.85k    61.00%
  Latency Distribution
     50%  515.00us
     75%    1.01ms
     90%    3.48ms
     99%    9.61ms
  4617796 requests in 30.10s, 0.97GB read
Requests/sec: 153418.21
Transfer/sec:     32.92MB
### Result for Kong git:master (run 2):
Running 30s test @ http://10.68.128.11:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.20ms    1.91ms  40.30ms   89.26%
    Req/Sec    30.48k     8.38k   57.68k    63.92%
  Latency Distribution
     50%  501.00us
     75%    1.08ms
     90%    3.35ms
     99%    9.46ms
  4564661 requests in 30.10s, 0.96GB read
Requests/sec: 151652.99
Transfer/sec:     32.54MB
### Result for Kong git:master (run 3):
Running 30s test @ http://10.68.128.11:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.18ms    1.84ms  32.33ms   88.70%
    Req/Sec    30.93k     8.06k   57.19k    58.54%
  Latency Distribution
     50%  521.00us
     75%    0.97ms
     90%    3.43ms
     99%    9.12ms
  4631246 requests in 30.10s, 0.97GB read
Requests/sec: 153865.15
Transfer/sec:     33.02MB
### Combined result for Kong git:master:
RPS     Avg: 152978.78
Latency Avg: 1.20ms    Max: 40.30ms
   P90 (ms): 3.48, 3.35, 3.43
   P99 (ms): 9.61, 9.46, 9.12
  
### Test Suite: git:master #simple #hybrid #key-auth 10 services each has 10 routes with key-auth, 100 consumers
### Result for Kong git:master (run 1):
Running 30s test @ http://10.68.128.11:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.24ms    1.96ms  43.42ms   90.65%
    Req/Sec    27.21k     6.89k   50.93k    64.39%
  Latency Distribution
     50%  582.00us
     75%    1.19ms
     90%    2.96ms
     99%    9.93ms
  4073489 requests in 30.10s, 0.85GB read
Requests/sec: 135334.52
Transfer/sec:     29.04MB
### Result for Kong git:master (run 2):
Running 30s test @ http://10.68.128.11:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.22ms    1.85ms  38.20ms   90.46%
    Req/Sec    27.10k     7.03k   47.56k    61.59%
  Latency Distribution
     50%  582.00us
     75%    1.18ms
     90%    2.90ms
     99%    9.36ms
  4058282 requests in 30.10s, 0.85GB read
Requests/sec: 134829.15
Transfer/sec:     28.93MB
### Result for Kong git:master (run 3):
Running 30s test @ http://10.68.128.11:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.21ms    1.86ms  41.72ms   90.29%
    Req/Sec    27.30k     6.93k   47.82k    59.67%
  Latency Distribution
     50%  597.00us
     75%    1.12ms
     90%    2.96ms
     99%    9.45ms
  4087468 requests in 30.10s, 0.86GB read
Requests/sec: 135799.58
Transfer/sec:     29.14MB
### Combined result for Kong git:master:
RPS     Avg: 135321.08
Latency Avg: 1.22ms    Max: 43.42ms
   P90 (ms): 2.96, 2.9, 2.96
   P99 (ms): 9.93, 9.36, 9.45
  
### Result for upstream directly (run 1):
Running 30s test @ http://10.68.128.9:8088/test
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   570.04us    1.27ms  12.09ms   87.27%
    Req/Sec   170.64k    13.66k  216.60k    65.56%
  Latency Distribution
     50%   57.00us
     75%   96.00us
     90%    2.41ms
     99%    6.36ms
  25484147 requests in 30.10s, 3.32GB read
Requests/sec: 846668.16
Transfer/sec:    113.04MB
### Result for upstream directly (run 2):
Running 30s test @ http://10.68.128.9:8088/test
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   573.13us    1.26ms  16.02ms   87.21%
    Req/Sec   154.32k     8.33k  212.54k    76.55%
  Latency Distribution
     50%   62.00us
     75%  105.00us
     90%    2.40ms
     99%    6.35ms
  23048668 requests in 30.10s, 3.01GB read
Requests/sec: 765735.84
Transfer/sec:    102.24MB
### Result for upstream directly (run 3):
Running 30s test @ http://10.68.128.9:8088/test
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   578.99us    1.27ms  12.13ms   87.13%
    Req/Sec   154.19k     8.56k  202.79k    79.60%
  Latency Distribution
     50%   63.00us
     75%  106.00us
     90%    2.41ms
     99%    6.37ms
  23015307 requests in 30.02s, 3.00GB read
Requests/sec: 766756.33
Transfer/sec:    102.37MB
### Combined result for upstream directly:
RPS     Avg: 793053.44
Latency Avg: 0.57ms    Max: 16.02ms
   P90 (ms): 2.41, 2.4, 2.41
   P99 (ms): 6.36, 6.35, 6.37
  
### Test Suite: git:perf/balancer-enhancements #simple #no_plugins #single_route
### Result for Kong git:perf/balancer-enhancements (run 1):
Running 30s test @ http://10.68.128.11:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.17ms    1.84ms  31.31ms   88.04%
    Req/Sec    33.29k     8.67k   57.66k    60.32%
  Latency Distribution
     50%  474.00us
     75%    0.96ms
     90%    3.55ms
     99%    9.06ms
  4974756 requests in 30.10s, 1.04GB read
Requests/sec: 165276.69
Transfer/sec:     35.46MB
### Result for Kong git:perf/balancer-enhancements (run 2):
Running 30s test @ http://10.68.128.11:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.20ms    1.91ms  38.42ms   88.39%
    Req/Sec    32.69k     9.29k   64.88k    61.98%
  Latency Distribution
     50%  458.00us
     75%    1.05ms
     90%    3.57ms
     99%    9.47ms
  4884915 requests in 30.10s, 1.02GB read
Requests/sec: 162292.40
Transfer/sec:     34.82MB
### Result for Kong git:perf/balancer-enhancements (run 3):
Running 30s test @ http://10.68.128.11:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.19ms    1.88ms  32.81ms   88.02%
    Req/Sec    33.18k     9.11k   66.12k    61.19%
  Latency Distribution
     50%  466.00us
     75%    0.97ms
     90%    3.61ms
     99%    9.27ms
  4958270 requests in 30.10s, 1.04GB read
Requests/sec: 164729.49
Transfer/sec:     35.35MB
### Combined result for Kong git:perf/balancer-enhancements:
RPS     Avg: 164099.53
Latency Avg: 1.19ms    Max: 38.42ms
   P90 (ms): 3.55, 3.57, 3.61
   P99 (ms): 9.06, 9.47, 9.27
  
### Test Suite: git:perf/balancer-enhancements #simple #no_plugins 10 services each has 10 routes
### Result for Kong git:perf/balancer-enhancements (run 1):
Running 30s test @ http://10.68.128.11:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.20ms    1.89ms  35.17ms   88.83%
    Req/Sec    30.62k     8.25k   52.00k    59.53%
  Latency Distribution
     50%  507.00us
     75%    1.05ms
     90%    3.48ms
     99%    9.49ms
  4585451 requests in 30.10s, 0.96GB read
Requests/sec: 152343.64
Transfer/sec:     32.69MB
### Result for Kong git:perf/balancer-enhancements (run 2):
Running 30s test @ http://10.68.128.11:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.21ms    1.92ms  31.60ms   88.77%
    Req/Sec    30.91k     8.40k   56.01k    59.73%
  Latency Distribution
     50%  509.00us
     75%    1.02ms
     90%    3.52ms
     99%    9.63ms
  4628313 requests in 30.10s, 0.97GB read
Requests/sec: 153767.98
Transfer/sec:     32.99MB
### Result for Kong git:perf/balancer-enhancements (run 3):
Running 30s test @ http://10.68.128.11:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.18ms    1.84ms  29.86ms   88.67%
    Req/Sec    30.90k     8.10k   52.27k    58.72%
  Latency Distribution
     50%  524.00us
     75%    0.97ms
     90%    3.44ms
     99%    9.21ms
  4618623 requests in 30.10s, 0.97GB read
Requests/sec: 153445.39
Transfer/sec:     32.93MB
### Combined result for Kong git:perf/balancer-enhancements:
RPS     Avg: 153185.67
Latency Avg: 1.20ms    Max: 35.17ms
   P90 (ms): 3.48, 3.52, 3.44
   P99 (ms): 9.49, 9.63, 9.21
  
### Test Suite: git:perf/balancer-enhancements #simple #key-auth 10 services each has 10 routes with key-auth, 100 consumers
### Result for Kong git:perf/balancer-enhancements (run 1):
Running 30s test @ http://10.68.128.11:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.31ms    2.14ms  40.77ms   90.63%
    Req/Sec    26.85k     7.09k   48.71k    63.06%
  Latency Distribution
     50%  586.00us
     75%    1.23ms
     90%    3.22ms
     99%   10.97ms
  4020705 requests in 30.10s, 862.74MB read
Requests/sec: 133580.86
Transfer/sec:     28.66MB
### Result for Kong git:perf/balancer-enhancements (run 2):
Running 30s test @ http://10.68.128.11:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.24ms    1.90ms  29.64ms   90.13%
    Req/Sec    27.10k     7.17k   49.45k    58.94%
  Latency Distribution
     50%  612.00us
     75%    1.09ms
     90%    3.09ms
     99%    9.74ms
  4057609 requests in 30.10s, 0.85GB read
Requests/sec: 134807.20
Transfer/sec:     28.93MB
### Result for Kong git:perf/balancer-enhancements (run 3):
Running 30s test @ http://10.68.128.11:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.21ms    1.83ms  32.38ms   90.27%
    Req/Sec    27.12k     6.72k   45.94k    62.19%
  Latency Distribution
     50%  602.00us
     75%    1.11ms
     90%    2.93ms
     99%    9.24ms
  4062197 requests in 30.10s, 0.85GB read
Requests/sec: 134959.27
Transfer/sec:     28.96MB
### Combined result for Kong git:perf/balancer-enhancements:
RPS     Avg: 134449.11
Latency Avg: 1.25ms    Max: 40.77ms
   P90 (ms): 3.22, 3.09, 2.93
   P99 (ms): 10.97, 9.74, 9.24
  
### Test Suite: git:master #simple #no_plugins #single_route
### Result for Kong git:master (run 1):
Running 30s test @ http://10.68.128.11:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.22ms    1.97ms  40.08ms   88.75%
    Req/Sec    32.39k     8.73k   53.66k    61.72%
  Latency Distribution
     50%  466.00us
     75%    1.09ms
     90%    3.56ms
     99%    9.86ms
  4840337 requests in 30.10s, 1.01GB read
Requests/sec: 160812.50
Transfer/sec:     34.51MB
### Result for Kong git:master (run 2):
Running 30s test @ http://10.68.128.11:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.21ms    1.94ms  29.61ms   88.28%
    Req/Sec    32.55k     9.09k   62.70k    59.79%
  Latency Distribution
     50%  474.00us
     75%    1.03ms
     90%    3.65ms
     99%    9.63ms
  4863926 requests in 30.10s, 1.02GB read
Requests/sec: 161598.34
Transfer/sec:     34.67MB
### Result for Kong git:master (run 3):
Running 30s test @ http://10.68.128.11:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.19ms    1.88ms  42.77ms   88.07%
    Req/Sec    32.87k     9.24k   61.05k    59.92%
  Latency Distribution
     50%  487.00us
     75%    0.95ms
     90%    3.60ms
     99%    9.26ms
  4912232 requests in 30.10s, 1.03GB read
Requests/sec: 163201.89
Transfer/sec:     35.02MB
### Combined result for Kong git:master:
RPS     Avg: 161870.91
Latency Avg: 1.21ms    Max: 42.77ms
   P90 (ms): 3.56, 3.65, 3.6
   P99 (ms): 9.86, 9.63, 9.26
  
### Test Suite: git:master #simple #no_plugins 10 services each has 10 routes
### Result for Kong git:master (run 1):
Running 30s test @ http://10.68.128.11:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.21ms    1.93ms  32.31ms   88.94%
    Req/Sec    30.56k     8.10k   51.35k    60.20%
  Latency Distribution
     50%  515.00us
     75%    1.04ms
     90%    3.50ms
     99%    9.73ms
  4575977 requests in 30.10s, 0.96GB read
Requests/sec: 152028.84
Transfer/sec:     32.62MB
### Result for Kong git:master (run 2):
Running 30s test @ http://10.68.128.11:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.19ms    1.86ms  34.49ms   88.91%
    Req/Sec    30.74k     8.11k   53.03k    62.79%
  Latency Distribution
     50%  511.00us
     75%    1.01ms
     90%    3.41ms
     99%    9.24ms
  4602788 requests in 30.10s, 0.96GB read
Requests/sec: 152919.62
Transfer/sec:     32.81MB
### Result for Kong git:master (run 3):
Running 30s test @ http://10.68.128.11:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.21ms    1.91ms  32.54ms   88.72%
    Req/Sec    30.79k     8.36k   55.97k    60.53%
  Latency Distribution
     50%  520.00us
     75%    0.99ms
     90%    3.52ms
     99%    9.55ms
  4610347 requests in 30.10s, 0.97GB read
Requests/sec: 153170.89
Transfer/sec:     32.87MB
### Combined result for Kong git:master:
RPS     Avg: 152706.45
Latency Avg: 1.20ms    Max: 34.49ms
   P90 (ms): 3.5, 3.41, 3.52
   P99 (ms): 9.73, 9.24, 9.55
  
### Test Suite: git:master #simple #key-auth 10 services each has 10 routes with key-auth, 100 consumers
### Result for Kong git:master (run 1):
Running 30s test @ http://10.68.128.11:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.29ms    2.03ms  39.50ms   90.45%
    Req/Sec    27.06k     6.92k   44.00k    60.47%
  Latency Distribution
     50%  579.00us
     75%    1.22ms
     90%    3.17ms
     99%   10.25ms
  4053033 requests in 30.10s, 869.67MB read
Requests/sec: 134655.00
Transfer/sec:     28.89MB
### Result for Kong git:master (run 2):
Running 30s test @ http://10.68.128.11:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.23ms    1.90ms  37.06ms   90.28%
    Req/Sec    27.07k     6.86k   46.34k    60.33%
  Latency Distribution
     50%  611.00us
     75%    1.11ms
     90%    3.01ms
     99%    9.65ms
  4054058 requests in 30.10s, 869.89MB read
Requests/sec: 134689.10
Transfer/sec:     28.90MB
### Result for Kong git:master (run 3):
Running 30s test @ http://10.68.128.11:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.24ms    1.93ms  40.29ms   90.40%
    Req/Sec    27.04k     7.04k   41.96k    61.53%
  Latency Distribution
     50%  598.00us
     75%    1.16ms
     90%    3.00ms
     99%    9.82ms
  4050053 requests in 30.10s, 869.03MB read
Requests/sec: 134556.22
Transfer/sec:     28.87MB
### Combined result for Kong git:master:
RPS     Avg: 134633.44
Latency Avg: 1.25ms    Max: 40.29ms
   P90 (ms): 3.17, 3.01, 3
   P99 (ms): 10.25, 9.65, 9.82
  

Kong error logs are also available in Github Actions artifacts.

Download Artifacts for detailed results and interactive SVG flamegraphs.

github-actions[bot] avatar Aug 09 '22 08:08 github-actions[bot]

:rocket: Performance test result

Test Suite: 01-rps 02-flamegraph (baseline,single_route,simple)

Imgur Images Imgur Images Imgur Images Imgur Images

Click to expand
Please see Github Actions artifacts for flamegraphs.

  ### Test Suite: git:perf/balancer-enhancements #simple #hybrid #no_plugins #single_route
### Result for Kong git:perf/balancer-enhancements (run 1):
Running 30s test @ http://10.68.128.1:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.13ms    2.62ms 210.25ms   91.72%
    Req/Sec    33.57k     8.59k   65.22k    65.02%
  Latency Distribution
     50%  444.00us
     75%    1.00ms
     90%    3.28ms
     99%    8.36ms
  5012587 requests in 30.10s, 1.05GB read
Requests/sec: 166532.88
Transfer/sec:     35.73MB
### Result for Kong git:perf/balancer-enhancements (run 2):
Running 30s test @ http://10.68.128.1:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.13ms    1.74ms  25.33ms   87.79%
    Req/Sec    33.83k     8.64k   57.05k    60.52%
  Latency Distribution
     50%  466.00us
     75%    0.91ms
     90%    3.45ms
     99%    8.52ms
  5055877 requests in 30.10s, 1.06GB read
Requests/sec: 167973.37
Transfer/sec:     36.04MB
### Result for Kong git:perf/balancer-enhancements (run 3):
Running 30s test @ http://10.68.128.1:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.13ms    1.76ms  30.10ms   88.20%
    Req/Sec    33.36k     8.47k   60.47k    62.38%
  Latency Distribution
     50%  454.00us
     75%    1.00ms
     90%    3.38ms
     99%    8.66ms
  4985477 requests in 30.10s, 1.04GB read
Requests/sec: 165635.62
Transfer/sec:     35.54MB
### Combined result for Kong git:perf/balancer-enhancements:
RPS     Avg: 166713.96
Latency Avg: 1.13ms    Max: 210.25ms
   P90 (ms): 3.28, 3.45, 3.38
   P99 (ms): 8.36, 8.52, 8.66
  
### Test Suite: git:perf/balancer-enhancements #simple #hybrid #no_plugins 10 services each has 10 routes
### Result for Kong git:perf/balancer-enhancements (run 1):
Running 30s test @ http://10.68.128.1:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.16ms    1.78ms  30.27ms   88.43%
    Req/Sec    31.43k     7.83k   50.16k    60.64%
  Latency Distribution
     50%  517.00us
     75%    0.94ms
     90%    3.40ms
     99%    8.77ms
  4703312 requests in 30.10s, 0.99GB read
Requests/sec: 156260.33
Transfer/sec:     33.53MB
### Result for Kong git:perf/balancer-enhancements (run 2):
Running 30s test @ http://10.68.128.1:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.16ms    1.80ms  36.32ms   88.71%
    Req/Sec    31.24k     8.10k   59.99k    63.45%
  Latency Distribution
     50%  497.00us
     75%    1.01ms
     90%    3.36ms
     99%    8.95ms
  4669471 requests in 30.10s, 0.98GB read
Requests/sec: 155137.15
Transfer/sec:     33.29MB
### Result for Kong git:perf/balancer-enhancements (run 3):
Running 30s test @ http://10.68.128.1:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.18ms    1.85ms  30.00ms   88.67%
    Req/Sec    31.21k     8.15k   51.58k    59.87%
  Latency Distribution
     50%  508.00us
     75%    0.98ms
     90%    3.43ms
     99%    9.28ms
  4672993 requests in 30.10s, 0.98GB read
Requests/sec: 155252.93
Transfer/sec:     33.31MB
### Combined result for Kong git:perf/balancer-enhancements:
RPS     Avg: 155550.14
Latency Avg: 1.17ms    Max: 36.32ms
   P90 (ms): 3.4, 3.36, 3.43
   P99 (ms): 8.77, 8.95, 9.28
  
### Test Suite: git:perf/balancer-enhancements #simple #hybrid #key-auth 10 services each has 10 routes with key-auth, 100 consumers
### Result for Kong git:perf/balancer-enhancements (run 1):
Running 30s test @ http://10.68.128.1:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.16ms    1.71ms  34.85ms   90.14%
    Req/Sec    27.65k     6.40k   43.53k    59.64%
  Latency Distribution
     50%  592.00us
     75%    1.09ms
     90%    2.82ms
     99%    8.44ms
  4138217 requests in 30.10s, 0.87GB read
Requests/sec: 137485.94
Transfer/sec:     29.50MB
### Result for Kong git:perf/balancer-enhancements (run 2):
Running 30s test @ http://10.68.128.1:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.19ms    1.82ms  33.06ms   90.16%
    Req/Sec    27.60k     6.92k   51.82k    61.70%
  Latency Distribution
     50%  586.00us
     75%    1.11ms
     90%    2.96ms
     99%    9.15ms
  4130473 requests in 30.10s, 0.87GB read
Requests/sec: 137228.80
Transfer/sec:     29.45MB
### Result for Kong git:perf/balancer-enhancements (run 3):
Running 30s test @ http://10.68.128.1:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.23ms    1.87ms  32.34ms   90.27%
    Req/Sec    27.36k     6.95k   49.61k    62.57%
  Latency Distribution
     50%  570.00us
     75%    1.20ms
     90%    3.02ms
     99%    9.41ms
  4094702 requests in 30.10s, 0.86GB read
Requests/sec: 136040.38
Transfer/sec:     29.19MB
### Combined result for Kong git:perf/balancer-enhancements:
RPS     Avg: 136918.37
Latency Avg: 1.19ms    Max: 34.85ms
   P90 (ms): 2.82, 2.96, 3.02
   P99 (ms): 8.44, 9.15, 9.41
  
### Test Suite: git:master #simple #hybrid #no_plugins #single_route
### Result for Kong git:master (run 1):
Running 30s test @ http://10.68.128.1:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.15ms    1.79ms  30.52ms   87.90%
    Req/Sec    33.52k     8.76k   61.80k    59.23%
  Latency Distribution
     50%  464.00us
     75%    0.94ms
     90%    3.51ms
     99%    8.78ms
  5007189 requests in 30.10s, 1.05GB read
Requests/sec: 166359.27
Transfer/sec:     35.70MB
### Result for Kong git:master (run 2):
Running 30s test @ http://10.68.128.1:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.17ms    1.89ms  47.58ms   88.28%
    Req/Sec    33.23k     8.91k   79.11k    60.56%
  Latency Distribution
     50%  466.00us
     75%    0.96ms
     90%    3.52ms
     99%    9.13ms
  4962337 requests in 30.10s, 1.04GB read
Requests/sec: 164863.24
Transfer/sec:     35.38MB
### Result for Kong git:master (run 3):
Running 30s test @ http://10.68.128.1:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.15ms    1.77ms  30.92ms   87.96%
    Req/Sec    33.26k     8.60k   66.25k    59.92%
  Latency Distribution
     50%  481.00us
     75%    0.94ms
     90%    3.46ms
     99%    8.67ms
  4969888 requests in 30.10s, 1.04GB read
Requests/sec: 165115.99
Transfer/sec:     35.43MB
### Combined result for Kong git:master:
RPS     Avg: 165446.17
Latency Avg: 1.16ms    Max: 47.58ms
   P90 (ms): 3.51, 3.52, 3.46
   P99 (ms): 8.78, 9.13, 8.67
  
### Test Suite: git:master #simple #hybrid #no_plugins 10 services each has 10 routes
### Result for Kong git:master (run 1):
Running 30s test @ http://10.68.128.1:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.18ms    1.82ms  34.60ms   88.71%
    Req/Sec    30.88k     8.06k   51.72k    59.51%
  Latency Distribution
     50%  507.00us
     75%    1.00ms
     90%    3.40ms
     99%    8.97ms
  4620886 requests in 30.10s, 0.97GB read
Requests/sec: 153521.96
Transfer/sec:     32.94MB
### Result for Kong git:master (run 2):
Running 30s test @ http://10.68.128.1:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.17ms    1.84ms  37.08ms   88.84%
    Req/Sec    30.94k     7.86k   56.19k    61.84%
  Latency Distribution
     50%  508.00us
     75%    1.02ms
     90%    3.38ms
     99%    9.14ms
  4629631 requests in 30.10s, 0.97GB read
Requests/sec: 153812.30
Transfer/sec:     33.00MB
### Result for Kong git:master (run 3):
Running 30s test @ http://10.68.128.1:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.15ms    1.77ms  29.38ms   88.61%
    Req/Sec    31.09k     7.71k   50.62k    61.45%
  Latency Distribution
     50%  514.00us
     75%    0.97ms
     90%    3.36ms
     99%    8.78ms
  4645790 requests in 30.10s, 0.97GB read
Requests/sec: 154346.17
Transfer/sec:     33.12MB
### Combined result for Kong git:master:
RPS     Avg: 153893.48
Latency Avg: 1.17ms    Max: 37.08ms
   P90 (ms): 3.4, 3.38, 3.36
   P99 (ms): 8.97, 9.14, 8.78
  
### Test Suite: git:master #simple #hybrid #key-auth 10 services each has 10 routes with key-auth, 100 consumers
### Result for Kong git:master (run 1):
Running 30s test @ http://10.68.128.1:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.19ms    1.81ms  36.89ms   90.13%
    Req/Sec    27.51k     6.70k   42.73k    60.73%
  Latency Distribution
     50%  591.00us
     75%    1.10ms
     90%    2.95ms
     99%    8.99ms
  4119177 requests in 30.10s, 0.86GB read
Requests/sec: 136853.10
Transfer/sec:     29.36MB
### Result for Kong git:master (run 2):
Running 30s test @ http://10.68.128.1:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.16ms    1.70ms  31.34ms   90.09%
    Req/Sec    27.55k     6.71k   50.48k    63.99%
  Latency Distribution
     50%  593.00us
     75%    1.10ms
     90%    2.84ms
     99%    8.50ms
  4125712 requests in 30.10s, 0.86GB read
Requests/sec: 137070.17
Transfer/sec:     29.41MB
### Result for Kong git:master (run 3):
Running 30s test @ http://10.68.128.1:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.19ms    1.80ms  36.50ms   90.20%
    Req/Sec    27.56k     6.62k   48.99k    61.57%
  Latency Distribution
     50%  583.00us
     75%    1.11ms
     90%    2.92ms
     99%    9.03ms
  4125396 requests in 30.10s, 0.86GB read
Requests/sec: 137059.87
Transfer/sec:     29.41MB
### Combined result for Kong git:master:
RPS     Avg: 136994.38
Latency Avg: 1.18ms    Max: 36.89ms
   P90 (ms): 2.95, 2.84, 2.92
   P99 (ms): 8.99, 8.5, 9.03
  
### Result for upstream directly (run 1):
Running 30s test @ http://10.68.128.3:8088/test
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   576.51us    1.28ms  16.08ms   87.23%
    Req/Sec   166.98k     8.37k  211.08k    69.71%
  Latency Distribution
     50%   56.00us
     75%   97.00us
     90%    2.42ms
     99%    6.44ms
  24957099 requests in 30.10s, 3.25GB read
Requests/sec: 829154.96
Transfer/sec:    110.70MB
### Result for upstream directly (run 2):
Running 30s test @ http://10.68.128.3:8088/test
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   573.14us    1.27ms  12.07ms   87.27%
    Req/Sec   163.36k     8.08k  191.54k    69.75%
  Latency Distribution
     50%   58.00us
     75%   99.00us
     90%    2.42ms
     99%    6.43ms
  24399150 requests in 30.10s, 3.18GB read
Requests/sec: 810618.37
Transfer/sec:    108.23MB
### Result for upstream directly (run 3):
Running 30s test @ http://10.68.128.3:8088/test
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   581.02us    1.28ms  12.06ms   87.21%
    Req/Sec   158.65k     7.78k  211.32k    72.15%
  Latency Distribution
     50%   59.00us
     75%  102.00us
     90%    2.43ms
     99%    6.46ms
  23694381 requests in 30.10s, 3.09GB read
Requests/sec: 787207.72
Transfer/sec:    105.10MB
### Combined result for upstream directly:
RPS     Avg: 808993.68
Latency Avg: 0.58ms    Max: 16.08ms
   P90 (ms): 2.42, 2.42, 2.43
   P99 (ms): 6.44, 6.43, 6.46
  
### Test Suite: git:perf/balancer-enhancements #simple #no_plugins #single_route
### Result for Kong git:perf/balancer-enhancements (run 1):
Running 30s test @ http://10.68.128.1:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.16ms    1.81ms  32.22ms   87.90%
    Req/Sec    33.61k     8.63k   64.78k    60.79%
  Latency Distribution
     50%  464.00us
     75%    0.95ms
     90%    3.52ms
     99%    8.87ms
  5023934 requests in 30.10s, 1.05GB read
Requests/sec: 166913.84
Transfer/sec:     35.82MB
### Result for Kong git:perf/balancer-enhancements (run 2):
Running 30s test @ http://10.68.128.1:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.16ms    1.81ms  29.18ms   87.83%
    Req/Sec    33.35k     8.98k   59.23k    59.99%
  Latency Distribution
     50%  466.00us
     75%    0.96ms
     90%    3.55ms
     99%    8.82ms
  4984088 requests in 30.10s, 1.04GB read
Requests/sec: 165588.57
Transfer/sec:     35.53MB
### Result for Kong git:perf/balancer-enhancements (run 3):
Running 30s test @ http://10.68.128.1:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.16ms    1.80ms  29.34ms   87.84%
    Req/Sec    33.65k     8.72k   60.00k    62.12%
  Latency Distribution
     50%  467.00us
     75%    0.92ms
     90%    3.53ms
     99%    8.89ms
  5028061 requests in 30.10s, 1.05GB read
Requests/sec: 167053.49
Transfer/sec:     35.85MB
### Combined result for Kong git:perf/balancer-enhancements:
RPS     Avg: 166518.63
Latency Avg: 1.16ms    Max: 32.22ms
   P90 (ms): 3.52, 3.55, 3.53
   P99 (ms): 8.87, 8.82, 8.89
  
### Test Suite: git:perf/balancer-enhancements #simple #no_plugins 10 services each has 10 routes
### Result for Kong git:perf/balancer-enhancements (run 1):
Running 30s test @ http://10.68.128.1:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.16ms    1.81ms  34.41ms   88.55%
    Req/Sec    31.19k     7.90k   53.71k    59.38%
  Latency Distribution
     50%  521.00us
     75%    0.95ms
     90%    3.41ms
     99%    8.89ms
  4667401 requests in 30.10s, 0.98GB read
Requests/sec: 155067.05
Transfer/sec:     33.27MB
### Result for Kong git:perf/balancer-enhancements (run 2):
Running 30s test @ http://10.68.128.1:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.18ms    1.85ms  38.63ms   88.83%
    Req/Sec    31.03k     8.14k   52.40k    60.44%
  Latency Distribution
     50%  494.00us
     75%    1.04ms
     90%    3.39ms
     99%    9.24ms
  4643481 requests in 30.10s, 0.97GB read
Requests/sec: 154272.42
Transfer/sec:     33.10MB
### Result for Kong git:perf/balancer-enhancements (run 3):
Running 30s test @ http://10.68.128.1:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.16ms    1.79ms  38.97ms   88.58%
    Req/Sec    31.14k     7.86k   55.67k    60.99%
  Latency Distribution
     50%  507.00us
     75%    0.98ms
     90%    3.39ms
     99%    8.85ms
  4654195 requests in 30.10s, 0.98GB read
Requests/sec: 154632.33
Transfer/sec:     33.18MB
### Combined result for Kong git:perf/balancer-enhancements:
RPS     Avg: 154657.27
Latency Avg: 1.17ms    Max: 38.97ms
   P90 (ms): 3.41, 3.39, 3.39
   P99 (ms): 8.89, 9.24, 8.85
  
### Test Suite: git:perf/balancer-enhancements #simple #key-auth 10 services each has 10 routes with key-auth, 100 consumers
### Result for Kong git:perf/balancer-enhancements (run 1):
Running 30s test @ http://10.68.128.1:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.18ms    1.76ms  33.37ms   90.31%
    Req/Sec    27.15k     6.54k   43.32k    61.53%
  Latency Distribution
     50%  611.00us
     75%    1.11ms
     90%    2.81ms
     99%    8.87ms
  4065571 requests in 30.10s, 0.85GB read
Requests/sec: 135071.68
Transfer/sec:     28.98MB
### Result for Kong git:perf/balancer-enhancements (run 2):
Running 30s test @ http://10.68.128.1:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.19ms    1.76ms  34.34ms   90.20%
    Req/Sec    27.13k     6.54k   53.44k    63.05%
  Latency Distribution
     50%  589.00us
     75%    1.15ms
     90%    2.88ms
     99%    8.75ms
  4054623 requests in 30.10s, 870.01MB read
Requests/sec: 134709.66
Transfer/sec:     28.91MB
### Result for Kong git:perf/balancer-enhancements (run 3):
Running 30s test @ http://10.68.128.1:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.19ms    1.78ms  29.51ms   90.21%
    Req/Sec    27.23k     6.57k   46.61k    61.70%
  Latency Distribution
     50%  612.00us
     75%    1.09ms
     90%    2.88ms
     99%    8.97ms
  4074979 requests in 30.10s, 0.85GB read
Requests/sec: 135384.87
Transfer/sec:     29.05MB
### Combined result for Kong git:perf/balancer-enhancements:
RPS     Avg: 135055.40
Latency Avg: 1.19ms    Max: 34.34ms
   P90 (ms): 2.81, 2.88, 2.88
   P99 (ms): 8.87, 8.75, 8.97
  
### Test Suite: git:master #simple #no_plugins #single_route
### Result for Kong git:master (run 1):
Running 30s test @ http://10.68.128.1:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.15ms    1.77ms  30.08ms   88.20%
    Req/Sec    33.01k     8.32k   52.47k    59.99%
  Latency Distribution
     50%  465.00us
     75%    0.99ms
     90%    3.41ms
     99%    8.65ms
  4932696 requests in 30.10s, 1.03GB read
Requests/sec: 163882.35
Transfer/sec:     35.16MB
### Result for Kong git:master (run 2):
Running 30s test @ http://10.68.128.1:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.16ms    1.82ms  32.05ms   88.01%
    Req/Sec    33.13k     8.73k   54.51k    61.12%
  Latency Distribution
     50%  471.00us
     75%    0.97ms
     90%    3.52ms
     99%    8.96ms
  4952173 requests in 30.10s, 1.04GB read
Requests/sec: 164527.16
Transfer/sec:     35.30MB
### Result for Kong git:master (run 3):
Running 30s test @ http://10.68.128.1:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.16ms    1.82ms  32.14ms   87.91%
    Req/Sec    33.47k     8.59k   61.04k    61.72%
  Latency Distribution
     50%  470.00us
     75%    0.93ms
     90%    3.54ms
     99%    8.91ms
  5001740 requests in 30.10s, 1.05GB read
Requests/sec: 166172.62
Transfer/sec:     35.66MB
### Combined result for Kong git:master:
RPS     Avg: 164860.71
Latency Avg: 1.16ms    Max: 32.14ms
   P90 (ms): 3.41, 3.52, 3.54
   P99 (ms): 8.65, 8.96, 8.91
  
### Test Suite: git:master #simple #no_plugins 10 services each has 10 routes
### Result for Kong git:master (run 1):
Running 30s test @ http://10.68.128.1:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.18ms    1.85ms  37.96ms   88.52%
    Req/Sec    31.20k     8.18k   53.36k    60.00%
  Latency Distribution
     50%  497.00us
     75%    0.99ms
     90%    3.48ms
     99%    9.10ms
  4672082 requests in 30.10s, 0.98GB read
Requests/sec: 155222.52
Transfer/sec:     33.31MB
### Result for Kong git:master (run 2):
Running 30s test @ http://10.68.128.1:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.17ms    1.81ms  32.06ms   88.59%
    Req/Sec    31.02k     8.12k   55.85k    59.87%
  Latency Distribution
     50%  504.00us
     75%    1.01ms
     90%    3.42ms
     99%    9.05ms
  4645836 requests in 30.10s, 0.97GB read
Requests/sec: 154350.64
Transfer/sec:     33.12MB
### Result for Kong git:master (run 3):
Running 30s test @ http://10.68.128.1:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.18ms    1.82ms  29.22ms   88.47%
    Req/Sec    31.13k     7.99k   51.03k    58.60%
  Latency Distribution
     50%  511.00us
     75%    0.98ms
     90%    3.45ms
     99%    9.00ms
  4662938 requests in 30.10s, 0.98GB read
Requests/sec: 154918.76
Transfer/sec:     33.24MB
### Combined result for Kong git:master:
RPS     Avg: 154830.64
Latency Avg: 1.18ms    Max: 37.96ms
   P90 (ms): 3.48, 3.42, 3.45
   P99 (ms): 9.1, 9.05, 9
  
### Test Suite: git:master #simple #key-auth 10 services each has 10 routes with key-auth, 100 consumers
### Result for Kong git:master (run 1):
Running 30s test @ http://10.68.128.1:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.19ms    1.75ms  32.80ms   90.28%
    Req/Sec    26.93k     6.28k   43.75k    62.48%
  Latency Distribution
     50%  596.00us
     75%    1.15ms
     90%    2.85ms
     99%    8.72ms
  4027450 requests in 30.10s, 864.18MB read
Requests/sec: 133805.89
Transfer/sec:     28.71MB
### Result for Kong git:master (run 2):
Running 30s test @ http://10.68.128.1:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.18ms    1.74ms  34.72ms   90.37%
    Req/Sec    26.97k     6.41k   45.96k    62.06%
  Latency Distribution
     50%  623.00us
     75%    1.11ms
     90%    2.77ms
     99%    8.73ms
  4038600 requests in 30.10s, 866.57MB read
Requests/sec: 134175.92
Transfer/sec:     28.79MB
### Result for Kong git:master (run 3):
Running 30s test @ http://10.68.128.1:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.19ms    1.77ms  32.69ms   90.38%
    Req/Sec    27.02k     6.51k   47.29k    61.77%
  Latency Distribution
     50%  600.00us
     75%    1.13ms
     90%    2.82ms
     99%    8.89ms
  4043310 requests in 30.10s, 867.58MB read
Requests/sec: 134332.55
Transfer/sec:     28.82MB
### Combined result for Kong git:master:
RPS     Avg: 134104.79
Latency Avg: 1.19ms    Max: 34.72ms
   P90 (ms): 2.85, 2.77, 2.82
   P99 (ms): 8.72, 8.73, 8.89
  

Kong error logs are also available in Github Actions artifacts.

Download Artifacts for detailed results and interactive SVG flamegraphs.

github-actions[bot] avatar Aug 09 '22 10:08 github-actions[bot]

:rocket: Performance test result

Test Suite: 01-rps 02-flamegraph (baseline,single_route,simple)

Imgur Images Imgur Images Imgur Images Imgur Images

Click to expand
Please see Github Actions artifacts for flamegraphs.

  ### Test Suite: git:perf/balancer-enhancements #simple #hybrid #no_plugins #single_route
### Result for Kong git:perf/balancer-enhancements (run 1):
Running 30s test @ http://10.68.128.7:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.06ms    1.60ms  34.23ms   88.33%
    Req/Sec    34.13k     8.04k   60.64k    63.72%
  Latency Distribution
     50%  452.00us
     75%    0.92ms
     90%    3.07ms
     99%    7.90ms
  5099369 requests in 30.10s, 1.07GB read
Requests/sec: 169415.11
Transfer/sec:     36.35MB
### Result for Kong git:perf/balancer-enhancements (run 2):
Running 30s test @ http://10.68.128.7:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.08ms    1.64ms  26.39ms   88.15%
    Req/Sec    34.00k     7.90k   56.09k    64.31%
  Latency Distribution
     50%  461.00us
     75%    0.92ms
     90%    3.18ms
     99%    8.10ms
  5081241 requests in 30.10s, 1.06GB read
Requests/sec: 168813.64
Transfer/sec:     36.22MB
### Result for Kong git:perf/balancer-enhancements (run 3):
Running 30s test @ http://10.68.128.7:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.10ms    1.69ms  31.90ms   88.47%
    Req/Sec    33.45k     8.22k   68.09k    61.69%
  Latency Distribution
     50%  456.00us
     75%    0.97ms
     90%    3.20ms
     99%    8.41ms
  4995301 requests in 30.10s, 1.05GB read
Requests/sec: 165959.12
Transfer/sec:     35.61MB
### Combined result for Kong git:perf/balancer-enhancements:
RPS     Avg: 168062.62
Latency Avg: 1.08ms    Max: 34.23ms
   P90 (ms): 3.07, 3.18, 3.2
   P99 (ms): 7.9, 8.1, 8.41
  
### Test Suite: git:perf/balancer-enhancements #simple #hybrid #no_plugins 10 services each has 10 routes
### Result for Kong git:perf/balancer-enhancements (run 1):
Running 30s test @ http://10.68.128.7:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.10ms    1.65ms  30.25ms   88.74%
    Req/Sec    31.40k     7.43k   52.32k    60.47%
  Latency Distribution
     50%  506.00us
     75%    0.96ms
     90%    3.13ms
     99%    8.18ms
  4702611 requests in 30.10s, 0.99GB read
Requests/sec: 156235.45
Transfer/sec:     33.52MB
### Result for Kong git:perf/balancer-enhancements (run 2):
Running 30s test @ http://10.68.128.7:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.11ms    1.68ms  27.09ms   88.93%
    Req/Sec    31.16k     7.34k   55.49k    61.59%
  Latency Distribution
     50%  508.00us
     75%    0.97ms
     90%    3.13ms
     99%    8.44ms
  4666376 requests in 30.10s, 0.98GB read
Requests/sec: 155032.48
Transfer/sec:     33.27MB
### Result for Kong git:perf/balancer-enhancements (run 3):
Running 30s test @ http://10.68.128.7:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.11ms    1.66ms  26.11ms   88.87%
    Req/Sec    31.02k     7.47k   53.96k    62.26%
  Latency Distribution
     50%  510.00us
     75%    1.00ms
     90%    3.11ms
     99%    8.29ms
  4645264 requests in 30.10s, 0.97GB read
Requests/sec: 154330.99
Transfer/sec:     33.12MB
### Combined result for Kong git:perf/balancer-enhancements:
RPS     Avg: 155199.64
Latency Avg: 1.11ms    Max: 30.25ms
   P90 (ms): 3.13, 3.13, 3.11
   P99 (ms): 8.18, 8.44, 8.29
  
### Test Suite: git:perf/balancer-enhancements #simple #hybrid #key-auth 10 services each has 10 routes with key-auth, 100 consumers
### Result for Kong git:perf/balancer-enhancements (run 1):
Running 30s test @ http://10.68.128.7:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.18ms    1.75ms  37.66ms   90.68%
    Req/Sec    27.20k     6.16k   47.36k    61.66%
  Latency Distribution
     50%  566.00us
     75%    1.21ms
     90%    2.73ms
     99%    8.81ms
  4073376 requests in 30.10s, 0.85GB read
Requests/sec: 135330.15
Transfer/sec:     29.04MB
### Result for Kong git:perf/balancer-enhancements (run 2):
Running 30s test @ http://10.68.128.7:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.14ms    1.66ms  26.21ms   90.46%
    Req/Sec    27.37k     6.12k   50.19k    61.93%
  Latency Distribution
     50%  586.00us
     75%    1.13ms
     90%    2.64ms
     99%    8.38ms
  4097652 requests in 30.10s, 0.86GB read
Requests/sec: 136137.11
Transfer/sec:     29.21MB
### Result for Kong git:perf/balancer-enhancements (run 3):
Running 30s test @ http://10.68.128.7:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.14ms    1.66ms  34.51ms   90.38%
    Req/Sec    27.50k     6.29k   49.06k    62.66%
  Latency Distribution
     50%  588.00us
     75%    1.12ms
     90%    2.67ms
     99%    8.38ms
  4118150 requests in 30.10s, 0.86GB read
Requests/sec: 136818.17
Transfer/sec:     29.36MB
### Combined result for Kong git:perf/balancer-enhancements:
RPS     Avg: 136095.14
Latency Avg: 1.15ms    Max: 37.66ms
   P90 (ms): 2.73, 2.64, 2.67
   P99 (ms): 8.81, 8.38, 8.38
  
### Test Suite: git:master #simple #hybrid #no_plugins #single_route
### Result for Kong git:master (run 1):
Running 30s test @ http://10.68.128.7:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.09ms    1.66ms  24.98ms   88.29%
    Req/Sec    33.17k     7.95k   55.58k    62.32%
  Latency Distribution
     50%  471.00us
     75%    0.97ms
     90%    3.20ms
     99%    8.21ms
  4957399 requests in 30.10s, 1.04GB read
Requests/sec: 164702.39
Transfer/sec:     35.34MB
### Result for Kong git:master (run 2):
Running 30s test @ http://10.68.128.7:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.09ms    1.66ms  26.75ms   88.23%
    Req/Sec    33.35k     7.91k   57.27k    61.85%
  Latency Distribution
     50%  467.00us
     75%    0.96ms
     90%    3.22ms
     99%    8.21ms
  4983855 requests in 30.10s, 1.04GB read
Requests/sec: 165580.40
Transfer/sec:     35.53MB
### Result for Kong git:master (run 3):
Running 30s test @ http://10.68.128.7:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.11ms    1.72ms  33.30ms   88.48%
    Req/Sec    33.19k     8.05k   59.31k    63.72%
  Latency Distribution
     50%  467.00us
     75%    0.95ms
     90%    3.23ms
     99%    8.53ms
  4959622 requests in 30.10s, 1.04GB read
Requests/sec: 164775.75
Transfer/sec:     35.36MB
### Combined result for Kong git:master:
RPS     Avg: 165019.51
Latency Avg: 1.10ms    Max: 33.30ms
   P90 (ms): 3.2, 3.22, 3.23
   P99 (ms): 8.21, 8.21, 8.53
  
### Test Suite: git:master #simple #hybrid #no_plugins 10 services each has 10 routes
### Result for Kong git:master (run 1):
Running 30s test @ http://10.68.128.7:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.11ms    1.65ms  27.39ms   89.02%
    Req/Sec    30.72k     7.59k   52.73k    59.53%
  Latency Distribution
     50%  517.00us
     75%    1.01ms
     90%    3.06ms
     99%    8.29ms
  4600851 requests in 30.10s, 0.96GB read
Requests/sec: 152854.86
Transfer/sec:     32.80MB
### Result for Kong git:master (run 2):
Running 30s test @ http://10.68.128.7:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.11ms    1.66ms  29.35ms   88.92%
    Req/Sec    31.04k     7.25k   55.02k    62.26%
  Latency Distribution
     50%  507.00us
     75%    0.99ms
     90%    3.10ms
     99%    8.25ms
  4647528 requests in 30.10s, 0.97GB read
Requests/sec: 154405.16
Transfer/sec:     33.13MB
### Result for Kong git:master (run 3):
Running 30s test @ http://10.68.128.7:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.11ms    1.66ms  30.62ms   88.90%
    Req/Sec    31.00k     7.14k   60.29k    61.73%
  Latency Distribution
     50%  506.00us
     75%    1.00ms
     90%    3.11ms
     99%    8.32ms
  4642934 requests in 30.10s, 0.97GB read
Requests/sec: 154253.05
Transfer/sec:     33.10MB
### Combined result for Kong git:master:
RPS     Avg: 153837.69
Latency Avg: 1.11ms    Max: 30.62ms
   P90 (ms): 3.06, 3.1, 3.11
   P99 (ms): 8.29, 8.25, 8.32
  
### Test Suite: git:master #simple #hybrid #key-auth 10 services each has 10 routes with key-auth, 100 consumers
### Result for Kong git:master (run 1):
Running 30s test @ http://10.68.128.7:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.13ms    1.63ms  26.43ms   90.56%
    Req/Sec    27.37k     6.08k   44.69k    62.52%
  Latency Distribution
     50%  599.00us
     75%    1.11ms
     90%    2.57ms
     99%    8.27ms
  4098754 requests in 30.10s, 0.86GB read
Requests/sec: 136173.61
Transfer/sec:     29.22MB
### Result for Kong git:master (run 2):
Running 30s test @ http://10.68.128.7:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.15ms    1.67ms  46.57ms   90.64%
    Req/Sec    27.24k     6.24k   46.15k    62.13%
  Latency Distribution
     50%  577.00us
     75%    1.17ms
     90%    2.62ms
     99%    8.29ms
  4079670 requests in 30.10s, 0.85GB read
Requests/sec: 135539.33
Transfer/sec:     29.08MB
### Result for Kong git:master (run 3):
Running 30s test @ http://10.68.128.7:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.17ms    1.62ms  28.03ms   89.27%
    Req/Sec    27.11k     6.04k   44.98k    61.86%
  Latency Distribution
     50%  594.00us
     75%    1.15ms
     90%    2.97ms
     99%    7.86ms
  4059202 requests in 30.10s, 0.85GB read
Requests/sec: 134859.40
Transfer/sec:     28.94MB
### Combined result for Kong git:master:
RPS     Avg: 135524.11
Latency Avg: 1.15ms    Max: 46.57ms
   P90 (ms): 2.57, 2.62, 2.97
   P99 (ms): 8.27, 8.29, 7.86
  
### Result for upstream directly (run 1):
Running 30s test @ http://10.68.128.5:8088/test
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   557.56us    1.26ms  24.43ms   87.54%
    Req/Sec   174.82k    10.40k  213.11k    73.08%
  Latency Distribution
     50%   55.00us
     75%   93.00us
     90%    2.35ms
     99%    6.37ms
  26112134 requests in 30.10s, 3.40GB read
Requests/sec: 867521.58
Transfer/sec:    115.83MB
### Result for upstream directly (run 2):
Running 30s test @ http://10.68.128.5:8088/test
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   575.69us    1.28ms  16.04ms   87.36%
    Req/Sec   157.65k     8.00k  196.99k    71.60%
  Latency Distribution
     50%   61.00us
     75%  103.00us
     90%    2.42ms
     99%    6.44ms
  23527247 requests in 30.04s, 3.07GB read
Requests/sec: 783067.59
Transfer/sec:    104.55MB
### Result for upstream directly (run 3):
Running 30s test @ http://10.68.128.5:8088/test
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   566.95us    1.26ms  16.09ms   87.50%
    Req/Sec   158.45k     8.26k  198.44k    70.22%
  Latency Distribution
     50%   61.00us
     75%  102.00us
     90%    2.40ms
     99%    6.39ms
  23662811 requests in 30.10s, 3.09GB read
Requests/sec: 786139.46
Transfer/sec:    104.96MB
### Combined result for upstream directly:
RPS     Avg: 812242.88
Latency Avg: 0.57ms    Max: 24.43ms
   P90 (ms): 2.35, 2.42, 2.4
   P99 (ms): 6.37, 6.44, 6.39
  
### Test Suite: git:perf/balancer-enhancements #simple #no_plugins #single_route
### Result for Kong git:perf/balancer-enhancements (run 1):
Running 30s test @ http://10.68.128.7:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.09ms    1.65ms  28.52ms   88.07%
    Req/Sec    33.70k     8.34k   72.10k    62.16%
  Latency Distribution
     50%  465.00us
     75%    0.93ms
     90%    3.23ms
     99%    8.16ms
  5033612 requests in 30.10s, 1.05GB read
Requests/sec: 167233.70
Transfer/sec:     35.88MB
### Result for Kong git:perf/balancer-enhancements (run 2):
Running 30s test @ http://10.68.128.7:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.08ms    1.63ms  28.30ms   88.04%
    Req/Sec    33.71k     7.95k   60.93k    60.79%
  Latency Distribution
     50%  460.00us
     75%    0.94ms
     90%    3.21ms
     99%    8.02ms
  5038751 requests in 30.10s, 1.06GB read
Requests/sec: 167407.06
Transfer/sec:     35.92MB
### Result for Kong git:perf/balancer-enhancements (run 3):
Running 30s test @ http://10.68.128.7:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.09ms    1.66ms  28.49ms   88.10%
    Req/Sec    33.71k     8.05k   58.09k    61.38%
  Latency Distribution
     50%  461.00us
     75%    0.94ms
     90%    3.25ms
     99%    8.23ms
  5036655 requests in 30.10s, 1.06GB read
Requests/sec: 167336.70
Transfer/sec:     35.91MB
### Combined result for Kong git:perf/balancer-enhancements:
RPS     Avg: 167325.82
Latency Avg: 1.09ms    Max: 28.52ms
   P90 (ms): 3.23, 3.21, 3.25
   P99 (ms): 8.16, 8.02, 8.23
  
### Test Suite: git:perf/balancer-enhancements #simple #no_plugins 10 services each has 10 routes
### Result for Kong git:perf/balancer-enhancements (run 1):
Running 30s test @ http://10.68.128.7:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.11ms    1.67ms  29.00ms   89.08%
    Req/Sec    30.83k     7.41k   50.95k    63.32%
  Latency Distribution
     50%  494.00us
     75%    1.05ms
     90%    3.07ms
     99%    8.31ms
  4616398 requests in 30.10s, 0.97GB read
Requests/sec: 153371.30
Transfer/sec:     32.91MB
### Result for Kong git:perf/balancer-enhancements (run 2):
Running 30s test @ http://10.68.128.7:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.14ms    1.75ms  30.45ms   89.06%
    Req/Sec    30.86k     7.67k   54.53k    60.20%
  Latency Distribution
     50%  513.00us
     75%    1.01ms
     90%    3.17ms
     99%    8.78ms
  4619407 requests in 30.10s, 0.97GB read
Requests/sec: 153471.44
Transfer/sec:     32.93MB
### Result for Kong git:perf/balancer-enhancements (run 3):
Running 30s test @ http://10.68.128.7:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.13ms    1.74ms  30.60ms   88.97%
    Req/Sec    31.22k     7.57k   51.56k    61.66%
  Latency Distribution
     50%  502.00us
     75%    0.99ms
     90%    3.18ms
     99%    8.70ms
  4675360 requests in 30.10s, 0.98GB read
Requests/sec: 155330.60
Transfer/sec:     33.33MB
### Combined result for Kong git:perf/balancer-enhancements:
RPS     Avg: 154057.78
Latency Avg: 1.13ms    Max: 30.60ms
   P90 (ms): 3.07, 3.17, 3.18
   P99 (ms): 8.31, 8.78, 8.7
  
### Test Suite: git:perf/balancer-enhancements #simple #key-auth 10 services each has 10 routes with key-auth, 100 consumers
### Result for Kong git:perf/balancer-enhancements (run 1):
Running 30s test @ http://10.68.128.7:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.14ms    1.64ms  33.57ms   90.55%
    Req/Sec    27.12k     6.02k   44.56k    64.58%
  Latency Distribution
     50%  594.00us
     75%    1.15ms
     90%    2.61ms
     99%    8.16ms
  4061559 requests in 30.10s, 0.85GB read
Requests/sec: 134937.76
Transfer/sec:     28.95MB
### Result for Kong git:perf/balancer-enhancements (run 2):
Running 30s test @ http://10.68.128.7:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.15ms    1.68ms  29.51ms   90.46%
    Req/Sec    27.24k     6.35k   48.77k    63.46%
  Latency Distribution
     50%  602.00us
     75%    1.13ms
     90%    2.67ms
     99%    8.48ms
  4078952 requests in 30.10s, 0.85GB read
Requests/sec: 135515.72
Transfer/sec:     29.08MB
### Result for Kong git:perf/balancer-enhancements (run 3):
Running 30s test @ http://10.68.128.7:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.14ms    1.63ms  29.03ms   90.29%
    Req/Sec    27.45k     6.24k   46.85k    62.06%
  Latency Distribution
     50%  602.00us
     75%    1.08ms
     90%    2.66ms
     99%    8.04ms
  4110630 requests in 30.10s, 0.86GB read
Requests/sec: 136568.24
Transfer/sec:     29.30MB
### Combined result for Kong git:perf/balancer-enhancements:
RPS     Avg: 135673.91
Latency Avg: 1.14ms    Max: 33.57ms
   P90 (ms): 2.61, 2.67, 2.66
   P99 (ms): 8.16, 8.48, 8.04
  
### Test Suite: git:master #simple #no_plugins #single_route
### Result for Kong git:master (run 1):
Running 30s test @ http://10.68.128.7:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.12ms    1.74ms  32.53ms   88.51%
    Req/Sec    32.95k     7.92k   55.34k    61.78%
  Latency Distribution
     50%  469.00us
     75%    0.97ms
     90%    3.26ms
     99%    8.66ms
  4925435 requests in 30.10s, 1.03GB read
Requests/sec: 163640.17
Transfer/sec:     35.11MB
### Result for Kong git:master (run 2):
Running 30s test @ http://10.68.128.7:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.10ms    1.66ms  31.33ms   88.21%
    Req/Sec    33.07k     8.05k   60.95k    60.92%
  Latency Distribution
     50%  479.00us
     75%    0.94ms
     90%    3.23ms
     99%    8.24ms
  4941727 requests in 30.10s, 1.04GB read
Requests/sec: 164181.02
Transfer/sec:     35.23MB
### Result for Kong git:master (run 3):
Running 30s test @ http://10.68.128.7:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.10ms    1.66ms  30.15ms   88.17%
    Req/Sec    32.94k     8.10k   59.68k    60.59%
  Latency Distribution
     50%  481.00us
     75%    0.94ms
     90%    3.25ms
     99%    8.20ms
  4922436 requests in 30.10s, 1.03GB read
Requests/sec: 163537.60
Transfer/sec:     35.09MB
### Combined result for Kong git:master:
RPS     Avg: 163786.26
Latency Avg: 1.11ms    Max: 32.53ms
   P90 (ms): 3.26, 3.23, 3.25
   P99 (ms): 8.66, 8.24, 8.2
  
### Test Suite: git:master #simple #no_plugins 10 services each has 10 routes
### Result for Kong git:master (run 1):
Running 30s test @ http://10.68.128.7:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.12ms    1.70ms  28.42ms   88.88%
    Req/Sec    31.00k     7.43k   52.70k    60.13%
  Latency Distribution
     50%  511.00us
     75%    0.99ms
     90%    3.16ms
     99%    8.54ms
  4641690 requests in 30.10s, 0.97GB read
Requests/sec: 154211.84
Transfer/sec:     33.09MB
### Result for Kong git:master (run 2):
Running 30s test @ http://10.68.128.7:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.12ms    1.69ms  28.13ms   88.83%
    Req/Sec    30.95k     7.50k   52.58k    63.06%
  Latency Distribution
     50%  519.00us
     75%    0.98ms
     90%    3.16ms
     99%    8.36ms
  4633967 requests in 30.10s, 0.97GB read
Requests/sec: 153954.94
Transfer/sec:     33.03MB
### Result for Kong git:master (run 3):
Running 30s test @ http://10.68.128.7:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.12ms    1.70ms  32.18ms   88.85%
    Req/Sec    31.02k     7.38k   56.89k    60.66%
  Latency Distribution
     50%  512.00us
     75%    0.98ms
     90%    3.17ms
     99%    8.49ms
  4643989 requests in 30.10s, 0.97GB read
Requests/sec: 154288.17
Transfer/sec:     33.11MB
### Combined result for Kong git:master:
RPS     Avg: 154151.65
Latency Avg: 1.12ms    Max: 32.18ms
   P90 (ms): 3.16, 3.16, 3.17
   P99 (ms): 8.54, 8.36, 8.49
  
### Test Suite: git:master #simple #key-auth 10 services each has 10 routes with key-auth, 100 consumers
### Result for Kong git:master (run 1):
Running 30s test @ http://10.68.128.7:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.15ms    1.64ms  29.16ms   90.46%
    Req/Sec    27.11k     5.93k   43.88k    62.72%
  Latency Distribution
     50%  586.00us
     75%    1.17ms
     90%    2.65ms
     99%    8.19ms
  4059130 requests in 30.10s, 0.85GB read
Requests/sec: 134856.98
Transfer/sec:     28.94MB
### Result for Kong git:master (run 2):
Running 30s test @ http://10.68.128.7:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.16ms    1.62ms  32.00ms   90.14%
    Req/Sec    27.01k     5.97k   44.02k    63.06%
  Latency Distribution
     50%  586.00us
     75%    1.19ms
     90%    2.75ms
     99%    7.98ms
  4044409 requests in 30.10s, 867.82MB read
Requests/sec: 134368.19
Transfer/sec:     28.83MB
### Result for Kong git:master (run 3):
Running 30s test @ http://10.68.128.7:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.15ms    1.66ms  31.27ms   90.50%
    Req/Sec    27.23k     5.97k   46.95k    62.06%
  Latency Distribution
     50%  592.00us
     75%    1.13ms
     90%    2.64ms
     99%    8.28ms
  4077179 requests in 30.10s, 0.85GB read
Requests/sec: 135456.62
Transfer/sec:     29.07MB
### Combined result for Kong git:master:
RPS     Avg: 134893.93
Latency Avg: 1.15ms    Max: 32.00ms
   P90 (ms): 2.65, 2.75, 2.64
   P99 (ms): 8.19, 7.98, 8.28
  

Kong error logs are also available in Github Actions artifacts.

Download Artifacts for detailed results and interactive SVG flamegraphs.

github-actions[bot] avatar Aug 09 '22 10:08 github-actions[bot]

:rocket: Performance test result

Test Suite: 01-rps 02-flamegraph (baseline,single_route,simple)

Imgur Images Imgur Images Imgur Images Imgur Images

Click to expand
Please see Github Actions artifacts for flamegraphs.

  ### Test Suite: git:perf/balancer-enhancements #simple #hybrid #no_plugins #single_route
### Result for Kong git:perf/balancer-enhancements (run 1):
Running 30s test @ http://10.68.128.3:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.16ms    1.87ms  30.45ms   88.36%
    Req/Sec    34.08k     8.57k   62.33k    62.18%
  Latency Distribution
     50%  452.00us
     75%    0.98ms
     90%    3.47ms
     99%    9.33ms
  5093946 requests in 30.10s, 1.07GB read
Requests/sec: 169240.83
Transfer/sec:     36.31MB
### Result for Kong git:perf/balancer-enhancements (run 2):
Running 30s test @ http://10.68.128.3:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.21ms    1.95ms  31.71ms   88.42%
    Req/Sec    33.63k     8.89k   54.72k    59.65%
  Latency Distribution
     50%  452.00us
     75%    1.01ms
     90%    3.60ms
     99%    9.71ms
  5025975 requests in 30.10s, 1.05GB read
Requests/sec: 166978.30
Transfer/sec:     35.83MB
### Result for Kong git:perf/balancer-enhancements (run 3):
Running 30s test @ http://10.68.128.3:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.17ms    1.85ms  35.58ms   87.95%
    Req/Sec    33.79k     8.63k   53.69k    59.59%
  Latency Distribution
     50%  465.00us
     75%    0.93ms
     90%    3.56ms
     99%    9.12ms
  5049344 requests in 30.10s, 1.06GB read
Requests/sec: 167753.90
Transfer/sec:     36.00MB
### Combined result for Kong git:perf/balancer-enhancements:
RPS     Avg: 167991.01
Latency Avg: 1.18ms    Max: 35.58ms
   P90 (ms): 3.47, 3.6, 3.56
   P99 (ms): 9.33, 9.71, 9.12
  
### Test Suite: git:perf/balancer-enhancements #simple #hybrid #no_plugins 10 services each has 10 routes
### Result for Kong git:perf/balancer-enhancements (run 1):
Running 30s test @ http://10.68.128.3:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.17ms    1.84ms  34.17ms   88.68%
    Req/Sec    31.53k     7.78k   51.91k    60.07%
  Latency Distribution
     50%  502.00us
     75%    0.98ms
     90%    3.41ms
     99%    9.27ms
  4720495 requests in 30.10s, 0.99GB read
Requests/sec: 156829.97
Transfer/sec:     33.65MB
### Result for Kong git:perf/balancer-enhancements (run 2):
Running 30s test @ http://10.68.128.3:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.17ms    1.81ms  30.60ms   88.55%
    Req/Sec    31.51k     7.80k   54.77k    59.87%
  Latency Distribution
     50%  501.00us
     75%    0.97ms
     90%    3.41ms
     99%    9.03ms
  4718578 requests in 30.10s, 0.99GB read
Requests/sec: 156766.70
Transfer/sec:     33.64MB
### Result for Kong git:perf/balancer-enhancements (run 3):
Running 30s test @ http://10.68.128.3:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.18ms    1.87ms  40.01ms   88.58%
    Req/Sec    31.46k     7.95k   50.45k    60.27%
  Latency Distribution
     50%  507.00us
     75%    0.97ms
     90%    3.48ms
     99%    9.34ms
  4711094 requests in 30.10s, 0.99GB read
Requests/sec: 156517.83
Transfer/sec:     33.58MB
### Combined result for Kong git:perf/balancer-enhancements:
RPS     Avg: 156704.83
Latency Avg: 1.17ms    Max: 40.01ms
   P90 (ms): 3.41, 3.41, 3.48
   P99 (ms): 9.27, 9.03, 9.34
  
### Test Suite: git:perf/balancer-enhancements #simple #hybrid #key-auth 10 services each has 10 routes with key-auth, 100 consumers
### Result for Kong git:perf/balancer-enhancements (run 1):
Running 30s test @ http://10.68.128.3:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.18ms    1.77ms  29.35ms   90.14%
    Req/Sec    27.57k     6.69k   46.79k    60.47%
  Latency Distribution
     50%  590.00us
     75%    1.11ms
     90%    2.90ms
     99%    9.01ms
  4128084 requests in 30.10s, 0.87GB read
Requests/sec: 137148.09
Transfer/sec:     29.43MB
### Result for Kong git:perf/balancer-enhancements (run 2):
Running 30s test @ http://10.68.128.3:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.24ms    1.87ms  35.60ms   89.81%
    Req/Sec    27.49k     6.62k   44.98k    61.98%
  Latency Distribution
     50%  560.00us
     75%    1.22ms
     90%    3.16ms
     99%    9.34ms
  4108183 requests in 30.10s, 0.86GB read
Requests/sec: 136487.63
Transfer/sec:     29.29MB
### Result for Kong git:perf/balancer-enhancements (run 3):
Running 30s test @ http://10.68.128.3:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.19ms    1.78ms  39.20ms   90.27%
    Req/Sec    27.25k     6.62k   42.39k    62.99%
  Latency Distribution
     50%  593.00us
     75%    1.16ms
     90%    2.87ms
     99%    8.94ms
  4079636 requests in 30.10s, 0.85GB read
Requests/sec: 135538.91
Transfer/sec:     29.08MB
### Combined result for Kong git:perf/balancer-enhancements:
RPS     Avg: 136391.54
Latency Avg: 1.20ms    Max: 39.20ms
   P90 (ms): 2.9, 3.16, 2.87
   P99 (ms): 9.01, 9.34, 8.94
  
### Test Suite: git:master #simple #hybrid #no_plugins #single_route
### Result for Kong git:master (run 1):
Running 30s test @ http://10.68.128.3:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.17ms    1.83ms  29.13ms   88.20%
    Req/Sec    33.18k     8.34k   59.38k    60.72%
  Latency Distribution
     50%  466.00us
     75%    0.98ms
     90%    3.50ms
     99%    9.12ms
  4958779 requests in 30.10s, 1.04GB read
Requests/sec: 164747.39
Transfer/sec:     35.35MB
### Result for Kong git:master (run 2):
Running 30s test @ http://10.68.128.3:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.16ms    1.84ms  28.89ms   88.05%
    Req/Sec    33.51k     8.30k   57.63k    60.65%
  Latency Distribution
     50%  477.00us
     75%    0.91ms
     90%    3.53ms
     99%    9.11ms
  5008027 requests in 30.10s, 1.05GB read
Requests/sec: 166382.42
Transfer/sec:     35.70MB
### Result for Kong git:master (run 3):
Running 30s test @ http://10.68.128.3:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.18ms    1.88ms  35.56ms   88.42%
    Req/Sec    33.04k     8.10k   59.35k    61.25%
  Latency Distribution
     50%  470.00us
     75%    0.99ms
     90%    3.51ms
     99%    9.32ms
  4938746 requests in 30.10s, 1.03GB read
Requests/sec: 164084.03
Transfer/sec:     35.21MB
### Combined result for Kong git:master:
RPS     Avg: 165071.28
Latency Avg: 1.17ms    Max: 35.56ms
   P90 (ms): 3.5, 3.53, 3.51
   P99 (ms): 9.12, 9.11, 9.32
  
### Test Suite: git:master #simple #hybrid #no_plugins 10 services each has 10 routes
### Result for Kong git:master (run 1):
Running 30s test @ http://10.68.128.3:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.25ms    2.07ms  47.75ms   89.26%
    Req/Sec    30.86k     8.21k   52.88k    60.80%
  Latency Distribution
     50%  487.00us
     75%    1.09ms
     90%    3.56ms
     99%   10.31ms
  4621213 requests in 30.10s, 0.97GB read
Requests/sec: 153532.00
Transfer/sec:     32.94MB
### Result for Kong git:master (run 2):
Running 30s test @ http://10.68.128.3:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.18ms    1.87ms  50.70ms   88.57%
    Req/Sec    31.34k     7.77k   56.58k    60.73%
  Latency Distribution
     50%  510.00us
     75%    0.95ms
     90%    3.49ms
     99%    9.28ms
  4692805 requests in 30.10s, 0.98GB read
Requests/sec: 155910.29
Transfer/sec:     33.45MB
### Result for Kong git:master (run 3):
Running 30s test @ http://10.68.128.3:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.21ms    1.96ms  41.27ms   88.96%
    Req/Sec    31.15k     7.80k   51.72k    61.79%
  Latency Distribution
     50%  503.00us
     75%    1.01ms
     90%    3.50ms
     99%    9.80ms
  4664421 requests in 30.10s, 0.98GB read
Requests/sec: 154967.16
Transfer/sec:     33.25MB
### Combined result for Kong git:master:
RPS     Avg: 154803.15
Latency Avg: 1.21ms    Max: 50.70ms
   P90 (ms): 3.56, 3.49, 3.5
   P99 (ms): 10.31, 9.28, 9.8
  
### Test Suite: git:master #simple #hybrid #key-auth 10 services each has 10 routes with key-auth, 100 consumers
### Result for Kong git:master (run 1):
Running 30s test @ http://10.68.128.3:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.19ms    1.80ms  30.96ms   90.08%
    Req/Sec    27.60k     6.56k   44.59k    61.26%
  Latency Distribution
     50%  601.00us
     75%    1.09ms
     90%    2.96ms
     99%    9.25ms
  4133631 requests in 30.10s, 0.87GB read
Requests/sec: 137332.89
Transfer/sec:     29.47MB
### Result for Kong git:master (run 2):
Running 30s test @ http://10.68.128.3:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.17ms    1.75ms  32.16ms   90.07%
    Req/Sec    27.69k     6.27k   50.42k    61.46%
  Latency Distribution
     50%  587.00us
     75%    1.09ms
     90%    2.90ms
     99%    8.73ms
  4145888 requests in 30.10s, 0.87GB read
Requests/sec: 137739.96
Transfer/sec:     29.56MB
### Result for Kong git:master (run 3):
Running 30s test @ http://10.68.128.3:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.21ms    1.88ms  45.04ms   90.33%
    Req/Sec    27.46k     6.56k   49.69k    64.25%
  Latency Distribution
     50%  601.00us
     75%    1.12ms
     90%    2.96ms
     99%    9.59ms
  4111147 requests in 30.10s, 0.86GB read
Requests/sec: 136585.78
Transfer/sec:     29.31MB
### Combined result for Kong git:master:
RPS     Avg: 137219.54
Latency Avg: 1.19ms    Max: 45.04ms
   P90 (ms): 2.96, 2.9, 2.96
   P99 (ms): 9.25, 8.73, 9.59
  
### Result for upstream directly (run 1):
Running 30s test @ http://10.68.128.1:8088/test
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   564.21us    1.27ms  24.05ms   87.34%
    Req/Sec   174.60k    12.42k  220.64k    72.42%
  Latency Distribution
     50%   56.00us
     75%   93.00us
     90%    2.38ms
     99%    6.33ms
  26076561 requests in 30.10s, 3.40GB read
Requests/sec: 866338.04
Transfer/sec:    115.67MB
### Result for upstream directly (run 2):
Running 30s test @ http://10.68.128.1:8088/test
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   578.27us    1.27ms  12.11ms   87.18%
    Req/Sec   156.76k     7.56k  218.69k    72.29%
  Latency Distribution
     50%   61.00us
     75%  103.00us
     90%    2.42ms
     99%    6.40ms
  23408441 requests in 30.10s, 3.05GB read
Requests/sec: 777710.64
Transfer/sec:    103.84MB
### Result for upstream directly (run 3):
Running 30s test @ http://10.68.128.1:8088/test
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   576.61us    1.28ms  12.13ms   87.24%
    Req/Sec   156.23k     7.57k  211.59k    73.15%
  Latency Distribution
     50%   61.00us
     75%  103.00us
     90%    2.41ms
     99%    6.44ms
  23332576 requests in 30.10s, 3.04GB read
Requests/sec: 775186.46
Transfer/sec:    103.50MB
### Combined result for upstream directly:
RPS     Avg: 806411.71
Latency Avg: 0.57ms    Max: 24.05ms
   P90 (ms): 2.38, 2.42, 2.41
   P99 (ms): 6.33, 6.4, 6.44
  
### Test Suite: git:perf/balancer-enhancements #simple #no_plugins #single_route
### Result for Kong git:perf/balancer-enhancements (run 1):
Running 30s test @ http://10.68.128.3:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.17ms    1.85ms  30.11ms   88.02%
    Req/Sec    33.71k     8.40k   57.91k    61.05%
  Latency Distribution
     50%  457.00us
     75%    0.98ms
     90%    3.55ms
     99%    9.13ms
  5038141 requests in 30.10s, 1.06GB read
Requests/sec: 167385.29
Transfer/sec:     35.92MB
### Result for Kong git:perf/balancer-enhancements (run 2):
Running 30s test @ http://10.68.128.3:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.17ms    1.85ms  32.96ms   87.84%
    Req/Sec    33.61k     8.68k   56.01k    60.12%
  Latency Distribution
     50%  471.00us
     75%    0.92ms
     90%    3.59ms
     99%    9.11ms
  5022417 requests in 30.10s, 1.05GB read
Requests/sec: 166860.39
Transfer/sec:     35.80MB
### Result for Kong git:perf/balancer-enhancements (run 3):
Running 30s test @ http://10.68.128.3:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.18ms    1.87ms  38.96ms   87.94%
    Req/Sec    33.75k     8.45k   60.42k    61.32%
  Latency Distribution
     50%  463.00us
     75%    0.95ms
     90%    3.61ms
     99%    9.26ms
  5043404 requests in 30.10s, 1.06GB read
Requests/sec: 167557.70
Transfer/sec:     35.95MB
### Combined result for Kong git:perf/balancer-enhancements:
RPS     Avg: 167267.79
Latency Avg: 1.17ms    Max: 38.96ms
   P90 (ms): 3.55, 3.59, 3.61
   P99 (ms): 9.13, 9.11, 9.26
  
### Test Suite: git:perf/balancer-enhancements #simple #no_plugins 10 services each has 10 routes
### Result for Kong git:perf/balancer-enhancements (run 1):
Running 30s test @ http://10.68.128.3:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.18ms    1.85ms  32.81ms   88.61%
    Req/Sec    31.37k     7.68k   50.71k    60.93%
  Latency Distribution
     50%  497.00us
     75%    0.99ms
     90%    3.45ms
     99%    9.24ms
  4698057 requests in 30.10s, 0.98GB read
Requests/sec: 156084.64
Transfer/sec:     33.49MB
### Result for Kong git:perf/balancer-enhancements (run 2):
Running 30s test @ http://10.68.128.3:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.19ms    1.89ms  28.91ms   88.63%
    Req/Sec    31.28k     8.06k   54.03k    60.60%
  Latency Distribution
     50%  504.00us
     75%    1.00ms
     90%    3.49ms
     99%    9.45ms
  4683202 requests in 30.10s, 0.98GB read
Requests/sec: 155591.65
Transfer/sec:     33.39MB
### Result for Kong git:perf/balancer-enhancements (run 3):
Running 30s test @ http://10.68.128.3:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.17ms    1.83ms  26.04ms   88.51%
    Req/Sec    31.45k     7.55k   50.46k    60.07%
  Latency Distribution
     50%  495.00us
     75%    0.99ms
     90%    3.45ms
     99%    9.13ms
  4709289 requests in 30.10s, 0.99GB read
Requests/sec: 156458.24
Transfer/sec:     33.57MB
### Combined result for Kong git:perf/balancer-enhancements:
RPS     Avg: 156044.84
Latency Avg: 1.18ms    Max: 32.81ms
   P90 (ms): 3.45, 3.49, 3.45
   P99 (ms): 9.24, 9.45, 9.13
  
### Test Suite: git:perf/balancer-enhancements #simple #key-auth 10 services each has 10 routes with key-auth, 100 consumers
### Result for Kong git:perf/balancer-enhancements (run 1):
Running 30s test @ http://10.68.128.3:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.22ms    1.88ms  38.20ms   90.32%
    Req/Sec    27.45k     6.34k   46.22k    61.33%
  Latency Distribution
     50%  566.00us
     75%    1.17ms
     90%    3.00ms
     99%    9.54ms
  4110853 requests in 30.10s, 0.86GB read
Requests/sec: 136575.60
Transfer/sec:     29.31MB
### Result for Kong git:perf/balancer-enhancements (run 2):
Running 30s test @ http://10.68.128.3:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.21ms    1.80ms  31.80ms   90.25%
    Req/Sec    27.22k     6.51k   48.26k    62.86%
  Latency Distribution
     50%  583.00us
     75%    1.18ms
     90%    2.92ms
     99%    9.15ms
  4076243 requests in 30.10s, 0.85GB read
Requests/sec: 135425.98
Transfer/sec:     29.06MB
### Result for Kong git:perf/balancer-enhancements (run 3):
Running 30s test @ http://10.68.128.3:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.21ms    1.85ms  40.14ms   90.19%
    Req/Sec    27.67k     6.34k   46.53k    62.72%
  Latency Distribution
     50%  580.00us
     75%    1.12ms
     90%    2.98ms
     99%    9.31ms
  4143794 requests in 30.10s, 0.87GB read
Requests/sec: 137670.28
Transfer/sec:     29.54MB
### Combined result for Kong git:perf/balancer-enhancements:
RPS     Avg: 136557.29
Latency Avg: 1.21ms    Max: 40.14ms
   P90 (ms): 3, 2.92, 2.98
   P99 (ms): 9.54, 9.15, 9.31
  
### Test Suite: git:master #simple #no_plugins #single_route
### Result for Kong git:master (run 1):
Running 30s test @ http://10.68.128.3:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.19ms    1.90ms  35.14ms   88.13%
    Req/Sec    33.25k     8.55k   68.56k    61.56%
  Latency Distribution
     50%  469.00us
     75%    0.96ms
     90%    3.61ms
     99%    9.40ms
  4965214 requests in 30.10s, 1.04GB read
Requests/sec: 164962.37
Transfer/sec:     35.40MB
### Result for Kong git:master (run 2):
Running 30s test @ http://10.68.128.3:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.20ms    1.94ms  35.13ms   88.19%
    Req/Sec    33.23k     8.57k   69.56k    62.03%
  Latency Distribution
     50%  470.00us
     75%    0.96ms
     90%    3.65ms
     99%    9.63ms
  4963299 requests in 30.10s, 1.04GB read
Requests/sec: 164897.41
Transfer/sec:     35.38MB
### Result for Kong git:master (run 3):
Running 30s test @ http://10.68.128.3:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.23ms    2.04ms  39.07ms   88.54%
    Req/Sec    33.26k     8.96k   58.79k    59.79%
  Latency Distribution
     50%  467.00us
     75%    0.97ms
     90%    3.67ms
     99%    9.98ms
  4970244 requests in 30.10s, 1.04GB read
Requests/sec: 165127.01
Transfer/sec:     35.43MB
### Combined result for Kong git:master:
RPS     Avg: 164995.60
Latency Avg: 1.21ms    Max: 39.07ms
   P90 (ms): 3.61, 3.65, 3.67
   P99 (ms): 9.4, 9.63, 9.98
  
### Test Suite: git:master #simple #no_plugins 10 services each has 10 routes
### Result for Kong git:master (run 1):
Running 30s test @ http://10.68.128.3:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.18ms    1.85ms  34.70ms   88.54%
    Req/Sec    31.45k     7.57k   51.97k    60.93%
  Latency Distribution
     50%  506.00us
     75%    0.95ms
     90%    3.47ms
     99%    9.25ms
  4709611 requests in 30.10s, 0.99GB read
Requests/sec: 156468.45
Transfer/sec:     33.57MB
### Result for Kong git:master (run 2):
Running 30s test @ http://10.68.128.3:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.19ms    1.88ms  33.50ms   88.90%
    Req/Sec    30.92k     7.55k   50.56k    60.20%
  Latency Distribution
     50%  499.00us
     75%    1.04ms
     90%    3.42ms
     99%    9.47ms
  4630543 requests in 30.10s, 0.97GB read
Requests/sec: 153841.66
Transfer/sec:     33.01MB
### Result for Kong git:master (run 3):
Running 30s test @ http://10.68.128.3:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.26ms    2.06ms  37.95ms   89.05%
    Req/Sec    30.95k     8.11k   49.98k    61.13%
  Latency Distribution
     50%  501.00us
     75%    1.03ms
     90%    3.63ms
     99%   10.38ms
  4634196 requests in 30.10s, 0.97GB read
Requests/sec: 153963.04
Transfer/sec:     33.04MB
### Combined result for Kong git:master:
RPS     Avg: 154757.72
Latency Avg: 1.21ms    Max: 37.95ms
   P90 (ms): 3.47, 3.42, 3.63
   P99 (ms): 9.25, 9.47, 10.38
  
### Test Suite: git:master #simple #key-auth 10 services each has 10 routes with key-auth, 100 consumers
### Result for Kong git:master (run 1):
Running 30s test @ http://10.68.128.3:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.19ms    1.78ms  33.61ms   90.14%
    Req/Sec    27.62k     6.57k   48.53k    62.78%
  Latency Distribution
     50%  585.00us
     75%    1.10ms
     90%    2.92ms
     99%    8.99ms
  4128132 requests in 30.10s, 0.87GB read
Requests/sec: 137149.82
Transfer/sec:     29.43MB
### Result for Kong git:master (run 2):
Running 30s test @ http://10.68.128.3:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.23ms    1.93ms  39.67ms   90.67%
    Req/Sec    27.25k     6.42k   65.20k    63.76%
  Latency Distribution
     50%  580.00us
     75%    1.18ms
     90%    2.90ms
     99%    9.92ms
  4069166 requests in 30.10s, 0.85GB read
Requests/sec: 135193.50
Transfer/sec:     29.01MB
### Result for Kong git:master (run 3):
Running 30s test @ http://10.68.128.3:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.22ms    1.89ms  36.76ms   90.24%
    Req/Sec    27.39k     6.53k   43.20k    62.66%
  Latency Distribution
     50%  604.00us
     75%    1.10ms
     90%    3.02ms
     99%    9.70ms
  4100857 requests in 30.10s, 0.86GB read
Requests/sec: 136244.65
Transfer/sec:     29.23MB
### Combined result for Kong git:master:
RPS     Avg: 136195.99
Latency Avg: 1.21ms    Max: 39.67ms
   P90 (ms): 2.92, 2.9, 3.02
   P99 (ms): 8.99, 9.92, 9.7
  

Kong error logs are also available in Github Actions artifacts.

Download Artifacts for detailed results and interactive SVG flamegraphs.

github-actions[bot] avatar Aug 10 '22 10:08 github-actions[bot]

:rocket: Performance test result

Test Suite: 01-rps 02-flamegraph (baseline,single_route,simple)

Imgur Images Imgur Images Imgur Images Imgur Images

Click to expand
Please see Github Actions artifacts for flamegraphs.

  ### Test Suite: git:perf/balancer-enhancements #simple #hybrid #no_plugins #single_route
### Result for Kong git:perf/balancer-enhancements (run 1):
Running 30s test @ http://10.68.128.5:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.30ms   10.33ms   1.01s    99.67%
    Req/Sec    34.27k     8.81k   75.15k    66.80%
  Latency Distribution
     50%  446.00us
     75%    0.90ms
     90%    3.18ms
     99%    8.40ms
  5115962 requests in 30.10s, 1.07GB read
Requests/sec: 169968.48
Transfer/sec:     36.47MB
### Result for Kong git:perf/balancer-enhancements (run 2):
Running 30s test @ http://10.68.128.5:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.08ms    1.64ms  26.07ms   88.29%
    Req/Sec    33.69k     8.41k   66.82k    63.58%
  Latency Distribution
     50%  462.00us
     75%    0.94ms
     90%    3.17ms
     99%    8.13ms
  5034089 requests in 30.10s, 1.05GB read
Requests/sec: 167251.02
Transfer/sec:     35.89MB
### Result for Kong git:perf/balancer-enhancements (run 3):
Running 30s test @ http://10.68.128.5:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.08ms    1.65ms  28.34ms   88.11%
    Req/Sec    34.08k     8.32k   58.66k    61.65%
  Latency Distribution
     50%  462.00us
     75%    0.91ms
     90%    3.20ms
     99%    8.07ms
  5093316 requests in 30.10s, 1.07GB read
Requests/sec: 169217.57
Transfer/sec:     36.31MB
### Combined result for Kong git:perf/balancer-enhancements:
RPS     Avg: 168812.36
Latency Avg: 1.15ms    Max: 1010.00ms
   P90 (ms): 3.18, 3.17, 3.2
   P99 (ms): 8.4, 8.13, 8.07
  
### Test Suite: git:perf/balancer-enhancements #simple #hybrid #no_plugins 10 services each has 10 routes
### Result for Kong git:perf/balancer-enhancements (run 1):
Running 30s test @ http://10.68.128.5:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.11ms    1.70ms  32.31ms   88.70%
    Req/Sec    31.84k     8.12k   50.66k    60.80%
  Latency Distribution
     50%  490.00us
     75%    0.96ms
     90%    3.18ms
     99%    8.48ms
  4768775 requests in 30.10s, 1.00GB read
Requests/sec: 158433.37
Transfer/sec:     34.00MB
### Result for Kong git:perf/balancer-enhancements (run 2):
Running 30s test @ http://10.68.128.5:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.10ms    1.66ms  30.91ms   88.67%
    Req/Sec    31.76k     7.80k   51.62k    62.33%
  Latency Distribution
     50%  497.00us
     75%    0.97ms
     90%    3.14ms
     99%    8.17ms
  4754783 requests in 30.10s, 1.00GB read
Requests/sec: 157968.20
Transfer/sec:     33.90MB
### Result for Kong git:perf/balancer-enhancements (run 3):
Running 30s test @ http://10.68.128.5:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.12ms    1.73ms  32.77ms   88.80%
    Req/Sec    31.93k     7.66k   59.15k    60.47%
  Latency Distribution
     50%  488.00us
     75%    0.97ms
     90%    3.20ms
     99%    8.61ms
  4781591 requests in 30.10s, 1.00GB read
Requests/sec: 158858.75
Transfer/sec:     34.09MB
### Combined result for Kong git:perf/balancer-enhancements:
RPS     Avg: 158420.11
Latency Avg: 1.11ms    Max: 32.77ms
   P90 (ms): 3.18, 3.14, 3.2
   P99 (ms): 8.48, 8.17, 8.61
  
### Test Suite: git:perf/balancer-enhancements #simple #hybrid #key-auth 10 services each has 10 routes with key-auth, 100 consumers
### Result for Kong git:perf/balancer-enhancements (run 1):
Running 30s test @ http://10.68.128.5:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.17ms    1.79ms  33.26ms   90.28%
    Req/Sec    28.13k     6.92k   47.40k    62.79%
  Latency Distribution
     50%  552.00us
     75%    1.13ms
     90%    2.86ms
     99%    9.15ms
  4212317 requests in 30.10s, 0.88GB read
Requests/sec: 139946.09
Transfer/sec:     30.03MB
### Result for Kong git:perf/balancer-enhancements (run 2):
Running 30s test @ http://10.68.128.5:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.16ms    1.76ms  42.45ms   90.32%
    Req/Sec    28.04k     6.80k   49.81k    64.39%
  Latency Distribution
     50%  568.00us
     75%    1.10ms
     90%    2.82ms
     99%    8.70ms
  4199255 requests in 30.10s, 0.88GB read
Requests/sec: 139511.77
Transfer/sec:     29.94MB
### Result for Kong git:perf/balancer-enhancements (run 3):
Running 30s test @ http://10.68.128.5:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.13ms    1.67ms  40.07ms   90.14%
    Req/Sec    28.27k     6.57k   45.14k    62.99%
  Latency Distribution
     50%  586.00us
     75%    1.06ms
     90%    2.75ms
     99%    8.32ms
  4233131 requests in 30.10s, 0.89GB read
Requests/sec: 140637.40
Transfer/sec:     30.18MB
### Combined result for Kong git:perf/balancer-enhancements:
RPS     Avg: 140031.75
Latency Avg: 1.15ms    Max: 42.45ms
   P90 (ms): 2.86, 2.82, 2.75
   P99 (ms): 9.15, 8.7, 8.32
  
### Test Suite: git:master #simple #hybrid #no_plugins #single_route
### Result for Kong git:master (run 1):
Running 30s test @ http://10.68.128.5:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.10ms    1.70ms  30.40ms   88.36%
    Req/Sec    33.62k     8.24k   54.84k    61.25%
  Latency Distribution
     50%  460.00us
     75%    0.96ms
     90%    3.22ms
     99%    8.36ms
  5023472 requests in 30.10s, 1.05GB read
Requests/sec: 166898.67
Transfer/sec:     35.81MB
### Result for Kong git:master (run 2):
Running 30s test @ http://10.68.128.5:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.11ms    1.70ms  28.44ms   88.06%
    Req/Sec    33.80k     8.66k   57.40k    63.52%
  Latency Distribution
     50%  464.00us
     75%    0.93ms
     90%    3.30ms
     99%    8.42ms
  5051284 requests in 30.10s, 1.06GB read
Requests/sec: 167822.51
Transfer/sec:     36.01MB
### Result for Kong git:master (run 3):
Running 30s test @ http://10.68.128.5:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.10ms    1.69ms  28.90ms   88.00%
    Req/Sec    34.06k     8.40k   61.65k    61.72%
  Latency Distribution
     50%  465.00us
     75%    0.90ms
     90%    3.30ms
     99%    8.30ms
  5089828 requests in 30.10s, 1.07GB read
Requests/sec: 169098.28
Transfer/sec:     36.28MB
### Combined result for Kong git:master:
RPS     Avg: 167939.82
Latency Avg: 1.10ms    Max: 30.40ms
   P90 (ms): 3.22, 3.3, 3.3
   P99 (ms): 8.36, 8.42, 8.3
  
### Test Suite: git:master #simple #hybrid #no_plugins 10 services each has 10 routes
### Result for Kong git:master (run 1):
Running 30s test @ http://10.68.128.5:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.17ms    1.82ms  29.58ms   89.05%
    Req/Sec    31.42k     7.79k   50.98k    60.52%
  Latency Distribution
     50%  479.00us
     75%    1.05ms
     90%    3.26ms
     99%    9.06ms
  4695723 requests in 30.10s, 0.98GB read
Requests/sec: 156008.20
Transfer/sec:     33.48MB
### Result for Kong git:master (run 2):
Running 30s test @ http://10.68.128.5:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.12ms    1.70ms  29.22ms   89.17%
    Req/Sec    31.29k     7.65k   66.01k    62.66%
  Latency Distribution
     50%  472.00us
     75%    1.08ms
     90%    3.07ms
     99%    8.53ms
  4686334 requests in 30.10s, 0.98GB read
Requests/sec: 155694.28
Transfer/sec:     33.41MB
### Result for Kong git:master (run 3):
Running 30s test @ http://10.68.128.5:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.13ms    1.75ms  28.08ms   88.76%
    Req/Sec    31.69k     7.79k   52.70k    59.27%
  Latency Distribution
     50%  500.00us
     75%    0.95ms
     90%    3.25ms
     99%    8.76ms
  4745409 requests in 30.10s, 0.99GB read
Requests/sec: 157657.07
Transfer/sec:     33.83MB
### Combined result for Kong git:master:
RPS     Avg: 156453.18
Latency Avg: 1.14ms    Max: 29.58ms
   P90 (ms): 3.26, 3.07, 3.25
   P99 (ms): 9.06, 8.53, 8.76
  
### Test Suite: git:master #simple #hybrid #key-auth 10 services each has 10 routes with key-auth, 100 consumers
### Result for Kong git:master (run 1):
Running 30s test @ http://10.68.128.5:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.17ms    1.61ms  32.53ms   88.74%
    Req/Sec    27.08k     6.05k   43.85k    64.58%
  Latency Distribution
     50%  557.00us
     75%    1.26ms
     90%    2.99ms
     99%    7.68ms
  4055250 requests in 30.10s, 870.15MB read
Requests/sec: 134727.42
Transfer/sec:     28.91MB
### Result for Kong git:master (run 2):
Running 30s test @ http://10.68.128.5:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.18ms    1.72ms  33.00ms   90.70%
    Req/Sec    26.96k     6.28k   46.12k    63.46%
  Latency Distribution
     50%  592.00us
     75%    1.16ms
     90%    2.71ms
     99%    8.69ms
  4037933 requests in 30.10s, 866.43MB read
Requests/sec: 134152.75
Transfer/sec:     28.79MB
### Result for Kong git:master (run 3):
Running 30s test @ http://10.68.128.5:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.15ms    1.66ms  38.26ms   90.43%
    Req/Sec    27.30k     6.34k   48.60k    61.86%
  Latency Distribution
     50%  598.00us
     75%    1.10ms
     90%    2.67ms
     99%    8.33ms
  4087967 requests in 30.10s, 0.86GB read
Requests/sec: 135814.42
Transfer/sec:     29.14MB
### Combined result for Kong git:master:
RPS     Avg: 134898.20
Latency Avg: 1.17ms    Max: 38.26ms
   P90 (ms): 2.99, 2.71, 2.67
   P99 (ms): 7.68, 8.69, 8.33
  
### Result for upstream directly (run 1):
Running 30s test @ http://10.68.128.7:8088/test
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   574.49us    1.27ms  12.08ms   87.16%
    Req/Sec   166.26k     9.15k  207.21k    72.53%
  Latency Distribution
     50%   57.00us
     75%   97.00us
     90%    2.41ms
     99%    6.37ms
  24814571 requests in 30.03s, 3.24GB read
Requests/sec: 826191.04
Transfer/sec:    110.31MB
### Result for upstream directly (run 2):
Running 30s test @ http://10.68.128.7:8088/test
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   570.82us    1.27ms  16.10ms   87.29%
    Req/Sec   164.57k     9.10k  215.48k    69.31%
  Latency Distribution
     50%   59.00us
     75%   99.00us
     90%    2.39ms
     99%    6.42ms
  24546319 requests in 30.10s, 3.20GB read
Requests/sec: 815509.61
Transfer/sec:    108.88MB
### Result for upstream directly (run 3):
Running 30s test @ http://10.68.128.7:8088/test
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   575.27us    1.27ms  16.07ms   87.35%
    Req/Sec   159.50k     8.13k  198.65k    72.17%
  Latency Distribution
     50%   60.00us
     75%  102.00us
     90%    2.43ms
     99%    6.41ms
  23836197 requests in 30.10s, 3.11GB read
Requests/sec: 791913.62
Transfer/sec:    105.73MB
### Combined result for upstream directly:
RPS     Avg: 811204.76
Latency Avg: 0.57ms    Max: 16.10ms
   P90 (ms): 2.41, 2.39, 2.43
   P99 (ms): 6.37, 6.42, 6.41
  
### Test Suite: git:perf/balancer-enhancements #simple #no_plugins #single_route
### Result for Kong git:perf/balancer-enhancements (run 1):
Running 30s test @ http://10.68.128.5:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.09ms    1.68ms  32.85ms   88.36%
    Req/Sec    33.89k     8.10k   55.74k    63.25%
  Latency Distribution
     50%  438.00us
     75%    1.00ms
     90%    3.20ms
     99%    8.30ms
  5064752 requests in 30.10s, 1.06GB read
Requests/sec: 168266.48
Transfer/sec:     36.11MB
### Result for Kong git:perf/balancer-enhancements (run 2):
Running 30s test @ http://10.68.128.5:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.10ms    1.66ms  26.93ms   88.38%
    Req/Sec    33.78k     8.37k   63.10k    63.18%
  Latency Distribution
     50%  441.00us
     75%    1.04ms
     90%    3.20ms
     99%    8.16ms
  5047132 requests in 30.10s, 1.06GB read
Requests/sec: 167680.39
Transfer/sec:     35.98MB
### Result for Kong git:perf/balancer-enhancements (run 3):
Running 30s test @ http://10.68.128.5:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.10ms    1.69ms  28.34ms   88.14%
    Req/Sec    33.75k     8.65k   58.25k    61.78%
  Latency Distribution
     50%  451.00us
     75%    0.97ms
     90%    3.27ms
     99%    8.29ms
  5043701 requests in 30.10s, 1.06GB read
Requests/sec: 167567.66
Transfer/sec:     35.96MB
### Combined result for Kong git:perf/balancer-enhancements:
RPS     Avg: 167838.18
Latency Avg: 1.10ms    Max: 32.85ms
   P90 (ms): 3.2, 3.2, 3.27
   P99 (ms): 8.3, 8.16, 8.29
  
### Test Suite: git:perf/balancer-enhancements #simple #no_plugins 10 services each has 10 routes
### Result for Kong git:perf/balancer-enhancements (run 1):
Running 30s test @ http://10.68.128.5:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.09ms    1.64ms  29.86ms   88.54%
    Req/Sec    32.04k     7.69k   51.56k    61.05%
  Latency Distribution
     50%  503.00us
     75%    0.93ms
     90%    3.15ms
     99%    8.10ms
  4788379 requests in 30.10s, 1.00GB read
Requests/sec: 159087.47
Transfer/sec:     34.14MB
### Result for Kong git:perf/balancer-enhancements (run 2):
Running 30s test @ http://10.68.128.5:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.12ms    1.73ms  37.35ms   88.79%
    Req/Sec    31.91k     7.65k   59.37k    62.46%
  Latency Distribution
     50%  486.00us
     75%    0.97ms
     90%    3.21ms
     99%    8.57ms
  4778391 requests in 30.10s, 1.00GB read
Requests/sec: 158752.48
Transfer/sec:     34.06MB
### Result for Kong git:perf/balancer-enhancements (run 3):
Running 30s test @ http://10.68.128.5:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.17ms    1.85ms  36.13ms   89.03%
    Req/Sec    31.49k     8.15k   54.68k    63.65%
  Latency Distribution
     50%  476.00us
     75%    1.03ms
     90%    3.30ms
     99%    9.19ms
  4715835 requests in 30.10s, 0.99GB read
Requests/sec: 156674.58
Transfer/sec:     33.62MB
### Combined result for Kong git:perf/balancer-enhancements:
RPS     Avg: 158171.51
Latency Avg: 1.13ms    Max: 37.35ms
   P90 (ms): 3.15, 3.21, 3.3
   P99 (ms): 8.1, 8.57, 9.19
  
### Test Suite: git:perf/balancer-enhancements #simple #key-auth 10 services each has 10 routes with key-auth, 100 consumers
### Result for Kong git:perf/balancer-enhancements (run 1):
Running 30s test @ http://10.68.128.5:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.25ms    1.93ms  33.85ms   90.23%
    Req/Sec    27.40k     6.92k   43.25k    65.78%
  Latency Distribution
     50%  589.00us
     75%    1.15ms
     90%    3.11ms
     99%    9.85ms
  4102776 requests in 30.10s, 0.86GB read
Requests/sec: 136306.42
Transfer/sec:     29.25MB
### Result for Kong git:perf/balancer-enhancements (run 2):
Running 30s test @ http://10.68.128.5:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.15ms    1.69ms  30.60ms   90.37%
    Req/Sec    27.70k     6.39k   51.62k    64.12%
  Latency Distribution
     50%  590.00us
     75%    1.10ms
     90%    2.71ms
     99%    8.52ms
  4147493 requests in 30.10s, 0.87GB read
Requests/sec: 137792.03
Transfer/sec:     29.57MB
### Result for Kong git:perf/balancer-enhancements (run 3):
Running 30s test @ http://10.68.128.5:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.16ms    1.70ms  31.68ms   90.44%
    Req/Sec    27.39k     6.60k   48.29k    61.53%
  Latency Distribution
     50%  585.00us
     75%    1.13ms
     90%    2.71ms
     99%    8.58ms
  4101137 requests in 30.10s, 0.86GB read
Requests/sec: 136252.08
Transfer/sec:     29.24MB
### Combined result for Kong git:perf/balancer-enhancements:
RPS     Avg: 136783.51
Latency Avg: 1.19ms    Max: 33.85ms
   P90 (ms): 3.11, 2.71, 2.71
   P99 (ms): 9.85, 8.52, 8.58
  
### Test Suite: git:master #simple #no_plugins #single_route
### Result for Kong git:master (run 1):
Running 30s test @ http://10.68.128.5:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.10ms    1.68ms  28.29ms   88.23%
    Req/Sec    33.57k     8.63k   62.25k    61.45%
  Latency Distribution
     50%  448.00us
     75%    1.00ms
     90%    3.24ms
     99%    8.24ms
  5016294 requests in 30.10s, 1.05GB read
Requests/sec: 166656.27
Transfer/sec:     35.76MB
### Result for Kong git:master (run 2):
Running 30s test @ http://10.68.128.5:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.11ms    1.70ms  26.45ms   88.14%
    Req/Sec    33.71k     8.46k   58.40k    61.78%
  Latency Distribution
     50%  469.00us
     75%    0.93ms
     90%    3.30ms
     99%    8.43ms
  5037183 requests in 30.10s, 1.06GB read
Requests/sec: 167350.93
Transfer/sec:     35.91MB
### Result for Kong git:master (run 3):
Running 30s test @ http://10.68.128.5:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.15ms    1.84ms  39.63ms   88.67%
    Req/Sec    33.53k     8.48k   57.26k    61.52%
  Latency Distribution
     50%  452.00us
     75%    0.99ms
     90%    3.36ms
     99%    9.07ms
  5010534 requests in 30.10s, 1.05GB read
Requests/sec: 166468.55
Transfer/sec:     35.72MB
### Combined result for Kong git:master:
RPS     Avg: 166825.25
Latency Avg: 1.12ms    Max: 39.63ms
   P90 (ms): 3.24, 3.3, 3.36
   P99 (ms): 8.24, 8.43, 9.07
  
### Test Suite: git:master #simple #no_plugins 10 services each has 10 routes
### Result for Kong git:master (run 1):
Running 30s test @ http://10.68.128.5:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.13ms    1.72ms  29.69ms   89.02%
    Req/Sec    31.21k     7.49k   53.97k    60.86%
  Latency Distribution
     50%  478.00us
     75%    1.08ms
     90%    3.13ms
     99%    8.54ms
  4673428 requests in 30.10s, 0.98GB read
Requests/sec: 155265.35
Transfer/sec:     33.32MB
### Result for Kong git:master (run 2):
Running 30s test @ http://10.68.128.5:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.12ms    1.72ms  33.21ms   88.72%
    Req/Sec    31.75k     7.59k   57.18k    60.53%
  Latency Distribution
     50%  493.00us
     75%    0.96ms
     90%    3.22ms
     99%    8.52ms
  4755119 requests in 30.10s, 1.00GB read
Requests/sec: 157979.95
Transfer/sec:     33.90MB
### Result for Kong git:master (run 3):
Running 30s test @ http://10.68.128.5:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.12ms    1.65ms  29.15ms   88.87%
    Req/Sec    31.30k     7.36k   55.69k    63.46%
  Latency Distribution
     50%  473.00us
     75%    1.08ms
     90%    3.06ms
     99%    8.09ms
  4687475 requests in 30.10s, 0.98GB read
Requests/sec: 155732.27
Transfer/sec:     33.42MB
### Combined result for Kong git:master:
RPS     Avg: 156325.86
Latency Avg: 1.12ms    Max: 33.21ms
   P90 (ms): 3.13, 3.22, 3.06
   P99 (ms): 8.54, 8.52, 8.09
  
### Test Suite: git:master #simple #key-auth 10 services each has 10 routes with key-auth, 100 consumers
### Result for Kong git:master (run 1):
Running 30s test @ http://10.68.128.5:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.14ms    1.63ms  27.03ms   90.11%
    Req/Sec    27.74k     6.45k   46.74k    63.59%
  Latency Distribution
     50%  558.00us
     75%    1.16ms
     90%    2.74ms
     99%    8.11ms
  4153583 requests in 30.10s, 0.87GB read
Requests/sec: 137994.54
Transfer/sec:     29.61MB
### Result for Kong git:master (run 2):
Running 30s test @ http://10.68.128.5:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.15ms    1.70ms  31.19ms   90.30%
    Req/Sec    27.89k     6.23k   53.05k    61.13%
  Latency Distribution
     50%  574.00us
     75%    1.10ms
     90%    2.75ms
     99%    8.55ms
  4176163 requests in 30.10s, 0.88GB read
Requests/sec: 138744.68
Transfer/sec:     29.77MB
### Result for Kong git:master (run 3):
Running 30s test @ http://10.68.128.5:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.17ms    1.67ms  26.43ms   89.39%
    Req/Sec    27.57k     6.06k   50.01k    61.66%
  Latency Distribution
     50%  553.00us
     75%    1.19ms
     90%    2.98ms
     99%    8.25ms
  4128007 requests in 30.10s, 0.86GB read
Requests/sec: 137145.06
Transfer/sec:     29.43MB
### Combined result for Kong git:master:
RPS     Avg: 137961.43
Latency Avg: 1.15ms    Max: 31.19ms
   P90 (ms): 2.74, 2.75, 2.98
   P99 (ms): 8.11, 8.55, 8.25
  

Kong error logs are also available in Github Actions artifacts.

Download Artifacts for detailed results and interactive SVG flamegraphs.

github-actions[bot] avatar Aug 12 '22 14:08 github-actions[bot]

:rocket: Performance test result

Test Suite: 01-rps 02-flamegraph (baseline,single_route,simple)

Imgur Images Imgur Images Imgur Images Imgur Images

Click to expand
Please see Github Actions artifacts for flamegraphs.

  ### Test Suite: git:perf/balancer-enhancements #simple #hybrid #no_plugins #single_route
### Result for Kong git:perf/balancer-enhancements (run 1):
Running 30s test @ http://10.68.128.11:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     2.38ms   29.29ms   1.03s    99.73%
    Req/Sec    33.79k     8.67k   58.63k    62.25%
  Latency Distribution
     50%  459.00us
     75%    0.96ms
     90%    3.27ms
     99%    9.10ms
  5050293 requests in 30.10s, 1.06GB read
Requests/sec: 167787.14
Transfer/sec:     36.00MB
### Result for Kong git:perf/balancer-enhancements (run 2):
Running 30s test @ http://10.68.128.11:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.15ms    1.84ms  34.06ms   88.62%
    Req/Sec    33.30k     8.92k   57.09k    60.19%
  Latency Distribution
     50%  462.00us
     75%    1.00ms
     90%    3.38ms
     99%    9.14ms
  4976407 requests in 30.10s, 1.04GB read
Requests/sec: 165334.37
Transfer/sec:     35.48MB
### Result for Kong git:perf/balancer-enhancements (run 3):
Running 30s test @ http://10.68.128.11:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.12ms    1.76ms  29.45ms   88.30%
    Req/Sec    33.59k     8.76k   59.11k    59.79%
  Latency Distribution
     50%  467.00us
     75%    0.95ms
     90%    3.33ms
     99%    8.73ms
  5020376 requests in 30.10s, 1.05GB read
Requests/sec: 166792.04
Transfer/sec:     35.79MB
### Combined result for Kong git:perf/balancer-enhancements:
RPS     Avg: 166637.85
Latency Avg: 1.55ms    Max: 1030.00ms
   P90 (ms): 3.27, 3.38, 3.33
   P99 (ms): 9.1, 9.14, 8.73
  
### Test Suite: git:perf/balancer-enhancements #simple #hybrid #no_plugins 10 services each has 10 routes
### Result for Kong git:perf/balancer-enhancements (run 1):
Running 30s test @ http://10.68.128.11:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.16ms    1.85ms  37.97ms   89.25%
    Req/Sec    31.16k     8.23k   50.23k    60.13%
  Latency Distribution
     50%  499.00us
     75%    1.01ms
     90%    3.24ms
     99%    9.20ms
  4666003 requests in 30.10s, 0.98GB read
Requests/sec: 155016.21
Transfer/sec:     33.26MB
### Result for Kong git:perf/balancer-enhancements (run 2):
Running 30s test @ http://10.68.128.11:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.18ms    1.92ms  49.53ms   89.33%
    Req/Sec    31.33k     8.38k   52.20k    59.32%
  Latency Distribution
     50%  493.00us
     75%    1.01ms
     90%    3.30ms
     99%    9.49ms
  4682851 requests in 30.10s, 0.98GB read
Requests/sec: 155580.77
Transfer/sec:     33.38MB
### Result for Kong git:perf/balancer-enhancements (run 3):
Running 30s test @ http://10.68.128.11:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.14ms    1.77ms  31.00ms   89.02%
    Req/Sec    31.26k     8.08k   54.89k    61.73%
  Latency Distribution
     50%  501.00us
     75%    1.01ms
     90%    3.21ms
     99%    8.88ms
  4680303 requests in 30.10s, 0.98GB read
Requests/sec: 155491.49
Transfer/sec:     33.36MB
### Combined result for Kong git:perf/balancer-enhancements:
RPS     Avg: 155362.82
Latency Avg: 1.16ms    Max: 49.53ms
   P90 (ms): 3.24, 3.3, 3.21
   P99 (ms): 9.2, 9.49, 8.88
  
### Test Suite: git:perf/balancer-enhancements #simple #hybrid #key-auth 10 services each has 10 routes with key-auth, 100 consumers
### Result for Kong git:perf/balancer-enhancements (run 1):
Running 30s test @ http://10.68.128.11:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.16ms    1.68ms  28.94ms   90.41%
    Req/Sec    26.97k     6.48k   43.43k    62.43%
  Latency Distribution
     50%  602.00us
     75%    1.17ms
     90%    2.72ms
     99%    8.50ms
  4036556 requests in 30.10s, 866.14MB read
Requests/sec: 134108.51
Transfer/sec:     28.78MB
### Result for Kong git:perf/balancer-enhancements (run 2):
Running 30s test @ http://10.68.128.11:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.20ms    1.77ms  37.14ms   90.51%
    Req/Sec    26.98k     6.85k   50.09k    61.81%
  Latency Distribution
     50%  596.00us
     75%    1.16ms
     90%    2.82ms
     99%    8.99ms
  4034959 requests in 30.10s, 865.79MB read
Requests/sec: 134055.65
Transfer/sec:     28.76MB
### Result for Kong git:perf/balancer-enhancements (run 3):
Running 30s test @ http://10.68.128.11:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.14ms    1.64ms  34.60ms   90.60%
    Req/Sec    27.12k     6.59k   43.46k    62.01%
  Latency Distribution
     50%  602.00us
     75%    1.13ms
     90%    2.58ms
     99%    8.27ms
  4055806 requests in 30.10s, 870.27MB read
Requests/sec: 134748.24
Transfer/sec:     28.91MB
### Combined result for Kong git:perf/balancer-enhancements:
RPS     Avg: 134304.13
Latency Avg: 1.17ms    Max: 37.14ms
   P90 (ms): 2.72, 2.82, 2.58
   P99 (ms): 8.5, 8.99, 8.27
  
### Test Suite: git:master #simple #hybrid #no_plugins #single_route
### Result for Kong git:master (run 1):
Running 30s test @ http://10.68.128.11:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.12ms    1.74ms  34.57ms   88.56%
    Req/Sec    32.95k     8.63k   55.71k    61.05%
  Latency Distribution
     50%  465.00us
     75%    1.01ms
     90%    3.26ms
     99%    8.63ms
  4924612 requests in 30.10s, 1.03GB read
Requests/sec: 163610.64
Transfer/sec:     35.11MB
### Result for Kong git:master (run 2):
Running 30s test @ http://10.68.128.11:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.16ms    1.82ms  29.15ms   88.59%
    Req/Sec    32.80k     9.01k   56.13k    59.52%
  Latency Distribution
     50%  472.00us
     75%    1.01ms
     90%    3.38ms
     99%    9.17ms
  4902137 requests in 30.10s, 1.03GB read
Requests/sec: 162862.97
Transfer/sec:     34.95MB
### Result for Kong git:master (run 3):
Running 30s test @ http://10.68.128.11:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.13ms    1.74ms  28.50ms   88.25%
    Req/Sec    33.05k     8.43k   57.18k    59.65%
  Latency Distribution
     50%  485.00us
     75%    0.95ms
     90%    3.34ms
     99%    8.65ms
  4938904 requests in 30.10s, 1.03GB read
Requests/sec: 164085.05
Transfer/sec:     35.21MB
### Combined result for Kong git:master:
RPS     Avg: 163519.55
Latency Avg: 1.14ms    Max: 34.57ms
   P90 (ms): 3.26, 3.38, 3.34
   P99 (ms): 8.63, 9.17, 8.65
  
### Test Suite: git:master #simple #hybrid #no_plugins 10 services each has 10 routes
### Result for Kong git:master (run 1):
Running 30s test @ http://10.68.128.11:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.13ms    1.75ms  30.52ms   88.91%
    Req/Sec    31.37k     7.85k   53.39k    60.65%
  Latency Distribution
     50%  505.00us
     75%    0.98ms
     90%    3.22ms
     99%    8.74ms
  4688755 requests in 30.10s, 0.98GB read
Requests/sec: 155775.55
Transfer/sec:     33.43MB
### Result for Kong git:master (run 2):
Running 30s test @ http://10.68.128.11:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.17ms    1.83ms  35.17ms   89.17%
    Req/Sec    30.89k     8.13k   52.67k    60.66%
  Latency Distribution
     50%  498.00us
     75%    1.05ms
     90%    3.26ms
     99%    9.22ms
  4624627 requests in 30.10s, 0.97GB read
Requests/sec: 153641.73
Transfer/sec:     32.97MB
### Result for Kong git:master (run 3):
Running 30s test @ http://10.68.128.11:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.15ms    1.77ms  29.90ms   88.88%
    Req/Sec    30.97k     8.30k   51.82k    61.74%
  Latency Distribution
     50%  506.00us
     75%    1.01ms
     90%    3.25ms
     99%    8.86ms
  4630852 requests in 30.10s, 0.97GB read
Requests/sec: 153853.16
Transfer/sec:     33.01MB
### Combined result for Kong git:master:
RPS     Avg: 154423.48
Latency Avg: 1.15ms    Max: 35.17ms
   P90 (ms): 3.22, 3.26, 3.25
   P99 (ms): 8.74, 9.22, 8.86
  
### Test Suite: git:master #simple #hybrid #key-auth 10 services each has 10 routes with key-auth, 100 consumers
### Result for Kong git:master (run 1):
Running 30s test @ http://10.68.128.11:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.15ms    1.66ms  30.51ms   90.33%
    Req/Sec    27.40k     6.43k   47.01k    62.70%
  Latency Distribution
     50%  584.00us
     75%    1.14ms
     90%    2.71ms
     99%    8.34ms
  4099717 requests in 30.10s, 0.86GB read
Requests/sec: 136207.13
Transfer/sec:     29.23MB
### Result for Kong git:master (run 2):
Running 30s test @ http://10.68.128.11:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.18ms    1.76ms  39.79ms   90.53%
    Req/Sec    27.27k     6.97k   50.69k    62.50%
  Latency Distribution
     50%  584.00us
     75%    1.15ms
     90%    2.75ms
     99%    8.81ms
  4080869 requests in 30.10s, 0.86GB read
Requests/sec: 135580.84
Transfer/sec:     29.09MB
### Result for Kong git:master (run 3):
Running 30s test @ http://10.68.128.11:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.15ms    1.69ms  34.51ms   90.62%
    Req/Sec    27.33k     6.58k   50.63k    64.34%
  Latency Distribution
     50%  595.00us
     75%    1.13ms
     90%    2.64ms
     99%    8.51ms
  4086914 requests in 30.10s, 0.86GB read
Requests/sec: 135781.77
Transfer/sec:     29.14MB
### Combined result for Kong git:master:
RPS     Avg: 135856.58
Latency Avg: 1.16ms    Max: 39.79ms
   P90 (ms): 2.71, 2.75, 2.64
   P99 (ms): 8.34, 8.81, 8.51
  
### Result for upstream directly (run 1):
Running 30s test @ http://10.68.128.9:8088/test
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   569.45us    1.27ms  12.09ms   87.19%
    Req/Sec   172.83k    12.56k  225.48k    65.56%
  Latency Distribution
     50%   56.00us
     75%   94.00us
     90%    2.43ms
     99%    6.38ms
  25812134 requests in 30.10s, 3.37GB read
Requests/sec: 857558.00
Transfer/sec:    114.50MB
### Result for upstream directly (run 2):
Running 30s test @ http://10.68.128.9:8088/test
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   574.06us    1.27ms  16.08ms   87.33%
    Req/Sec   157.53k     8.62k  200.95k    73.97%
  Latency Distribution
     50%   61.00us
     75%  103.00us
     90%    2.42ms
     99%    6.39ms
  23539688 requests in 30.10s, 3.07GB read
Requests/sec: 782052.45
Transfer/sec:    104.41MB
### Result for upstream directly (run 3):
Running 30s test @ http://10.68.128.9:8088/test
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency   577.98us    1.28ms  12.12ms   87.21%
    Req/Sec   157.17k     8.06k  204.96k    72.75%
  Latency Distribution
     50%   61.00us
     75%  103.00us
     90%    2.42ms
     99%    6.42ms
  23472342 requests in 30.10s, 3.06GB read
Requests/sec: 779815.34
Transfer/sec:    104.12MB
### Combined result for upstream directly:
RPS     Avg: 806475.26
Latency Avg: 0.57ms    Max: 16.08ms
   P90 (ms): 2.43, 2.42, 2.42
   P99 (ms): 6.38, 6.39, 6.42
  
### Test Suite: git:perf/balancer-enhancements #simple #no_plugins #single_route
### Result for Kong git:perf/balancer-enhancements (run 1):
Running 30s test @ http://10.68.128.11:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.12ms    1.73ms  30.73ms   88.58%
    Req/Sec    33.28k     8.44k   56.89k    61.92%
  Latency Distribution
     50%  454.00us
     75%    1.03ms
     90%    3.23ms
     99%    8.59ms
  4973015 requests in 30.10s, 1.04GB read
Requests/sec: 165220.95
Transfer/sec:     35.45MB
### Result for Kong git:perf/balancer-enhancements (run 2):
Running 30s test @ http://10.68.128.11:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.13ms    1.75ms  30.76ms   88.34%
    Req/Sec    33.27k     8.78k   58.88k    61.45%
  Latency Distribution
     50%  470.00us
     75%    0.96ms
     90%    3.33ms
     99%    8.73ms
  4972463 requests in 30.10s, 1.04GB read
Requests/sec: 165203.94
Transfer/sec:     35.45MB
### Result for Kong git:perf/balancer-enhancements (run 3):
Running 30s test @ http://10.68.128.11:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.15ms    1.82ms  31.71ms   88.57%
    Req/Sec    33.25k     8.60k   53.93k    62.25%
  Latency Distribution
     50%  461.00us
     75%    0.99ms
     90%    3.36ms
     99%    9.05ms
  4968903 requests in 30.10s, 1.04GB read
Requests/sec: 165083.93
Transfer/sec:     35.42MB
### Combined result for Kong git:perf/balancer-enhancements:
RPS     Avg: 165169.61
Latency Avg: 1.13ms    Max: 31.71ms
   P90 (ms): 3.23, 3.33, 3.36
   P99 (ms): 8.59, 8.73, 9.05
  
### Test Suite: git:perf/balancer-enhancements #simple #no_plugins 10 services each has 10 routes
### Result for Kong git:perf/balancer-enhancements (run 1):
Running 30s test @ http://10.68.128.11:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.15ms    1.79ms  28.89ms   88.77%
    Req/Sec    31.60k     8.11k   50.23k    59.97%
  Latency Distribution
     50%  493.00us
     75%    0.98ms
     90%    3.31ms
     99%    8.97ms
  4728140 requests in 30.10s, 0.99GB read
Requests/sec: 157085.35
Transfer/sec:     33.71MB
### Result for Kong git:perf/balancer-enhancements (run 2):
Running 30s test @ http://10.68.128.11:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.13ms    1.73ms  29.90ms   89.08%
    Req/Sec    31.26k     7.99k   51.19k    60.85%
  Latency Distribution
     50%  489.00us
     75%    1.03ms
     90%    3.13ms
     99%    8.72ms
  4671451 requests in 30.10s, 0.98GB read
Requests/sec: 155199.61
Transfer/sec:     33.30MB
### Result for Kong git:perf/balancer-enhancements (run 3):
Running 30s test @ http://10.68.128.11:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.15ms    1.79ms  36.55ms   88.96%
    Req/Sec    31.42k     8.29k   60.87k    61.98%
  Latency Distribution
     50%  488.00us
     75%    1.01ms
     90%    3.25ms
     99%    8.99ms
  4695891 requests in 30.10s, 0.98GB read
Requests/sec: 156013.93
Transfer/sec:     33.48MB
### Combined result for Kong git:perf/balancer-enhancements:
RPS     Avg: 156099.63
Latency Avg: 1.14ms    Max: 36.55ms
   P90 (ms): 3.31, 3.13, 3.25
   P99 (ms): 8.97, 8.72, 8.99
  
### Test Suite: git:perf/balancer-enhancements #simple #key-auth 10 services each has 10 routes with key-auth, 100 consumers
### Result for Kong git:perf/balancer-enhancements (run 1):
Running 30s test @ http://10.68.128.11:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.18ms    1.77ms  40.39ms   90.57%
    Req/Sec    27.42k     6.72k   47.53k    61.74%
  Latency Distribution
     50%  582.00us
     75%    1.15ms
     90%    2.76ms
     99%    8.90ms
  4100203 requests in 30.10s, 0.86GB read
Requests/sec: 136223.18
Transfer/sec:     29.23MB
### Result for Kong git:perf/balancer-enhancements (run 2):
Running 30s test @ http://10.68.128.11:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.17ms    1.73ms  38.33ms   90.69%
    Req/Sec    27.06k     6.75k   50.23k    61.86%
  Latency Distribution
     50%  599.00us
     75%    1.15ms
     90%    2.69ms
     99%    8.68ms
  4052084 requests in 30.10s, 869.47MB read
Requests/sec: 134620.32
Transfer/sec:     28.89MB
### Result for Kong git:perf/balancer-enhancements (run 3):
Running 30s test @ http://10.68.128.11:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.18ms    1.77ms  39.20ms   90.60%
    Req/Sec    27.32k     6.78k   48.00k    61.46%
  Latency Distribution
     50%  593.00us
     75%    1.14ms
     90%    2.72ms
     99%    8.93ms
  4092061 requests in 30.10s, 0.86GB read
Requests/sec: 135948.53
Transfer/sec:     29.17MB
### Combined result for Kong git:perf/balancer-enhancements:
RPS     Avg: 135597.34
Latency Avg: 1.18ms    Max: 40.39ms
   P90 (ms): 2.76, 2.69, 2.72
   P99 (ms): 8.9, 8.68, 8.93
  
### Test Suite: git:master #simple #no_plugins #single_route
### Result for Kong git:master (run 1):
Running 30s test @ http://10.68.128.11:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.19ms    1.93ms  32.98ms   88.61%
    Req/Sec    33.09k     8.85k   55.11k    59.52%
  Latency Distribution
     50%  471.00us
     75%    0.98ms
     90%    3.51ms
     99%    9.59ms
  4944841 requests in 30.10s, 1.04GB read
Requests/sec: 164285.56
Transfer/sec:     35.25MB
### Result for Kong git:master (run 2):
Running 30s test @ http://10.68.128.11:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.14ms    1.77ms  27.21ms   88.56%
    Req/Sec    33.06k     8.68k   57.48k    61.72%
  Latency Distribution
     50%  467.00us
     75%    1.00ms
     90%    3.31ms
     99%    8.84ms
  4939892 requests in 30.10s, 1.04GB read
Requests/sec: 164118.37
Transfer/sec:     35.22MB
### Result for Kong git:master (run 3):
Running 30s test @ http://10.68.128.11:8000/s1-r1
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.18ms    1.90ms  36.78ms   88.72%
    Req/Sec    33.08k     8.80k   59.06k    62.45%
  Latency Distribution
     50%  465.00us
     75%    1.01ms
     90%    3.43ms
     99%    9.40ms
  4944348 requests in 30.10s, 1.04GB read
Requests/sec: 164266.85
Transfer/sec:     35.25MB
### Combined result for Kong git:master:
RPS     Avg: 164223.59
Latency Avg: 1.17ms    Max: 36.78ms
   P90 (ms): 3.51, 3.31, 3.43
   P99 (ms): 9.59, 8.84, 9.4
  
### Test Suite: git:master #simple #no_plugins 10 services each has 10 routes
### Result for Kong git:master (run 1):
Running 30s test @ http://10.68.128.11:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.22ms    1.96ms  35.43ms   89.37%
    Req/Sec    30.63k     8.34k   52.17k    58.54%
  Latency Distribution
     50%  500.00us
     75%    1.08ms
     90%    3.37ms
     99%    9.79ms
  4585606 requests in 30.10s, 0.96GB read
Requests/sec: 152345.29
Transfer/sec:     32.69MB
### Result for Kong git:master (run 2):
Running 30s test @ http://10.68.128.11:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.15ms    1.78ms  41.06ms   88.97%
    Req/Sec    31.08k     8.16k   59.66k    60.41%
  Latency Distribution
     50%  507.00us
     75%    1.01ms
     90%    3.25ms
     99%    8.90ms
  4647862 requests in 30.10s, 0.97GB read
Requests/sec: 154418.25
Transfer/sec:     33.13MB
### Result for Kong git:master (run 3):
Running 30s test @ http://10.68.128.11:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.14ms    1.76ms  37.42ms   88.93%
    Req/Sec    31.22k     7.75k   50.05k    59.48%
  Latency Distribution
     50%  509.00us
     75%    0.99ms
     90%    3.22ms
     99%    8.75ms
  4669038 requests in 30.10s, 0.98GB read
Requests/sec: 155121.96
Transfer/sec:     33.28MB
### Combined result for Kong git:master:
RPS     Avg: 153961.83
Latency Avg: 1.17ms    Max: 41.06ms
   P90 (ms): 3.37, 3.25, 3.22
   P99 (ms): 9.79, 8.9, 8.75
  
### Test Suite: git:master #simple #key-auth 10 services each has 10 routes with key-auth, 100 consumers
### Result for Kong git:master (run 1):
Running 30s test @ http://10.68.128.11:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.20ms    1.80ms  32.10ms   90.44%
    Req/Sec    27.17k     6.94k   48.07k    62.23%
  Latency Distribution
     50%  588.00us
     75%    1.17ms
     90%    2.85ms
     99%    9.16ms
  4066322 requests in 30.10s, 0.85GB read
Requests/sec: 135097.39
Transfer/sec:     28.99MB
### Result for Kong git:master (run 2):
Running 30s test @ http://10.68.128.11:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.16ms    1.71ms  34.25ms   90.56%
    Req/Sec    27.16k     6.61k   50.83k    58.52%
  Latency Distribution
     50%  597.00us
     75%    1.13ms
     90%    2.66ms
     99%    8.56ms
  4059994 requests in 30.10s, 0.85GB read
Requests/sec: 134887.61
Transfer/sec:     28.94MB
### Result for Kong git:master (run 3):
Running 30s test @ http://10.68.128.11:8000/
  5 threads and 100 connections
  Thread Stats   Avg      Stdev     Max   +/- Stdev
    Latency     1.18ms    1.75ms  34.56ms   90.43%
    Req/Sec    27.19k     6.61k   44.97k    60.84%
  Latency Distribution
     50%  581.00us
     75%    1.18ms
     90%    2.81ms
     99%    8.77ms
  4068889 requests in 30.10s, 0.85GB read
Requests/sec: 135178.60
Transfer/sec:     29.01MB
### Combined result for Kong git:master:
RPS     Avg: 135054.53
Latency Avg: 1.18ms    Max: 34.56ms
   P90 (ms): 2.85, 2.66, 2.81
   P99 (ms): 9.16, 8.56, 8.77
  

Kong error logs are also available in Github Actions artifacts.

Download Artifacts for detailed results and interactive SVG flamegraphs.

github-actions[bot] avatar Aug 12 '22 15:08 github-actions[bot]

@bungle Is this still being persued or are we dropping this one?

hbagdi avatar Oct 25 '22 22:10 hbagdi

@bungle Is this PR already in progress?

ADD-SP avatar Nov 08 '22 10:11 ADD-SP

@bungle please rebase this one

@locao assigning this to you for review. Thanks!

kikito avatar Nov 08 '22 17:11 kikito

@bungle Could you resolve the conflicts on this PR?

dndx avatar Nov 15 '22 06:11 dndx

@hbagdi yes, I am still looking if this has any benefits.

bungle avatar Nov 16 '22 10:11 bungle