grpc_bench icon indicating copy to clipboard operation
grpc_bench copied to clipboard

The benchmark result on my machine

Open gcnyin opened this issue 2 years ago • 2 comments

Using Intel i5 12400f.

Failed to build due to poor network, some cases are not included.

-----------------------------------------------------------------------------------------------------------------------------------------
| name                        |   req/s |   avg. latency |        90 % in |        95 % in |        99 % in | avg. cpu |   avg. memory |
-----------------------------------------------------------------------------------------------------------------------------------------
| cpp_grpc_mt                 |   92032 |       10.73 ms |       12.22 ms |       12.94 ms |       14.33 ms |  101.16% |     33.72 MiB |
| dotnet_grpc                 |   91283 |        9.97 ms |       17.24 ms |       29.36 ms |       55.29 ms |   98.26% |    123.91 MiB |
| cpp_grpc_st                 |   86103 |       11.46 ms |       12.66 ms |       13.41 ms |       14.95 ms |  100.49% |     28.84 MiB |
| go_vtgrpc                   |   81918 |       11.77 ms |       18.49 ms |       20.71 ms |       25.11 ms |   98.91% |     34.42 MiB |
| go_grpc                     |   68811 |       14.13 ms |       22.49 ms |       25.23 ms |       29.44 ms |   91.29% |     42.42 MiB |
| java_quarkus                |   50271 |       19.72 ms |       32.60 ms |       35.18 ms |       70.74 ms |   90.87% |    109.67 MiB |
| scala_akka                  |   41381 |       22.87 ms |       63.83 ms |       72.63 ms |       83.80 ms |    91.3% |    245.62 MiB |
| java_quarkus_native         |   41071 |       24.25 ms |       30.74 ms |       31.69 ms |       34.17 ms |   100.4% |     81.19 MiB |
| java_micronaut_workstealing |    5822 |      171.10 ms |      191.94 ms |      286.23 ms |      682.01 ms |   94.33% |    510.28 MiB |
| java_micronaut              |    5588 |      178.27 ms |      189.90 ms |      204.31 ms |      551.48 ms |   99.49% |    507.34 MiB |
| python_async_grpc           |    4125 |      241.36 ms |      270.65 ms |      274.03 ms |      281.93 ms |   94.47% |     29.94 MiB |
| java_aot                    |    3627 |      274.03 ms |      517.37 ms |      608.49 ms |      804.75 ms |  102.57% |    445.43 MiB |
| python_grpc                 |    2316 |      428.55 ms |      469.73 ms |      472.57 ms |      476.32 ms |   90.27% |     32.84 MiB |
-----------------------------------------------------------------------------------------------------------------------------------------
Benchmark Execution Parameters:
88af19c Thu, 15 Sep 2022 08:50:20 +0200 GitHub [chore] updated swift 5.7.0 (#279)
- GRPC_BENCHMARK_DURATION=60s
- GRPC_BENCHMARK_WARMUP=60s
- GRPC_SERVER_CPUS=1
- GRPC_SERVER_RAM=512m
- GRPC_CLIENT_CONNECTIONS=50
- GRPC_CLIENT_CONCURRENCY=1000
- GRPC_CLIENT_QPS=0
- GRPC_CLIENT_CPUS=9
- GRPC_REQUEST_SCENARIO=complex_proto

gcnyin avatar Sep 15 '22 12:09 gcnyin

Thanks for running them! Let me ask @Trisfald if we can run another round of benchmarks anytime soon.

LesnyRumcajs avatar Sep 16 '22 11:09 LesnyRumcajs

I think there are some differences between Intel i5 12400f and Intel Xeon E5-1650.

Some languages do not perform well at 12400f.

gcnyin avatar Sep 16 '22 12:09 gcnyin

@gcnyin Makes sense. I'd be happy to add your results to the wiki if you'd manage to run all the available benchmarks. :)

LesnyRumcajs avatar Sep 22 '22 08:09 LesnyRumcajs

@gcnyin I've created a Benchmark results topic here; feel free to post your results! :rocket:

LesnyRumcajs avatar Sep 23 '22 07:09 LesnyRumcajs