serializer-benchmark icon indicating copy to clipboard operation
serializer-benchmark copied to clipboard

Show results?

Open soyuka opened this issue 7 years ago • 6 comments

soyuka avatar Jul 11 '18 10:07 soyuka

The README used to contain some, but it was before using PHPBench Tool and adding more seializers: https://github.com/tsantos84/serializer-benchmark/blob/26a354f341155cb9064581263033cf0c94480868/README.md

Mind that results are quite approximate, since even with consecutive runs each one will give you different numbers. One should rather compare result ratios instead.

eduard-sukharev avatar Jul 11 '18 11:07 eduard-sukharev

Current results for single run on my machine are:

For serialization:

6 subjects, 6 iterations, 6 revs, 0 rejects, 0 failures, 0 warnings
(best [mean mode] worst) = 1.437 [6.997 6.997] 1.437 (ms)
⅀T: 41.979ms μSD/r 0.000ms μRSD/r: 0.000%
suite: 133eee7455371dec342b457dce59864435d2beb3, date: 2018-07-11, stime: 12:09:04
+--------------------------------+----------------+---------+---------+---------+------------+-------+
| benchmark                      | subject        | mean    | worst   | best    | mem_real   | diff  |
+--------------------------------+----------------+---------+---------+---------+------------+-------+
| TSantosBench                   | benchSerialize | 1.437ms | 1.437ms | 1.437ms | 6,291,456b | 1.00x |
| ZumbaJsonBench                 | benchSerialize | 4.441ms | 4.441ms | 4.441ms | 4,194,304b | 3.09x |
| JmsBench                       | benchSerialize | 7.971ms | 7.971ms | 7.971ms | 4,194,304b | 5.55x |
| SymfonyBench                   | benchSerialize | 8.812ms | 8.812ms | 8.812ms | 4,194,304b | 6.13x |
| NilPortuguesBench              | benchSerialize | 9.441ms | 9.441ms | 9.441ms | 4,194,304b | 6.57x |
| SymfonyCustomDenormalizerBench | benchSerialize | 9.877ms | 9.877ms | 9.877ms | 4,194,304b | 6.87x |
+--------------------------------+----------------+---------+---------+---------+------------+-------+

For deserialization:

6 subjects, 6 iterations, 6 revs, 0 rejects, 0 failures, 0 warnings
(best [mean mode] worst) = 1.288 [4.313 4.313] 1.288 (ms)
⅀T: 25.879ms μSD/r 0.000ms μRSD/r: 0.000%
suite: 133eee7f130f310cd1a6470bc464fc7afc7289f6, date: 2018-07-11, stime: 12:09:10
+--------------------------------+------------------+---------+---------+---------+------------+-------+
| benchmark                      | subject          | mean    | worst   | best    | mem_real   | diff  |
+--------------------------------+------------------+---------+---------+---------+------------+-------+
| SymfonyCustomDenormalizerBench | benchDeserialize | 1.288ms | 1.288ms | 1.288ms | 4,194,304b | 1.00x |
| TSantosBench                   | benchDeserialize | 1.999ms | 1.999ms | 1.999ms | 6,291,456b | 1.55x |
| ZumbaJsonBench                 | benchDeserialize | 3.604ms | 3.604ms | 3.604ms | 4,194,304b | 2.80x |
| NilPortuguesBench              | benchDeserialize | 4.512ms | 4.512ms | 4.512ms | 4,194,304b | 3.50x |
| JmsBench                       | benchDeserialize | 6.645ms | 6.645ms | 6.645ms | 6,291,456b | 5.16x |
| SymfonyBench                   | benchDeserialize | 7.831ms | 7.831ms | 7.831ms | 4,194,304b | 6.08x |
+--------------------------------+------------------+---------+---------+---------+------------+-------+

eduard-sukharev avatar Jul 11 '18 12:07 eduard-sukharev

Thanks to anticipate the results, @eduard-sukharev.

@soyuka In addition, we'd appreciate your inputs about any issue in vendor's setup.

tsantos84 avatar Jul 11 '18 13:07 tsantos84

BTW, I'm planning to run this benchmark on EC2 instance to abstract the environment.

tsantos84 avatar Jul 11 '18 13:07 tsantos84

Thanks @eduard-sukharev

In addition, we'd appreciate your inputs about any issue in vendor's setup.

When I came here I read the README expecting some results, I don't really want to install everything just wanted a "quick look" on the results. IMO these should be added to the readme.

soyuka avatar Jul 11 '18 14:07 soyuka

Sure, @soyuka. As soon as I finished the benchmark on EC2 instance I update the README with the results.

tsantos84 avatar Jul 11 '18 15:07 tsantos84