entity-system-benchmarks icon indicating copy to clipboard operation
entity-system-benchmarks copied to clipboard

What do those benchmarks measure?

Open 983 opened this issue 8 years ago • 2 comments

The README says "All benchmarks measure throughput; higher score is better." but there is no explanation of what "throughput" is. I assume that one "throughput" is how often the operation listed at the top of each image can be executed in one second. I tried to find the actual information in the source code and now I'm not sure because it might also be [https://github.com/junkdog/entity-system-benchmarks/blob/8e13b8e3d4c904a444e68ba09b176770e413e397/common/src/main/java/com/github/esfbench/JmhSettings.java](10 seconds) or that file might be something entirely different. Who knows.

Anyway, I think that it would be nice if the essential information was apparent from the README.

983 avatar Mar 19 '16 16:03 983

Hi, yeah, the README could definitely do with some improvements; I'll attend to it in the near future. Been holding off a general overhaul.

In the meantime;

I assume that one "throughput" is how often the operation listed at the top of each image can be executed in one second.

Correct. The different types of benchmarks in README#benchmarks-explained describe a single op/execution.

JmhSettings

JmhSettings contains the shared configuration for all benchmarks.

The raw logs can be found here: https://github.com/junkdog/entity-system-benchmarks/tree/master/results

Anyway, I think that it would be nice if the essential information was apparent from the README.

I'll ping you when it's been updated.

junkdog avatar Mar 19 '16 17:03 junkdog

Very nice! Thanks for clarification :)

983 avatar Mar 19 '16 17:03 983