Programming-Language-Benchmarks icon indicating copy to clipboard operation
Programming-Language-Benchmarks copied to clipboard

"docker/k8s" versus "dev machine"

Open igouy opened this issue 3 years ago • 3 comments
trafficstars

On the home page

Main goals: … Facilitate benchmarking on real server environments as nowadays more and more applications are deployed with docker/k8s. It's likely to get a very different result from what you get on your dev machine. …

Now there are plenty of results, are they different?

igouy avatar Jan 26 '22 18:01 igouy

When writing this, I was assuming GH action uses dockerized environment for CI, but that might not be true per its doc, looks like it's using Azure VM, which might still be some virtualized environment other than bare metal, but may or may not be docker/podman. I will think about how to make the wording more accurate. Thanks for bringing this up.

p.s. Regarding the numbers, I don't see any difference tho

hanabi1224 avatar Jan 27 '22 00:01 hanabi1224

https://benchmarksgame-team.pages.debian.net/benchmarksgame/sometimes-people-just-make-up-stuff.html#cloud-desktop

igouy avatar Jan 28 '22 20:01 igouy

@igouy Could we please have the link to the old numbers published for the i5-3330? I have problem finding it. Any chance seeing the tabulated row numbers with the input parameters, compiler versions and settings etc and to see how the normalization was done? I would also like to know why SBCL was not included in your list?

bpecsek avatar Jan 30 '22 14:01 bpecsek