microprocessor-trend-data icon indicating copy to clipboard operation
microprocessor-trend-data copied to clipboard

Recent single-core SPECint data misleading

Open codebent opened this issue 5 years ago • 1 comments

I know that it's just the way things have progressed in the benchmarking game, but most of the "single-core" speed results use auto-parallelization and do not truly represent single-core performance. The last non autopar'd x86 results were submitted in 2009 and it topped out at 23.1. I would guess that without autopar current systems would be in the ~50 range. So not a 4x increase in performance over 10 years, but closer to 2.

codebent avatar Jan 22 '20 21:01 codebent

@codebent thanks for pointing this out. Yes, SPECint is only an approximation to single-core performance and somewhat biased. However, it is a standardized metric that can be compared across a broad range of processors and many people are aware of its shortcomings.

In the end, it's a log-scale plot, so if we overestimate single-core performance by a factor of two, it doesn't change the overall picture :-)

karlrupp avatar Jan 24 '20 11:01 karlrupp