pyperformance icon indicating copy to clipboard operation
pyperformance copied to clipboard

Add a Macro Benchmark that Exercises Threading (Multi-Core Concurrency)

Open ericsnowcurrently opened this issue 3 years ago • 0 comments

From @methane (https://mail.python.org/archives/list/[email protected]/message/KVH7QLJ4VJBQQ45LZTWDXO2SEC6ANX7T/):

CPU cache invalidation exists regardless. With the current GIL the effect it is reduced significantly.

It's an interesting point. We can not see the benefit from pypeformance, because it doesn't use much data and it runs one process at a time. So the pyperformance can not make enough stress to the last level cache which is shared by many cores.

We need multiprocess performance benchmark apart from pyperformance, to stress the last level cache from multiple cores. It helps not only this PEP, but also optimizing containers like dict and set.

ericsnowcurrently avatar Feb 28 '22 20:02 ericsnowcurrently