ReBench
ReBench copied to clipboard
smarr
Release ReBench 1.1
This PR prepares the 1.1 release.
This release focuses on reducing the noise from the system.
For this purpse, it introduces the rebench-denoise tool, which will adapt
system parameters to:
- change CPU governor to the performance setting
- disables turbo boost
- reduces the sampling frequency allowed byte the kernel
- execute benchmarks with CPU shielding and
nice -n-20
Note that the use of rebench-denoise will require root rights.
It can also be used as stand-alone tool, for which documentation is here:
https://rebench.readthedocs.io/en/latest/denoise/
Thanks to @tobega and @qinsoon for contributing bug fixes.
Coverage: 80.721%. Remained the same when pulling 15b4f79f0bbe22341c126cb8c264f53057684d56 on release-prep into a4d7898c4fe87daf7dbbde310dd50eea8acadbd7 on master.
@qinsoon, @steveblackburn, @wenyuzhao my understanding is that you guys are using ReBench in the context of the @MMTk project.
Could I ask you to give the latest version a try and let me know whether things work for you?
The rebench-denoise tool is ideally something useful, but at the moment only really tested on Ubuntu and Intel hardware.
I am aware of issues on AMD. And I am also aware of problems with Fedora.
If you need support for any of those platforms, we'll try to look into it, otherwise, I'll go ahead with the release and plan to have a bug fix release later on. Currently, I don't really have access to any AMD/Fedora setups to test things easily.
And, I suspect, there may be further issues down the line in the context of virtualized environments.
Hi @smarr We use ReBench to run Java micro benchmarks as one of the checks in our CI. I will update to the latest revision and let you know. It should work well as we are currently using a fixed revision of ReBench that is not far away from the head. For rebench-denoise, we are not using it at the moment, mostly due to the fact that it requires root access and we cannot run it in our CI script.
Ok, great, think that means it should be good to release then. Thanks for confirming!