benchmarking

benchmarking copied to clipboard

My suggestion is to add all core benchmarks to the build setup but run them once a month. Since running all the benchmarks takes multiple days, it would be crazy to run them nightly. With monthly setup we can have complete performance data and overtime we can get a trend line. There is still a problem of presenting this data accurately without overwhelming the users and gain understanding of the performance trend. It would be really helpful to get some feedback from the community mainly contributors for the benchmarking team.

FWIW I've been running most node core benchmark categories nightly, with results available for viewing/comparing here.