gear
gear copied to clipboard
Consider other options for performance benchmarks
File Location(s)
No response
Proposal
Caused by #900
The following options can be considered as a further evolvement of the task:
- choose some algorithm as a base measurement of hardware state. Run it on the main branch and the source PR branch then use the results to adjust benchmark values;
- use box-plots for both the main branch and the feature/working branch. Since collecting statistics is a time consuming operation we could create some label and perform the operation only for labeled PRs;
- add new standalone runner. All performance benchmarks analysis should be done on the runner only.