cob icon indicating copy to clipboard operation
cob copied to clipboard

Published 20 hours ago • verified publisher icon knqyf263

Feature request: store benchmark result & compare with file

Open hazcod opened this issue 5 years ago • 2 comments

Hi, love the project! Is it an idea to keep the previous bench result in a file, e.g. .github/cob.yaml and compare that? This way you don't always need to re-run the benchmark twice, and it allows to compare against other branches than master.

hazcod avatar Jan 13 '20 20:01 hazcod

We can store it, but I'm afraid that the bench score varies due to the environment since CI service launches a bit different environment each time. Do you have any ideas?

knqyf263 avatar Jan 15 '20 12:01 knqyf263

Maybe turn on/off with a toggle and store the result under .cob/ or so? In theory GHA should have the same virtual instances:

Each virtual machine has the same hardware resources available.

2-core CPU
7 GB of RAM memory
14 GB of SSD disk space

hazcod avatar Jan 19 '20 00:01 hazcod