hyperformula icon indicating copy to clipboard operation
hyperformula copied to clipboard

GH workflow that measures the performance

Open sequba opened this issue 3 years ago • 2 comments

Changes

  • node script that runs all benchmarks and writes the results to file
  • node script that compares the results from a few files and prints the report to a file
  • GH workflow that uses these scripts and posts the result as a PR comment
  • new dev-dependency: as-table - a tiny library to format data as a plain-text table

How has this been tested?

On this PR with feature/issue-973-fake-develop as a base branch instead of develop. It doesn't work with develop until this PR is merged.

Types of changes

  • [ ] Breaking change (fix or feature that would cause existing functionality to not work as expected)
  • [ ] New feature or improvement (non-breaking change which adds functionality)
  • [ ] Bug fix (non-breaking change which fixes an issue)
  • [ ] Additional language file or change to the existing one (translations)
  • [ ] Change to the documentation
  • [x] Internal tooling

Related issues:

Fixes #973

Checklist:

  • [x] My code follows the code style of this project.
  • [ ] I described the modification in the CHANGELOG.md file.
  • [ ] My change requires a change to the documentation.
  • [ ] My change requires a migration guide.

sequba avatar Aug 03 '22 12:08 sequba

Performance comparison of head (705ca67a6112f3932d991be332d43d2363e855cc) vs base (a499e286f85fdc00b65746d238d9aeb319a51d06)

                                     testName |  base |  head |  change
-----------------------------------------------------------------------
                                      Sheet A | 474.9 | 485.3 |  +2.19%
                                      Sheet B | 216.9 | 216.3 |  -0.28%
                                      Sheet T | 253.1 | 266.8 |  +5.41%
                                Column ranges | 610.6 | 611.9 |  +0.21%
Sheet A:  change value, add/remove row/column |    32 |    37 | +15.63%
 Sheet B: change value, add/remove row/column |   288 |   304 |  +5.56%
                   Column ranges - add column |   230 |   228 |  -0.87%
                Column ranges - without batch |   488 |   484 |  -0.82%
                        Column ranges - batch |   150 |   151 |  +0.67%

github-actions[bot] avatar Aug 08 '22 11:08 github-actions[bot]

Codecov Report

Merging #1042 (fa33072) into develop (3dde8ce) will not change coverage. The diff coverage is n/a.

Impacted file tree graph

@@           Coverage Diff            @@
##           develop    #1042   +/-   ##
========================================
  Coverage    95.73%   95.73%           
========================================
  Files          161      161           
  Lines        14056    14056           
  Branches      2912     2912           
========================================
  Hits         13456    13456           
  Misses         600      600           

codecov[bot] avatar Aug 08 '22 13:08 codecov[bot]