live icon indicating copy to clipboard operation
live copied to clipboard

Add benchmarks

Open amirouche opened this issue 3 years ago • 1 comments

Have a way to run benchmarks:

  • [ ] use linux perf-tools to gather statistics
  • [ ] benchmark compilation separatly
  • [ ] aggregation for:
    • [ ] memory use
    • [ ] wall-clock time
  • [ ] benchmark safe and unsafe
  • [ ] score board
  • [ ] add a github actions that can only be run via the interface (ie. no triggers)

~ref: https://github.com/benchmark-action/github-action-benchmark~ ~ref: https://github.com/ecraven/r7rs-benchmarks/issues/60~ ~ref: https://github.com/ecraven/r7rs-coverage/issues/4~ ref: https://github.com/larcenists/larceny/tree/master/test/Benchmarking/R6RS/src ref: https://benchmarksgame-team.pages.debian.net/benchmarksgame/index.html ref: https://github.com/gothinkster/realworld ref: https://www.techempower.com/benchmarks/

amirouche avatar Nov 27 '21 17:11 amirouche

re github-action-benchmark is not what is needed. We would need something that can compare several implementations, and then aggregate the results of various metrics, and eventually get together a scoreboard.

amirouche avatar Nov 29 '21 14:11 amirouche