hyperion
hyperion copied to clipboard
tweag
A lab for future Criterion features.
Uses olsRegress from Statistics.Regression, and adds additional information to the reports and their display. Results on the micro benchmark are strange : some batches have almost perfect confidence, some others...
See the commit messages: ``` Remove location from metadata … The current location metadata is always null. The user may set an actual location on the command line. ``` ```...
Right now the hyperion reports from `doAnalyze` are only available in JSON form (`doAnalyze` performs the benchmarks, the analysis _and_ the JSON reporting). This means that, currently, the two ways...
`timeBound` seems to ignore given time bound, and only runs the first batch. For example, `stack exec hyperion-end-to-end-benchmark-example` currently runs 10 times the benchmark and exits, regardless the time bound...
TLDR. `time_in_nanoseconds` is reported wrongly, we need to implement more advanced algorithm to measure that. Full version. I wanted to check the influence of the hyperion framework on the measured...
Currently hyperion returns only raw measurement data and without external tool it's hard to make sense of data because we don't know how accurate those measurements were. It would be...
Some bits (like metadata merging, value replacement, benchmark order) are tricky to get right. See #35 for instance. A test-suite should be in place to catch regressions.