critcmp
critcmp copied to clipboard
output group order is different from cli
Currently, it seems that the output results from critcmp are sorted by time, with faster groups appearing first. However, this might not be consistent with the order specified in the CLI, which could be confusing. Perhaps there could be an option to follow the order from the CLI or place the fastest group first.
critcmp ~/Downloads/benchcmp2.json ~/Downloads/master.json
group benchcmp2_cecf96b9 master
----- ------------------ ------
bufvec/manual_chunk 1.01 4.3±0.02µs ? ?/sec 1.00 4.3±0.02µs ? ?/sec
critcmp ~/Downloads/benchcmp2.json ~/Downloads/0.0.1.json
group 0.0.1 benchcmp2_cecf96b9
----- ----- ------------------
bufvec/manual_chunk 1.00 4.3±0.03µs ? ?/sec 1.00 4.3±0.02µs ? ?/sec
it seems that the output results from critcmp are sorted by time, with faster groups appearing first
No, it's sorted lexicographically.
I don't have any plans to change this, but if there's a simple patch that does it, I would consider it.