github-action-benchmark
github-action-benchmark copied to clipboard
catch2 time units are ignored when graphing and generating alerts
When using the "catch2" extractor, the time units, "ms", "us", etc, are extracted and printed, but otherwise ignored.
This results in broken graphs when the time is near a unit boundary:
It also results in false alerts:
Any news on this? getRatio
doesn't involve unit calculation atm, though it seems like an easy fix for a problem that makes this action pretty useless for catch:
https://github.com/benchmark-action/github-action-benchmark/blob/8e749722e912d8d81d0ef090f927695c58efcf5e/src/write.ts#L567