quick-xml icon indicating copy to clipboard operation
quick-xml copied to clipboard

Add workflow to run benchmarks

Open Mingun opened this issue 10 months ago • 2 comments

Using https://github.com/boa-dev/criterion-compare-action. Let's see what it can give us

Mingun avatar Sep 05 '23 14:09 Mingun

There's just too much noise with github actions to get good results. It looks like there are swings of up to 13% in the test run.

The criteron book recommends using something like IaI instead https://github.com/bheisler/criterion.rs/blob/master/book/src/faq.md#how-should-i-run-criterionrs-benchmarks-in-a-ci-pipeline

dralley avatar Sep 05 '23 16:09 dralley

Yeah, I read that, but if such actions is exist, it would be interesting to check them. Actually, I want to see a graph somewhere, similar to which https://github.com/benchmark-action/github-action-benchmark is produced, so to have an idea of performance, but that action unfortunately doesn't work with criterion.

I agree, that it is not worth to merge it right now

Mingun avatar Sep 05 '23 16:09 Mingun