github-action-benchmark

github-action-benchmark copied to clipboard

Add initial Haskell support

1

I would like to add Haskell support (only .csv output of `criterion` package for now). I had some issues with passing the checks in my fork, so I would be...

charrsky

It would be nice if the benchmark action could support the [lit](https://llvm.org/docs/CommandGuide/lit.html) the LLVM Integrated Tester. The json output generated by lit looks as follows: ``` { "__version__": [ 15,...

tgymnich

My intention, to make PRs less verbose, is to get a benchmark-action comment *only* if there's an alert. That's why I have `comment-always: false` and `comment-on-alert: true` with `alert-threshold: 150%`....

edulix

How to process multiple benchmark files?

6

I have tried the GitHub action layout below but get the following error. ``` 2021-06-09T15:56:24.8321073Z [command]/usr/bin/git -c user.name=github-action-benchmark -c [email protected] -c http.https://github.com/.extraheader= fetch origin gh-pages:gh-pages 2021-06-09T15:56:25.0151197Z From https://github.com/Levi-Armstrong/tesseract-1 2021-06-09T15:56:25.0152452Z !...

Levi-Armstrong

For vitest, we plan to use tinybench, a fork of benchmark.js. As such it is potentially adding whitespace at the beginning of the benchmark output. So if you would like...

Uzlopak

Track historic best results and (optionally) compute ratio based on best results

1

Thanks for providing this awesome action that our team greatly enjoys! Our team got concerned that, since this action shows alerts based on comparison to the previous run only, it...

ksvladimir

catch2 time units are ignored when graphing and generating alerts

1

When using the "catch2" extractor, the time units, "ms", "us", etc, are extracted and printed, but otherwise ignored. This results in broken graphs when the time is near a unit...

paradust7

There might be situations if the changes drastically improves the performance or the thresholds are configured with lower values it lead to failure of the action whereas it is not....

madhan-mettle

Hello and thanks for this repo / tool - much appreciated! This is one possible approach to address the issue I filed : [allows go benchmarks to work with extra...

joe-kimmel-vmw

the `extractGoResult` function works great as long as there's only a single metric on the line. However golang's benchmark tool supports including additional compiler and user defined metrics, which will...

joe-kimmel-vmw