bench icon indicating copy to clipboard operation
bench copied to clipboard

Integration with language agnostic continuous benchmarking frameworks

Open Robinlovelace opened this issue 3 years ago • 3 comments

I've been looking at this and think it would be great for this action to support R projects: https://github.com/marketplace/actions/continuous-benchmark

I'm not sure how much effort would be required to make that happen so this is more of a question than a feature request but happy to help out and think the idea of graphs showing change over time from GitHub, that this project would enable by the looks of it, would be amazing.

Robinlovelace avatar Jul 31 '21 07:07 Robinlovelace

Slightly out of topic, but {touchstone} by @lorenzwalthert could get you started today.

https://github.com/lorenzwalthert/touchstone

krlmlr avatar Aug 01 '21 03:08 krlmlr

Thanks for the heads-up @krlmlr, touchstone looks like it's progressed well since I last looked at it. Looking at the continuous-benchmark action it looks like it's not actively maintained, wonder if there are other language agnostic frameworks that could reduce duplication of effort. Look forward to giving touchstone a spin in any case..

Robinlovelace avatar Aug 01 '21 18:08 Robinlovelace

Hey @Robinlovelace {touchstone} has developed a lot since last year and we are getting ready to submit to rOpenSci and CRAN. Now is a good time to test it, we would love some feedback from new users!

assignUser avatar Jan 19 '22 16:01 assignUser