criterion icon indicating copy to clipboard operation
criterion copied to clipboard

Feature request: allow limiting very long-running tests

Open jberryman opened this issue 5 years ago • 3 comments

I would like a flag that lets me say "never spend more than X seconds on a benchmark; if the time limit is exceeded compile statistics with runs you've done".

I assumed from help that this was what -L did, but I was wrong (I think those docs could be improved too; -L seems to run a benchmark for some fixed amount of time which we wouldn't normally call a "time limit"... I wonder if it was originally meant to do what I thought it did...).

jberryman avatar Dec 12 '19 19:12 jberryman

maybe dupe of https://github.com/bos/criterion/issues/210

jberryman avatar Dec 12 '19 22:12 jberryman

Hello there, I have the same problem as @jberryman. Are there any news about this enhancement? Any possible workarounds? Thanks.

daberg avatar Apr 22 '20 16:04 daberg

I'm not actively working on this, but I would welcome a PR that implemented it.

RyanGlScott avatar Apr 22 '20 16:04 RyanGlScott