benchee
benchee copied to clipboard
Easy and extensible benchmarking in Elixir providing you with lots of statistics!
The unit implementations have a lot of method definitions that an implementation needs to define but that definitely just call out to a more common for code sharing. For instance:...
For example, display `1.23 Million` instead of `1.23M`. This should be an option `unit_label` with possible values `:short` and `:long` defaulting to short. It can then be picked up by...
For different use cases, like PragTob/benchee_html#10 it'd be great to have statistics about statistics - what I'd call "meta statistics" - although there's probably some better real statistics name for...
There's a lot of discussion of this topic in #108 . It's not a high priority now but I wanted to log the issue :) Oh yeah, this concerns Linux...
Hello, ~~I see when running the following code that input `"single` with case `"head_match"` will consume all my RAM, all my swap, and will get OOM killed.~~ ~~Same case with...
Due to Garbage Collection, scheduling and load on the system we can get outliers in our measurements that impact esp. the average a lot. That happens esp. a lot with...
Hi @PragTob, how are you doing? **What**: an option like `assert_all_same: true` which would run all functions (for each input if using `inputs`) and ensure that results are equal for...
Original ask from @PragTob: https://bsky.app/profile/pragtob.bsky.social/post/3lo6lbllur22r edit by @PragTob, full text of original ask: > I finally want to get a logo for benchee - it looks so sad without a...
This line here: https://github.com/bencheeorg/benchee/blob/741db4d1c282543bca6857204df9ec59c65100dd/lib/benchee/system.ex#L114 Appears to fail on up-to-date Windows 11 systems due to WMIC having been deprecated. Here's an article announcing the deprecation: https://techcommunity.microsoft.com/blog/windows-itpro-blog/wmi-command-line-wmic-utility-deprecation-next-steps/4039242 It seems the only alternative...
Is it by design that `before_scenario` runs multiple times if `parallel` is greater than `1`? I'm trying to setup a single process which can be accessed by the parallel run...