BenchmarkTools.jl
BenchmarkTools.jl copied to clipboard
JuliaCI
A benchmarking framework for the Julia language
Currently, the `setup` phase is documented properly, but a similar example of the `teardown` would be well appreciated as that quickly got lost when trying to work on some benchmarks...
I am trying to read into the comment: https://github.com/JuliaCI/BenchmarkTools.jl/blob/45052b1953029a0bfd0829ab735dd055d01d9676/src/execution.jl#L268-L270 Is this to allow `tune!`ing benchmarks as a separate step from `run`ning them? At the risk of being further off-topic, I'm...
This is a WIP PR to merge a `@localbtime` and friends macro into BenchmarkTools.jl . There's a thread with [reported issues here](https://github.com/JuliaCI/BenchmarkTools.jl/issues/118#issuecomment-526712519) and this PR took existing code from `LocalScopeBenchmarks.jl`,...
There's a mismatch between what the documentation suggests and how these functions are exported. `maximum` and `minimum` are exported to `Base`, while `median` and `mean` are exported to `Statistics`. https://github.com/JuliaCI/BenchmarkTools.jl/blob/65ef038de1c1ffa0f5d4f4088044214457f0f7df/src/groups.jl#L66-L69...
It would be nice to have a function to disable dead-code elimination / constant propagation. [Rust has this](https://doc.rust-lang.org/std/hint/fn.black_box.html); it's implemented as the identity function, but with magic inside: ```rust assert_eq!(100,...
I know this has been brought up before (e.g. https://github.com/JuliaCI/BenchmarkTools.jl/issues/65 ) and others, but let me make a slightly different suggestion. The current `@btime` and `@benchmark` are great, but what...
Results like ```julia julia> using BenchmarkTools julia> foo(x) = exp(x) foo (generic function with 1 method) julia> @btime foo(1) 0.029 ns (0 allocations: 0 bytes) 2.718281828459045 ``` confuse many discussions...
One can reproduce the error on the [benchmarkerror](https://github.com/JuliaDiffEq/DiffEqDevTools.jl/tree/benchmarkerror) branch of DiffEqDevTools.jl. MWE: ```julia using OrdinaryDiffEq, DiffEqDevTools prob = ODEProblem((u,p,t)->u,[1.0;0.0;0.0],(0.0,1.0)) test_sol = TestSolution(solve(prob,Rodas5(),abstol=1/10^14,reltol=1/10^14)) abstols = @. 1/10^(5:8) reltols = @. 1/10^(1:4)...
I have started using this package to test a module I'm making and it works really well! I was thinking that it would be useful to have function to generate...
Good documentation for btime: ``` help?> @btime @btime expression [other parameters...] Similar to the @time macro included with Julia, this executes an expression, printing the time it took to execute...
