BenchmarkTools.jl
BenchmarkTools.jl copied to clipboard
@benchmarkset seems to be missing cases
When I run the example code from the docs I get the following
julia> @benchmarkset "suite" for k in 1:5
@case "case $k" rand($k, $k)
end
1-element BenchmarkTools.BenchmarkGroup:
tags: []
"suite" => 1-element BenchmarkTools.BenchmarkGroup:
tags: []
"case 5" => Benchmark(evals=1, seconds=5.0, samples=10000)
Instead of what I would expect:
5-element BenchmarkTools.BenchmarkGroup:
tags: []
"suite" => 1-element BenchmarkTools.BenchmarkGroup:
tags: []
"case 1" => Benchmark(evals=1, seconds=5.0, samples=10000)
"case 2" => Benchmark(evals=1, seconds=5.0, samples=10000)
"case 3" => Benchmark(evals=1, seconds=5.0, samples=10000)
"case 4" => Benchmark(evals=1, seconds=5.0, samples=10000)
"case 5" => Benchmark(evals=1, seconds=5.0, samples=10000)
Am I missing something? @Roger-luo
Version Info
Julia Version 1.6.1
Commit 6aaedecc44 (2021-04-23 05:59 UTC)
Platform Info:
OS: macOS (x86_64-apple-darwin18.7.0)
CPU: Apple M1
WORD_SIZE: 64
LIBM: libopenlibm
LLVM: libLLVM-11.0.1 (ORCJIT, westmere)
Same issue here.