BenchmarkTools.jl icon indicating copy to clipboard operation
BenchmarkTools.jl copied to clipboard

@benchmarkset seems to be missing cases

Open awadell1 opened this issue 3 years ago • 1 comments

When I run the example code from the docs I get the following

julia> @benchmarkset "suite" for k in 1:5
           @case "case $k" rand($k, $k)
       end
1-element BenchmarkTools.BenchmarkGroup:
  tags: []
  "suite" => 1-element BenchmarkTools.BenchmarkGroup:
	  tags: []
	  "case 5" => Benchmark(evals=1, seconds=5.0, samples=10000)

Instead of what I would expect:

5-element BenchmarkTools.BenchmarkGroup:
  tags: []
  "suite" => 1-element BenchmarkTools.BenchmarkGroup:
	  tags: []
	  "case 1" => Benchmark(evals=1, seconds=5.0, samples=10000)
	  "case 2" => Benchmark(evals=1, seconds=5.0, samples=10000)
	  "case 3" => Benchmark(evals=1, seconds=5.0, samples=10000)
	  "case 4" => Benchmark(evals=1, seconds=5.0, samples=10000)
	  "case 5" => Benchmark(evals=1, seconds=5.0, samples=10000)

Am I missing something? @Roger-luo

Version Info

Julia Version 1.6.1
Commit 6aaedecc44 (2021-04-23 05:59 UTC)
Platform Info:
  OS: macOS (x86_64-apple-darwin18.7.0)
  CPU: Apple M1
  WORD_SIZE: 64
  LIBM: libopenlibm
  LLVM: libLLVM-11.0.1 (ORCJIT, westmere)

awadell1 avatar Jun 14 '21 19:06 awadell1

Same issue here.

LilithHafner avatar Mar 11 '22 14:03 LilithHafner