0.2.23 stops when a @testset has a failing test

[dpinol]

using Test

@testset "a" begin
    @test 1 == 2
end
@testset "b" begin
    @test 1 == 2
end

With Jive 0.2.21

1/1 kk.jl
a: Test Failed at /home/dani/source/repos/sc-cli/test/kk.jl:4
  Expression: 1 == 2
   Evaluated: 1 == 2
Stacktrace:
 [1] macro expansion
   @ /opt/julia/julia-1.8.0-beta3/share/julia/stdlib/v1.8/Test/src/Test.jl:464 [inlined]
 [2] macro expansion
   @ ~/source/repos/sc-cli/test/kk.jl:4 [inlined]
 [3] macro expansion
   @ /opt/julia/julia-1.8.0-beta3/share/julia/stdlib/v1.8/Test/src/Test.jl:1357 [inlined]
 [4] top-level scope
   @ ~/source/repos/sc-cli/test/kk.jl:4
b: Test Failed at /home/dani/source/repos/sc-cli/test/kk.jl:7
  Expression: 1 == 2
   Evaluated: 1 == 2
Stacktrace:
 [1] macro expansion
   @ /opt/julia/julia-1.8.0-beta3/share/julia/stdlib/v1.8/Test/src/Test.jl:464 [inlined]
 [2] macro expansion
   @ ~/source/repos/sc-cli/test/kk.jl:7 [inlined]
 [3] macro expansion
   @ /opt/julia/julia-1.8.0-beta3/share/julia/stdlib/v1.8/Test/src/Test.jl:1357 [inlined]
 [4] top-level scope
   @ ~/source/repos/sc-cli/test/kk.jl:7
    Fail: 2  (compile: 0.01, elapsed: 0.14 seconds)
❗️  Test run finished with 2 test failures.  (compile: 0.01, elapsed: 0.14 seconds)

1/1 kk.jl
a: Test Failed at /home/dani/source/repos/sli2/test/kk.jl:4
  Expression: 1 == 2
   Evaluated: 1 == 2
Stacktrace:
 [1] macro expansion
   @ /opt/julia/julia-1.8.0-beta3/share/julia/stdlib/v1.8/Test/src/Test.jl:464 [inlined]
 [2] macro expansion
   @ ~/source/repos/sli2/test/kk.jl:4 [inlined]
 [3] macro expansion
   @ /opt/julia/julia-1.8.0-beta3/share/julia/stdlib/v1.8/Test/src/Test.jl:1357 [inlined]
 [4] top-level scope
   @ ~/source/repos/sli2/test/kk.jl:4
kk.jl: Error During Test at /home/dani/.julia/packages/Jive/Qby3B/src/runtests.jl:236
  Got exception outside of a @test
  LoadError: Some tests did not pass: 0 passed, 1 failed, 0 errored, 0 broken.
  in expression starting at /home/dani/source/repos/sli2/test/kk.jl:3
    Error: 1  (compile: 0.06, elapsed: 0.10 seconds)
❗️  Test run finished with 1 error.  (compile: 0.06, elapsed: 0.10 seconds)

[wookay]

I recommend to pin the pkg, during fix the issue.

using Pkg; Pkg.pin(name="Jive", version="0.2.21")

[wookay]

you could Pkg.free and update to Jive v0.2.24. thanks.

Pkg.free("Jive")

[wookay]

tested in the repo

• https://github.com/wookay/TestJiveIssue54.jl
• https://github.com/wookay/TestJiveIssue54.jl/runs/6117639999?check_suite_focus=true#step:4:9

[dpinol]

fixed