QuantumClifford.jl icon indicating copy to clipboard operation
QuantumClifford.jl copied to clipboard

Published 20 hours ago • verified publisher icon QuantumSavory

configure two gate noise in various code evaluation setups

Open ismoldayev opened this issue 1 year ago • 1 comments

Implemented add_two_qubit_gate_noise for NaiveSyndromeECCSetup.

ismoldayev avatar Apr 02 '24 14:04 ismoldayev

I will mark this is a draft. When you have addressed the change and you have passing tests, re-request a review from me and make it not a draft anymore.

Ping me if you have questions or if something is unclear.

Krastanov avatar Apr 02 '24 17:04 Krastanov

Benchmark Result

Judge result

Benchmark Report for /home/runner/work/QuantumClifford.jl/QuantumClifford.jl

Job Properties

  • Time of benchmarks:
  • Target: 11 Apr 2024 - 05:55
  • Baseline: 11 Apr 2024 - 06:02
  • Package commits:
  • Target: 15bac5
  • Baseline: 64f695
  • Julia commits:
  • Target: 45fb08
  • Baseline: 45fb08
  • Julia command flags:
  • Target: None
  • Baseline: None
  • Environment variables:
  • Target: None
  • Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with :x:), while a ratio less than 1.0 denotes a possible improvement (marked with :white_check_mark:). Only significant results - results that indicate possible regressions or improvements - are shown below (thus, an empty table means that all benchmark results remained invariant between builds).

ID time ratio memory ratio
["circuitsim", "mctrajectories", "q101_r1"] 0.91 (5%) :white_check_mark: 1.00 (1%)
["circuitsim", "mctrajectories_union", "q1001_r1"] 0.92 (5%) :white_check_mark: 1.00 (1%)
["circuitsim", "pftrajectories", "q1001_r1"] 0.94 (5%) :white_check_mark: 1.00 (1%)
["circuitsim", "pftrajectories_sumtype", "q1001_r100"] 0.93 (5%) :white_check_mark: 1.00 (1%)
["circuitsim", "pftrajectories_union", "q1001_r100"] 0.92 (5%) :white_check_mark: 1.00 (1%)
["circuitsim", "pftrajectories_union", "q1001_r10000"] 0.94 (5%) :white_check_mark: 1.00 (1%)
["clifford", "symbolic", "cnot_on_diag500_stab"] 1.08 (5%) :x: 1.00 (1%)
["ecc", "evaluate_decoder", "shor_bp_naivesyn"] 1.06 (5%) :x: 1.01 (1%)
["ecc", "evaluate_decoder", "shor_bp_shorsyn"] 0.97 (5%) 0.98 (1%) :white_check_mark:
["ecc", "evaluate_decoder", "shor_pybp_shorsyn"] 1.26 (5%) :x: 1.00 (1%)
["ecc", "evaluate_decoder", "shor_table_naivesyn"] 1.24 (5%) :x: 1.05 (1%) :x:
["ecc", "evaluate_decoder", "shor_table_shorsyn"] 1.20 (5%) :x: 1.07 (1%) :x:
["ecc", "evaluate_decoder", "toric8_bp_naivesyn"] 0.98 (5%) 0.99 (1%) :white_check_mark:
["ecc", "evaluate_decoder", "toric8_bp_shorsyn"] 0.96 (5%) 0.96 (1%) :white_check_mark:
["ecc", "evaluate_decoder", "toric8_pybp_naivesyn"] 1.02 (5%) 1.02 (1%) :x:
["ecc", "evaluate_decoder", "toric8_pybp_shorsyn"] 1.05 (5%) :x: 1.03 (1%) :x:
["ecc", "evaluate_decoder", "toric8_pymatch_naivesyn"] 1.35 (5%) :x: 1.07 (1%) :x:
["ecc", "evaluate_decoder", "toric8_pymatch_shorsyn"] 1.24 (5%) :x: 1.08 (1%) :x:
["ecc", "evaluate_decoder", "toric8_table_naivesyn"] 1.42 (5%) :x: 1.08 (1%) :x:
["ecc", "evaluate_decoder", "toric8_table_shorsyn"] 1.26 (5%) :x: 1.09 (1%) :x:
["pauli", "mul", "100000"] 0.95 (5%) :white_check_mark: 1.00 (1%)
["stabilizer", "canon", "diag_cano500"] 1.06 (5%) :x: 1.00 (1%)
["stabilizer", "canon", "diag_rref500"] 0.87 (5%) :white_check_mark: 1.00 (1%)
["stabilizer", "project", "stabilizer"] 1.06 (5%) :x: 1.00 (1%)
["stabilizer", "tensor", "diag_pow5_20"] 0.90 (5%) :white_check_mark: 1.00 (1%)
["stabilizer", "trace", "destabilizer"] 0.90 (5%) :white_check_mark: 1.00 (1%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["circuitsim", "mctrajectories"]
  • ["circuitsim", "mctrajectories_sumtype"]
  • ["circuitsim", "mctrajectories_union"]
  • ["circuitsim", "pftrajectories"]
  • ["circuitsim", "pftrajectories_sumtype"]
  • ["circuitsim", "pftrajectories_union"]
  • ["clifford", "dense"]
  • ["clifford", "symbolic"]
  • ["ecc", "evaluate_decoder"]
  • ["pauli", "mul"]
  • ["stabilizer", "canon"]
  • ["stabilizer", "project"]
  • ["stabilizer", "tensor"]
  • ["stabilizer", "trace"]

Julia versioninfo

Target

Julia Version 1.12.0-DEV.328
Commit 45fb084873b (2024-04-10 23:55 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.4 LTS
 uname: Linux 6.5.0-1017-azure #17~22.04.1-Ubuntu SMP Sat Mar 9 04:50:38 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 0 MHz 2212 s 0 s 276 s 6540 s 0 s
 #2 0 MHz 2777 s 0 s 273 s 6011 s 0 s
 #3 0 MHz 2254 s 0 s 283 s 6498 s 0 s
 #4 0 MHz 2228 s 0 s 301 s 6500 s 0 s
 Memory: 15.606498718261719 GB (13366.4921875 MB free)
 Uptime: 912.97 sec
 Load Avg: 1.07 1.11 0.81
 WORD_SIZE: 64
 LLVM: libLLVM-16.0.6 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline

Julia Version 1.12.0-DEV.328
Commit 45fb084873b (2024-04-10 23:55 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.4 LTS
 uname: Linux 6.5.0-1017-azure #17~22.04.1-Ubuntu SMP Sat Mar 9 04:50:38 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 0 MHz 3300 s 0 s 375 s 9629 s 0 s
 #2 0 MHz 3443 s 0 s 364 s 9529 s 0 s
 #3 0 MHz 3909 s 0 s 385 s 9020 s 0 s
 #4 0 MHz 3244 s 0 s 394 s 9672 s 0 s
 Memory: 15.606498718261719 GB (13209.2890625 MB free)
 Uptime: 1342.14 sec
 Load Avg: 1.0 1.07 0.93
 WORD_SIZE: 64
 LLVM: libLLVM-16.0.6 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Target result

Benchmark Report for /home/runner/work/QuantumClifford.jl/QuantumClifford.jl

Job Properties

  • Time of benchmark: 11 Apr 2024 - 5:55
  • Package commit: 15bac5
  • Julia commit: 45fb08
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks. The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to index into the BaseBenchmarks suite to retrieve the corresponding benchmarks. The percentages accompanying time and memory values in the below table are noise tolerances. The "true" time/memory value for a given benchmark is expected to fall within this percentage of the reported value. An empty cell means that the value was zero.

ID time GC time memory allocations
["circuitsim", "mctrajectories", "q1001_r1"] 14.857 ms (5%) 500.77 KiB (1%) 18019
["circuitsim", "mctrajectories", "q101_r1"] 155.913 μs (5%) 50.53 KiB (1%) 1818
["circuitsim", "mctrajectories_sumtype", "q1001_r1"] 13.267 ms (5%) 496 bytes (1%) 9
["circuitsim", "mctrajectories_sumtype", "q101_r1"] 117.421 μs (5%) 256 bytes (1%) 8
["circuitsim", "mctrajectories_union", "q1001_r1"] 13.118 ms (5%) 496 bytes (1%) 9
["circuitsim", "mctrajectories_union", "q101_r1"] 116.198 μs (5%) 256 bytes (1%) 8
["circuitsim", "pftrajectories", "q1001_r1"] 55.725 μs (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q1001_r100"] 171.062 μs (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q1001_r10000"] 1.098 ms (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q101_r1"] 6.011 μs (5%) 9.42 KiB (1%) 201
["circuitsim", "pftrajectories_sumtype", "q1001_r1"] 44.886 μs (5%) 93.84 KiB (1%) 2002
["circuitsim", "pftrajectories_sumtype", "q1001_r100"] 145.894 μs (5%) 93.84 KiB (1%) 2002
["circuitsim", "pftrajectories_sumtype", "q1001_r10000"] 1.087 ms (5%) 93.84 KiB (1%) 2002
["circuitsim", "pftrajectories_sumtype", "q1001_r10000_fastrow"] 5.853 ms (5%) 93.84 KiB (1%) 2002
["circuitsim", "pftrajectories_sumtype", "q101_r1"] 4.488 μs (5%) 9.47 KiB (1%) 202
["circuitsim", "pftrajectories_union", "q1001_r1"] 22.612 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q1001_r100"] 124.213 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q1001_r10000"] 996.864 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q101_r1"] 2.344 μs (5%) 96 bytes (1%) 2
["clifford", "dense", "cnot250_on_dense500_destab"] 11.340 ms (5%) 512 bytes (1%) 8
["clifford", "dense", "cnot250_on_dense500_stab"] 5.829 ms (5%) 512 bytes (1%) 8
["clifford", "dense", "cnot250_on_diag500_destab"] 1.123 ms (5%) 512 bytes (1%) 8
["clifford", "dense", "cnot250_on_diag500_stab"] 560.621 μs (5%) 512 bytes (1%) 8
["clifford", "dense", "cnot_on_dense500_destab"] 50.815 μs (5%) 368 bytes (1%) 10
["clifford", "dense", "cnot_on_dense500_stab"] 23.284 μs (5%) 368 bytes (1%) 10
["clifford", "dense", "cnot_on_diag500_destab"] 26.190 μs (5%) 368 bytes (1%) 10
["clifford", "dense", "cnot_on_diag500_stab"] 13.305 μs (5%) 368 bytes (1%) 10
["clifford", "dense", "dense500_on_dense500_destab"] 11.591 ms (5%) 512 bytes (1%) 8
["clifford", "dense", "dense500_on_dense500_stab"] 5.841 ms (5%) 512 bytes (1%) 8
["clifford", "dense", "dense500_on_diag500_destab"] 906.528 μs (5%) 512 bytes (1%) 8
["clifford", "dense", "dense500_on_diag500_stab"] 560.650 μs (5%) 512 bytes (1%) 8
["clifford", "symbolic", "cnot250_on_dense500_destab"] 1.347 ms (5%)
["clifford", "symbolic", "cnot250_on_dense500_stab"] 687.349 μs (5%)
["clifford", "symbolic", "cnot250_on_diag500_destab"] 1.161 ms (5%)
["clifford", "symbolic", "cnot250_on_diag500_stab"] 569.450 μs (5%)
["clifford", "symbolic", "cnot_on_dense500_destab"] 4.769 μs (5%)
["clifford", "symbolic", "cnot_on_dense500_stab"] 2.294 μs (5%)
["clifford", "symbolic", "cnot_on_diag500_destab"] 4.678 μs (5%)
["clifford", "symbolic", "cnot_on_diag500_stab"] 2.304 μs (5%)
["ecc", "evaluate_decoder", "shor_bp_comm"] 1.838 ms (5%) 1.77 MiB (1%) 42707
["ecc", "evaluate_decoder", "shor_bp_naivesyn"] 4.293 ms (5%) 3.64 MiB (1%) 82355
["ecc", "evaluate_decoder", "shor_bp_shorsyn"] 4.759 ms (5%) 3.74 MiB (1%) 83700
["ecc", "evaluate_decoder", "shor_pybp_comm"] 57.014 ms (5%) 4.76 MiB (1%) 144207
["ecc", "evaluate_decoder", "shor_pybp_naivesyn"] 146.434 ms (5%) 9.58 MiB (1%) 284515
["ecc", "evaluate_decoder", "shor_pybp_shorsyn"] 152.713 ms (5%) 9.69 MiB (1%) 285860
["ecc", "evaluate_decoder", "shor_table_comm"] 254.808 μs (5%) 241.42 KiB (1%) 4593
["ecc", "evaluate_decoder", "shor_table_naivesyn"] 1.065 ms (5%) 351.50 KiB (1%) 5287
["ecc", "evaluate_decoder", "shor_table_shorsyn"] 1.509 ms (5%) 457.11 KiB (1%) 6632
["ecc", "evaluate_decoder", "toric8_bp_comm"] 705.939 ms (5%) 15.394 ms 174.38 MiB (1%) 1045346
["ecc", "evaluate_decoder", "toric8_bp_naivesyn"] 1.381 s (5%) 34.260 ms 343.10 MiB (1%) 2089179
["ecc", "evaluate_decoder", "toric8_bp_shorsyn"] 1.362 s (5%) 24.640 ms 338.94 MiB (1%) 2088830
["ecc", "evaluate_decoder", "toric8_pybp_comm"] 465.414 ms (5%) 8.11 MiB (1%) 163696
["ecc", "evaluate_decoder", "toric8_pybp_naivesyn"] 975.840 ms (5%) 18.42 MiB (1%) 372135
["ecc", "evaluate_decoder", "toric8_pybp_shorsyn"] 983.176 ms (5%) 21.24 MiB (1%) 412834
["ecc", "evaluate_decoder", "toric8_pymatch_comm"] 4.174 ms (5%) 1.95 MiB (1%) 23176
["ecc", "evaluate_decoder", "toric8_pymatch_naivesyn"] 16.781 ms (5%) 5.95 MiB (1%) 91102
["ecc", "evaluate_decoder", "toric8_pymatch_shorsyn"] 25.891 ms (5%) 8.77 MiB (1%) 131801
["ecc", "evaluate_decoder", "toric8_table_comm"] 2.643 ms (5%) 1.64 MiB (1%) 23082
["ecc", "evaluate_decoder", "toric8_table_naivesyn"] 14.500 ms (5%) 5.30 MiB (1%) 90907
["ecc", "evaluate_decoder", "toric8_table_shorsyn"] 23.514 ms (5%) 8.12 MiB (1%) 131606
["pauli", "mul", "100"] 14.275 ns (5%)
["pauli", "mul", "1000"] 17.919 ns (5%)
["pauli", "mul", "100000"] 685.356 ns (5%)
["pauli", "mul", "20000000"] 185.147 μs (5%)
["stabilizer", "canon", "cano500"] 3.073 ms (5%)
["stabilizer", "canon", "diag_cano500"] 709.199 μs (5%)
["stabilizer", "canon", "diag_gott500"] 4.205 ms (5%) 5.19 MiB (1%) 34521
["stabilizer", "canon", "diag_rref500"] 627.085 μs (5%)
["stabilizer", "canon", "gott500"] 6.517 ms (5%) 5.19 MiB (1%) 34531
["stabilizer", "canon", "md_cano500"] 1.540 ms (5%)
["stabilizer", "canon", "md_rref500"] 1.576 ms (5%)
["stabilizer", "canon", "rref500"] 3.117 ms (5%)
["stabilizer", "project", "destabilizer"] 18.395 μs (5%) 288 bytes (1%) 5
["stabilizer", "project", "stabilizer"] 9.698 μs (5%) 80 bytes (1%) 2
["stabilizer", "tensor", "diag_pow5_20"] 1.210 ms (5%) 23.97 MiB (1%) 34
["stabilizer", "tensor", "pow5_20"] 2.734 μs (5%) 6.44 KiB (1%) 31
["stabilizer", "trace", "destabilizer"] 30.708 μs (5%) 80 bytes (1%) 2
["stabilizer", "trace", "stabilizer"] 24.115 μs (5%) 112 bytes (1%) 3

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["circuitsim", "mctrajectories"]
  • ["circuitsim", "mctrajectories_sumtype"]
  • ["circuitsim", "mctrajectories_union"]
  • ["circuitsim", "pftrajectories"]
  • ["circuitsim", "pftrajectories_sumtype"]
  • ["circuitsim", "pftrajectories_union"]
  • ["clifford", "dense"]
  • ["clifford", "symbolic"]
  • ["ecc", "evaluate_decoder"]
  • ["pauli", "mul"]
  • ["stabilizer", "canon"]
  • ["stabilizer", "project"]
  • ["stabilizer", "tensor"]
  • ["stabilizer", "trace"]

Julia versioninfo

Julia Version 1.12.0-DEV.328
Commit 45fb084873b (2024-04-10 23:55 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.4 LTS
 uname: Linux 6.5.0-1017-azure #17~22.04.1-Ubuntu SMP Sat Mar 9 04:50:38 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 0 MHz 2212 s 0 s 276 s 6540 s 0 s
 #2 0 MHz 2777 s 0 s 273 s 6011 s 0 s
 #3 0 MHz 2254 s 0 s 283 s 6498 s 0 s
 #4 0 MHz 2228 s 0 s 301 s 6500 s 0 s
 Memory: 15.606498718261719 GB (13366.4921875 MB free)
 Uptime: 912.97 sec
 Load Avg: 1.07 1.11 0.81
 WORD_SIZE: 64
 LLVM: libLLVM-16.0.6 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline result

Benchmark Report for /home/runner/work/QuantumClifford.jl/QuantumClifford.jl

Job Properties

  • Time of benchmark: 11 Apr 2024 - 6:2
  • Package commit: 64f695
  • Julia commit: 45fb08
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks. The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to index into the BaseBenchmarks suite to retrieve the corresponding benchmarks. The percentages accompanying time and memory values in the below table are noise tolerances. The "true" time/memory value for a given benchmark is expected to fall within this percentage of the reported value. An empty cell means that the value was zero.

ID time GC time memory allocations
["circuitsim", "mctrajectories", "q1001_r1"] 15.213 ms (5%) 500.77 KiB (1%) 18019
["circuitsim", "mctrajectories", "q101_r1"] 171.762 μs (5%) 50.53 KiB (1%) 1818
["circuitsim", "mctrajectories_sumtype", "q1001_r1"] 13.467 ms (5%) 496 bytes (1%) 9
["circuitsim", "mctrajectories_sumtype", "q101_r1"] 119.144 μs (5%) 256 bytes (1%) 8
["circuitsim", "mctrajectories_union", "q1001_r1"] 14.248 ms (5%) 496 bytes (1%) 9
["circuitsim", "mctrajectories_union", "q101_r1"] 117.821 μs (5%) 256 bytes (1%) 8
["circuitsim", "pftrajectories", "q1001_r1"] 59.532 μs (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q1001_r100"] 175.319 μs (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q1001_r10000"] 1.070 ms (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q101_r1"] 5.991 μs (5%) 9.42 KiB (1%) 201
["circuitsim", "pftrajectories_sumtype", "q1001_r1"] 44.924 μs (5%) 93.84 KiB (1%) 2002
["circuitsim", "pftrajectories_sumtype", "q1001_r100"] 157.706 μs (5%) 93.84 KiB (1%) 2002
["circuitsim", "pftrajectories_sumtype", "q1001_r10000"] 1.084 ms (5%) 93.84 KiB (1%) 2002
["circuitsim", "pftrajectories_sumtype", "q1001_r10000_fastrow"] 5.872 ms (5%) 93.84 KiB (1%) 2002
["circuitsim", "pftrajectories_sumtype", "q101_r1"] 4.519 μs (5%) 9.47 KiB (1%) 202
["circuitsim", "pftrajectories_union", "q1001_r1"] 23.214 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q1001_r100"] 134.482 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q1001_r10000"] 1.055 ms (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q101_r1"] 2.404 μs (5%) 96 bytes (1%) 2
["clifford", "dense", "cnot250_on_dense500_destab"] 11.593 ms (5%) 512 bytes (1%) 8
["clifford", "dense", "cnot250_on_dense500_stab"] 5.787 ms (5%) 512 bytes (1%) 8
["clifford", "dense", "cnot250_on_diag500_destab"] 1.123 ms (5%) 512 bytes (1%) 8
["clifford", "dense", "cnot250_on_diag500_stab"] 543.890 μs (5%) 512 bytes (1%) 8
["clifford", "dense", "cnot_on_dense500_destab"] 50.495 μs (5%) 368 bytes (1%) 10
["clifford", "dense", "cnot_on_dense500_stab"] 22.973 μs (5%) 368 bytes (1%) 10
["clifford", "dense", "cnot_on_diag500_destab"] 26.169 μs (5%) 368 bytes (1%) 10
["clifford", "dense", "cnot_on_diag500_stab"] 13.144 μs (5%) 368 bytes (1%) 10
["clifford", "dense", "dense500_on_dense500_destab"] 11.600 ms (5%) 512 bytes (1%) 8
["clifford", "dense", "dense500_on_dense500_stab"] 5.782 ms (5%) 512 bytes (1%) 8
["clifford", "dense", "dense500_on_diag500_destab"] 921.369 μs (5%) 512 bytes (1%) 8
["clifford", "dense", "dense500_on_diag500_stab"] 561.653 μs (5%) 512 bytes (1%) 8
["clifford", "symbolic", "cnot250_on_dense500_destab"] 1.373 ms (5%)
["clifford", "symbolic", "cnot250_on_dense500_stab"] 685.496 μs (5%)
["clifford", "symbolic", "cnot250_on_diag500_destab"] 1.161 ms (5%)
["clifford", "symbolic", "cnot250_on_diag500_stab"] 568.556 μs (5%)
["clifford", "symbolic", "cnot_on_dense500_destab"] 4.749 μs (5%)
["clifford", "symbolic", "cnot_on_dense500_stab"] 2.294 μs (5%)
["clifford", "symbolic", "cnot_on_diag500_destab"] 4.678 μs (5%)
["clifford", "symbolic", "cnot_on_diag500_stab"] 2.124 μs (5%)
["ecc", "evaluate_decoder", "shor_bp_comm"] 1.841 ms (5%) 1.77 MiB (1%) 42609
["ecc", "evaluate_decoder", "shor_bp_naivesyn"] 4.064 ms (5%) 3.61 MiB (1%) 81578
["ecc", "evaluate_decoder", "shor_bp_shorsyn"] 4.911 ms (5%) 3.81 MiB (1%) 85268
["ecc", "evaluate_decoder", "shor_pybp_comm"] 56.446 ms (5%) 4.76 MiB (1%) 144207
["ecc", "evaluate_decoder", "shor_pybp_naivesyn"] 139.949 ms (5%) 9.57 MiB (1%) 284018
["ecc", "evaluate_decoder", "shor_pybp_shorsyn"] 120.891 ms (5%) 9.66 MiB (1%) 285104
["ecc", "evaluate_decoder", "shor_table_comm"] 253.336 μs (5%) 241.42 KiB (1%) 4593
["ecc", "evaluate_decoder", "shor_table_naivesyn"] 861.939 μs (5%) 334.20 KiB (1%) 4790
["ecc", "evaluate_decoder", "shor_table_shorsyn"] 1.253 ms (5%) 427.73 KiB (1%) 5876
["ecc", "evaluate_decoder", "toric8_bp_comm"] 682.194 ms (5%) 11.414 ms 172.71 MiB (1%) 1035497
["ecc", "evaluate_decoder", "toric8_bp_naivesyn"] 1.406 s (5%) 23.828 ms 346.80 MiB (1%) 2101365
["ecc", "evaluate_decoder", "toric8_bp_shorsyn"] 1.424 s (5%) 26.518 ms 353.37 MiB (1%) 2157670
["ecc", "evaluate_decoder", "toric8_pybp_comm"] 470.647 ms (5%) 8.11 MiB (1%) 163696
["ecc", "evaluate_decoder", "toric8_pybp_naivesyn"] 957.503 ms (5%) 18.04 MiB (1%) 360388
["ecc", "evaluate_decoder", "toric8_pybp_shorsyn"] 934.000 ms (5%) 20.56 MiB (1%) 392802
["ecc", "evaluate_decoder", "toric8_pymatch_comm"] 4.176 ms (5%) 1.95 MiB (1%) 23176
["ecc", "evaluate_decoder", "toric8_pymatch_naivesyn"] 12.432 ms (5%) 5.58 MiB (1%) 79355
["ecc", "evaluate_decoder", "toric8_pymatch_shorsyn"] 20.914 ms (5%) 8.09 MiB (1%) 111769
["ecc", "evaluate_decoder", "toric8_table_comm"] 2.633 ms (5%) 1.64 MiB (1%) 23082
["ecc", "evaluate_decoder", "toric8_table_naivesyn"] 10.211 ms (5%) 4.93 MiB (1%) 79160
["ecc", "evaluate_decoder", "toric8_table_shorsyn"] 18.643 ms (5%) 7.44 MiB (1%) 111574
["pauli", "mul", "100"] 14.244 ns (5%)
["pauli", "mul", "1000"] 18.200 ns (5%)
["pauli", "mul", "100000"] 724.096 ns (5%)
["pauli", "mul", "20000000"] 183.033 μs (5%)
["stabilizer", "canon", "cano500"] 3.068 ms (5%)
["stabilizer", "canon", "diag_cano500"] 665.974 μs (5%)
["stabilizer", "canon", "diag_gott500"] 4.036 ms (5%) 5.19 MiB (1%) 34521
["stabilizer", "canon", "diag_rref500"] 722.125 μs (5%)
["stabilizer", "canon", "gott500"] 6.519 ms (5%) 5.19 MiB (1%) 34531
["stabilizer", "canon", "md_cano500"] 1.489 ms (5%)
["stabilizer", "canon", "md_rref500"] 1.627 ms (5%)
["stabilizer", "canon", "rref500"] 3.167 ms (5%)
["stabilizer", "project", "destabilizer"] 19.146 μs (5%) 288 bytes (1%) 5
["stabilizer", "project", "stabilizer"] 9.157 μs (5%) 80 bytes (1%) 2
["stabilizer", "tensor", "diag_pow5_20"] 1.348 ms (5%) 23.97 MiB (1%) 34
["stabilizer", "tensor", "pow5_20"] 2.856 μs (5%) 6.44 KiB (1%) 31
["stabilizer", "trace", "destabilizer"] 33.963 μs (5%) 80 bytes (1%) 2
["stabilizer", "trace", "stabilizer"] 24.666 μs (5%) 112 bytes (1%) 3

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["circuitsim", "mctrajectories"]
  • ["circuitsim", "mctrajectories_sumtype"]
  • ["circuitsim", "mctrajectories_union"]
  • ["circuitsim", "pftrajectories"]
  • ["circuitsim", "pftrajectories_sumtype"]
  • ["circuitsim", "pftrajectories_union"]
  • ["clifford", "dense"]
  • ["clifford", "symbolic"]
  • ["ecc", "evaluate_decoder"]
  • ["pauli", "mul"]
  • ["stabilizer", "canon"]
  • ["stabilizer", "project"]
  • ["stabilizer", "tensor"]
  • ["stabilizer", "trace"]

Julia versioninfo

Julia Version 1.12.0-DEV.328
Commit 45fb084873b (2024-04-10 23:55 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.4 LTS
 uname: Linux 6.5.0-1017-azure #17~22.04.1-Ubuntu SMP Sat Mar 9 04:50:38 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 0 MHz 3300 s 0 s 375 s 9629 s 0 s
 #2 0 MHz 3443 s 0 s 364 s 9529 s 0 s
 #3 0 MHz 3909 s 0 s 385 s 9020 s 0 s
 #4 0 MHz 3244 s 0 s 394 s 9672 s 0 s
 Memory: 15.606498718261719 GB (13209.2890625 MB free)
 Uptime: 1342.14 sec
 Load Avg: 1.0 1.07 0.93
 WORD_SIZE: 64
 LLVM: libLLVM-16.0.6 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Runtime information

Runtime Info
BLAS #threads 2
BLAS.vendor() lbt
Sys.CPU_THREADS 4

lscpu output:

Architecture: x86_64 CPU op-mode(s): 32-bit, 64-bit Address sizes: 48 bits physical, 48 bits virtual Byte Order: Little Endian CPU(s): 4 On-line CPU(s) list: 0-3 Vendor ID: AuthenticAMD Model name: AMD EPYC 7763 64-Core Processor CPU family: 25 Model: 1 Thread(s) per core: 2 Core(s) per socket: 2 Socket(s): 1 Stepping: 1 BogoMIPS: 4890.86 Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm constant_tsc rep_good nopl tsc_reliable nonstop_tsc cpuid extd_apicid aperfmperf pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext invpcid_single vmmcall fsgsbase bmi1 avx2 smep bmi2 erms invpcid rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr rdpru arat npt nrip_save tsc_scale vmcb_clean flushbyasid decodeassists pausefilter pfthreshold v_vmsave_vmload umip vaes vpclmulqdq rdpid fsrm Virtualization: AMD-V Hypervisor vendor: Microsoft Virtualization type: full L1d cache: 64 KiB (2 instances) L1i cache: 64 KiB (2 instances) L2 cache: 1 MiB (2 instances) L3 cache: 32 MiB (1 instance) NUMA node(s): 1 NUMA node0 CPU(s): 0-3 Vulnerability Gather data sampling: Not affected Vulnerability Itlb multihit: Not affected Vulnerability L1tf: Not affected Vulnerability Mds: Not affected Vulnerability Meltdown: Not affected Vulnerability Mmio stale data: Not affected Vulnerability Retbleed: Not affected Vulnerability Spec rstack overflow: Vulnerable: Safe RET, no microcode Vulnerability Spec store bypass: Vulnerable Vulnerability Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization Vulnerability Spectre v2: Mitigation; Retpolines, STIBP disabled, RSB filling, PBRSB-eIBRS Not affected Vulnerability Srbds: Not affected Vulnerability Tsx async abort: Not affected

Cpu Property Value
Brand AMD EPYC 7763 64-Core Processor
Vendor :AMD
Architecture :Unknown
Model Family: 0xaf, Model: 0x01, Stepping: 0x01, Type: 0x00
Cores 16 physical cores, 16 logical cores (on executing CPU)
No Hyperthreading hardware capability detected
Clock Frequencies Not supported by CPU
Data Cache Level 1:3 : (32, 512, 32768) kbytes
64 byte cache line size
Address Size 48 bits virtual, 48 bits physical
SIMD 256 bit = 32 byte max. SIMD vector size
Time Stamp Counter TSC is accessible via rdtsc
TSC runs at constant rate (invariant from clock frequency)
Perf. Monitoring Performance Monitoring Counters (PMC) are not supported
Hypervisor Yes, Microsoft
Benchmark Result

Judge result

Benchmark Report for /home/runner/work/QuantumClifford.jl/QuantumClifford.jl

Job Properties

  • Time of benchmarks:
  • Target: 17 Apr 2024 - 20:26
  • Baseline: 17 Apr 2024 - 20:33
  • Package commits:
  • Target: 17f9d5
  • Baseline: 64f695
  • Julia commits:
  • Target: 0f7674
  • Baseline: 0f7674
  • Julia command flags:
  • Target: None
  • Baseline: None
  • Environment variables:
  • Target: None
  • Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with :x:), while a ratio less than 1.0 denotes a possible improvement (marked with :white_check_mark:). Only significant results - results that indicate possible regressions or improvements - are shown below (thus, an empty table means that all benchmark results remained invariant between builds).

ID time ratio memory ratio
["circuitsim", "mctrajectories_union", "q1001_r1"] 1.06 (5%) :x: 1.00 (1%)
["circuitsim", "pftrajectories", "q1001_r1"] 1.09 (5%) :x: 1.00 (1%)
["circuitsim", "pftrajectories", "q1001_r100"] 1.06 (5%) :x: 1.00 (1%)
["circuitsim", "pftrajectories", "q1001_r10000"] 1.05 (5%) :x: 1.00 (1%)
["circuitsim", "pftrajectories", "q101_r1"] 1.09 (5%) :x: 1.00 (1%)
["circuitsim", "pftrajectories_sumtype", "q1001_r1"] 0.94 (5%) :white_check_mark: 1.00 (1%)
["circuitsim", "pftrajectories_sumtype", "q101_r1"] 0.94 (5%) :white_check_mark: 1.00 (1%)
["clifford", "dense", "cnot250_on_diag500_stab"] 0.87 (5%) :white_check_mark: 1.00 (1%)
["clifford", "dense", "cnot_on_dense500_stab"] 1.06 (5%) :x: 1.00 (1%)
["clifford", "dense", "dense500_on_diag500_stab"] 0.87 (5%) :white_check_mark: 1.00 (1%)
["ecc", "evaluate_decoder", "shor_bp_comm"] 1.05 (5%) :x: 1.01 (1%)
["ecc", "evaluate_decoder", "shor_bp_naivesyn"] 3.10 (5%) :x: 1.75 (1%) :x:
["ecc", "evaluate_decoder", "shor_bp_shorsyn"] 2.93 (5%) :x: 1.70 (1%) :x:
["ecc", "evaluate_decoder", "shor_pybp_comm"] 1.06 (5%) :x: 1.00 (1%)
["ecc", "evaluate_decoder", "shor_pybp_naivesyn"] 1.13 (5%) :x: 1.28 (1%) :x:
["ecc", "evaluate_decoder", "shor_pybp_shorsyn"] 1.23 (5%) :x: 1.28 (1%) :x:
["ecc", "evaluate_decoder", "shor_table_naivesyn"] 10.36 (5%) :x: 9.31 (1%) :x:
["ecc", "evaluate_decoder", "shor_table_shorsyn"] 7.40 (5%) :x: 7.51 (1%) :x:
["ecc", "evaluate_decoder", "toric8_bp_comm"] 0.99 (5%) 0.99 (1%) :white_check_mark:
["ecc", "evaluate_decoder", "toric8_bp_naivesyn"] 1.20 (5%) :x: 1.16 (1%) :x:
["ecc", "evaluate_decoder", "toric8_bp_shorsyn"] 1.18 (5%) :x: 1.15 (1%) :x:
["ecc", "evaluate_decoder", "toric8_pybp_naivesyn"] 1.22 (5%) :x: 3.89 (1%) :x:
["ecc", "evaluate_decoder", "toric8_pybp_shorsyn"] 1.28 (5%) :x: 3.54 (1%) :x:
["ecc", "evaluate_decoder", "toric8_pymatch_naivesyn"] 16.18 (5%) :x: 10.34 (1%) :x:
["ecc", "evaluate_decoder", "toric8_pymatch_shorsyn"] 10.08 (5%) :x: 7.46 (1%) :x:
["ecc", "evaluate_decoder", "toric8_table_naivesyn"] 19.49 (5%) :x: 11.57 (1%) :x:
["ecc", "evaluate_decoder", "toric8_table_shorsyn"] 11.36 (5%) :x: 8.02 (1%) :x:
["pauli", "mul", "20000000"] 1.10 (5%) :x: 1.00 (1%)
["stabilizer", "canon", "diag_rref500"] 0.93 (5%) :white_check_mark: 1.00 (1%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["circuitsim", "mctrajectories"]
  • ["circuitsim", "mctrajectories_sumtype"]
  • ["circuitsim", "mctrajectories_union"]
  • ["circuitsim", "pftrajectories"]
  • ["circuitsim", "pftrajectories_sumtype"]
  • ["circuitsim", "pftrajectories_union"]
  • ["clifford", "dense"]
  • ["clifford", "symbolic"]
  • ["ecc", "evaluate_decoder"]
  • ["pauli", "mul"]
  • ["stabilizer", "canon"]
  • ["stabilizer", "project"]
  • ["stabilizer", "tensor"]
  • ["stabilizer", "trace"]

Julia versioninfo

Target

Julia Version 1.12.0-DEV.361
Commit 0f7674e2266 (2024-04-17 14:44 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.4 LTS
 uname: Linux 6.5.0-1018-azure #19~22.04.2-Ubuntu SMP Thu Mar 21 16:45:46 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 0 MHz 2206 s 0 s 425 s 8021 s 0 s
 #2 0 MHz 2607 s 0 s 405 s 7656 s 0 s
 #3 0 MHz 2689 s 0 s 474 s 7493 s 0 s
 #4 0 MHz 3147 s 0 s 415 s 7112 s 0 s
 Memory: 15.606494903564453 GB (13372.5234375 MB free)
 Uptime: 1076.45 sec
 Load Avg: 1.14 1.37 0.97
 WORD_SIZE: 64
 LLVM: libLLVM-16.0.6 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline

Julia Version 1.12.0-DEV.361
Commit 0f7674e2266 (2024-04-17 14:44 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.4 LTS
 uname: Linux 6.5.0-1018-azure #19~22.04.2-Ubuntu SMP Thu Mar 21 16:45:46 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 0 MHz 3035 s 0 s 526 s 11365 s 0 s
 #2 0 MHz 3161 s 0 s 507 s 11276 s 0 s
 #3 0 MHz 4162 s 0 s 556 s 10223 s 0 s
 #4 0 MHz 4721 s 0 s 504 s 9734 s 0 s
 Memory: 15.606494903564453 GB (13258.21484375 MB free)
 Uptime: 1506.03 sec
 Load Avg: 1.0 1.12 1.0
 WORD_SIZE: 64
 LLVM: libLLVM-16.0.6 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Target result

Benchmark Report for /home/runner/work/QuantumClifford.jl/QuantumClifford.jl

Job Properties

  • Time of benchmark: 17 Apr 2024 - 20:26
  • Package commit: 17f9d5
  • Julia commit: 0f7674
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks. The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to index into the BaseBenchmarks suite to retrieve the corresponding benchmarks. The percentages accompanying time and memory values in the below table are noise tolerances. The "true" time/memory value for a given benchmark is expected to fall within this percentage of the reported value. An empty cell means that the value was zero.

ID time GC time memory allocations
["circuitsim", "mctrajectories", "q1001_r1"] 15.323 ms (5%) 500.77 KiB (1%) 18019
["circuitsim", "mctrajectories", "q101_r1"] 169.267 μs (5%) 50.53 KiB (1%) 1818
["circuitsim", "mctrajectories_sumtype", "q1001_r1"] 13.218 ms (5%) 496 bytes (1%) 9
["circuitsim", "mctrajectories_sumtype", "q101_r1"] 118.533 μs (5%) 256 bytes (1%) 8
["circuitsim", "mctrajectories_union", "q1001_r1"] 13.913 ms (5%) 496 bytes (1%) 9
["circuitsim", "mctrajectories_union", "q101_r1"] 117.191 μs (5%) 256 bytes (1%) 8
["circuitsim", "pftrajectories", "q1001_r1"] 64.761 μs (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q1001_r100"] 180.179 μs (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q1001_r10000"] 1.153 ms (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q101_r1"] 6.501 μs (5%) 9.42 KiB (1%) 201
["circuitsim", "pftrajectories_sumtype", "q1001_r1"] 42.059 μs (5%) 93.84 KiB (1%) 2002
["circuitsim", "pftrajectories_sumtype", "q1001_r100"] 158.108 μs (5%) 93.84 KiB (1%) 2002
["circuitsim", "pftrajectories_sumtype", "q1001_r10000"] 1.137 ms (5%) 93.84 KiB (1%) 2002
["circuitsim", "pftrajectories_sumtype", "q1001_r10000_fastrow"] 5.855 ms (5%) 93.84 KiB (1%) 2002
["circuitsim", "pftrajectories_sumtype", "q101_r1"] 4.208 μs (5%) 9.47 KiB (1%) 202
["circuitsim", "pftrajectories_union", "q1001_r1"] 22.602 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q1001_r100"] 136.766 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q1001_r10000"] 1.099 ms (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q101_r1"] 2.334 μs (5%) 96 bytes (1%) 2
["clifford", "dense", "cnot250_on_dense500_destab"] 11.610 ms (5%) 512 bytes (1%) 8
["clifford", "dense", "cnot250_on_dense500_stab"] 5.694 ms (5%) 512 bytes (1%) 8
["clifford", "dense", "cnot250_on_diag500_destab"] 1.122 ms (5%) 512 bytes (1%) 8
["clifford", "dense", "cnot250_on_diag500_stab"] 489.029 μs (5%) 512 bytes (1%) 8
["clifford", "dense", "cnot_on_dense500_destab"] 50.916 μs (5%) 368 bytes (1%) 10
["clifford", "dense", "cnot_on_dense500_stab"] 24.536 μs (5%) 368 bytes (1%) 10
["clifford", "dense", "cnot_on_diag500_destab"] 26.449 μs (5%) 368 bytes (1%) 10
["clifford", "dense", "cnot_on_diag500_stab"] 13.746 μs (5%) 368 bytes (1%) 10
["clifford", "dense", "dense500_on_dense500_destab"] 11.613 ms (5%) 512 bytes (1%) 8
["clifford", "dense", "dense500_on_dense500_stab"] 5.691 ms (5%) 512 bytes (1%) 8
["clifford", "dense", "dense500_on_diag500_destab"] 980.353 μs (5%) 512 bytes (1%) 8
["clifford", "dense", "dense500_on_diag500_stab"] 488.928 μs (5%) 512 bytes (1%) 8
["clifford", "symbolic", "cnot250_on_dense500_destab"] 1.439 ms (5%)
["clifford", "symbolic", "cnot250_on_dense500_stab"] 688.173 μs (5%)
["clifford", "symbolic", "cnot250_on_diag500_destab"] 1.161 ms (5%)
["clifford", "symbolic", "cnot250_on_diag500_stab"] 568.879 μs (5%)
["clifford", "symbolic", "cnot_on_dense500_destab"] 4.728 μs (5%)
["clifford", "symbolic", "cnot_on_dense500_stab"] 2.304 μs (5%)
["clifford", "symbolic", "cnot_on_diag500_destab"] 4.649 μs (5%)
["clifford", "symbolic", "cnot_on_diag500_stab"] 2.294 μs (5%)
["ecc", "evaluate_decoder", "shor_bp_comm"] 1.891 ms (5%) 1.78 MiB (1%) 42749
["ecc", "evaluate_decoder", "shor_bp_naivesyn"] 12.465 ms (5%) 6.35 MiB (1%) 103695
["ecc", "evaluate_decoder", "shor_bp_shorsyn"] 14.368 ms (5%) 6.43 MiB (1%) 104725
["ecc", "evaluate_decoder", "shor_pybp_comm"] 61.103 ms (5%) 4.76 MiB (1%) 144207
["ecc", "evaluate_decoder", "shor_pybp_naivesyn"] 150.920 ms (5%) 12.28 MiB (1%) 305574
["ecc", "evaluate_decoder", "shor_pybp_shorsyn"] 143.627 ms (5%) 12.37 MiB (1%) 306828
["ecc", "evaluate_decoder", "shor_table_comm"] 257.415 μs (5%) 241.42 KiB (1%) 4593
["ecc", "evaluate_decoder", "shor_table_naivesyn"] 9.017 ms (5%) 3.04 MiB (1%) 26346
["ecc", "evaluate_decoder", "shor_table_shorsyn"] 9.418 ms (5%) 3.14 MiB (1%) 27600
["ecc", "evaluate_decoder", "toric8_bp_comm"] 697.117 ms (5%) 13.566 ms 173.17 MiB (1%) 1038248
["ecc", "evaluate_decoder", "toric8_bp_naivesyn"] 1.656 s (5%) 39.423 ms 407.64 MiB (1%) 2570827
["ecc", "evaluate_decoder", "toric8_bp_shorsyn"] 1.645 s (5%) 38.518 ms 405.36 MiB (1%) 2581315
["ecc", "evaluate_decoder", "toric8_pybp_comm"] 456.527 ms (5%) 8.11 MiB (1%) 163696
["ecc", "evaluate_decoder", "toric8_pybp_naivesyn"] 1.176 s (5%) 70.12 MiB (1%) 778322
["ecc", "evaluate_decoder", "toric8_pybp_shorsyn"] 1.189 s (5%) 72.83 MiB (1%) 818092
["ecc", "evaluate_decoder", "toric8_pymatch_comm"] 4.262 ms (5%) 1.95 MiB (1%) 23176
["ecc", "evaluate_decoder", "toric8_pymatch_naivesyn"] 204.900 ms (5%) 4.517 ms 57.66 MiB (1%) 497289
["ecc", "evaluate_decoder", "toric8_pymatch_shorsyn"] 212.858 ms (5%) 60.36 MiB (1%) 537059
["ecc", "evaluate_decoder", "toric8_table_comm"] 2.658 ms (5%) 1.64 MiB (1%) 23082
["ecc", "evaluate_decoder", "toric8_table_naivesyn"] 200.300 ms (5%) 57.01 MiB (1%) 497094
["ecc", "evaluate_decoder", "toric8_table_shorsyn"] 212.644 ms (5%) 4.384 ms 59.71 MiB (1%) 536864
["pauli", "mul", "100"] 14.516 ns (5%)
["pauli", "mul", "1000"] 18.821 ns (5%)
["pauli", "mul", "100000"] 730.554 ns (5%)
["pauli", "mul", "20000000"] 190.698 μs (5%)
["stabilizer", "canon", "cano500"] 3.124 ms (5%)
["stabilizer", "canon", "diag_cano500"] 752.717 μs (5%)
["stabilizer", "canon", "diag_gott500"] 4.088 ms (5%) 5.19 MiB (1%) 34521
["stabilizer", "canon", "diag_rref500"] 626.789 μs (5%)
["stabilizer", "canon", "gott500"] 6.449 ms (5%) 5.19 MiB (1%) 34531
["stabilizer", "canon", "md_cano500"] 1.564 ms (5%)
["stabilizer", "canon", "md_rref500"] 1.585 ms (5%)
["stabilizer", "canon", "rref500"] 3.151 ms (5%)
["stabilizer", "project", "destabilizer"] 19.105 μs (5%) 288 bytes (1%) 5
["stabilizer", "project", "stabilizer"] 9.197 μs (5%) 80 bytes (1%) 2
["stabilizer", "tensor", "diag_pow5_20"] 1.238 ms (5%) 23.97 MiB (1%) 34
["stabilizer", "tensor", "pow5_20"] 2.850 μs (5%) 6.44 KiB (1%) 31
["stabilizer", "trace", "destabilizer"] 31.218 μs (5%) 80 bytes (1%) 2
["stabilizer", "trace", "stabilizer"] 24.647 μs (5%) 112 bytes (1%) 3

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["circuitsim", "mctrajectories"]
  • ["circuitsim", "mctrajectories_sumtype"]
  • ["circuitsim", "mctrajectories_union"]
  • ["circuitsim", "pftrajectories"]
  • ["circuitsim", "pftrajectories_sumtype"]
  • ["circuitsim", "pftrajectories_union"]
  • ["clifford", "dense"]
  • ["clifford", "symbolic"]
  • ["ecc", "evaluate_decoder"]
  • ["pauli", "mul"]
  • ["stabilizer", "canon"]
  • ["stabilizer", "project"]
  • ["stabilizer", "tensor"]
  • ["stabilizer", "trace"]

Julia versioninfo

Julia Version 1.12.0-DEV.361
Commit 0f7674e2266 (2024-04-17 14:44 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.4 LTS
 uname: Linux 6.5.0-1018-azure #19~22.04.2-Ubuntu SMP Thu Mar 21 16:45:46 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 0 MHz 2206 s 0 s 425 s 8021 s 0 s
 #2 0 MHz 2607 s 0 s 405 s 7656 s 0 s
 #3 0 MHz 2689 s 0 s 474 s 7493 s 0 s
 #4 0 MHz 3147 s 0 s 415 s 7112 s 0 s
 Memory: 15.606494903564453 GB (13372.5234375 MB free)
 Uptime: 1076.45 sec
 Load Avg: 1.14 1.37 0.97
 WORD_SIZE: 64
 LLVM: libLLVM-16.0.6 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline result

Benchmark Report for /home/runner/work/QuantumClifford.jl/QuantumClifford.jl

Job Properties

  • Time of benchmark: 17 Apr 2024 - 20:33
  • Package commit: 64f695
  • Julia commit: 0f7674
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks. The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to index into the BaseBenchmarks suite to retrieve the corresponding benchmarks. The percentages accompanying time and memory values in the below table are noise tolerances. The "true" time/memory value for a given benchmark is expected to fall within this percentage of the reported value. An empty cell means that the value was zero.

ID time GC time memory allocations
["circuitsim", "mctrajectories", "q1001_r1"] 15.093 ms (5%) 500.77 KiB (1%) 18019
["circuitsim", "mctrajectories", "q101_r1"] 171.101 μs (5%) 50.53 KiB (1%) 1818
["circuitsim", "mctrajectories_sumtype", "q1001_r1"] 13.197 ms (5%) 496 bytes (1%) 9
["circuitsim", "mctrajectories_sumtype", "q101_r1"] 118.533 μs (5%) 256 bytes (1%) 8
["circuitsim", "mctrajectories_union", "q1001_r1"] 13.069 ms (5%) 496 bytes (1%) 9
["circuitsim", "mctrajectories_union", "q101_r1"] 116.959 μs (5%) 256 bytes (1%) 8
["circuitsim", "pftrajectories", "q1001_r1"] 59.582 μs (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q1001_r100"] 170.780 μs (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q1001_r10000"] 1.097 ms (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q101_r1"] 5.991 μs (5%) 9.42 KiB (1%) 201
["circuitsim", "pftrajectories_sumtype", "q1001_r1"] 44.884 μs (5%) 93.84 KiB (1%) 2002
["circuitsim", "pftrajectories_sumtype", "q1001_r100"] 155.632 μs (5%) 93.84 KiB (1%) 2002
["circuitsim", "pftrajectories_sumtype", "q1001_r10000"] 1.085 ms (5%) 93.84 KiB (1%) 2002
["circuitsim", "pftrajectories_sumtype", "q1001_r10000_fastrow"] 5.832 ms (5%) 93.84 KiB (1%) 2002
["circuitsim", "pftrajectories_sumtype", "q101_r1"] 4.479 μs (5%) 9.47 KiB (1%) 202
["circuitsim", "pftrajectories_union", "q1001_r1"] 23.213 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q1001_r100"] 132.439 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q1001_r10000"] 1.054 ms (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q101_r1"] 2.394 μs (5%) 96 bytes (1%) 2
["clifford", "dense", "cnot250_on_dense500_destab"] 11.601 ms (5%) 512 bytes (1%) 8
["clifford", "dense", "cnot250_on_dense500_stab"] 5.843 ms (5%) 512 bytes (1%) 8
["clifford", "dense", "cnot250_on_diag500_destab"] 1.123 ms (5%) 512 bytes (1%) 8
["clifford", "dense", "cnot250_on_diag500_stab"] 560.525 μs (5%) 512 bytes (1%) 8
["clifford", "dense", "cnot_on_dense500_destab"] 50.876 μs (5%) 368 bytes (1%) 10
["clifford", "dense", "cnot_on_dense500_stab"] 23.213 μs (5%) 368 bytes (1%) 10
["clifford", "dense", "cnot_on_diag500_destab"] 26.500 μs (5%) 368 bytes (1%) 10
["clifford", "dense", "cnot_on_diag500_stab"] 13.385 μs (5%) 368 bytes (1%) 10
["clifford", "dense", "dense500_on_dense500_destab"] 11.585 ms (5%) 512 bytes (1%) 8
["clifford", "dense", "dense500_on_dense500_stab"] 5.850 ms (5%) 512 bytes (1%) 8
["clifford", "dense", "dense500_on_diag500_destab"] 980.166 μs (5%) 512 bytes (1%) 8
["clifford", "dense", "dense500_on_diag500_stab"] 560.533 μs (5%) 512 bytes (1%) 8
["clifford", "symbolic", "cnot250_on_dense500_destab"] 1.434 ms (5%)
["clifford", "symbolic", "cnot250_on_dense500_stab"] 687.624 μs (5%)
["clifford", "symbolic", "cnot250_on_diag500_destab"] 1.161 ms (5%)
["clifford", "symbolic", "cnot250_on_diag500_stab"] 569.600 μs (5%)
["clifford", "symbolic", "cnot_on_dense500_destab"] 4.738 μs (5%)
["clifford", "symbolic", "cnot_on_dense500_stab"] 2.314 μs (5%)
["clifford", "symbolic", "cnot_on_diag500_destab"] 4.659 μs (5%)
["clifford", "symbolic", "cnot_on_diag500_stab"] 2.304 μs (5%)
["ecc", "evaluate_decoder", "shor_bp_comm"] 1.794 ms (5%) 1.76 MiB (1%) 42371
["ecc", "evaluate_decoder", "shor_bp_naivesyn"] 4.016 ms (5%) 3.62 MiB (1%) 81844
["ecc", "evaluate_decoder", "shor_bp_shorsyn"] 4.907 ms (5%) 3.78 MiB (1%) 84722
["ecc", "evaluate_decoder", "shor_pybp_comm"] 57.732 ms (5%) 4.76 MiB (1%) 144207
["ecc", "evaluate_decoder", "shor_pybp_naivesyn"] 133.329 ms (5%) 9.57 MiB (1%) 284018
["ecc", "evaluate_decoder", "shor_pybp_shorsyn"] 116.459 ms (5%) 9.66 MiB (1%) 285104
["ecc", "evaluate_decoder", "shor_table_comm"] 255.590 μs (5%) 241.42 KiB (1%) 4593
["ecc", "evaluate_decoder", "shor_table_naivesyn"] 870.620 μs (5%) 334.20 KiB (1%) 4790
["ecc", "evaluate_decoder", "shor_table_shorsyn"] 1.272 ms (5%) 427.73 KiB (1%) 5876
["ecc", "evaluate_decoder", "toric8_bp_comm"] 703.838 ms (5%) 15.848 ms 175.14 MiB (1%) 1049812
["ecc", "evaluate_decoder", "toric8_bp_naivesyn"] 1.377 s (5%) 23.270 ms 350.42 MiB (1%) 2122652
["ecc", "evaluate_decoder", "toric8_bp_shorsyn"] 1.399 s (5%) 28.118 ms 352.36 MiB (1%) 2151699
["ecc", "evaluate_decoder", "toric8_pybp_comm"] 455.558 ms (5%) 8.11 MiB (1%) 163696
["ecc", "evaluate_decoder", "toric8_pybp_naivesyn"] 961.784 ms (5%) 18.04 MiB (1%) 360388
["ecc", "evaluate_decoder", "toric8_pybp_shorsyn"] 929.218 ms (5%) 20.56 MiB (1%) 392802
["ecc", "evaluate_decoder", "toric8_pymatch_comm"] 4.197 ms (5%) 1.95 MiB (1%) 23176
["ecc", "evaluate_decoder", "toric8_pymatch_naivesyn"] 12.663 ms (5%) 5.58 MiB (1%) 79355
["ecc", "evaluate_decoder", "toric8_pymatch_shorsyn"] 21.112 ms (5%) 8.09 MiB (1%) 111769
["ecc", "evaluate_decoder", "toric8_table_comm"] 2.624 ms (5%) 1.64 MiB (1%) 23082
["ecc", "evaluate_decoder", "toric8_table_naivesyn"] 10.275 ms (5%) 4.93 MiB (1%) 79160
["ecc", "evaluate_decoder", "toric8_table_shorsyn"] 18.715 ms (5%) 7.44 MiB (1%) 111574
["pauli", "mul", "100"] 14.215 ns (5%)
["pauli", "mul", "1000"] 18.259 ns (5%)
["pauli", "mul", "100000"] 732.860 ns (5%)
["pauli", "mul", "20000000"] 172.624 μs (5%)
["stabilizer", "canon", "cano500"] 3.082 ms (5%)
["stabilizer", "canon", "diag_cano500"] 752.891 μs (5%)
["stabilizer", "canon", "diag_gott500"] 4.141 ms (5%) 5.19 MiB (1%) 34521
["stabilizer", "canon", "diag_rref500"] 675.953 μs (5%)
["stabilizer", "canon", "gott500"] 6.487 ms (5%) 5.19 MiB (1%) 34531
["stabilizer", "canon", "md_cano500"] 1.547 ms (5%)
["stabilizer", "canon", "md_rref500"] 1.567 ms (5%)
["stabilizer", "canon", "rref500"] 3.143 ms (5%)
["stabilizer", "project", "destabilizer"] 18.445 μs (5%) 288 bytes (1%) 5
["stabilizer", "project", "stabilizer"] 9.318 μs (5%) 80 bytes (1%) 2
["stabilizer", "tensor", "diag_pow5_20"] 1.219 ms (5%) 23.97 MiB (1%) 34
["stabilizer", "tensor", "pow5_20"] 2.845 μs (5%) 6.44 KiB (1%) 31
["stabilizer", "trace", "destabilizer"] 31.309 μs (5%) 80 bytes (1%) 2
["stabilizer", "trace", "stabilizer"] 24.105 μs (5%) 112 bytes (1%) 3

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["circuitsim", "mctrajectories"]
  • ["circuitsim", "mctrajectories_sumtype"]
  • ["circuitsim", "mctrajectories_union"]
  • ["circuitsim", "pftrajectories"]
  • ["circuitsim", "pftrajectories_sumtype"]
  • ["circuitsim", "pftrajectories_union"]
  • ["clifford", "dense"]
  • ["clifford", "symbolic"]
  • ["ecc", "evaluate_decoder"]
  • ["pauli", "mul"]
  • ["stabilizer", "canon"]
  • ["stabilizer", "project"]
  • ["stabilizer", "tensor"]
  • ["stabilizer", "trace"]

Julia versioninfo

Julia Version 1.12.0-DEV.361
Commit 0f7674e2266 (2024-04-17 14:44 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.4 LTS
 uname: Linux 6.5.0-1018-azure #19~22.04.2-Ubuntu SMP Thu Mar 21 16:45:46 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 0 MHz 3035 s 0 s 526 s 11365 s 0 s
 #2 0 MHz 3161 s 0 s 507 s 11276 s 0 s
 #3 0 MHz 4162 s 0 s 556 s 10223 s 0 s
 #4 0 MHz 4721 s 0 s 504 s 9734 s 0 s
 Memory: 15.606494903564453 GB (13258.21484375 MB free)
 Uptime: 1506.03 sec
 Load Avg: 1.0 1.12 1.0
 WORD_SIZE: 64
 LLVM: libLLVM-16.0.6 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Runtime information

Runtime Info
BLAS #threads 2
BLAS.vendor() lbt
Sys.CPU_THREADS 4

lscpu output:

Architecture: x86_64 CPU op-mode(s): 32-bit, 64-bit Address sizes: 48 bits physical, 48 bits virtual Byte Order: Little Endian CPU(s): 4 On-line CPU(s) list: 0-3 Vendor ID: AuthenticAMD Model name: AMD EPYC 7763 64-Core Processor CPU family: 25 Model: 1 Thread(s) per core: 2 Core(s) per socket: 2 Socket(s): 1 Stepping: 1 BogoMIPS: 4890.87 Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx mmxext fxsr_opt pdpe1gb rdtscp lm constant_tsc rep_good nopl tsc_reliable nonstop_tsc cpuid extd_apicid aperfmperf pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm cmp_legacy svm cr8_legacy abm sse4a misalignsse 3dnowprefetch osvw topoext invpcid_single vmmcall fsgsbase bmi1 avx2 smep bmi2 erms invpcid rdseed adx smap clflushopt clwb sha_ni xsaveopt xsavec xgetbv1 xsaves clzero xsaveerptr rdpru arat npt nrip_save tsc_scale vmcb_clean flushbyasid decodeassists pausefilter pfthreshold v_vmsave_vmload umip vaes vpclmulqdq rdpid fsrm Virtualization: AMD-V Hypervisor vendor: Microsoft Virtualization type: full L1d cache: 64 KiB (2 instances) L1i cache: 64 KiB (2 instances) L2 cache: 1 MiB (2 instances) L3 cache: 32 MiB (1 instance) NUMA node(s): 1 NUMA node0 CPU(s): 0-3 Vulnerability Gather data sampling: Not affected Vulnerability Itlb multihit: Not affected Vulnerability L1tf: Not affected Vulnerability Mds: Not affected Vulnerability Meltdown: Not affected Vulnerability Mmio stale data: Not affected Vulnerability Retbleed: Not affected Vulnerability Spec rstack overflow: Vulnerable: Safe RET, no microcode Vulnerability Spec store bypass: Vulnerable Vulnerability Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization Vulnerability Spectre v2: Mitigation; Retpolines, STIBP disabled, RSB filling, PBRSB-eIBRS Not affected Vulnerability Srbds: Not affected Vulnerability Tsx async abort: Not affected

Cpu Property Value
Brand AMD EPYC 7763 64-Core Processor
Vendor :AMD
Architecture :Unknown
Model Family: 0xaf, Model: 0x01, Stepping: 0x01, Type: 0x00
Cores 16 physical cores, 16 logical cores (on executing CPU)
No Hyperthreading hardware capability detected
Clock Frequencies Not supported by CPU
Data Cache Level 1:3 : (32, 512, 32768) kbytes
64 byte cache line size
Address Size 48 bits virtual, 48 bits physical
SIMD 256 bit = 32 byte max. SIMD vector size
Time Stamp Counter TSC is accessible via rdtsc
TSC runs at constant rate (invariant from clock frequency)
Perf. Monitoring Performance Monitoring Counters (PMC) are not supported
Hypervisor Yes, Microsoft
Benchmark Result

Judge result

Benchmark Report for /home/runner/work/QuantumClifford.jl/QuantumClifford.jl

Job Properties

  • Time of benchmarks:
  • Target: 17 Apr 2024 - 20:39
  • Baseline: 17 Apr 2024 - 20:46
  • Package commits:
  • Target: 8e1fc7
  • Baseline: 64f695
  • Julia commits:
  • Target: 0f7674
  • Baseline: 0f7674
  • Julia command flags:
  • Target: None
  • Baseline: None
  • Environment variables:
  • Target: None
  • Baseline: None

Results

A ratio greater than 1.0 denotes a possible regression (marked with :x:), while a ratio less than 1.0 denotes a possible improvement (marked with :white_check_mark:). Only significant results - results that indicate possible regressions or improvements - are shown below (thus, an empty table means that all benchmark results remained invariant between builds).

ID time ratio memory ratio
["circuitsim", "mctrajectories_union", "q1001_r1"] 0.95 (5%) :white_check_mark: 1.00 (1%)
["circuitsim", "pftrajectories_sumtype", "q1001_r1"] 0.90 (5%) :white_check_mark: 1.00 (1%)
["circuitsim", "pftrajectories_sumtype", "q1001_r100"] 0.95 (5%) :white_check_mark: 1.00 (1%)
["circuitsim", "pftrajectories_sumtype", "q1001_r10000_fastrow"] 0.94 (5%) :white_check_mark: 1.00 (1%)
["circuitsim", "pftrajectories_sumtype", "q101_r1"] 0.87 (5%) :white_check_mark: 1.00 (1%)
["circuitsim", "pftrajectories_union", "q101_r1"] 0.91 (5%) :white_check_mark: 1.00 (1%)
["clifford", "dense", "cnot250_on_diag500_destab"] 0.93 (5%) :white_check_mark: 1.00 (1%)
["clifford", "dense", "cnot_on_dense500_destab"] 0.94 (5%) :white_check_mark: 1.00 (1%)
["ecc", "evaluate_decoder", "shor_bp_naivesyn"] 3.36 (5%) :x: 1.75 (1%) :x:
["ecc", "evaluate_decoder", "shor_bp_shorsyn"] 2.81 (5%) :x: 1.70 (1%) :x:
["ecc", "evaluate_decoder", "shor_pybp_naivesyn"] 0.95 (5%) :white_check_mark: 1.28 (1%) :x:
["ecc", "evaluate_decoder", "shor_pybp_shorsyn"] 1.11 (5%) :x: 1.28 (1%) :x:
["ecc", "evaluate_decoder", "shor_table_naivesyn"] 10.15 (5%) :x: 9.31 (1%) :x:
["ecc", "evaluate_decoder", "shor_table_shorsyn"] 7.06 (5%) :x: 7.51 (1%) :x:
["ecc", "evaluate_decoder", "toric8_bp_comm"] 1.01 (5%) 1.02 (1%) :x:
["ecc", "evaluate_decoder", "toric8_bp_naivesyn"] 1.21 (5%) :x: 1.17 (1%) :x:
["ecc", "evaluate_decoder", "toric8_bp_shorsyn"] 1.17 (5%) :x: 1.18 (1%) :x:
["ecc", "evaluate_decoder", "toric8_pybp_naivesyn"] 1.21 (5%) :x: 3.89 (1%) :x:
["ecc", "evaluate_decoder", "toric8_pybp_shorsyn"] 1.15 (5%) :x: 3.54 (1%) :x:
["ecc", "evaluate_decoder", "toric8_pymatch_naivesyn"] 15.08 (5%) :x: 10.34 (1%) :x:
["ecc", "evaluate_decoder", "toric8_pymatch_shorsyn"] 9.42 (5%) :x: 7.46 (1%) :x:
["ecc", "evaluate_decoder", "toric8_table_naivesyn"] 15.63 (5%) :x: 11.57 (1%) :x:
["ecc", "evaluate_decoder", "toric8_table_shorsyn"] 10.14 (5%) :x: 8.02 (1%) :x:
["stabilizer", "canon", "diag_cano500"] 1.11 (5%) :x: 1.00 (1%)
["stabilizer", "project", "stabilizer"] 1.07 (5%) :x: 1.00 (1%)
["stabilizer", "tensor", "diag_pow5_20"] 0.90 (5%) :white_check_mark: 1.00 (1%)
["stabilizer", "trace", "destabilizer"] 0.91 (5%) :white_check_mark: 1.00 (1%)

Benchmark Group List

Here's a list of all the benchmark groups executed by this job:

  • ["circuitsim", "mctrajectories"]
  • ["circuitsim", "mctrajectories_sumtype"]
  • ["circuitsim", "mctrajectories_union"]
  • ["circuitsim", "pftrajectories"]
  • ["circuitsim", "pftrajectories_sumtype"]
  • ["circuitsim", "pftrajectories_union"]
  • ["clifford", "dense"]
  • ["clifford", "symbolic"]
  • ["ecc", "evaluate_decoder"]
  • ["pauli", "mul"]
  • ["stabilizer", "canon"]
  • ["stabilizer", "project"]
  • ["stabilizer", "tensor"]
  • ["stabilizer", "trace"]

Julia versioninfo

Target

Julia Version 1.12.0-DEV.361
Commit 0f7674e2266 (2024-04-17 14:44 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.4 LTS
 uname: Linux 6.5.0-1018-azure #19~22.04.2-Ubuntu SMP Thu Mar 21 16:45:46 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 0 MHz 2990 s 0 s 426 s 6658 s 0 s
 #2 0 MHz 2786 s 0 s 379 s 6905 s 0 s
 #3 0 MHz 2358 s 0 s 454 s 7256 s 0 s
 #4 0 MHz 2489 s 0 s 417 s 7188 s 0 s
 Memory: 15.606494903564453 GB (13364.25390625 MB free)
 Uptime: 1016.34 sec
 Load Avg: 1.01 1.27 0.92
 WORD_SIZE: 64
 LLVM: libLLVM-16.0.6 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Baseline

Julia Version 1.12.0-DEV.361
Commit 0f7674e2266 (2024-04-17 14:44 UTC)
Build Info:
 Official https://julialang.org/ release
Platform Info:
 OS: Linux (x86_64-linux-gnu)
 Ubuntu 22.04.4 LTS
 uname: Linux 6.5.0-1018-azure #19~22.04.2-Ubuntu SMP Thu Mar 21 16:45:46 UTC 2024 x86_64 x86_64
 CPU: AMD EPYC 7763 64-Core Processor: 
 speed user nice sys idle irq
 #1 0 MHz 3816 s 0 s 521 s 10042 s 0 s
 #2 0 MHz 3733 s 0 s 477 s 10166 s 0 s
 #3 0 MHz 3491 s 0 s 560 s 10324 s 0 s
 #4 0 MHz 4042 s 0 s 501 s 9862 s 0 s
 Memory: 15.606494903564453 GB (13230.83203125 MB free)
 Uptime: 1448.54 sec
 Load Avg: 1.01 1.15 1.0
 WORD_SIZE: 64
 LLVM: libLLVM-16.0.6 (ORCJIT, znver3)
Threads: 1 default, 0 interactive, 1 GC (on 4 virtual cores)

Target result

Benchmark Report for /home/runner/work/QuantumClifford.jl/QuantumClifford.jl

Job Properties

  • Time of benchmark: 17 Apr 2024 - 20:39
  • Package commit: 8e1fc7
  • Julia commit: 0f7674
  • Julia command flags: None
  • Environment variables: None

Results

Below is a table of this job's results, obtained by running the benchmarks. The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to index into the BaseBenchmarks suite to retrieve the corresponding benchmarks. The percentages accompanying time and memory values in the below table are noise tolerances. The "true" time/memory value for a given benchmark is expected to fall within this percentage of the reported value. An empty cell means that the value was zero.

ID time GC time memory allocations
["circuitsim", "mctrajectories", "q1001_r1"] 14.927 ms (5%) 500.77 KiB (1%) 18019
["circuitsim", "mctrajectories", "q101_r1"] 158.104 μs (5%) 50.53 KiB (1%) 1818
["circuitsim", "mctrajectories_sumtype", "q1001_r1"] 13.528 ms (5%) 496 bytes (1%) 9
["circuitsim", "mctrajectories_sumtype", "q101_r1"] 109.514 μs (5%) 256 bytes (1%) 8
["circuitsim", "mctrajectories_union", "q1001_r1"] 12.961 ms (5%) 496 bytes (1%) 9
["circuitsim", "mctrajectories_union", "q101_r1"] 108.062 μs (5%) 256 bytes (1%) 8
["circuitsim", "pftrajectories", "q1001_r1"] 56.555 μs (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q1001_r100"] 158.705 μs (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q1001_r10000"] 1.016 ms (5%) 93.80 KiB (1%) 2001
["circuitsim", "pftrajectories", "q101_r1"] 5.630 μs (5%) 9.42 KiB (1%) 201
["circuitsim", "pftrajectories_sumtype", "q1001_r1"] 38.783 μs (5%) 93.84 KiB (1%) 2002
["circuitsim", "pftrajectories_sumtype", "q1001_r100"] 140.041 μs (5%) 93.84 KiB (1%) 2002
["circuitsim", "pftrajectories_sumtype", "q1001_r10000"] 1.026 ms (5%) 93.84 KiB (1%) 2002
["circuitsim", "pftrajectories_sumtype", "q1001_r10000_fastrow"] 5.534 ms (5%) 93.84 KiB (1%) 2002
["circuitsim", "pftrajectories_sumtype", "q101_r1"] 3.857 μs (5%) 9.47 KiB (1%) 202
["circuitsim", "pftrajectories_union", "q1001_r1"] 20.848 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q1001_r100"] 122.227 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q1001_r10000"] 978.594 μs (5%) 96 bytes (1%) 2
["circuitsim", "pftrajectories_union", "q101_r1"] 2.154 μs (5%) 96 bytes (1%) 2
["clifford", "dense", "cnot250_on_dense500_destab"] 10.911 ms (5%) 512 bytes (1%) 8
["clifford", "dense", "cnot250_on_dense500_stab"] 5.395 ms (5%) 512 bytes (1%) 8
["clifford", "dense", "cnot250_on_diag500_destab"] 1.035 ms (5%) 512 bytes (1%) 8
["clifford", "dense", "cnot250_on_diag500_stab"] 516.673 μs (5%) 512 bytes (1%) 8
["clifford", "dense", "cnot_on_dense500_destab"] 47.558 μs (5%) 368 bytes (1%) 10
["clifford", "dense", "cnot_on_dense500_stab"] 22.542 μs (5%) 368 bytes (1%) 10
["clifford", "dense", "cnot_on_diag500_destab"] 24.296 μs (5%) 368 bytes (1%) 10
["clifford", "dense", "cnot_on_diag500_stab"] 12.764 μs (5%) 368 bytes (1%) 10
["clifford", "dense", "dense500_on_dense500_destab"] 10.903 ms (5%) 512 bytes (1%) 8
["clifford", "dense", "dense500_on_dense500_stab"] 5.372 ms (5%) 512 bytes (1%) 8
["clifford", "dense", "dense500_on_diag500_destab"] 904.295 μs (5%) 512 bytes (1%) 8
["clifford", "dense", "dense500_on_diag500_stab"] 516.643 μs (5%) 512 bytes (1%) 8
["clifford", "symbolic", "cnot250_on_dense500_destab"] 1.324 ms (5%)
["clifford", "symbolic", "cnot250_on_dense500_stab"] 633.620 μs (5%)
["clifford", "symbolic", "cnot250_on_diag500_destab"] 1.070 ms (5%)
["clifford", "symbolic", "cnot250_on_diag500_stab"] 525.118 μs (5%)
["clifford", "symbolic", "cnot_on_dense500_destab"] 4.448 μs (5%)
["clifford", "symbolic", "cnot_on_dense500_stab"] 2.304 μs (5%)
["clifford", "symbolic", "cnot_on_diag500_destab"] 4.328 μs (5%)
["clifford", "symbolic", "cnot_on_diag500_stab"] 2.113 μs (5%)
["ecc", "evaluate_decoder", "shor_bp_comm"] 1.690 ms (5%) 1.76 MiB (1%) 42301
["ecc", "evaluate_decoder", "shor_bp_naivesyn"] 13.085 ms (5%) 6.34 MiB (1%) 103485
["ecc", "evaluate_decoder", "shor_bp_shorsyn"] 13.680 ms (5%) 6.44 MiB (1%) 104963
["ecc", "evaluate_decoder", "shor_pybp_comm"] 69.984 ms (5%) 4.76 MiB (1%) 144207
["ecc", "evaluate_decoder", "shor_pybp_naivesyn"] 164.259 ms (5%) 12.28 MiB (1%) 305574
["ecc", "evaluate_decoder", "shor_pybp_shorsyn"] 149....[Comment body truncated]

github-actions[bot] avatar Apr 11 '24 06:04 github-actions[bot]