Transducers.jl
Transducers.jl copied to clipboard
Published
20 hours ago •
JuliaFolds
JuliaFolds
Update */Manifest.toml
Codecov Report
Merging #243 into master will not change coverage. The diff coverage is
n/a.
@@ Coverage Diff @@
## master #243 +/- ##
=======================================
Coverage 90.17% 90.17%
=======================================
Files 20 20
Lines 1395 1395
=======================================
Hits 1258 1258
Misses 137 137
Continue to review full report at Codecov.
Legend - Click here to learn more
Δ = absolute <relative> (impact),ø = not affected,? = missing dataPowered by Codecov. Last update d8a2512...d8a2512. Read the comment docs.
Benchmark result
Judge result
Benchmark Report for /home/runner/work/Transducers.jl/Transducers.jl
Job Properties
- Time of benchmarks:
- Target: 5 Mar 2020 - 07:16
- Baseline: 5 Mar 2020 - 07:19
- Package commits:
- Target: 747582
- Baseline: f62c6a
- Julia commits:
- Target: 2d5741
- Baseline: 2d5741
- Julia command flags:
- Target: None
- Baseline: None
- Environment variables:
- Target:
OMP_NUM_THREADS => 1JULIA_NUM_THREADS => 1 - Baseline:
OMP_NUM_THREADS => 1JULIA_NUM_THREADS => 1
- Target:
Results
A ratio greater than 1.0 denotes a possible regression (marked with :x:), while a ratio less
than 1.0 denotes a possible improvement (marked with :white_check_mark:). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).
| ID | time ratio | memory ratio |
|---|---|---|
["filter_map_map!", "xf"] |
0.85 (5%) :white_check_mark: | 1.00 (1%) |
["gemm", "fusedmul", "xf", "16"] |
0.92 (5%) :white_check_mark: | 1.00 (1%) |
["gemm", "fusedmul", "xf", "32"] |
0.89 (5%) :white_check_mark: | 1.00 (1%) |
["gemm", "mul", "linalg", "8"] |
1.15 (5%) :x: | 1.00 (1%) |
["gemm", "mul", "man", "false", "256"] |
1.08 (5%) :x: | 1.00 (1%) |
["gemm", "mul", "man", "false", "8"] |
0.73 (5%) :white_check_mark: | 1.00 (1%) |
["gemm", "mul", "man", "ivdep", "256"] |
1.06 (5%) :x: | 1.00 (1%) |
["gemm", "mul", "man", "ivdep", "8"] |
1.06 (5%) :x: | 1.00 (1%) |
["gemm", "mul", "man", "true", "256"] |
1.08 (5%) :x: | 1.00 (1%) |
["gemm", "mul", "man", "true", "8"] |
1.22 (5%) :x: | 1.00 (1%) |
["gemm", "mul", "xf", "false", "256"] |
1.08 (5%) :x: | 1.00 (1%) |
["gemm", "mul", "xf", "false", "8"] |
0.91 (5%) :white_check_mark: | 1.00 (1%) |
["gemm", "mul", "xf", "ivdep", "256"] |
1.05 (5%) :x: | 1.00 (1%) |
["gemm", "mul", "xf", "true", "256"] |
1.08 (5%) :x: | 1.00 (1%) |
["gemm", "mul", "xf", "true", "8"] |
1.06 (5%) :x: | 1.00 (1%) |
["missing_dot", "equiv"] |
0.95 (5%) :white_check_mark: | 1.00 (1%) |
Benchmark Group List
Here's a list of all the benchmark groups executed by this job:
-
["cat"] -
["collect"] -
["dot"] -
["filter_map_map!"] -
["filter_map_reduce"] -
["findall"] -
["gemm", "fusedmul", "blas"] -
["gemm", "fusedmul", "xf"] -
["gemm", "mul", "linalg"] -
["gemm", "mul", "man", "false"] -
["gemm", "mul", "man", "ivdep"] -
["gemm", "mul", "man", "true"] -
["gemm", "mul", "xf", "false"] -
["gemm", "mul", "xf", "ivdep"] -
["gemm", "mul", "xf", "true"] -
["missing_argmax"] -
["missing_dot"] -
["partition_by"]
Julia versioninfo
Target
Julia Version 1.3.1
Commit 2d5741174c (2019-12-30 21:36 UTC)
Platform Info:
OS: Linux (x86_64-pc-linux-gnu)
Ubuntu 18.04.4 LTS
uname: Linux 5.0.0-1032-azure #34-Ubuntu SMP Mon Feb 10 19:37:25 UTC 2020 x86_64 x86_64
CPU: Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz:
speed user nice sys idle irq
#1 2095 MHz 13588 s 0 s 1078 s 37399 s 0 s
#2 2095 MHz 36312 s 0 s 1198 s 14837 s 0 s
Memory: 6.782737731933594 GB (3485.9453125 MB free)
Uptime: 538.0 sec
Load Avg: 1.01904296875 0.9296875 0.52734375
WORD_SIZE: 64
LIBM: libopenlibm
LLVM: libLLVM-6.0.1 (ORCJIT, skylake)
Baseline
Julia Version 1.3.1
Commit 2d5741174c (2019-12-30 21:36 UTC)
Platform Info:
OS: Linux (x86_64-pc-linux-gnu)
Ubuntu 18.04.4 LTS
uname: Linux 5.0.0-1032-azure #34-Ubuntu SMP Mon Feb 10 19:37:25 UTC 2020 x86_64 x86_64
CPU: Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz:
speed user nice sys idle irq
#1 2095 MHz 27445 s 0 s 1183 s 45716 s 0 s
#2 2095 MHz 44674 s 0 s 1400 s 28544 s 0 s
Memory: 6.782737731933594 GB (3456.84765625 MB free)
Uptime: 762.0 sec
Load Avg: 1.046875 0.99072265625 0.64453125
WORD_SIZE: 64
LIBM: libopenlibm
LLVM: libLLVM-6.0.1 (ORCJIT, skylake)
Target result
Benchmark Report for /home/runner/work/Transducers.jl/Transducers.jl
Job Properties
- Time of benchmark: 5 Mar 2020 - 7:16
- Package commit: 747582
- Julia commit: 2d5741
- Julia command flags: None
- Environment variables:
OMP_NUM_THREADS => 1JULIA_NUM_THREADS => 1
Results
Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.
| ID | time | GC time | memory | allocations |
|---|---|---|---|---|
["cat", "base"] |
192.906 μs (5%) | |||
["cat", "xf"] |
1.420 μs (5%) | |||
["collect", "filter-missing"] |
78.203 μs (5%) | 33.05 KiB (1%) | 20 | |
["collect", "identity-float"] |
57.602 μs (5%) | 256.91 KiB (1%) | 20 | |
["collect", "identity-union"] |
275.408 μs (5%) | 285.45 KiB (1%) | 6659 | |
["dot", "blas"] |
1.010 μs (5%) | |||
["dot", "man"] |
980.100 ns (5%) | |||
["dot", "rf"] |
1.790 μs (5%) | |||
["dot", "xf"] |
1.780 μs (5%) | |||
["filter_map_map!", "man"] |
53.205 μs (5%) | |||
["filter_map_map!", "xf"] |
60.905 μs (5%) | 144 bytes (1%) | 8 | |
["filter_map_reduce", "man"] |
191.706 μs (5%) | |||
["filter_map_reduce", "xf"] |
191.806 μs (5%) | |||
["findall", "base"] |
679.224 μs (5%) | 2.00 MiB (1%) | 21 | |
["findall", "xf-array"] |
517.218 μs (5%) | 3.05 MiB (1%) | 100015 | |
["findall", "xf-iter"] |
656.322 μs (5%) | 2.00 MiB (1%) | 29 | |
["gemm", "fusedmul", "blas", "16"] |
3.801 ms (5%) | |||
["gemm", "fusedmul", "blas", "2"] |
2.922 ms (5%) | |||
["gemm", "fusedmul", "blas", "32"] |
5.151 ms (5%) | |||
["gemm", "fusedmul", "blas", "8"] |
3.016 ms (5%) | |||
["gemm", "fusedmul", "xf", "16"] |
4.167 ms (5%) | 160 bytes (1%) | 6 | |
["gemm", "fusedmul", "xf", "2"] |
531.545 μs (5%) | 160 bytes (1%) | 6 | |
["gemm", "fusedmul", "xf", "32"] |
8.445 ms (5%) | 160 bytes (1%) | 6 | |
["gemm", "fusedmul", "xf", "8"] |
2.208 ms (5%) | 160 bytes (1%) | 6 | |
["gemm", "mul", "linalg", "256"] |
757.222 μs (5%) | |||
["gemm", "mul", "linalg", "32"] |
2.511 μs (5%) | |||
["gemm", "mul", "linalg", "8"] |
229.789 ns (5%) | |||
["gemm", "mul", "man", "false", "256"] |
1.468 ms (5%) | |||
["gemm", "mul", "man", "false", "32"] |
3.800 μs (5%) | |||
["gemm", "mul", "man", "false", "8"] |
363.976 ns (5%) | |||
["gemm", "mul", "man", "ivdep", "256"] |
1.451 ms (5%) | |||
["gemm", "mul", "man", "ivdep", "32"] |
3.300 μs (5%) | |||
["gemm", "mul", "man", "ivdep", "8"] |
317.103 ns (5%) | |||
["gemm", "mul", "man", "true", "256"] |
1.470 ms (5%) | |||
["gemm", "mul", "man", "true", "32"] |
4.214 μs (5%) | |||
["gemm", "mul", "man", "true", "8"] |
367.317 ns (5%) | |||
["gemm", "mul", "xf", "false", "256"] |
1.463 ms (5%) | 48 bytes (1%) | 2 | |
["gemm", "mul", "xf", "false", "32"] |
3.638 μs (5%) | 48 bytes (1%) | 2 | |
["gemm", "mul", "xf", "false", "8"] |
364.834 ns (5%) | 48 bytes (1%) | 2 | |
["gemm", "mul", "xf", "ivdep", "256"] |
1.444 ms (5%) | 48 bytes (1%) | 2 | |
["gemm", "mul", "xf", "ivdep", "32"] |
3.163 μs (5%) | 48 bytes (1%) | 2 | |
["gemm", "mul", "xf", "ivdep", "8"] |
303.594 ns (5%) | 48 bytes (1%) | 2 | |
["gemm", "mul", "xf", "true", "256"] |
1.462 ms (5%) | 48 bytes (1%) | 2 | |
["gemm", "mul", "xf", "true", "32"] |
3.850 μs (5%) | 48 bytes (1%) | 2 | |
["gemm", "mul", "xf", "true", "8"] |
318.812 ns (5%) | 48 bytes (1%) | 2 | |
["missing_argmax", "man"] |
2.233 μs (5%) | 32 bytes (1%) | 1 | |
["missing_argmax", "rf"] |
2.145 μs (5%) | 32 bytes (1%) | 1 | |
["missing_argmax", "xf"] |
2.111 μs (5%) | 32 bytes (1%) | 1 | |
["missing_dot", "equiv"] |
1.210 μs (5%) | 16 bytes (1%) | 1 | |
["missing_dot", "man"] |
1.120 μs (5%) | 16 bytes (1%) | 1 | |
["missing_dot", "naive"] |
3.938 μs (5%) | 16 bytes (1%) | 1 | |
["missing_dot", "rf"] |
1.150 μs (5%) | 16 bytes (1%) | 1 | |
["missing_dot", "rf_nota"] |
1.260 μs (5%) | 16 bytes (1%) | 1 | |
["missing_dot", "xf"] |
179.505 μs (5%) | 73.95 KiB (1%) | 3859 | |
["missing_dot", "xf_nota"] |
179.405 μs (5%) | 74.05 KiB (1%) | 3864 | |
["partition_by", "man"] |
1.643 ms (5%) | 352 bytes (1%) | 4 | |
["partition_by", "xf"] |
1.530 ms (5%) | 576 bytes (1%) | 7 |
Benchmark Group List
Here's a list of all the benchmark groups executed by this job:
-
["cat"] -
["collect"] -
["dot"] -
["filter_map_map!"] -
["filter_map_reduce"] -
["findall"] -
["gemm", "fusedmul", "blas"] -
["gemm", "fusedmul", "xf"] -
["gemm", "mul", "linalg"] -
["gemm", "mul", "man", "false"] -
["gemm", "mul", "man", "ivdep"] -
["gemm", "mul", "man", "true"] -
["gemm", "mul", "xf", "false"] -
["gemm", "mul", "xf", "ivdep"] -
["gemm", "mul", "xf", "true"] -
["missing_argmax"] -
["missing_dot"] -
["partition_by"]
Julia versioninfo
Julia Version 1.3.1
Commit 2d5741174c (2019-12-30 21:36 UTC)
Platform Info:
OS: Linux (x86_64-pc-linux-gnu)
Ubuntu 18.04.4 LTS
uname: Linux 5.0.0-1032-azure #34-Ubuntu SMP Mon Feb 10 19:37:25 UTC 2020 x86_64 x86_64
CPU: Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz:
speed user nice sys idle irq
#1 2095 MHz 13588 s 0 s 1078 s 37399 s 0 s
#2 2095 MHz 36312 s 0 s 1198 s 14837 s 0 s
Memory: 6.782737731933594 GB (3485.9453125 MB free)
Uptime: 538.0 sec
Load Avg: 1.01904296875 0.9296875 0.52734375
WORD_SIZE: 64
LIBM: libopenlibm
LLVM: libLLVM-6.0.1 (ORCJIT, skylake)
Baseline result
Benchmark Report for /home/runner/work/Transducers.jl/Transducers.jl
Job Properties
- Time of benchmark: 5 Mar 2020 - 7:19
- Package commit: f62c6a
- Julia commit: 2d5741
- Julia command flags: None
- Environment variables:
OMP_NUM_THREADS => 1JULIA_NUM_THREADS => 1
Results
Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.
| ID | time | GC time | memory | allocations |
|---|---|---|---|---|
["cat", "base"] |
192.910 μs (5%) | |||
["cat", "xf"] |
1.420 μs (5%) | |||
["collect", "filter-missing"] |
78.304 μs (5%) | 33.05 KiB (1%) | 20 | |
["collect", "identity-float"] |
57.003 μs (5%) | 256.91 KiB (1%) | 20 | |
["collect", "identity-union"] |
279.515 μs (5%) | 285.26 KiB (1%) | 6682 | |
["dot", "blas"] |
1.000 μs (5%) | |||
["dot", "man"] |
1.010 μs (5%) | |||
["dot", "rf"] |
1.790 μs (5%) | |||
["dot", "xf"] |
1.790 μs (5%) | |||
["filter_map_map!", "man"] |
54.402 μs (5%) | |||
["filter_map_map!", "xf"] |
71.603 μs (5%) | 144 bytes (1%) | 8 | |
["filter_map_reduce", "man"] |
191.711 μs (5%) | |||
["filter_map_reduce", "xf"] |
191.711 μs (5%) | |||
["findall", "base"] |
669.742 μs (5%) | 2.00 MiB (1%) | 21 | |
["findall", "xf-array"] |
507.531 μs (5%) | 3.05 MiB (1%) | 100015 | |
["findall", "xf-iter"] |
651.739 μs (5%) | 2.00 MiB (1%) | 29 | |
["gemm", "fusedmul", "blas", "16"] |
3.772 ms (5%) | |||
["gemm", "fusedmul", "blas", "2"] |
2.888 ms (5%) | |||
["gemm", "fusedmul", "blas", "32"] |
5.252 ms (5%) | |||
["gemm", "fusedmul", "blas", "8"] |
3.038 ms (5%) | |||
["gemm", "fusedmul", "xf", "16"] |
4.550 ms (5%) | 160 bytes (1%) | 6 | |
["gemm", "fusedmul", "xf", "2"] |
548.923 μs (5%) | 160 bytes (1%) | 6 | |
["gemm", "fusedmul", "xf", "32"] |
9.498 ms (5%) | 160 bytes (1%) | 6 | |
["gemm", "fusedmul", "xf", "8"] |
2.180 ms (5%) | 160 bytes (1%) | 6 | |
["gemm", "mul", "linalg", "256"] |
756.839 μs (5%) | |||
["gemm", "mul", "linalg", "32"] |
2.500 μs (5%) | |||
["gemm", "mul", "linalg", "8"] |
200.000 ns (5%) | |||
["gemm", "mul", "man", "false", "256"] |
1.357 ms (5%) | |||
["gemm", "mul", "man", "false", "32"] |
4.000 μs (5%) | |||
["gemm", "mul", "man", "false", "8"] |
500.000 ns (5%) | |||
["gemm", "mul", "man", "ivdep", "256"] |
1.373 ms (5%) | |||
["gemm", "mul", "man", "ivdep", "32"] |
3.300 μs (5%) | |||
["gemm", "mul", "man", "ivdep", "8"] |
300.000 ns (5%) | |||
["gemm", "mul", "man", "true", "256"] |
1.357 ms (5%) | |||
["gemm", "mul", "man", "true", "32"] |
4.300 μs (5%) | |||
["gemm", "mul", "man", "true", "8"] |
300.000 ns (5%) | |||
["gemm", "mul", "xf", "false", "256"] |
1.357 ms (5%) | 48 bytes (1%) | 2 | |
["gemm", "mul", "xf", "false", "32"] |
3.800 μs (5%) | 48 bytes (1%) | 2 | |
["gemm", "mul", "xf", "false", "8"] |
400.000 ns (5%) | 48 bytes (1%) | 2 | |
["gemm", "mul", "xf", "ivdep", "256"] |
1.375 ms (5%) | 48 bytes (1%) | 2 | |
["gemm", "mul", "xf", "ivdep", "32"] |
3.200 μs (5%) | 48 bytes (1%) | 2 | |
["gemm", "mul", "xf", "ivdep", "8"] |
300.000 ns (5%) | 48 bytes (1%) | 2 | |
["gemm", "mul", "xf", "true", "256"] |
1.359 ms (5%) | 48 bytes (1%) | 2 | |
["gemm", "mul", "xf", "true", "32"] |
4.000 μs (5%) | 48 bytes (1%) | 2 | |
["gemm", "mul", "xf", "true", "8"] |
300.000 ns (5%) | 48 bytes (1%) | 2 | |
["missing_argmax", "man"] |
2.233 μs (5%) | 32 bytes (1%) | 1 | |
["missing_argmax", "rf"] |
2.133 μs (5%) | 32 bytes (1%) | 1 | |
["missing_argmax", "xf"] |
2.156 μs (5%) | 32 bytes (1%) | 1 | |
["missing_dot", "equiv"] |
1.280 μs (5%) | 16 bytes (1%) | 1 | |
["missing_dot", "man"] |
1.120 μs (5%) | 16 bytes (1%) | 1 | |
["missing_dot", "naive"] |
3.938 μs (5%) | 16 bytes (1%) | 1 | |
["missing_dot", "rf"] |
1.130 μs (5%) | 16 bytes (1%) | 1 | |
["missing_dot", "rf_nota"] |
1.200 μs (5%) | 16 bytes (1%) | 1 | |
["missing_dot", "xf"] |
178.710 μs (5%) | 73.98 KiB (1%) | 3861 | |
["missing_dot", "xf_nota"] |
175.710 μs (5%) | 73.98 KiB (1%) | 3860 | |
["partition_by", "man"] |
1.656 ms (5%) | 352 bytes (1%) | 4 | |
["partition_by", "xf"] |
1.570 ms (5%) | 576 bytes (1%) | 7 |
Benchmark Group List
Here's a list of all the benchmark groups executed by this job:
-
["cat"] -
["collect"] -
["dot"] -
["filter_map_map!"] -
["filter_map_reduce"] -
["findall"] -
["gemm", "fusedmul", "blas"] -
["gemm", "fusedmul", "xf"] -
["gemm", "mul", "linalg"] -
["gemm", "mul", "man", "false"] -
["gemm", "mul", "man", "ivdep"] -
["gemm", "mul", "man", "true"] -
["gemm", "mul", "xf", "false"] -
["gemm", "mul", "xf", "ivdep"] -
["gemm", "mul", "xf", "true"] -
["missing_argmax"] -
["missing_dot"] -
["partition_by"]
Julia versioninfo
Julia Version 1.3.1
Commit 2d5741174c (2019-12-30 21:36 UTC)
Platform Info:
OS: Linux (x86_64-pc-linux-gnu)
Ubuntu 18.04.4 LTS
uname: Linux 5.0.0-1032-azure #34-Ubuntu SMP Mon Feb 10 19:37:25 UTC 2020 x86_64 x86_64
CPU: Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz:
speed user nice sys idle irq
#1 2095 MHz 27445 s 0 s 1183 s 45716 s 0 s
#2 2095 MHz 44674 s 0 s 1400 s 28544 s 0 s
Memory: 6.782737731933594 GB (3456.84765625 MB free)
Uptime: 762.0 sec
Load Avg: 1.046875 0.99072265625 0.64453125
WORD_SIZE: 64
LIBM: libopenlibm
LLVM: libLLVM-6.0.1 (ORCJIT, skylake)
Runtime information
| Runtime Info | |
|---|---|
| BLAS #threads | 2 |
BLAS.vendor() |
openblas64 |
Sys.CPU_THREADS |
2 |
lscpu output:
Architecture: x86_64
CPU op-mode(s): 32-bit, 64-bit
Byte Order: Little Endian
CPU(s): 2
On-line CPU(s) list: 0,1
Thread(s) per core: 1
Core(s) per socket: 2
Socket(s): 1
NUMA node(s): 1
Vendor ID: GenuineIntel
CPU family: 6
Model: 85
Model name: Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz
Stepping: 4
CPU MHz: 2095.195
BogoMIPS: 4190.39
Hypervisor vendor: Microsoft
Virtualization type: full
L1d cache: 32K
L1i cache: 32K
L2 cache: 1024K
L3 cache: 36608K
NUMA node0 CPU(s): 0,1
Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology cpuid pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch invpcid_single pti fsgsbase bmi1 hle avx2 smep bmi2 erms invpcid rtm mpx avx512f avx512dq rdseed adx smap clflushopt avx512cd avx512bw avx512vl xsaveopt xsavec xsaves
| Cpu Property | Value |
|---|---|
| Brand | Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz |
| Vendor | :Intel |
| Architecture | :Skylake |
| Model | Family: 0x06, Model: 0x55, Stepping: 0x04, Type: 0x00 |
| Cores | 2 physical cores, 2 logical cores (on executing CPU) |
| No Hyperthreading detected | |
| Clock Frequencies | Not supported by CPU |
| Data Cache | Level 1:3 : (32, 1024, 36608) kbytes |
| 64 byte cache line size | |
| Address Size | 48 bits virtual, 44 bits physical |
| SIMD | 512 bit = 64 byte max. SIMD vector size |
| Time Stamp Counter | TSC is accessible via rdtsc |
| TSC increased at every clock cycle (non-invariant TSC) | |
| Perf. Monitoring | Performance Monitoring Counters (PMC) are not supported |
| Hypervisor | Yes, Microsoft |
![github-actions[bot] avatar](https://avatars.githubusercontent.com/in/15368?v=4 "Published by a pub.dev verified publisher"){kind=small}
Multi-thread benchmark result
Judge result
Benchmark Report for /home/runner/work/Transducers.jl/Transducers.jl
Job Properties
- Time of benchmarks:
- Target: 5 Mar 2020 - 07:17
- Baseline: 5 Mar 2020 - 07:22
- Package commits:
- Target: 747582
- Baseline: f62c6a
- Julia commits:
- Target: 2d5741
- Baseline: 2d5741
- Julia command flags:
- Target: None
- Baseline: None
- Environment variables:
- Target:
JULIA_NUM_THREADS => 2 - Baseline:
JULIA_NUM_THREADS => 2
- Target:
Results
A ratio greater than 1.0 denotes a possible regression (marked with :x:), while a ratio less
than 1.0 denotes a possible improvement (marked with :white_check_mark:). Only significant results - results
that indicate possible regressions or improvements - are shown below (thus, an empty table means that all
benchmark results remained invariant between builds).
| ID | time ratio | memory ratio |
|---|---|---|
["collect", "seq"] |
1.08 (5%) :x: | 1.00 (1%) |
["collect", "unordered", "basesize=1024"] |
1.02 (5%) | 1.08 (1%) :x: |
["findfirst", "n=1000", "reduce", "basesize=128"] |
0.92 (5%) :white_check_mark: | 0.92 (1%) :white_check_mark: |
["findfirst", "n=1000", "reduce", "basesize=256"] |
0.88 (5%) :white_check_mark: | 0.92 (1%) :white_check_mark: |
["findfirst", "n=1000", "reduce", "basesize=512"] |
0.83 (5%) :white_check_mark: | 0.91 (1%) :white_check_mark: |
["findfirst", "n=400", "reduce", "basesize=128"] |
1.04 (5%) | 1.07 (1%) :x: |
["findfirst", "n=400", "reduce", "basesize=512"] |
0.96 (5%) | 0.96 (1%) :white_check_mark: |
["findfirst", "n=500", "reduce", "basesize=128"] |
1.13 (5%) :x: | 1.23 (1%) :x: |
["findfirst", "n=500", "reduce", "basesize=256"] |
0.76 (5%) :white_check_mark: | 0.82 (1%) :white_check_mark: |
["findfirst", "n=500", "reduce", "basesize=512"] |
1.08 (5%) :x: | 0.92 (1%) :white_check_mark: |
["parallel_histogram", "assoc", "basesize=4096"] |
0.98 (5%) | 0.87 (1%) :white_check_mark: |
["parallel_histogram", "comm", "basesize=4096"] |
1.10 (5%) :x: | 1.00 (1%) |
["parallel_histogram", "comm", "basesize=8192"] |
1.02 (5%) | 1.01 (1%) :x: |
["parallel_histogram", "seq"] |
0.95 (5%) :white_check_mark: | 1.00 (1%) |
["sum", "random", "reduce", "basesize=128"] |
1.06 (5%) :x: | 1.00 (1%) |
["sum", "valley", "reduce", "basesize=128"] |
1.12 (5%) :x: | 1.00 (1%) |
["sum", "valley", "reduce", "basesize=256"] |
1.19 (5%) :x: | 1.00 (1%) |
["words", "nthreads=1"] |
0.94 (5%) :white_check_mark: | 1.00 (1%) |
Benchmark Group List
Here's a list of all the benchmark groups executed by this job:
-
["collect", "assoc"] -
["collect"] -
["collect", "unordered"] -
["findfirst", "n=1000"] -
["findfirst", "n=1000", "reduce"] -
["findfirst", "n=400"] -
["findfirst", "n=400", "reduce"] -
["findfirst", "n=500"] -
["findfirst", "n=500", "reduce"] -
["overhead"] -
["parallel_histogram", "assoc"] -
["parallel_histogram", "comm"] -
["parallel_histogram"] -
["sum", "random"] -
["sum", "random", "reduce"] -
["sum", "uniform"] -
["sum", "uniform", "reduce"] -
["sum", "valley"] -
["sum", "valley", "reduce"] -
["words"]
Julia versioninfo
Target
Julia Version 1.3.1
Commit 2d5741174c (2019-12-30 21:36 UTC)
Platform Info:
OS: Linux (x86_64-pc-linux-gnu)
Ubuntu 18.04.4 LTS
uname: Linux 5.0.0-1032-azure #34-Ubuntu SMP Mon Feb 10 19:37:25 UTC 2020 x86_64 x86_64
CPU: Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz:
speed user nice sys idle irq
#1 2095 MHz 49531 s 0 s 1922 s 12986 s 0 s
#2 2095 MHz 44287 s 0 s 1860 s 18530 s 0 s
Memory: 6.782737731933594 GB (3534.9609375 MB free)
Uptime: 662.0 sec
Load Avg: 1.73681640625 1.52392578125 0.8818359375
WORD_SIZE: 64
LIBM: libopenlibm
LLVM: libLLVM-6.0.1 (ORCJIT, skylake)
Baseline
Julia Version 1.3.1
Commit 2d5741174c (2019-12-30 21:36 UTC)
Platform Info:
OS: Linux (x86_64-pc-linux-gnu)
Ubuntu 18.04.4 LTS
uname: Linux 5.0.0-1032-azure #34-Ubuntu SMP Mon Feb 10 19:37:25 UTC 2020 x86_64 x86_64
CPU: Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz:
speed user nice sys idle irq
#1 2095 MHz 73225 s 0 s 2360 s 16599 s 0 s
#2 2095 MHz 63830 s 0 s 2331 s 26379 s 0 s
Memory: 6.782737731933594 GB (3579.28125 MB free)
Uptime: 942.0 sec
Load Avg: 1.6416015625 1.58349609375 1.07958984375
WORD_SIZE: 64
LIBM: libopenlibm
LLVM: libLLVM-6.0.1 (ORCJIT, skylake)
Target result
Benchmark Report for /home/runner/work/Transducers.jl/Transducers.jl
Job Properties
- Time of benchmark: 5 Mar 2020 - 7:17
- Package commit: 747582
- Julia commit: 2d5741
- Julia command flags: None
- Environment variables:
JULIA_NUM_THREADS => 2
Results
Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.
| ID | time | GC time | memory | allocations |
|---|---|---|---|---|
["collect", "assoc", "basesize=1"] |
383.408 ms (5%) | 12.543 ms | 91.55 MiB (1%) | 1754696 |
["collect", "assoc", "basesize=1024"] |
255.109 ms (5%) | 1.84 MiB (1%) | 1967 | |
["collect", "assoc", "basesize=32"] |
246.364 ms (5%) | 5.77 MiB (1%) | 59138 | |
["collect", "seq"] |
506.649 ms (5%) | 513.00 KiB (1%) | 23 | |
["collect", "unordered", "basesize=1"] |
467.638 ms (5%) | 7.415 ms | 30.23 MiB (1%) | 473614 |
["collect", "unordered", "basesize=1024"] |
310.593 ms (5%) | 834.38 KiB (1%) | 6515 | |
["collect", "unordered", "basesize=32"] |
275.135 ms (5%) | 1.51 MiB (1%) | 19312 | |
["findfirst", "n=1000", "foldl"] |
686.697 ms (5%) | |||
["findfirst", "n=1000", "reduce", "basesize=128"] |
737.116 ms (5%) | 1.33 MiB (1%) | 26619 | |
["findfirst", "n=1000", "reduce", "basesize=256"] |
435.695 ms (5%) | 494.11 KiB (1%) | 9633 | |
["findfirst", "n=1000", "reduce", "basesize=512"] |
613.246 ms (5%) | 352.69 KiB (1%) | 6877 | |
["findfirst", "n=400", "foldl"] |
506.398 ms (5%) | |||
["findfirst", "n=400", "reduce", "basesize=128"] |
293.349 ms (5%) | 1.28 MiB (1%) | 25673 | |
["findfirst", "n=400", "reduce", "basesize=256"] |
285.110 ms (5%) | 663.22 KiB (1%) | 13064 | |
["findfirst", "n=400", "reduce", "basesize=512"] |
305.720 ms (5%) | 404.58 KiB (1%) | 7943 | |
["findfirst", "n=500", "foldl"] |
84.870 ms (5%) | |||
["findfirst", "n=500", "reduce", "basesize=128"] |
161.785 ms (5%) | 737.53 KiB (1%) | 14309 | |
["findfirst", "n=500", "reduce", "basesize=256"] |
133.937 ms (5%) | 382.11 KiB (1%) | 7357 | |
["findfirst", "n=500", "reduce", "basesize=512"] |
161.766 ms (5%) | 212.52 KiB (1%) | 4126 | |
["overhead", "n=64"] |
166.608 μs (5%) | 155.14 KiB (1%) | 3009 | |
["parallel_histogram", "assoc", "basesize=16384"] |
3.934 ms (5%) | 732.22 KiB (1%) | 109 | |
["parallel_histogram", "assoc", "basesize=4096"] |
4.637 ms (5%) | 1.80 MiB (1%) | 539 | |
["parallel_histogram", "assoc", "basesize=8192"] |
4.226 ms (5%) | 1.43 MiB (1%) | 260 | |
["parallel_histogram", "comm", "basesize=16384"] |
15.061 ms (5%) | 1.22 MiB (1%) | 169 | |
["parallel_histogram", "comm", "basesize=4096"] |
24.618 ms (5%) | 1.06 MiB (1%) | 6082 | |
["parallel_histogram", "comm", "basesize=8192"] |
21.804 ms (5%) | 1.28 MiB (1%) | 4229 | |
["parallel_histogram", "seq"] |
7.295 ms (5%) | 364.63 KiB (1%) | 25 | |
["sum", "random", "foldl"] |
15.144 ms (5%) | |||
["sum", "random", "reduce", "basesize=128"] |
8.164 ms (5%) | 331.41 KiB (1%) | 6836 | |
["sum", "random", "reduce", "basesize=256"] |
7.819 ms (5%) | 164.13 KiB (1%) | 3394 | |
["sum", "random", "reduce", "basesize=512"] |
7.824 ms (5%) | 80.80 KiB (1%) | 1677 | |
["sum", "uniform", "foldl"] |
14.766 ms (5%) | |||
["sum", "uniform", "reduce", "basesize=128"] |
7.265 ms (5%) | 331.39 KiB (1%) | 6835 | |
["sum", "uniform", "reduce", "basesize=256"] |
7.252 ms (5%) | 164.13 KiB (1%) | 3394 | |
["sum", "uniform", "reduce", "basesize=512"] |
7.281 ms (5%) | 80.75 KiB (1%) | 1674 | |
["sum", "valley", "foldl"] |
15.811 ms (5%) | |||
["sum", "valley", "reduce", "basesize=128"] |
9.100 ms (5%) | 331.30 KiB (1%) | 6829 | |
["sum", "valley", "reduce", "basesize=256"] |
8.990 ms (5%) | 164.11 KiB (1%) | 3393 | |
["sum", "valley", "reduce", "basesize=512"] |
7.784 ms (5%) | 80.75 KiB (1%) | 1674 | |
["words", "nthreads=1"] |
34.088 ms (5%) | 6.432 ms | 64.77 MiB (1%) | 2096283 |
["words", "nthreads=2"] |
19.220 ms (5%) | 65.13 MiB (1%) | 2096366 | |
["words", "nthreads=4"] |
20.441 ms (5%) | 65.85 MiB (1%) | 2096533 |
Benchmark Group List
Here's a list of all the benchmark groups executed by this job:
-
["collect", "assoc"] -
["collect"] -
["collect", "unordered"] -
["findfirst", "n=1000"] -
["findfirst", "n=1000", "reduce"] -
["findfirst", "n=400"] -
["findfirst", "n=400", "reduce"] -
["findfirst", "n=500"] -
["findfirst", "n=500", "reduce"] -
["overhead"] -
["parallel_histogram", "assoc"] -
["parallel_histogram", "comm"] -
["parallel_histogram"] -
["sum", "random"] -
["sum", "random", "reduce"] -
["sum", "uniform"] -
["sum", "uniform", "reduce"] -
["sum", "valley"] -
["sum", "valley", "reduce"] -
["words"]
Julia versioninfo
Julia Version 1.3.1
Commit 2d5741174c (2019-12-30 21:36 UTC)
Platform Info:
OS: Linux (x86_64-pc-linux-gnu)
Ubuntu 18.04.4 LTS
uname: Linux 5.0.0-1032-azure #34-Ubuntu SMP Mon Feb 10 19:37:25 UTC 2020 x86_64 x86_64
CPU: Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz:
speed user nice sys idle irq
#1 2095 MHz 49531 s 0 s 1922 s 12986 s 0 s
#2 2095 MHz 44287 s 0 s 1860 s 18530 s 0 s
Memory: 6.782737731933594 GB (3534.9609375 MB free)
Uptime: 662.0 sec
Load Avg: 1.73681640625 1.52392578125 0.8818359375
WORD_SIZE: 64
LIBM: libopenlibm
LLVM: libLLVM-6.0.1 (ORCJIT, skylake)
Baseline result
Benchmark Report for /home/runner/work/Transducers.jl/Transducers.jl
Job Properties
- Time of benchmark: 5 Mar 2020 - 7:22
- Package commit: f62c6a
- Julia commit: 2d5741
- Julia command flags: None
- Environment variables:
JULIA_NUM_THREADS => 2
Results
Below is a table of this job's results, obtained by running the benchmarks.
The values listed in the ID column have the structure [parent_group, child_group, ..., key], and can be used to
index into the BaseBenchmarks suite to retrieve the corresponding benchmarks.
The percentages accompanying time and memory values in the below table are noise tolerances. The "true"
time/memory value for a given benchmark is expected to fall within this percentage of the reported value.
An empty cell means that the value was zero.
| ID | time | GC time | memory | allocations |
|---|---|---|---|---|
["collect", "assoc", "basesize=1"] |
377.007 ms (5%) | 10.439 ms | 91.55 MiB (1%) | 1754685 |
["collect", "assoc", "basesize=1024"] |
243.520 ms (5%) | 1.84 MiB (1%) | 1967 | |
["collect", "assoc", "basesize=32"] |
249.410 ms (5%) | 5.77 MiB (1%) | 59123 | |
["collect", "seq"] |
469.142 ms (5%) | 513.00 KiB (1%) | 23 | |
["collect", "unordered", "basesize=1"] |
489.573 ms (5%) | 30.25 MiB (1%) | 475016 | |
["collect", "unordered", "basesize=1024"] |
303.090 ms (5%) | 772.50 KiB (1%) | 2555 | |
["collect", "unordered", "basesize=32"] |
270.227 ms (5%) | 1.51 MiB (1%) | 19438 | |
["findfirst", "n=1000", "foldl"] |
670.925 ms (5%) | |||
["findfirst", "n=1000", "reduce", "basesize=128"] |
798.240 ms (5%) | 1.45 MiB (1%) | 28967 | |
["findfirst", "n=1000", "reduce", "basesize=256"] |
493.043 ms (5%) | 535.08 KiB (1%) | 10437 | |
["findfirst", "n=1000", "reduce", "basesize=512"] |
735.907 ms (5%) | 388.69 KiB (1%) | 7596 | |
["findfirst", "n=400", "foldl"] |
504.329 ms (5%) | |||
["findfirst", "n=400", "reduce", "basesize=128"] |
281.090 ms (5%) | 1.19 MiB (1%) | 24019 | |
["findfirst", "n=400", "reduce", "basesize=256"] |
282.823 ms (5%) | 657.95 KiB (1%) | 12955 | |
["findfirst", "n=400", "reduce", "basesize=512"] |
318.022 ms (5%) | 422.28 KiB (1%) | 8284 | |
["findfirst", "n=500", "foldl"] |
82.851 ms (5%) | |||
["findfirst", "n=500", "reduce", "basesize=128"] |
143.684 ms (5%) | 597.31 KiB (1%) | 11596 | |
["findfirst", "n=500", "reduce", "basesize=256"] |
175.394 ms (5%) | 463.95 KiB (1%) | 8954 | |
["findfirst", "n=500", "reduce", "basesize=512"] |
149.241 ms (5%) | 232.09 KiB (1%) | 4472 | |
["overhead", "n=64"] |
162.805 μs (5%) | 155.11 KiB (1%) | 3007 | |
["parallel_histogram", "assoc", "basesize=16384"] |
3.930 ms (5%) | 732.22 KiB (1%) | 109 | |
["parallel_histogram", "assoc", "basesize=4096"] |
4.719 ms (5%) | 2.07 MiB (1%) | 545 | |
["parallel_histogram", "assoc", "basesize=8192"] |
4.183 ms (5%) | 1.43 MiB (1%) | 260 | |
["parallel_histogram", "comm", "basesize=16384"] |
14.947 ms (5%) | 1.22 MiB (1%) | 334 | |
["parallel_histogram", "comm", "basesize=4096"] |
22.418 ms (5%) | 1.06 MiB (1%) | 6025 | |
["parallel_histogram", "comm", "basesize=8192"] |
21.292 ms (5%) | 1.27 MiB (1%) | 3240 | |
["parallel_histogram", "seq"] |
7.692 ms (5%) | 364.63 KiB (1%) | 25 | |
["sum", "random", "foldl"] |
15.182 ms (5%) | |||
["sum", "random", "reduce", "basesize=128"] |
7.676 ms (5%) | 331.42 KiB (1%) | 6837 | |
["sum", "random", "reduce", "basesize=256"] |
7.531 ms (5%) | 164.08 KiB (1%) | 3391 | |
["sum", "random", "reduce", "basesize=512"] |
7.579 ms (5%) | 80.73 KiB (1%) | 1673 | |
["sum", "uniform", "foldl"] |
15.074 ms (5%) | |||
["sum", "uniform", "reduce", "basesize=128"] |
7.170 ms (5%) | 331.42 KiB (1%) | 6837 | |
["sum", "uniform", "reduce", "basesize=256"] |
7.236 ms (5%) | 164.13 KiB (1%) | 3394 | |
["sum", "uniform", "reduce", "basesize=512"] |
7.299 ms (5%) | 80.73 KiB (1%) | 1673 | |
["sum", "valley", "foldl"] |
15.468 ms (5%) | |||
["sum", "valley", "reduce", "basesize=128"] |
8.127 ms (5%) | 331.25 KiB (1%) | 6826 | |
["sum", "valley", "reduce", "basesize=256"] |
7.580 ms (5%) | 164.09 KiB (1%) | 3392 | |
["sum", "valley", "reduce", "basesize=512"] |
7.561 ms (5%) | 80.77 KiB (1%) | 1675 | |
["words", "nthreads=1"] |
36.372 ms (5%) | 5.923 ms | 64.70 MiB (1%) | 2094032 |
["words", "nthreads=2"] |
18.705 ms (5%) | 65.42 MiB (1%) | 2094197 | |
["words", "nthreads=4"] |
19.678 ms (5%) | 66.05 MiB (1%) | 2094511 |
Benchmark Group List
Here's a list of all the benchmark groups executed by this job:
-
["collect", "assoc"] -
["collect"] -
["collect", "unordered"] -
["findfirst", "n=1000"] -
["findfirst", "n=1000", "reduce"] -
["findfirst", "n=400"] -
["findfirst", "n=400", "reduce"] -
["findfirst", "n=500"] -
["findfirst", "n=500", "reduce"] -
["overhead"] -
["parallel_histogram", "assoc"] -
["parallel_histogram", "comm"] -
["parallel_histogram"] -
["sum", "random"] -
["sum", "random", "reduce"] -
["sum", "uniform"] -
["sum", "uniform", "reduce"] -
["sum", "valley"] -
["sum", "valley", "reduce"] -
["words"]
Julia versioninfo
Julia Version 1.3.1
Commit 2d5741174c (2019-12-30 21:36 UTC)
Platform Info:
OS: Linux (x86_64-pc-linux-gnu)
Ubuntu 18.04.4 LTS
uname: Linux 5.0.0-1032-azure #34-Ubuntu SMP Mon Feb 10 19:37:25 UTC 2020 x86_64 x86_64
CPU: Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz:
speed user nice sys idle irq
#1 2095 MHz 73225 s 0 s 2360 s 16599 s 0 s
#2 2095 MHz 63830 s 0 s 2331 s 26379 s 0 s
Memory: 6.782737731933594 GB (3579.28125 MB free)
Uptime: 942.0 sec
Load Avg: 1.6416015625 1.58349609375 1.07958984375
WORD_SIZE: 64
LIBM: libopenlibm
LLVM: libLLVM-6.0.1 (ORCJIT, skylake)
Runtime information
| Runtime Info | |
|---|---|
| BLAS #threads | 2 |
BLAS.vendor() |
openblas64 |
Sys.CPU_THREADS |
2 |
lscpu output:
Architecture: x86_64
CPU op-mode(s): 32-bit, 64-bit
Byte Order: Little Endian
CPU(s): 2
On-line CPU(s) list: 0,1
Thread(s) per core: 1
Core(s) per socket: 2
Socket(s): 1
NUMA node(s): 1
Vendor ID: GenuineIntel
CPU family: 6
Model: 85
Model name: Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz
Stepping: 4
CPU MHz: 2095.192
BogoMIPS: 4190.38
Hypervisor vendor: Microsoft
Virtualization type: full
L1d cache: 32K
L1i cache: 32K
L2 cache: 1024K
L3 cache: 36608K
NUMA node0 CPU(s): 0,1
Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss ht syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology cpuid pni pclmulqdq ssse3 fma cx16 pcid sse4_1 sse4_2 movbe popcnt aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch invpcid_single pti fsgsbase bmi1 hle avx2 smep bmi2 erms invpcid rtm mpx avx512f avx512dq rdseed adx smap clflushopt avx512cd avx512bw avx512vl xsaveopt xsavec xsaves
| Cpu Property | Value |
|---|---|
| Brand | Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz |
| Vendor | :Intel |
| Architecture | :Skylake |
| Model | Family: 0x06, Model: 0x55, Stepping: 0x04, Type: 0x00 |
| Cores | 2 physical cores, 2 logical cores (on executing CPU) |
| No Hyperthreading detected | |
| Clock Frequencies | Not supported by CPU |
| Data Cache | Level 1:3 : (32, 1024, 36608) kbytes |
| 64 byte cache line size | |
| Address Size | 48 bits virtual, 44 bits physical |
| SIMD | 512 bit = 64 byte max. SIMD vector size |
| Time Stamp Counter | TSC is accessible via rdtsc |
| TSC increased at every clock cycle (non-invariant TSC) | |
| Perf. Monitoring | Performance Monitoring Counters (PMC) are not supported |
| Hypervisor | Yes, Microsoft |
Codecov Report
All modified and coverable lines are covered by tests :white_check_mark:
Project coverage is 94.36%. Comparing base (
2a51f8d) to head (939b4a3).
Additional details and impacted files
@@ Coverage Diff @@
## master #243 +/- ##
==========================================
- Coverage 94.61% 94.36% -0.26%
==========================================
Files 32 32
Lines 2267 2255 -12
==========================================
- Hits 2145 2128 -17
- Misses 122 127 +5
| Flag | Coverage Δ | |
|---|---|---|
| Run.test | 94.36% <ø> (-0.26%) |
:arrow_down: |
Flags with carried forward coverage won't be shown. Click here to find out more.
:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.
