hyrise
hyrise copied to clipboard
Published
20 hours ago •
hyrise
hyrise
Improve output writing of hash-based aggregate
This PR attempts to improve the performance and output structure of the hash aggregate. It mainly introduces two changes.
(i) Instead of writing a large single chunk as the result, the group-by columns and aggregation results are now split into chunks (using Chunk::DEFAULT_SIZE). There are some improvements for parallel query executions. On the one hand, writing is parallelized. On the other hand, succeeding operators might perform better as they don't execute on a huge single chunks (most operators parallelize on chunks; for single-threaded execution, more chunks can decrease performance (see TPC-DS and comments below)).
(ii) Instead of materializing the group-by columns, we only forward reference columns. This is done the same way the projection operator works. As we need to combine reference and value segments (i.e., group-by columns and aggregate results), we create intermediate value segments which are referenced in the output table.
Benchmarks
Summary:
- most queries are not impacted, only very few ones improve (e..g, TPC-H Q10 which has a wide group by list and a large output)
- TPC-DS 97 degrades in single-threaded mode significantly. This is not directly caused by the aggregate, but by the following SortMergeJoin, which now needs to materialize the group by columns (previously done in the aggregate) and suffers from multiple chunks in this case. For the ordered MT case, this PR improved performance, but in the shuffle MT case, performance drops slightly due to Q97.
Benchmarks after changes to NULL writing.
AMD
System
cx28 - click to expand
| property | value |
|---|---|
| Hostname | cx28 |
| CPU | AMD EPYC 7742 64-Core Processor |
| Memory | 513GB |
| numactl | nodebind: 0 |
| numactl | membind: 0 1 |
Commit Info and Build Time
| commit | date | message | build time |
|---|---|---|---|
| f5bdcb3c4 | 13.02.2024 14:38 | Improve Predicate Placement and Avoid Semi-Join Reductions (#2590) | real 436.14 user 3388.27 sys 296.53 |
| b1462bd92 | 26.02.2024 22:44 | Revert third party to master | real 452.36 user 3377.71 sys 309.37 |
hyriseBenchmarkTPCH - single-threaded, SF 10.0
Sum of avg. item runtimes: -1% || Geometric mean of throughput changes: +1%
Configuration Overview - click to expand
+Configuration Overview----+------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCH_f5bdcb3c47233e058ef9792c861ed1794fca2d18_st.json | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCH_b1462bd925a2ddf5934cba02729cf4758d1c0176_st.json |
+--------------------------+------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------+
| GIT-HASH | f5bdcb3c47233e058ef9792c861ed1794fca2d18-dirty | b1462bd925a2ddf5934cba02729cf4758d1c0176-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| clustering | None | None |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2024-02-27 09:02:59 | 2024-02-27 13:07:47 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 100 | 100 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| use_prepared_statements | False | False |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+--------------------------+------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------+
++----------++----------+----------+--------++----------+----------+--------+---------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++----------++----------+----------+--------++----------+----------+--------+---------+
+| TPC-H 01 || 6321.13 | 6402.74 | +1% || 0.16 | 0.16 | -1% | 0.5118 |
+| TPC-H 02 || 49.72 | 49.08 | -1%˄ || 20.11 | 20.37 | +1%˄ | 0.1846 |
+| TPC-H 03 || 1885.20 | 1849.17 | -2% || 0.53 | 0.54 | +2% | 0.0001 |
+| TPC-H 04 || 1892.70 | 1876.13 | -1% || 0.53 | 0.53 | +1% | 0.0170 |
+| TPC-H 05 || 3441.27 | 3357.57 | -2% || 0.29 | 0.30 | +2% | 0.0691 |
+| TPC-H 06 || 212.88 | 212.44 | -0%˄ || 4.70 | 4.71 | +0%˄ | 0.8122 |
+| TPC-H 07 || 1137.27 | 1158.16 | +2% || 0.88 | 0.86 | -2% | 0.0001 |
+| TPC-H 08 || 726.59 | 747.91 | +3% || 1.38 | 1.34 | -3% | 0.0000 |
+| TPC-H 09 || 7430.05 | 7456.97 | +0% || 0.13 | 0.13 | -0% | ˅ |
+| TPC-H 10 || 2378.01 | 1853.61 | -22% || 0.42 | 0.54 | +28% | 0.0000 |
+| TPC-H 11 || 75.39 | 70.29 | -7%˄ || 13.26 | 14.23 | +7%˄ | 0.0000 |
+| TPC-H 12 || 1762.94 | 1762.11 | -0% || 0.57 | 0.57 | +0% | 0.9281 |
+| TPC-H 13 || 6704.26 | 6577.47 | -2% || 0.15 | 0.15 | +2% | ˅ |
+| TPC-H 14 || 677.06 | 677.60 | +0% || 1.48 | 1.48 | -0% | 0.8446 |
+| TPC-H 15 || 267.10 | 257.08 | -4%˄ || 3.74 | 3.89 | +4%˄ | 0.0000 |
+| TPC-H 16 || 708.20 | 719.82 | +2% || 1.41 | 1.39 | -2% | 0.0000 |
+| TPC-H 17 || 289.23 | 284.78 | -2%˄ || 3.46 | 3.51 | +2%˄ | 0.0000 |
+| TPC-H 18 || 1595.15 | 1653.59 | +4% || 0.63 | 0.60 | -4% | 0.0003 |
+| TPC-H 19 || 285.39 | 278.67 | -2%˄ || 3.50 | 3.59 | +2%˄ | 0.0008 |
+| TPC-H 20 || 742.58 | 792.99 | +7% || 1.35 | 1.26 | -6% | 0.1331 |
+| TPC-H 21 || 6037.64 | 6068.27 | +1% || 0.17 | 0.16 | -1% | 0.3654 |
+| TPC-H 22 || 630.42 | 623.75 | -1% || 1.59 | 1.60 | +1% | 0.0000 |
++----------++----------+----------+--------++----------+----------+--------+---------+
+| Sum || 45250.18 | 44730.21 | -1% || | | | |
+| Geomean || | | || | | +1% | |
++----------++----------+----------+--------++----------+----------+--------+---------+
+| Notes || ˄ Execution stopped due to max runs reached |
+| || ˅ Insufficient number of runs for p-value calculation |
++----------++----------+----------+--------++----------+----------+--------+---------+
hyriseBenchmarkTPCH - single-threaded, SF 0.01
Sum of avg. item runtimes: -2% || Geometric mean of throughput changes: +1%
Configuration Overview - click to expand
+Configuration Overview----+----------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCH_f5bdcb3c47233e058ef9792c861ed1794fca2d18_st_s01.json | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCH_b1462bd925a2ddf5934cba02729cf4758d1c0176_st_s01.json |
+--------------------------+----------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------+
| GIT-HASH | f5bdcb3c47233e058ef9792c861ed1794fca2d18-dirty | b1462bd925a2ddf5934cba02729cf4758d1c0176-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| clustering | None | None |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2024-02-27 09:24:07 | 2024-02-27 13:29:00 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 100 | 100 |
| scale_factor | 0.009999999776482582 | 0.009999999776482582 |
| time_unit | ns | ns |
| use_prepared_statements | False | False |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+--------------------------+----------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------+
++----------++----------+---------+--------++----------+----------+--------+---------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++----------++----------+---------+--------++----------+----------+--------+---------+
+| TPC-H 01 || 10.05 | 10.04 | -0%˄ || 99.49 | 99.56 | +0%˄ | 0.9617 |
+| TPC-H 02 || 4.56 | 4.58 | +0%˄ || 219.00 | 218.27 | -0%˄ | 0.9358 |
+| TPC-H 03 || 0.69 | 0.70 | +2%˄ || 1445.40 | 1423.21 | -2%˄ | 0.0032 |
+| TPC-H 04 || 0.41 | 0.41 | +0%˄ || 2453.65 | 2443.21 | -0%˄ | 0.3447 |
+| TPC-H 05 || 1.04 | 1.02 | -1%˄ || 964.05 | 975.75 | +1%˄ | 0.5209 |
+| TPC-H 06 || 0.22 | 0.22 | +1%˄ || 4584.23 | 4542.69 | -1%˄ | 0.1883 |
+| TPC-H 07 || 10.69 | 9.76 | -9%˄ || 93.55 | 102.39 | +9%˄ | 0.2143 |
+| TPC-H 08 || 15.37 | 15.36 | -0%˄ || 65.08 | 65.12 | +0%˄ | 0.9709 |
+| TPC-H 09 || 4.20 | 3.88 | -7%˄ || 238.10 | 257.32 | +8%˄ | 0.5853 |
+| TPC-H 10 || 0.79 | 0.72 | -9%˄ || 1268.07 | 1387.02 | +9%˄ | 0.0000 |
+| TPC-H 11 || 0.20 | 0.20 | +3%˄ || 5087.57 | 4936.32 | -3%˄ | 0.0018 |
+| TPC-H 12 || 0.68 | 0.69 | +1%˄ || 1475.84 | 1455.14 | -1%˄ | 0.6488 |
+| TPC-H 13 || 2.12 | 2.14 | +1%˄ || 472.14 | 466.05 | -1%˄ | 0.0000 |
+| TPC-H 14 || 0.31 | 0.32 | +3%˄ || 3173.26 | 3091.29 | -3%˄ | 0.0009 |
+| TPC-H 15 || 1.32 | 1.33 | +1%˄ || 757.48 | 750.66 | -1%˄ | 0.0027 |
+| TPC-H 16 || 2.49 | 2.51 | +1%˄ || 401.73 | 398.17 | -1%˄ | 0.0000 |
+| TPC-H 17 || 0.77 | 0.71 | -7%˄ || 1304.39 | 1406.01 | +8%˄ | 0.5222 |
+| TPC-H 18 || 1.13 | 1.14 | +1%˄ || 882.22 | 875.54 | -1%˄ | 0.0008 |
+| TPC-H 19 || 6.42 | 6.48 | +1%˄ || 155.62 | 154.26 | -1%˄ | 0.0000 |
+| TPC-H 20 || 2.89 | 2.93 | +1%˄ || 345.17 | 341.65 | -1%˄ | 0.4044 |
+| TPC-H 21 || 1.10 | 1.12 | +2%˄ || 906.18 | 887.20 | -2%˄ | 0.5912 |
+| TPC-H 22 || 1.28 | 1.31 | +2%˄ || 779.80 | 764.53 | -2%˄ | 0.0000 |
++----------++----------+---------+--------++----------+----------+--------+---------+
+| Sum || 68.71 | 67.58 | -2% || | | | |
+| Geomean || | | || | | +1% | |
++----------++----------+---------+--------++----------+----------+--------+---------+
+| Notes || ˄ Execution stopped due to max runs reached |
++----------++----------+---------+--------++----------+----------+--------+---------+
hyriseBenchmarkTPCH - multi-threaded, ordered, 1 client, 64 cores, SF 10.0
Sum of avg. item runtimes: -5% || Geometric mean of throughput changes: +4%
Configuration Overview - click to expand
+Configuration Overview---------+--------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCH_f5bdcb3c47233e058ef9792c861ed1794fca2d18_mt_ordered.json | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCH_b1462bd925a2ddf5934cba02729cf4758d1c0176_mt_ordered.json |
+-------------------------------+--------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | f5bdcb3c47233e058ef9792c861ed1794fca2d18-dirty | b1462bd925a2ddf5934cba02729cf4758d1c0176-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| clustering | None | None |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2024-02-27 09:24:36 | 2024-02-27 13:29:29 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| use_prepared_statements | False | False |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+--------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------+
++----------++----------+----------+--------++----------+----------+--------+----------------------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++----------++----------+----------+--------++----------+----------+--------+----------------------+
+| TPC-H 01 || 5783.61 | 5800.20 | +0% || 0.17 | 0.17 | -0% | (run time too short) |
+| TPC-H 02 || 59.67 | 60.43 | +1% || 15.52 | 15.30 | -1% | 0.2333 |
+| TPC-H 03 || 874.14 | 831.59 | -5% || 1.13 | 1.18 | +4% | 0.0000 |
+| TPC-H 04 || 813.66 | 829.00 | +2% || 1.22 | 1.18 | -3% | (run time too short) |
+| TPC-H 05 || 627.37 | 641.32 | +2% || 1.57 | 1.53 | -2% | (run time too short) |
+| TPC-H 06 || 64.25 | 64.25 | -0% || 14.52 | 14.51 | -0% | 0.9935 |
+| TPC-H 07 || 329.93 | 325.41 | -1% || 2.98 | 3.02 | +1% | 0.0726 |
+| TPC-H 08 || 287.35 | 288.59 | +0% || 3.42 | 3.40 | -0% | 0.3524 |
+| TPC-H 09 || 2735.48 | 2713.39 | -1% || 0.35 | 0.37 | +5% | (run time too short) |
+| TPC-H 10 || 1484.68 | 789.77 | -47% || 0.67 | 1.25 | +88% | 0.0000 |
+| TPC-H 11 || 74.78 | 68.30 | -9% || 12.52 | 13.58 | +9% | 0.0000 |
+| TPC-H 12 || 696.34 | 694.87 | -0% || 1.42 | 1.42 | +0% | 0.6729 |
+| TPC-H 13 || 4097.43 | 3999.43 | -2% || 0.23 | 0.23 | +0% | (run time too short) |
+| TPC-H 14 || 160.52 | 160.45 | -0% || 6.02 | 6.03 | +0% | 0.9353 |
+| TPC-H 15 || 187.06 | 169.56 | -9% || 5.20 | 5.72 | +10% | 0.0000 |
+| TPC-H 16 || 887.23 | 883.89 | -0% || 1.12 | 1.12 | +0% | 0.4905 |
+| TPC-H 17 || 92.58 | 92.47 | -0% || 10.27 | 10.25 | -0% | 0.7963 |
+| TPC-H 18 || 2745.25 | 2448.92 | -11% || 0.35 | 0.40 | +14% | (run time too short) |
+| TPC-H 19 || 126.85 | 124.49 | -2% || 7.57 | 7.72 | +2% | 0.2108 |
+| TPC-H 20 || 251.86 | 263.31 | +5% || 3.88 | 3.72 | -4% | 0.0013 |
+| TPC-H 21 || 1306.04 | 1338.07 | +2% || 0.75 | 0.73 | -2% | (run time too short) |
+| TPC-H 22 || 160.67 | 163.79 | +2% || 6.02 | 5.92 | -2% | 0.0000 |
++----------++----------+----------+--------++----------+----------+--------+----------------------+
+| Sum || 23846.75 | 22751.50 | -5% || | | | |
+| Geomean || | | || | | +4% | |
++----------++----------+----------+--------++----------+----------+--------+----------------------+
hyriseBenchmarkTPCH - multi-threaded, shuffled, 64 clients, 64 cores, SF 10.0
Sum of avg. item runtimes: -0% || Geometric mean of throughput changes: +1%
Configuration Overview - click to expand
+Configuration Overview---------+------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCH_f5bdcb3c47233e058ef9792c861ed1794fca2d18_mt.json | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCH_b1462bd925a2ddf5934cba02729cf4758d1c0176_mt.json |
+-------------------------------+------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------+
| GIT-HASH | f5bdcb3c47233e058ef9792c861ed1794fca2d18-dirty | b1462bd925a2ddf5934cba02729cf4758d1c0176-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 64 | 64 |
| clustering | None | None |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2024-02-27 09:48:43 | 2024-02-27 13:53:35 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| use_prepared_statements | False | False |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------+
++----------++----------+----------+--------++----------+----------+--------+---------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++----------++----------+----------+--------++----------+----------+--------+---------+
+| TPC-H 01 || 6613.21 | 6690.46 | +1% || 0.99 | 1.00 | +1% | 0.4381 |
+| TPC-H 02 || 489.34 | 533.74 | +9% || 0.99 | 1.00 | +1% | 0.5515 |
+| TPC-H 03 || 3079.76 | 3233.69 | +5% || 0.99 | 1.00 | +1% | 0.3717 |
+| TPC-H 04 || 2753.18 | 2433.05 | -12% || 0.99 | 1.00 | +1% | 0.0374 |
+| TPC-H 05 || 4137.62 | 4113.94 | -1% || 0.99 | 1.00 | +1% | 0.9007 |
+| TPC-H 06 || 818.00 | 785.68 | -4% || 0.99 | 1.00 | +1% | 0.7382 |
+| TPC-H 07 || 3441.11 | 3616.57 | +5% || 0.99 | 1.00 | +1% | 0.3565 |
+| TPC-H 08 || 2433.48 | 2617.83 | +8% || 0.99 | 1.00 | +1% | 0.2645 |
+| TPC-H 09 || 6743.38 | 6714.81 | -0% || 0.99 | 1.00 | +1% | 0.8932 |
+| TPC-H 10 || 4299.36 | 3656.75 | -15% || 0.99 | 1.00 | +1% | 0.0005 |
+| TPC-H 11 || 536.45 | 623.33 | +16% || 0.99 | 1.00 | +1% | 0.2335 |
+| TPC-H 12 || 3114.12 | 2762.67 | -11% || 0.99 | 1.00 | +1% | 0.0171 |
+| TPC-H 13 || 5972.51 | 5867.96 | -2% || 0.99 | 1.00 | +1% | 0.3865 |
+| TPC-H 14 || 1123.94 | 1220.39 | +9% || 0.99 | 1.00 | +1% | 0.2800 |
+| TPC-H 15 || 665.07 | 745.32 | +12% || 0.99 | 1.00 | +1% | 0.1990 |
+| TPC-H 16 || 2582.12 | 2577.91 | -0% || 0.99 | 1.00 | +1% | 0.9763 |
+| TPC-H 17 || 883.51 | 915.84 | +4% || 0.99 | 1.00 | +1% | 0.7434 |
+| TPC-H 18 || 3777.06 | 3742.92 | -1% || 0.99 | 1.00 | +1% | 0.7417 |
+| TPC-H 19 || 1159.39 | 1241.38 | +7% || 0.99 | 1.00 | +1% | 0.4524 |
+| TPC-H 20 || 2075.07 | 2275.03 | +10% || 0.99 | 1.00 | +1% | 0.1853 |
+| TPC-H 21 || 5767.83 | 5761.08 | -0% || 0.99 | 1.00 | +1% | 0.9762 |
+| TPC-H 22 || 1157.37 | 1191.62 | +3% || 0.99 | 1.00 | +1% | 0.7277 |
++----------++----------+----------+--------++----------+----------+--------+---------+
+| Sum || 63622.86 | 63321.99 | -0% || | | | |
+| Geomean || | | || | | +1% | |
++----------++----------+----------+--------++----------+----------+--------+---------+
hyriseBenchmarkTPCDS - single-threaded
Sum of avg. item runtimes: +6% || Geometric mean of throughput changes: -2%
Configuration Overview - click to expand
+Configuration Overview---+-------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCDS_f5bdcb3c47233e058ef9792c861ed1794fca2d18_st.json | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCDS_b1462bd925a2ddf5934cba02729cf4758d1c0176_st.json |
+-------------------------+-------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------+
| GIT-HASH | f5bdcb3c47233e058ef9792c861ed1794fca2d18-dirty | b1462bd925a2ddf5934cba02729cf4758d1c0176-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2024-02-27 10:10:52 | 2024-02-27 14:15:39 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 100 | 100 |
| time_unit | ns | ns |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------+-------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------+
++---------++----------+----------+--------++----------+----------+--------+---------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++---------++----------+----------+--------++----------+----------+--------+---------+
+| 01 || 290.05 | 311.93 | +8%˄ || 3.45 | 3.21 | -7%˄ | 0.0000 |
+| 03 || 97.03 | 100.49 | +4%˄ || 10.31 | 9.95 | -3%˄ | 0.0000 |
+| 06 || 235.67 | 238.74 | +1%˄ || 4.24 | 4.19 | -1%˄ | 0.0000 |
+| 07 || 379.24 | 366.55 | -3%˄ || 2.64 | 2.73 | +3%˄ | 0.0000 |
+| 09 || 1098.40 | 1104.57 | +1% || 0.91 | 0.91 | -1% | 0.0257 |
+| 10 || 165.69 | 163.72 | -1%˄ || 6.04 | 6.11 | +1%˄ | 0.0095 |
+| 13 || 667.44 | 658.84 | -1% || 1.50 | 1.52 | +1% | 0.0012 |
+| 15 || 136.19 | 134.31 | -1%˄ || 7.34 | 7.45 | +1%˄ | 0.0000 |
+| 16 || 68.84 | 68.81 | -0%˄ || 14.53 | 14.53 | +0%˄ | 0.9082 |
+| 17 || 423.76 | 422.03 | -0%˄ || 2.36 | 2.37 | +0%˄ | 0.0085 |
+| 19 || 137.95 | 135.97 | -1%˄ || 7.25 | 7.35 | +1%˄ | 0.0000 |
+| 25 || 208.13 | 206.05 | -1%˄ || 4.80 | 4.85 | +1%˄ | 0.0000 |
+| 26 || 155.69 | 149.40 | -4%˄ || 6.42 | 6.69 | +4%˄ | 0.0000 |
+| 28 || 820.16 | 820.40 | +0% || 1.22 | 1.22 | -0% | 0.8189 |
+| 29 || 599.65 | 606.46 | +1%˄ || 1.67 | 1.65 | -1%˄ | 0.0006 |
+| 31 || 1593.95 | 1596.55 | +0% || 0.63 | 0.63 | -0% | 0.6169 |
+| 32 || 35.25 | 33.57 | -5%˄ || 28.37 | 29.78 | +5%˄ | 0.0000 |
+| 34 || 227.44 | 220.50 | -3%˄ || 4.40 | 4.53 | +3%˄ | 0.0000 |
+| 35 || 828.23 | 812.60 | -2% || 1.21 | 1.23 | +2% | 0.0000 |
+| 37 || 790.15 | 795.71 | +1% || 1.27 | 1.26 | -1% | 0.1826 |
+| 39a || 1908.95 | 1913.52 | +0% || 0.52 | 0.52 | -0% | 0.5046 |
+| 39b || 1940.88 | 1889.33 | -3% || 0.52 | 0.53 | +3% | 0.0000 |
+| 41 || 304.21 | 308.28 | +1%˄ || 3.29 | 3.24 | -1%˄ | 0.0000 |
+| 42 || 112.66 | 112.61 | -0%˄ || 8.88 | 8.88 | +0%˄ | 0.9118 |
+| 43 || 1077.25 | 1068.77 | -1% || 0.93 | 0.94 | +1% | 0.0002 |
+| 45 || 173.82 | 187.82 | +8%˄ || 5.75 | 5.32 | -7%˄ | 0.0000 |
+| 48 || 1131.53 | 1135.30 | +0% || 0.88 | 0.88 | -0% | 0.3431 |
+| 50 || 160.93 | 164.38 | +2%˄ || 6.21 | 6.08 | -2%˄ | 0.0000 |
+| 52 || 111.85 | 114.43 | +2%˄ || 8.94 | 8.74 | -2%˄ | 0.0000 |
+| 55 || 105.32 | 108.02 | +3%˄ || 9.49 | 9.26 | -3%˄ | 0.0000 |
+| 62 || 616.89 | 622.70 | +1% || 1.62 | 1.61 | -1% | 0.0000 |
+| 65 || 2123.91 | 2365.39 | +11% || 0.47 | 0.42 | -10% | 0.0000 |
+| 69 || 178.34 | 180.47 | +1%˄ || 5.61 | 5.54 | -1%˄ | 0.0000 |
+| 73 || 106.23 | 107.02 | +1%˄ || 9.41 | 9.34 | -1%˄ | 0.0010 |
+| 79 || 621.22 | 639.67 | +3% || 1.61 | 1.56 | -3% | 0.0000 |
+| 81 || 202.18 | 208.14 | +3%˄ || 4.95 | 4.80 | -3%˄ | 0.0000 |
+| 82 || 856.82 | 881.28 | +3% || 1.17 | 1.13 | -3% | 0.0000 |
+| 83 || 53.72 | 54.03 | +1%˄ || 18.61 | 18.51 | -1%˄ | 0.6426 |
+| 85 || 202.90 | 205.25 | +1%˄ || 4.93 | 4.87 | -1%˄ | 0.0000 |
+| 88 || 955.37 | 956.99 | +0% || 1.05 | 1.04 | -0% | 0.0958 |
+| 91 || 20.78 | 21.08 | +1%˄ || 48.12 | 47.42 | -1%˄ | 0.0011 |
+| 92 || 53.62 | 50.61 | -6%˄ || 18.65 | 19.76 | +6%˄ | 0.0000 |
+| 93 || 5219.27 | 5222.99 | +0% || 0.19 | 0.19 | -0% | 0.8055 |
+| 94 || 52.00 | 53.72 | +3%˄ || 19.23 | 18.61 | -3%˄ | 0.0000 |
+| 95 || 4849.14 | 4731.74 | -2% || 0.21 | 0.21 | +2% | 0.0646 |
+| 96 || 82.88 | 83.20 | +0%˄ || 12.07 | 12.02 | -0%˄ | 0.6976 |
+| 97 || 2882.32 | 4751.47 | +65% || 0.35 | 0.21 | -39% | 0.0000 |
+| 99 || 1138.31 | 1142.70 | +0% || 0.88 | 0.88 | -0% | 0.0033 |
++---------++----------+----------+--------++----------+----------+--------+---------+
+| Sum || 36202.15 | 38228.10 | +6% || | | | |
+| Geomean || | | || | | -2% | |
++---------++----------+----------+--------++----------+----------+--------+---------+
+| Notes || ˄ Execution stopped due to max runs reached |
++---------++----------+----------+--------++----------+----------+--------+---------+
hyriseBenchmarkTPCDS - multi-threaded, shuffled, 64 clients, 64 cores
Sum of avg. item runtimes: +2% || Geometric mean of throughput changes: -2%
Configuration Overview - click to expand
+Configuration Overview---------+-------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCDS_f5bdcb3c47233e058ef9792c861ed1794fca2d18_mt.json | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCDS_b1462bd925a2ddf5934cba02729cf4758d1c0176_mt.json |
+-------------------------------+-------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------+
| GIT-HASH | f5bdcb3c47233e058ef9792c861ed1794fca2d18-dirty | b1462bd925a2ddf5934cba02729cf4758d1c0176-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 64 | 64 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2024-02-27 10:40:10 | 2024-02-27 14:45:03 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+-------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------+
++---------++----------+----------+--------++----------+----------+--------+---------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++---------++----------+----------+--------++----------+----------+--------+---------+
+| 01 || 649.14 | 827.96 | +28% || 0.99 | 0.97 | -2% | 0.0002 |
+| 03 || 305.34 | 312.32 | +2% || 0.99 | 0.97 | -2% | 0.8562 |
+| 06 || 974.95 | 972.30 | -0% || 0.99 | 0.97 | -2% | 0.9696 |
+| 07 || 953.29 | 936.81 | -2% || 0.99 | 0.97 | -2% | 0.8066 |
+| 09 || 897.48 | 976.35 | +9% || 0.99 | 0.97 | -2% | 0.2982 |
+| 10 || 732.92 | 898.11 | +23% || 0.99 | 0.97 | -2% | 0.0250 |
+| 13 || 1797.36 | 1922.26 | +7% || 0.99 | 0.97 | -2% | 0.1883 |
+| 15 || 552.10 | 548.17 | -1% || 0.99 | 0.97 | -2% | 0.9404 |
+| 16 || 487.29 | 492.64 | +1% || 0.99 | 0.97 | -2% | 0.9229 |
+| 17 || 1292.95 | 1382.81 | +7% || 0.99 | 0.97 | -2% | 0.2648 |
+| 19 || 685.22 | 676.83 | -1% || 0.99 | 0.97 | -2% | 0.8866 |
+| 25 || 1091.48 | 1113.84 | +2% || 0.99 | 0.97 | -2% | 0.7807 |
+| 26 || 532.68 | 574.07 | +8% || 0.99 | 0.97 | -2% | 0.4373 |
+| 28 || 1770.30 | 1703.96 | -4% || 0.99 | 0.97 | -2% | 0.5588 |
+| 29 || 1716.37 | 1786.42 | +4% || 0.99 | 0.97 | -2% | 0.4624 |
+| 31 || 2733.61 | 2907.44 | +6% || 0.99 | 0.97 | -2% | 0.1748 |
+| 32 || 205.81 | 233.28 | +13% || 0.99 | 0.97 | -2% | 0.3998 |
+| 34 || 777.44 | 790.86 | +2% || 0.99 | 0.97 | -2% | 0.8439 |
+| 35 || 2283.54 | 2266.88 | -1% || 0.99 | 0.97 | -2% | 0.8688 |
+| 37 || 879.39 | 921.74 | +5% || 0.99 | 0.97 | -2% | 0.5188 |
+| 39a || 2634.88 | 2834.57 | +8% || 0.99 | 0.97 | -2% | 0.0227 |
+| 39b || 2726.12 | 2720.00 | -0% || 0.99 | 0.97 | -2% | 0.9470 |
+| 41 || 3855.21 | 3942.37 | +2% || 0.99 | 0.97 | -2% | 0.5397 |
+| 42 || 570.44 | 492.39 | -14% || 0.99 | 0.97 | -2% | 0.1686 |
+| 43 || 1493.73 | 1568.13 | +5% || 0.99 | 0.97 | -2% | 0.3360 |
+| 45 || 832.59 | 808.35 | -3% || 0.99 | 0.97 | -2% | 0.7026 |
+| 48 || 2640.03 | 2637.15 | -0% || 0.99 | 0.97 | -2% | 0.9802 |
+| 50 || 945.51 | 1147.63 | +21% || 0.99 | 0.97 | -2% | 0.0041 |
+| 52 || 509.46 | 502.81 | -1% || 0.99 | 0.97 | -2% | 0.8999 |
+| 55 || 471.23 | 474.26 | +1% || 0.99 | 0.97 | -2% | 0.9529 |
+| 62 || 999.43 | 1082.88 | +8% || 0.99 | 0.97 | -2% | 0.1697 |
+| 65 || 4555.61 | 4269.15 | -6% || 0.99 | 0.97 | -2% | 0.0002 |
+| 69 || 1015.05 | 1006.63 | -1% || 0.99 | 0.97 | -2% | 0.9110 |
+| 73 || 564.58 | 592.04 | +5% || 0.99 | 0.97 | -2% | 0.6674 |
+| 79 || 1512.49 | 1599.39 | +6% || 0.99 | 0.97 | -2% | 0.2126 |
+| 81 || 693.25 | 729.79 | +5% || 0.99 | 0.97 | -2% | 0.4659 |
+| 82 || 1012.67 | 1055.78 | +4% || 0.99 | 0.97 | -2% | 0.5106 |
+| 83 || 379.94 | 332.43 | -13% || 0.99 | 0.97 | -2% | 0.2730 |
+| 85 || 877.59 | 1003.96 | +14% || 0.99 | 0.97 | -2% | 0.1033 |
+| 88 || 2689.76 | 2706.30 | +1% || 0.99 | 0.97 | -2% | 0.8979 |
+| 91 || 203.02 | 222.40 | +10% || 0.99 | 0.97 | -2% | 0.5234 |
+| 92 || 334.79 | 325.92 | -3% || 0.99 | 0.97 | -2% | 0.8550 |
+| 93 || 2358.47 | 2208.69 | -6% || 0.99 | 0.97 | -2% | 0.0771 |
+| 94 || 473.33 | 531.32 | +12% || 0.99 | 0.97 | -2% | 0.2981 |
+| 95 || 2199.38 | 2312.72 | +5% || 0.99 | 0.97 | -2% | 0.2437 |
+| 96 || 373.95 | 412.96 | +10% || 0.99 | 0.97 | -2% | 0.3619 |
+| 97 || 4461.17 | 4306.93 | -3% || 0.99 | 0.97 | -2% | 0.1603 |
+| 99 || 1378.90 | 1371.20 | -1% || 0.99 | 0.97 | -2% | 0.8983 |
++---------++----------+----------+--------++----------+----------+--------+---------+
+| Sum || 64081.26 | 65443.24 | +2% || | | | |
+| Geomean || | | || | | -2% | |
++---------++----------+----------+--------++----------+----------+--------+---------+
hyriseBenchmarkTPCC - single-threaded
Sum of avg. item runtimes: +1% || Geometric mean of throughput changes: -1%
Configuration Overview - click to expand
+Configuration Overview---+------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCC_f5bdcb3c47233e058ef9792c861ed1794fca2d18_st.json | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCC_b1462bd925a2ddf5934cba02729cf4758d1c0176_st.json |
+-------------------------+------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------+
| GIT-HASH | f5bdcb3c47233e058ef9792c861ed1794fca2d18-dirty | b1462bd925a2ddf5934cba02729cf4758d1c0176-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2024-02-27 11:00:40 | 2024-02-27 15:05:29 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10 | 10 |
| time_unit | ns | ns |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------+------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------+
++--------------++----------+---------+--------++----------+----------+--------+----------------------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++--------------++----------+---------+--------++----------+----------+--------+----------------------+
+| Delivery || 64.53 | 65.40 | +1% || 1.53 | 1.52 | -1% | (run time too short) |
+| New-Order || 44.30 | 44.76 | +1% || 17.08 | 16.88 | -1% | 0.4747 |
+| Order-Status || 2.29 | 2.21 | -4% || 1.52 | 1.50 | -1% | (run time too short) |
+| Payment || 8.27 | 8.39 | +1% || 16.26 | 16.19 | -0% | 0.0810 |
+| Stock-Level || 3.70 | 3.65 | -1% || 1.52 | 1.47 | -3% | (run time too short) |
++--------------++----------+---------+--------++----------+----------+--------+----------------------+
+| Sum || 123.09 | 124.40 | +1% || | | | |
+| Geomean || | | || | | -1% | |
++--------------++----------+---------+--------++----------+----------+--------+----------------------+
hyriseBenchmarkTPCC - multi-threaded, shuffled, 64 clients, 64 cores
Sum of avg. item runtimes: +0% || Geometric mean of throughput changes: -0%
Configuration Overview - click to expand
+Configuration Overview---------+------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCC_f5bdcb3c47233e058ef9792c861ed1794fca2d18_mt.json | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCC_b1462bd925a2ddf5934cba02729cf4758d1c0176_mt.json |
+-------------------------------+------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------+
| GIT-HASH | f5bdcb3c47233e058ef9792c861ed1794fca2d18-dirty | b1462bd925a2ddf5934cba02729cf4758d1c0176-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 64 | 64 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2024-02-27 11:01:49 | 2024-02-27 15:06:37 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10 | 10 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------+
++--------------++----------+---------+--------++----------+----------+--------+---------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++--------------++----------+---------+--------++----------+----------+--------+---------+
+| Delivery || 319.13 | 321.22 | +1% || 17.73 | 17.63 | -1% | 0.0334 |
+| unsucc.: || 4.10 | 4.25 | +4% || 20.67 | 20.69 | +0% | |
+| New-Order || 196.41 | 196.36 | -0% || 220.84 | 220.59 | -0% | 0.8269 |
+| unsucc.: || 10.73 | 10.81 | +1% || 211.20 | 210.46 | -0% | |
+| Order-Status || 13.75 | 13.68 | -0% || 38.41 | 38.32 | -0% | 0.6378 |
+| Payment || 32.78 | 33.27 | +2% || 119.37 | 118.43 | -1% | 0.0000 |
+| unsucc.: || 7.47 | 7.57 | +1% || 293.52 | 293.50 | -0% | |
+| Stock-Level || 23.15 | 23.14 | -0% || 38.41 | 38.32 | -0% | 0.9694 |
++--------------++----------+---------+--------++----------+----------+--------+---------+
+| Sum || 585.21 | 587.67 | +0% || | | | |
+| Geomean || | | || | | -0% | |
++--------------++----------+---------+--------++----------+----------+--------+---------+
hyriseBenchmarkJoinOrder - single-threaded
Sum of avg. item runtimes: +0% || Geometric mean of throughput changes: +0%
Configuration Overview - click to expand
+Configuration Overview---+-----------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkJoinOrder_f5bdcb3c47233e058ef9792c861ed1794fca2d18_st.json | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkJoinOrder_b1462bd925a2ddf5934cba02729cf4758d1c0176_st.json |
+-------------------------+-----------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------+
| GIT-HASH | f5bdcb3c47233e058ef9792c861ed1794fca2d18-dirty | b1462bd925a2ddf5934cba02729cf4758d1c0176-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2024-02-27 11:22:06 | 2024-02-27 15:26:53 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 100 | 100 |
| time_unit | ns | ns |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------+-----------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------+
++---------++----------+----------+--------++----------+----------+--------+---------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++---------++----------+----------+--------++----------+----------+--------+---------+
+| 10a || 118.64 | 122.61 | +3%˄ || 8.43 | 8.16 | -3%˄ | 0.0716 |
+| 10b || 75.45 | 86.81 | +15%˄ || 13.25 | 11.52 | -13%˄ | 0.0000 |
+| 10c || 439.69 | 440.08 | +0%˄ || 2.27 | 2.27 | -0%˄ | 0.6026 |
+| 11a || 132.99 | 122.01 | -8%˄ || 7.52 | 8.20 | +9%˄ | 0.0000 |
+| 11b || 128.24 | 103.81 | -19%˄ || 7.80 | 9.63 | +24%˄ | 0.0000 |
+| 11c || 28.81 | 23.67 | -18%˄ || 34.70 | 42.24 | +22%˄ | 0.0000 |
+| 11d || 31.39 | 30.28 | -4%˄ || 31.85 | 33.01 | +4%˄ | 0.0001 |
+| 12a || 41.65 | 42.63 | +2%˄ || 24.01 | 23.45 | -2%˄ | 0.0000 |
+| 12b || 33.30 | 33.82 | +2%˄ || 30.03 | 29.56 | -2%˄ | 0.0000 |
+| 12c || 107.71 | 107.94 | +0%˄ || 9.28 | 9.26 | -0%˄ | 0.3440 |
+| 13a || 236.43 | 237.24 | +0%˄ || 4.23 | 4.21 | -0%˄ | 0.0039 |
+| 13b || 287.69 | 286.55 | -0%˄ || 3.48 | 3.49 | +0%˄ | 0.0000 |
+| 13c || 228.59 | 230.06 | +1%˄ || 4.37 | 4.35 | -1%˄ | 0.0067 |
+| 13d || 616.81 | 620.62 | +1% || 1.62 | 1.61 | -1% | 0.0000 |
+| 14a || 144.26 | 143.62 | -0%˄ || 6.93 | 6.96 | +0%˄ | 0.0014 |
+| 14b || 141.30 | 140.85 | -0%˄ || 7.08 | 7.10 | +0%˄ | 0.0173 |
+| 14c || 242.42 | 243.02 | +0%˄ || 4.12 | 4.11 | -0%˄ | 0.6468 |
+| 15a || 62.24 | 62.11 | -0%˄ || 16.07 | 16.10 | +0%˄ | 0.0863 |
+| 15b || 67.74 | 67.73 | -0%˄ || 14.76 | 14.76 | +0%˄ | 0.9171 |
+| 15c || 51.13 | 50.89 | -0%˄ || 19.56 | 19.65 | +0%˄ | 0.0298 |
+| 15d || 49.84 | 49.87 | +0%˄ || 20.06 | 20.05 | -0%˄ | 0.3507 |
+| 16a || 1938.55 | 1933.28 | -0% || 0.52 | 0.52 | +0% | 0.3696 |
+| 16b || 3245.05 | 3259.73 | +0% || 0.31 | 0.31 | -0% | 0.2300 |
+| 16c || 2158.69 | 2154.44 | -0% || 0.46 | 0.46 | +0% | 0.5503 |
+| 16d || 2111.37 | 2099.45 | -1% || 0.47 | 0.48 | +1% | 0.0352 |
+| 17a || 759.59 | 758.61 | -0% || 1.32 | 1.32 | +0% | 0.4644 |
+| 17b || 632.11 | 631.10 | -0% || 1.58 | 1.58 | +0% | 0.4815 |
+| 17c || 606.66 | 606.57 | -0% || 1.65 | 1.65 | +0% | 0.9509 |
+| 17d || 671.55 | 671.20 | -0% || 1.49 | 1.49 | +0% | 0.8049 |
+| 17e || 2193.42 | 2189.38 | -0% || 0.46 | 0.46 | +0% | 0.4350 |
+| 17f || 1258.52 | 1256.98 | -0% || 0.79 | 0.80 | +0% | 0.4949 |
+| 18a || 150.45 | 148.75 | -1%˄ || 6.65 | 6.72 | +1%˄ | 0.0000 |
+| 18b || 143.71 | 143.96 | +0%˄ || 6.96 | 6.95 | -0%˄ | 0.2715 |
+| 18c || 291.78 | 292.66 | +0%˄ || 3.43 | 3.42 | -0%˄ | 0.0991 |
+| 19a || 269.24 | 270.61 | +1%˄ || 3.71 | 3.70 | -1%˄ | 0.0000 |
+| 19b || 231.51 | 231.28 | -0%˄ || 4.32 | 4.32 | +0%˄ | 0.4349 |
+| 19c || 317.91 | 316.35 | -0%˄ || 3.15 | 3.16 | +0%˄ | 0.0002 |
+| 19d || 822.30 | 823.76 | +0% || 1.22 | 1.21 | -0% | 0.0159 |
+| 1a || 13.52 | 13.55 | +0%˄ || 73.92 | 73.80 | -0%˄ | 0.4878 |
+| 1b || 22.28 | 22.26 | -0%˄ || 44.87 | 44.90 | +0%˄ | 0.7655 |
+| 1c || 19.61 | 19.70 | +0%˄ || 50.99 | 50.76 | -0%˄ | 0.0178 |
+| 1d || 12.36 | 12.83 | +4%˄ || 80.90 | 77.89 | -4%˄ | 0.0000 |
+| 20a || 762.35 | 764.81 | +0% || 1.31 | 1.31 | -0% | 0.0049 |
+| 20b || 790.62 | 790.75 | +0% || 1.26 | 1.26 | -0% | 0.9071 |
+| 20c || 465.73 | 463.28 | -1%˄ || 2.15 | 2.16 | +1%˄ | 0.0000 |
+| 21a || 149.05 | 148.83 | -0%˄ || 6.71 | 6.72 | +0%˄ | 0.3216 |
+| 21b || 137.81 | 136.35 | -1%˄ || 7.26 | 7.33 | +1%˄ | 0.0000 |
+| 21c || 142.69 | 141.93 | -1%˄ || 7.01 | 7.05 | +1%˄ | 0.0062 |
+| 22a || 231.37 | 231.88 | +0%˄ || 4.32 | 4.31 | -0%˄ | 0.1988 |
+| 22b || 210.02 | 211.83 | +1%˄ || 4.76 | 4.72 | -1%˄ | 0.0005 |
+| 22c || 313.07 | 312.35 | -0%˄ || 3.19 | 3.20 | +0%˄ | 0.0742 |
+| 22d || 489.58 | 486.95 | -1%˄ || 2.04 | 2.05 | +1%˄ | 0.0008 |
+| 23a || 55.64 | 55.53 | -0%˄ || 17.97 | 18.01 | +0%˄ | 0.0012 |
+| 23b || 71.50 | 71.78 | +0%˄ || 13.99 | 13.93 | -0%˄ | 0.2287 |
+| 23c || 61.26 | 60.78 | -1%˄ || 16.32 | 16.45 | +1%˄ | 0.0000 |
+| 24a || 231.94 | 232.03 | +0%˄ || 4.31 | 4.31 | -0%˄ | 0.6613 |
+| 24b || 224.97 | 225.35 | +0%˄ || 4.44 | 4.44 | -0%˄ | 0.0133 |
+| 25a || 152.81 | 153.38 | +0%˄ || 6.54 | 6.52 | -0%˄ | 0.0951 |
+| 25b || 87.47 | 87.81 | +0%˄ || 11.43 | 11.39 | -0%˄ | 0.0000 |
+| 25c || 358.60 | 356.98 | -0%˄ || 2.79 | 2.80 | +0%˄ | 0.0373 |
+| 26a || 264.05 | 264.73 | +0%˄ || 3.79 | 3.78 | -0%˄ | 0.2846 |
+| 26b || 227.16 | 227.55 | +0%˄ || 4.40 | 4.39 | -0%˄ | 0.6181 |
+| 26c || 444.06 | 444.26 | +0%˄ || 2.25 | 2.25 | -0%˄ | 0.5149 |
+| 27a || 139.93 | 140.16 | +0%˄ || 7.15 | 7.13 | -0%˄ | 0.4303 |
+| 27b || 121.37 | 122.81 | +1%˄ || 8.24 | 8.14 | -1%˄ | 0.0000 |
+| 27c || 141.60 | 142.41 | +1%˄ || 7.06 | 7.02 | -1%˄ | 0.0016 |
+| 28a || 258.45 | 258.63 | +0%˄ || 3.87 | 3.87 | -0%˄ | 0.5122 |
+| 28b || 95.31 | 95.22 | -0%˄ || 10.49 | 10.50 | +0%˄ | 0.6801 |
+| 28c || 234.34 | 234.26 | -0%˄ || 4.27 | 4.27 | +0%˄ | 0.8537 |
+| 29a || 184.70 | 183.89 | -0%˄ || 5.41 | 5.44 | +0%˄ | 0.0000 |
+| 29b || 838.67 | 835.45 | -0% || 1.19 | 1.20 | +0% | 0.0000 |
+| 29c || 239.40 | 240.06 | +0%˄ || 4.18 | 4.17 | -0%˄ | 0.0000 |
+| 2a || 44.18 | 43.62 | -1%˄ || 22.63 | 22.92 | +1%˄ | 0.0119 |
+| 2b || 40.40 | 40.33 | -0%˄ || 24.75 | 24.79 | +0%˄ | 0.0036 |
+| 2c || 34.43 | 34.65 | +1%˄ || 29.04 | 28.85 | -1%˄ | 0.0000 |
+| 2d || 86.05 | 86.48 | +0%˄ || 11.62 | 11.56 | -1%˄ | 0.1894 |
+| 30a || 129.78 | 129.55 | -0%˄ || 7.70 | 7.72 | +0%˄ | 0.5500 |
+| 30b || 130.83 | 132.43 | +1%˄ || 7.64 | 7.55 | -1%˄ | 0.0000 |
+| 30c || 231.04 | 229.10 | -1%˄ || 4.33 | 4.36 | +1%˄ | 0.0000 |
+| 31a || 108.89 | 108.78 | -0%˄ || 9.18 | 9.19 | +0%˄ | 0.2858 |
+| 31b || 105.55 | 105.05 | -0%˄ || 9.47 | 9.52 | +0%˄ | 0.0344 |
+| 31c || 121.46 | 121.36 | -0%˄ || 8.23 | 8.24 | +0%˄ | 0.3478 |
+| 32a || 23.27 | 23.21 | -0%˄ || 42.96 | 43.07 | +0%˄ | 0.1399 |
+| 32b || 52.47 | 53.60 | +2%˄ || 19.06 | 18.66 | -2%˄ | 0.0000 |
+| 33a || 45.83 | 45.28 | -1%˄ || 21.82 | 22.08 | +1%˄ | 0.0002 |
+| 33b || 27.69 | 28.00 | +1%˄ || 36.10 | 35.71 | -1%˄ | 0.0000 |
+| 33c || 59.69 | 59.04 | -1%˄ || 16.75 | 16.94 | +1%˄ | 0.0000 |
+| 3a || 100.86 | 100.77 | -0%˄ || 9.91 | 9.92 | +0%˄ | 0.7539 |
+| 3b || 22.02 | 22.02 | -0%˄ || 45.40 | 45.40 | +0%˄ | 0.9331 |
+| 3c || 295.29 | 301.06 | +2%˄ || 3.39 | 3.32 | -2%˄ | 0.0000 |
+| 4a || 197.04 | 197.76 | +0%˄ || 5.07 | 5.06 | -0%˄ | 0.2249 |
+| 4b || 20.70 | 20.66 | -0%˄ || 48.30 | 48.39 | +0%˄ | 0.5332 |
+| 4c || 249.73 | 251.10 | +1%˄ || 4.00 | 3.98 | -1%˄ | 0.0212 |
+| 5a || 64.41 | 64.53 | +0%˄ || 15.52 | 15.49 | -0%˄ | 0.5784 |
+| 5b || 60.81 | 60.95 | +0%˄ || 16.44 | 16.41 | -0%˄ | 0.2487 |
+| 5c || 112.88 | 112.44 | -0%˄ || 8.86 | 8.89 | +0%˄ | 0.0074 |
+| 6a || 220.01 | 219.81 | -0%˄ || 4.55 | 4.55 | +0%˄ | 0.7064 |
+| 6b || 238.88 | 238.52 | -0%˄ || 4.19 | 4.19 | +0%˄ | 0.6255 |
+| 6c || 207.21 | 207.86 | +0%˄ || 4.83 | 4.81 | -0%˄ | 0.0017 |
+| 6d || 559.60 | 561.26 | +0%˄ || 1.79 | 1.78 | -0%˄ | 0.1841 |
+| 6e || 216.91 | 217.35 | +0%˄ || 4.61 | 4.60 | -0%˄ | 0.4820 |
+| 6f || 1051.44 | 1051.89 | +0% || 0.95 | 0.95 | -0% | 0.7741 |
+| 7a || 93.49 | 94.26 | +1%˄ || 10.70 | 10.61 | -1%˄ | 0.0000 |
+| 7b || 84.11 | 85.47 | +2%˄ || 11.89 | 11.70 | -2%˄ | 0.0000 |
+| 7c || 718.20 | 724.67 | +1% || 1.39 | 1.38 | -1% | 0.0001 |
+| 8a || 187.94 | 186.84 | -1%˄ || 5.32 | 5.35 | +1%˄ | 0.0000 |
+| 8b || 181.31 | 180.40 | -1%˄ || 5.52 | 5.54 | +1%˄ | 0.0000 |
+| 8c || 2207.08 | 2220.87 | +1% || 0.45 | 0.45 | -1% | 0.0086 |
+| 8d || 361.91 | 362.19 | +0%˄ || 2.76 | 2.76 | -0%˄ | 0.5193 |
+| 9a || 324.54 | 324.92 | +0%˄ || 3.08 | 3.08 | -0%˄ | 0.2427 |
+| 9b || 214.92 | 215.67 | +0%˄ || 4.65 | 4.64 | -0%˄ | 0.0034 |
+| 9c || 349.72 | 350.67 | +0%˄ || 2.86 | 2.85 | -0%˄ | 0.0865 |
+| 9d || 565.27 | 571.20 | +1%˄ || 1.77 | 1.75 | -1%˄ | 0.0000 |
++---------++----------+----------+--------++----------+----------+--------+---------+
+| Sum || 39409.86 | 39410.30 | +0% || | | | |
+| Geomean || | | || | | +0% | |
++---------++----------+----------+--------++----------+----------+--------+---------+
+| Notes || ˄ Execution stopped due to max runs reached |
++---------++----------+----------+--------++----------+----------+--------+---------+
hyriseBenchmarkJoinOrder - multi-threaded, shuffled, 64 clients, 64 cores
Sum of avg. item runtimes: -0% || Geometric mean of throughput changes: +0%
Configuration Overview - click to expand
+Configuration Overview---------+-----------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkJoinOrder_f5bdcb3c47233e058ef9792c861ed1794fca2d18_mt.json | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkJoinOrder_b1462bd925a2ddf5934cba02729cf4758d1c0176_mt.json |
+-------------------------------+-----------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------+
| GIT-HASH | f5bdcb3c47233e058ef9792c861ed1794fca2d18-dirty | b1462bd925a2ddf5934cba02729cf4758d1c0176-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 64 | 64 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2024-02-27 12:09:43 | 2024-02-27 16:14:31 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+-----------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------+
++---------++----------+----------+--------++----------+----------+--------+---------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++---------++----------+----------+--------++----------+----------+--------+---------+
+| 10a || 231.23 | 208.11 | -10% || 1.11 | 1.11 | +0% | 0.3407 |
+| 10b || 184.02 | 163.72 | -11% || 1.11 | 1.11 | +0% | 0.3984 |
+| 10c || 597.44 | 655.32 | +10% || 1.11 | 1.11 | +0% | 0.1232 |
+| 11a || 139.21 | 150.26 | +8% || 1.11 | 1.11 | +0% | 0.5357 |
+| 11b || 143.62 | 127.86 | -11% || 1.11 | 1.11 | +0% | 0.4379 |
+| 11c || 101.20 | 110.20 | +9% || 1.11 | 1.11 | +0% | 0.5037 |
+| 11d || 120.51 | 94.41 | -22% || 1.11 | 1.11 | +0% | 0.0546 |
+| 12a || 171.30 | 173.44 | +1% || 1.11 | 1.11 | +0% | 0.9232 |
+| 12b || 95.24 | 95.81 | +1% || 1.11 | 1.11 | +0% | 0.9680 |
+| 12c || 414.94 | 394.90 | -5% || 1.11 | 1.11 | +0% | 0.5392 |
+| 13a || 534.18 | 531.61 | -0% || 1.11 | 1.11 | +0% | 0.9336 |
+| 13b || 390.84 | 367.57 | -6% || 1.11 | 1.11 | +0% | 0.3954 |
+| 13c || 354.03 | 423.24 | +20% || 1.11 | 1.11 | +0% | 0.0345 |
+| 13d || 987.33 | 982.41 | -0% || 1.11 | 1.11 | +0% | 0.8897 |
+| 14a || 439.38 | 411.85 | -6% || 1.11 | 1.11 | +0% | 0.3602 |
+| 14b || 488.91 | 472.83 | -3% || 1.11 | 1.11 | +0% | 0.6419 |
+| 14c || 640.21 | 630.52 | -2% || 1.11 | 1.11 | +0% | 0.7855 |
+| 15a || 145.02 | 135.90 | -6% || 1.11 | 1.11 | +0% | 0.5865 |
+| 15b || 119.60 | 144.21 | +21% || 1.11 | 1.11 | +0% | 0.1428 |
+| 15c || 139.98 | 162.96 | +16% || 1.11 | 1.11 | +0% | 0.1980 |
+| 15d || 167.11 | 166.69 | -0% || 1.11 | 1.11 | +0% | 0.9814 |
+| 16a || 1664.25 | 1682.19 | +1% || 1.11 | 1.11 | +0% | 0.6917 |
+| 16b || 3242.24 | 3284.11 | +1% || 1.11 | 1.11 | -0% | 0.4227 |
+| 16c || 1897.12 | 1932.41 | +2% || 1.11 | 1.11 | -0% | 0.4469 |
+| 16d || 1921.43 | 1933.75 | +1% || 1.11 | 1.11 | +0% | 0.8104 |
+| 17a || 949.44 | 979.60 | +3% || 1.11 | 1.11 | +0% | 0.5189 |
+| 17b || 679.33 | 707.60 | +4% || 1.11 | 1.11 | +0% | 0.4369 |
+| 17c || 641.25 | 653.90 | +2% || 1.11 | 1.11 | +0% | 0.7301 |
+| 17d || 698.08 | 632.16 | -9% || 1.11 | 1.11 | +0% | 0.0924 |
+| 17e || 1842.62 | 1787.22 | -3% || 1.11 | 1.11 | +0% | 0.2543 |
+| 17f || 1291.23 | 1265.95 | -2% || 1.11 | 1.11 | +0% | 0.6087 |
+| 18a || 305.72 | 318.08 | +4% || 1.11 | 1.11 | +0% | 0.6615 |
+| 18b || 394.00 | 440.03 | +12% || 1.11 | 1.11 | +0% | 0.1778 |
+| 18c || 769.14 | 712.99 | -7% || 1.11 | 1.11 | +0% | 0.2342 |
+| 19a || 639.41 | 640.95 | +0% || 1.11 | 1.11 | +0% | 0.9683 |
+| 19b || 421.80 | 447.77 | +6% || 1.11 | 1.11 | +0% | 0.4224 |
+| 19c || 714.79 | 749.88 | +5% || 1.11 | 1.11 | +0% | 0.4302 |
+| 19d || 1585.67 | 1527.64 | -4% || 1.11 | 1.11 | +0% | 0.2428 |
+| 1a || 39.83 | 41.91 | +5% || 1.11 | 1.11 | +0% | 0.7396 |
+| 1b || 65.62 | 70.06 | +7% || 1.11 | 1.11 | +0% | 0.7566 |
+| 1c || 52.34 | 68.35 | +31% || 1.11 | 1.11 | +0% | 0.1532 |
+| 1d || 34.20 | 36.60 | +7% || 1.11 | 1.11 | +0% | 0.6855 |
+| 20a || 529.70 | 506.65 | -4% || 1.11 | 1.11 | +0% | 0.5069 |
+| 20b || 423.54 | 441.36 | +4% || 1.11 | 1.11 | +0% | 0.5856 |
+| 20c || 420.14 | 454.38 | +8% || 1.11 | 1.11 | +0% | 0.3084 |
+| 21a || 218.63 | 198.84 | -9% || 1.11 | 1.11 | +0% | 0.4103 |
+| 21b || 177.77 | 154.60 | -13% || 1.11 | 1.11 | +0% | 0.2957 |
+| 21c || 191.30 | 215.65 | +13% || 1.11 | 1.11 | +0% | 0.3576 |
+| 22a || 577.99 | 534.03 | -8% || 1.11 | 1.11 | +0% | 0.2553 |
+| 22b || 526.54 | 482.16 | -8% || 1.11 | 1.11 | +0% | 0.2665 |
+| 22c || 806.72 | 780.94 | -3% || 1.11 | 1.11 | +0% | 0.5671 |
+| 22d || 1061.05 | 1117.80 | +5% || 1.11 | 1.11 | +0% | 0.2889 |
+| 23a || 175.96 | 179.12 | +2% || 1.11 | 1.11 | +0% | 0.8850 |
+| 23b || 149.78 | 133.52 | -11% || 1.11 | 1.11 | +0% | 0.3485 |
+| 23c || 194.10 | 192.18 | -1% || 1.11 | 1.11 | +0% | 0.9288 |
+| 24a || 486.90 | 481.96 | -1% || 1.11 | 1.11 | +0% | 0.9039 |
+| 24b || 312.88 | 336.97 | +8% || 1.11 | 1.11 | +0% | 0.4203 |
+| 25a || 479.81 | 473.89 | -1% || 1.11 | 1.11 | +0% | 0.8607 |
+| 25b || 291.58 | 259.35 | -11% || 1.11 | 1.11 | +0% | 0.2918 |
+| 25c || 955.24 | 993.90 | +4% || 1.11 | 1.11 | +0% | 0.4318 |
+| 26a || 442.51 | 412.53 | -7% || 1.11 | 1.11 | +0% | 0.2959 |
+| 26b || 303.13 | 291.66 | -4% || 1.11 | 1.11 | +0% | 0.6443 |
+| 26c || 664.45 | 642.13 | -3% || 1.11 | 1.11 | +0% | 0.5049 |
+| 27a || 232.61 | 213.70 | -8% || 1.11 | 1.11 | +0% | 0.5014 |
+| 27b || 156.02 | 204.45 | +31% || 1.11 | 1.11 | +0% | 0.0295 |
+| 27c || 225.47 | 246.37 | +9% || 1.11 | 1.11 | +0% | 0.4428 |
+| 28a || 769.50 | 754.11 | -2% || 1.11 | 1.11 | +0% | 0.7126 |
+| 28b || 295.84 | 304.18 | +3% || 1.11 | 1.11 | +0% | 0.7762 |
+| 28c || 674.86 | 756.78 | +12% || 1.11 | 1.11 | +0% | 0.0374 |
+| 29a || 315.79 | 340.32 | +8% || 1.11 | 1.11 | +0% | 0.3977 |
+| 29b || 426.62 | 416.71 | -2% || 1.11 | 1.11 | +0% | 0.7910 |
+| 29c || 428.73 | 455.32 | +6% || 1.11 | 1.11 | +0% | 0.4487 |
+| 2a || 136.42 | 158.55 | +16% || 1.11 | 1.11 | +0% | 0.1304 |
+| 2b || 157.17 | 128.78 | -18% || 1.11 | 1.11 | +0% | 0.0976 |
+| 2c || 92.29 | 119.77 | +30% || 1.11 | 1.11 | +0% | 0.0366 |
+| 2d || 231.85 | 241.73 | +4% || 1.11 | 1.11 | +0% | 0.5845 |
+| 30a || 439.61 | 451.03 | +3% || 1.11 | 1.11 | +0% | 0.7743 |
+| 30b || 427.63 | 396.14 | -7% || 1.11 | 1.11 | +0% | 0.3710 |
+| 30c || 738.98 | 754.41 | +2% || 1.11 | 1.11 | +0% | 0.7175 |
+| 31a || 332.29 | 357.73 | +8% || 1.11 | 1.11 | +0% | 0.4533 |
+| 31b || 267.09 | 264.76 | -1% || 1.11 | 1.11 | +0% | 0.9342 |
+| 31c || 421.81 | 394.96 | -6% || 1.11 | 1.11 | +0% | 0.4558 |
+| 32a || 59.74 | 58.95 | -1% || 1.11 | 1.11 | +0% | 0.9342 |
+| 32b || 236.10 | 205.77 | -13% || 1.11 | 1.11 | +0% | 0.2421 |
+| 33a || 164.79 | 148.89 | -10% || 1.11 | 1.11 | +0% | 0.4880 |
+| 33b || 80.80 | 97.31 | +20% || 1.11 | 1.11 | +0% | 0.1561 |
+| 33c || 188.91 | 204.92 | +8% || 1.11 | 1.11 | +0% | 0.5169 |
+| 3a || 292.82 | 312.64 | +7% || 1.11 | 1.11 | +0% | 0.4733 |
+| 3b || 106.52 | 85.96 | -19% || 1.11 | 1.11 | +0% | 0.3087 |
+| 3c || 533.75 | 543.98 | +2% || 1.11 | 1.11 | +0% | 0.8079 |
+| 4a || 331.78 | 326.19 | -2% || 1.11 | 1.11 | +0% | 0.8580 |
+| 4b || 63.77 | 64.59 | +1% || 1.11 | 1.11 | +0% | 0.9409 |
+| 4c || 348.18 | 377.94 | +9% || 1.11 | 1.11 | +0% | 0.3062 |
+| 5a || 256.35 | 269.92 | +5% || 1.11 | 1.11 | +0% | 0.6479 |
+| 5b || 167.09 | 154.07 | -8% || 1.11 | 1.11 | +0% | 0.5335 |
+| 5c || 429.00 | 355.40 | -17% || 1.11 | 1.11 | +0% | 0.0428 |
+| 6a || 166.28 | 168.39 | +1% || 1.11 | 1.11 | +0% | 0.9099 |
+| 6b || 215.85 | 205.48 | -5% || 1.11 | 1.11 | +0% | 0.6013 |
+| 6c || 158.24 | 150.62 | -5% || 1.11 | 1.11 | +0% | 0.7030 |
+| 6d || 578.65 | 610.12 | +5% || 1.11 | 1.11 | +0% | 0.4024 |
+| 6e || 163.87 | 169.00 | +3% || 1.11 | 1.11 | +0% | 0.8179 |
+| 6f || 1256.57 | 1276.33 | +2% || 1.11 | 1.11 | +0% | 0.6207 |
+| 7a || 198.00 | 176.17 | -11% || 1.11 | 1.11 | +0% | 0.3167 |
+| 7b || 178.69 | 193.96 | +9% || 1.11 | 1.11 | +0% | 0.4618 |
+| 7c || 1182.53 | 1122.10 | -5% || 1.11 | 1.11 | +0% | 0.1987 |
+| 8a || 234.73 | 237.21 | +1% || 1.11 | 1.11 | +0% | 0.9186 |
+| 8b || 193.77 | 188.92 | -3% || 1.11 | 1.11 | +0% | 0.8161 |
+| 8c || 2511.89 | 2478.03 | -1% || 1.11 | 1.11 | +0% | 0.5122 |
+| 8d || 726.74 | 720.42 | -1% || 1.11 | 1.11 | +0% | 0.8462 |
+| 9a || 806.16 | 742.23 | -8% || 1.11 | 1.11 | +0% | 0.1524 |
+| 9b || 510.14 | 530.96 | +4% || 1.11 | 1.11 | +0% | 0.5909 |
+| 9c || 746.61 | 736.32 | -1% || 1.11 | 1.11 | -0% | 0.8151 |
+| 9d || 1253.06 | 1194.88 | -5% || 1.11 | 1.11 | +0% | 0.2468 |
++---------++----------+----------+--------++----------+----------+--------+---------+
+| Sum || 56956.50 | 56868.08 | -0% || | | | |
+| Geomean || | | || | | +0% | |
++---------++----------+----------+--------++----------+----------+--------+---------+
hyriseBenchmarkStarSchema - single-threaded
Sum of avg. item runtimes: -4% || Geometric mean of throughput changes: +1%
Configuration Overview - click to expand
+Configuration Overview---+------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkStarSchema_f5bdcb3c47233e058ef9792c861ed1794fca2d18_st.json | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkStarSchema_b1462bd925a2ddf5934cba02729cf4758d1c0176_st.json |
+-------------------------+------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | f5bdcb3c47233e058ef9792c861ed1794fca2d18-dirty | b1462bd925a2ddf5934cba02729cf4758d1c0176-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2024-02-27 12:30:15 | 2024-02-27 16:35:02 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 100 | 100 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------+------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------+
++---------++----------+----------+--------++----------+----------+--------+---------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++---------++----------+----------+--------++----------+----------+--------+---------+
+| 1.1 || 495.59 | 507.44 | +2%˄ || 2.02 | 1.97 | -2%˄ | 0.0342 |
+| 1.2 || 267.60 | 270.20 | +1%˄ || 3.74 | 3.70 | -1%˄ | 0.0509 |
+| 1.3 || 257.26 | 256.79 | -0%˄ || 3.89 | 3.89 | +0%˄ | 0.6566 |
+| 2.1 || 825.92 | 824.96 | -0% || 1.21 | 1.21 | +0% | 0.5510 |
+| 2.2 || 438.29 | 438.92 | +0%˄ || 2.28 | 2.28 | -0%˄ | 0.1649 |
+| 2.3 || 257.40 | 258.07 | +0%˄ || 3.88 | 3.87 | -0%˄ | 0.0613 |
+| 3.1 || 3300.02 | 3185.98 | -3% || 0.30 | 0.31 | +4% | 0.0000 |
+| 3.2 || 424.64 | 414.88 | -2%˄ || 2.35 | 2.41 | +2%˄ | 0.0000 |
+| 3.3 || 168.04 | 165.12 | -2%˄ || 5.95 | 6.06 | +2%˄ | 0.0000 |
+| 3.4 || 155.60 | 153.23 | -2%˄ || 6.43 | 6.53 | +2%˄ | 0.0000 |
+| 4.1 || 3665.60 | 3375.19 | -8% || 0.27 | 0.30 | +9% | 0.0000 |
+| 4.2 || 1095.65 | 1076.57 | -2% || 0.91 | 0.93 | +2% | 0.0532 |
+| 4.3 || 322.14 | 314.76 | -2%˄ || 3.10 | 3.18 | +2%˄ | 0.0000 |
++---------++----------+----------+--------++----------+----------+--------+---------+
+| Sum || 11673.74 | 11242.10 | -4% || | | | |
+| Geomean || | | || | | +1% | |
++---------++----------+----------+--------++----------+----------+--------+---------+
+| Notes || ˄ Execution stopped due to max runs reached |
++---------++----------+----------+--------++----------+----------+--------+---------+
hyriseBenchmarkStarSchema - multi-threaded, shuffled, 64 clients, 64 cores
Sum of avg. item runtimes: -1% || Geometric mean of throughput changes: +1%
Configuration Overview - click to expand
+Configuration Overview---------+------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkStarSchema_f5bdcb3c47233e058ef9792c861ed1794fca2d18_mt.json | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkStarSchema_b1462bd925a2ddf5934cba02729cf4758d1c0176_mt.json |
+-------------------------------+------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | f5bdcb3c47233e058ef9792c861ed1794fca2d18-dirty | b1462bd925a2ddf5934cba02729cf4758d1c0176-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 64 | 64 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2024-02-27 12:39:43 | 2024-02-27 16:44:26 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------+
++---------++----------+----------+--------++----------+----------+--------+---------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++---------++----------+----------+--------++----------+----------+--------+---------+
+| 1.1 || 920.13 | 918.16 | -0% || 3.53 | 3.57 | +1% | 0.9440 |
+| 1.2 || 504.97 | 493.93 | -2% || 3.53 | 3.57 | +1% | 0.5342 |
+| 1.3 || 473.41 | 459.68 | -3% || 3.53 | 3.57 | +1% | 0.4383 |
+| 2.1 || 2301.06 | 2254.62 | -2% || 3.53 | 3.56 | +1% | 0.2986 |
+| 2.2 || 1297.26 | 1243.64 | -4% || 3.53 | 3.57 | +1% | 0.1214 |
+| 2.3 || 411.55 | 401.53 | -2% || 3.53 | 3.57 | +1% | 0.5305 |
+| 3.1 || 3214.13 | 3219.95 | +0% || 3.52 | 3.56 | +1% | 0.8856 |
+| 3.2 || 1173.45 | 1143.50 | -3% || 3.53 | 3.57 | +1% | 0.3206 |
+| 3.3 || 564.01 | 578.72 | +3% || 3.53 | 3.57 | +1% | 0.5003 |
+| 3.4 || 584.33 | 573.07 | -2% || 3.53 | 3.57 | +1% | 0.6231 |
+| 4.1 || 3016.49 | 3044.47 | +1% || 3.53 | 3.56 | +1% | 0.4899 |
+| 4.2 || 2675.27 | 2681.49 | +0% || 3.52 | 3.56 | +1% | 0.8942 |
+| 4.3 || 844.90 | 819.21 | -3% || 3.53 | 3.57 | +1% | 0.3231 |
++---------++----------+----------+--------++----------+----------+--------+---------+
+| Sum || 17980.97 | 17831.97 | -1% || | | | |
+| Geomean || | | || | | +1% | |
++---------++----------+----------+--------++----------+----------+--------+---------+
Intel
System
cx01 - click to expand
| property | value |
|---|---|
| Hostname | cx01 |
| CPU | Intel(R) Xeon(R) Gold 5220S CPU @ 2.70GHz |
| Memory | 178GB |
| numactl | nodebind: 0 1 |
| numactl | membind: 0 1 2 3 |
Commit Info and Build Time
| commit | date | message | build time |
|---|---|---|---|
| f5bdcb3c4 | 13.02.2024 14:38 | Improve Predicate Placement and Avoid Semi-Join Reductions (#2590) | real 375.43 user 4284.91 sys 159.84 |
| b1462bd92 | 26.02.2024 22:44 | Revert third party to master | real 390.04 user 4301.86 sys 160.97 |
hyriseBenchmarkTPCH - single-threaded, SF 10.0
Sum of avg. item runtimes: -1% || Geometric mean of throughput changes: +1%
Configuration Overview - click to expand
+Configuration Overview----+--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkTPCH_f5bdcb3c47233e058ef9792c861ed1794fca2d18_st.json | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkTPCH_b1462bd925a2ddf5934cba02729cf4758d1c0176_st.json |
+--------------------------+--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+
| GIT-HASH | f5bdcb3c47233e058ef9792c861ed1794fca2d18-dirty | b1462bd925a2ddf5934cba02729cf4758d1c0176-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| clustering | None | None |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2024-02-27 07:52:39 | 2024-02-27 11:36:59 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 100 | 100 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| use_prepared_statements | False | False |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+--------------------------+--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+
++----------++----------+----------+--------++----------+----------+--------+---------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++----------++----------+----------+--------++----------+----------+--------+---------+
+| TPC-H 01 || 5719.82 | 5677.18 | -1% || 0.17 | 0.18 | +1% | 0.6311 |
+| TPC-H 02 || 42.27 | 42.29 | +0%˄ || 23.65 | 23.64 | -0%˄ | 0.9691 |
+| TPC-H 03 || 1239.91 | 1217.89 | -2% || 0.81 | 0.82 | +2% | 0.0139 |
+| TPC-H 04 || 1260.66 | 1254.76 | -0% || 0.79 | 0.80 | +0% | 0.5797 |
+| TPC-H 05 || 1989.42 | 1984.07 | -0% || 0.50 | 0.50 | +0% | 0.6650 |
+| TPC-H 06 || 152.39 | 145.32 | -5%˄ || 6.56 | 6.88 | +5%˄ | 0.0000 |
+| TPC-H 07 || 741.27 | 743.62 | +0% || 1.35 | 1.34 | -0% | 0.3775 |
+| TPC-H 08 || 462.75 | 472.80 | +2%˄ || 2.16 | 2.12 | -2%˄ | 0.0000 |
+| TPC-H 09 || 4714.26 | 4739.63 | +1% || 0.21 | 0.21 | -1% | 0.1223 |
+| TPC-H 10 || 1566.35 | 1202.10 | -23% || 0.64 | 0.83 | +30% | 0.0000 |
+| TPC-H 11 || 56.80 | 55.44 | -2%˄ || 17.60 | 18.04 | +2%˄ | 0.0000 |
+| TPC-H 12 || 859.59 | 855.38 | -0% || 1.16 | 1.17 | +0% | 0.0027 |
+| TPC-H 13 || 4652.42 | 4499.79 | -3% || 0.21 | 0.22 | +3% | 0.0000 |
+| TPC-H 14 || 389.18 | 386.03 | -1%˄ || 2.57 | 2.59 | +1%˄ | 0.0172 |
+| TPC-H 15 || 177.32 | 167.62 | -5%˄ || 5.64 | 5.97 | +6%˄ | 0.0000 |
+| TPC-H 16 || 541.41 | 553.96 | +2%˄ || 1.85 | 1.81 | -2%˄ | 0.0000 |
+| TPC-H 17 || 200.30 | 197.93 | -1%˄ || 4.99 | 5.05 | +1%˄ | 0.0000 |
+| TPC-H 18 || 1407.24 | 1532.31 | +9% || 0.71 | 0.65 | -8% | 0.0000 |
+| TPC-H 19 || 191.09 | 192.67 | +1%˄ || 5.23 | 5.19 | -1%˄ | 0.0608 |
+| TPC-H 20 || 430.70 | 463.61 | +8%˄ || 2.32 | 2.16 | -7%˄ | 0.0358 |
+| TPC-H 21 || 3413.81 | 3371.47 | -1% || 0.29 | 0.30 | +1% | 0.0447 |
+| TPC-H 22 || 411.68 | 408.14 | -1%˄ || 2.43 | 2.45 | +1%˄ | 0.0000 |
++----------++----------+----------+--------++----------+----------+--------+---------+
+| Sum || 30620.65 | 30164.02 | -1% || | | | |
+| Geomean || | | || | | +1% | |
++----------++----------+----------+--------++----------+----------+--------+---------+
+| Notes || ˄ Execution stopped due to max runs reached |
++----------++----------+----------+--------++----------+----------+--------+---------+
hyriseBenchmarkTPCH - single-threaded, SF 0.01
Sum of avg. item runtimes: -1% || Geometric mean of throughput changes: +2%
Configuration Overview - click to expand
+Configuration Overview----+------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkTPCH_f5bdcb3c47233e058ef9792c861ed1794fca2d18_st_s01.json | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkTPCH_b1462bd925a2ddf5934cba02729cf4758d1c0176_st_s01.json |
+--------------------------+------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | f5bdcb3c47233e058ef9792c861ed1794fca2d18-dirty | b1462bd925a2ddf5934cba02729cf4758d1c0176-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| clustering | None | None |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2024-02-27 08:11:16 | 2024-02-27 11:55:34 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 100 | 100 |
| scale_factor | 0.009999999776482582 | 0.009999999776482582 |
| time_unit | ns | ns |
| use_prepared_statements | False | False |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+--------------------------+------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------+
++----------++----------+---------+--------++----------+----------+--------+---------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++----------++----------+---------+--------++----------+----------+--------+---------+
+| TPC-H 01 || 4.96 | 4.96 | +0%˄ || 201.75 | 201.46 | -0%˄ | 0.5953 |
+| TPC-H 02 || 3.97 | 3.94 | -1%˄ || 251.86 | 253.95 | +1%˄ | 0.8921 |
+| TPC-H 03 || 0.58 | 0.57 | -1%˄ || 1731.22 | 1757.00 | +1%˄ | 0.0131 |
+| TPC-H 04 || 0.40 | 0.40 | -1%˄ || 2496.99 | 2514.98 | +1%˄ | 0.0131 |
+| TPC-H 05 || 0.97 | 0.99 | +2%˄ || 1030.37 | 1012.06 | -2%˄ | 0.2861 |
+| TPC-H 06 || 0.17 | 0.17 | +0%˄ || 5681.84 | 5680.68 | -0%˄ | 0.8744 |
+| TPC-H 07 || 11.10 | 10.91 | -2%˄ || 90.10 | 91.67 | +2%˄ | 0.7618 |
+| TPC-H 08 || 14.94 | 14.78 | -1%˄ || 66.95 | 67.67 | +1%˄ | 0.7206 |
+| TPC-H 09 || 3.90 | 3.71 | -5%˄ || 256.47 | 269.68 | +5%˄ | 0.7329 |
+| TPC-H 10 || 0.73 | 0.63 | -14%˄ || 1360.52 | 1587.69 | +17%˄ | 0.0000 |
+| TPC-H 11 || 0.20 | 0.20 | -2%˄ || 4887.43 | 4962.34 | +2%˄ | 0.0682 |
+| TPC-H 12 || 0.59 | 0.58 | -1%˄ || 1697.98 | 1712.41 | +1%˄ | 0.0032 |
+| TPC-H 13 || 1.94 | 1.96 | +1%˄ || 515.00 | 509.74 | -1%˄ | 0.0014 |
+| TPC-H 14 || 0.32 | 0.32 | -1%˄ || 3093.28 | 3125.40 | +1%˄ | 0.2273 |
+| TPC-H 15 || 1.32 | 1.31 | -1%˄ || 755.85 | 762.16 | +1%˄ | 0.0002 |
+| TPC-H 16 || 2.27 | 2.26 | -0%˄ || 439.90 | 441.34 | +0%˄ | 0.1681 |
+| TPC-H 17 || 0.62 | 0.59 | -5%˄ || 1606.56 | 1699.05 | +6%˄ | 0.6671 |
+| TPC-H 18 || 1.12 | 1.05 | -6%˄ || 892.15 | 948.66 | +6%˄ | 0.0000 |
+| TPC-H 19 || 5.80 | 5.78 | -0%˄ || 172.38 | 172.88 | +0%˄ | 0.0118 |
+| TPC-H 20 || 2.67 | 2.68 | +0%˄ || 373.70 | 373.47 | -0%˄ | 0.9743 |
+| TPC-H 21 || 1.03 | 0.97 | -6%˄ || 965.61 | 1031.67 | +7%˄ | 0.0807 |
+| TPC-H 22 || 1.21 | 1.20 | -0%˄ || 825.47 | 829.43 | +0%˄ | 0.0002 |
++----------++----------+---------+--------++----------+----------+--------+---------+
+| Sum || 60.81 | 59.95 | -1% || | | | |
+| Geomean || | | || | | +2% | |
++----------++----------+---------+--------++----------+----------+--------+---------+
+| Notes || ˄ Execution stopped due to max runs reached |
++----------++----------+---------+--------++----------+----------+--------+---------+
hyriseBenchmarkTPCH - multi-threaded, ordered, 1 client, 9 cores, SF 10.0
Sum of avg. item runtimes: -5% || Geometric mean of throughput changes: +4%
Configuration Overview - click to expand
+Configuration Overview---------+----------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkTPCH_f5bdcb3c47233e058ef9792c861ed1794fca2d18_mt_ordered.json | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkTPCH_b1462bd925a2ddf5934cba02729cf4758d1c0176_mt_ordered.json |
+-------------------------------+----------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | f5bdcb3c47233e058ef9792c861ed1794fca2d18-dirty | b1462bd925a2ddf5934cba02729cf4758d1c0176-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| clustering | None | None |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 9 | 9 |
| data_preparation_cores | 0 | 0 |
| date | 2024-02-27 08:11:44 | 2024-02-27 11:56:02 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| use_prepared_statements | False | False |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [9] | [9] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+----------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------+
++----------++----------+----------+--------++----------+----------+--------+----------------------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++----------++----------+----------+--------++----------+----------+--------+----------------------+
+| TPC-H 01 || 4432.23 | 4498.55 | +1% || 0.22 | 0.22 | +0% | (run time too short) |
+| TPC-H 02 || 25.50 | 26.12 | +2% || 31.87 | 31.10 | -2% | 0.0025 |
+| TPC-H 03 || 426.27 | 405.98 | -5% || 2.32 | 2.42 | +4% | 0.0000 |
+| TPC-H 04 || 383.78 | 397.01 | +3% || 2.57 | 2.48 | -3% | 0.0001 |
+| TPC-H 05 || 367.29 | 365.98 | -0% || 2.68 | 2.68 | -0% | 0.3460 |
+| TPC-H 06 || 41.18 | 41.07 | -0% || 21.47 | 21.38 | -0% | 0.1021 |
+| TPC-H 07 || 207.41 | 208.35 | +0% || 4.70 | 4.67 | -1% | 0.3333 |
+| TPC-H 08 || 154.08 | 155.86 | +1% || 6.28 | 6.23 | -1% | 0.0024 |
+| TPC-H 09 || 1395.28 | 1385.17 | -1% || 0.70 | 0.72 | +2% | (run time too short) |
+| TPC-H 10 || 811.71 | 391.85 | -52% || 1.22 | 2.52 | +107% | 0.0000 |
+| TPC-H 11 || 37.93 | 39.70 | +5% || 24.23 | 22.93 | -5% | 0.0000 |
+| TPC-H 12 || 337.56 | 333.12 | -1% || 2.90 | 2.95 | +2% | 0.0000 |
+| TPC-H 13 || 2448.06 | 2363.25 | -3% || 0.40 | 0.42 | +4% | (run time too short) |
+| TPC-H 14 || 85.63 | 85.30 | -0% || 11.00 | 11.00 | +0% | 0.0170 |
+| TPC-H 15 || 116.16 | 108.59 | -7% || 8.20 | 8.87 | +8% | 0.0000 |
+| TPC-H 16 || 409.73 | 423.33 | +3% || 2.40 | 2.32 | -3% | 0.0000 |
+| TPC-H 17 || 57.49 | 57.35 | -0% || 16.10 | 16.25 | +1% | 0.3507 |
+| TPC-H 18 || 1957.76 | 1658.43 | -15% || 0.50 | 0.60 | +20% | (run time too short) |
+| TPC-H 19 || 69.20 | 68.44 | -1% || 13.72 | 13.88 | +1% | 0.0000 |
+| TPC-H 20 || 152.51 | 160.16 | +5% || 6.33 | 6.03 | -5% | 0.0000 |
+| TPC-H 21 || 684.19 | 686.85 | +0% || 1.43 | 1.43 | -0% | (run time too short) |
+| TPC-H 22 || 117.85 | 117.71 | -0% || 8.18 | 8.20 | +0% | 0.5400 |
++----------++----------+----------+--------++----------+----------+--------+----------------------+
+| Sum || 14718.82 | 13978.16 | -5% || | | | |
+| Geomean || | | || | | +4% | |
++----------++----------+----------+--------++----------+----------+--------+----------------------+
hyriseBenchmarkTPCH - multi-threaded, shuffled, 9 clients, 9 cores, SF 10.0
Sum of avg. item runtimes: -5% || Geometric mean of throughput changes: +6%
Configuration Overview - click to expand
+Configuration Overview---------+--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkTPCH_f5bdcb3c47233e058ef9792c861ed1794fca2d18_mt.json | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkTPCH_b1462bd925a2ddf5934cba02729cf4758d1c0176_mt.json |
+-------------------------------+--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+
| GIT-HASH | f5bdcb3c47233e058ef9792c861ed1794fca2d18-dirty | b1462bd925a2ddf5934cba02729cf4758d1c0176-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 9 | 9 |
| clustering | None | None |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 9 | 9 |
| data_preparation_cores | 0 | 0 |
| date | 2024-02-27 08:35:26 | 2024-02-27 12:19:43 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| use_prepared_statements | False | False |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [9] | [9] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+
++----------++----------+----------+--------++----------+----------+--------+---------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++----------++----------+----------+--------++----------+----------+--------+---------+
+| TPC-H 01 || 6081.08 | 5811.63 | -4% || 0.20 | 0.21 | +6% | 0.0551 |
+| TPC-H 02 || 210.73 | 166.96 | -21% || 0.20 | 0.21 | +5% | 0.3445 |
+| TPC-H 03 || 2236.72 | 2258.55 | +1% || 0.20 | 0.21 | +5% | 0.9263 |
+| TPC-H 04 || 1725.43 | 1748.47 | +1% || 0.20 | 0.21 | +6% | 0.9000 |
+| TPC-H 05 || 2881.11 | 2437.64 | -15% || 0.20 | 0.21 | +6% | 0.0497 |
+| TPC-H 06 || 539.74 | 439.48 | -19% || 0.20 | 0.21 | +5% | 0.3370 |
+| TPC-H 07 || 2059.58 | 2040.65 | -1% || 0.20 | 0.21 | +5% | 0.9430 |
+| TPC-H 08 || 1941.57 | 1433.36 | -26% || 0.20 | 0.21 | +6% | 0.0390 |
+| TPC-H 09 || 4585.74 | 4250.54 | -7% || 0.20 | 0.21 | +6% | 0.2496 |
+| TPC-H 10 || 2495.32 | 2025.04 | -19% || 0.20 | 0.21 | +6% | 0.0153 |
+| TPC-H 11 || 230.38 | 396.39 | +72% || 0.20 | 0.22 | +6% | 0.0361 |
+| TPC-H 12 || 1940.83 | 1864.43 | -4% || 0.20 | 0.21 | +6% | 0.7167 |
+| TPC-H 13 || 4413.59 | 4098.33 | -7% || 0.20 | 0.21 | +5% | 0.0359 |
+| TPC-H 14 || 781.41 | 712.03 | -9% || 0.20 | 0.21 | +6% | 0.6132 |
+| TPC-H 15 || 519.01 | 467.35 | -10% || 0.20 | 0.21 | +5% | 0.6318 |
+| TPC-H 16 || 1096.25 | 1499.27 | +37% || 0.20 | 0.22 | +6% | 0.0122 |
+| TPC-H 17 || 576.30 | 470.67 | -18% || 0.20 | 0.22 | +6% | 0.3925 |
+| TPC-H 18 || 2647.92 | 2661.83 | +1% || 0.20 | 0.21 | +5% | 0.8988 |
+| TPC-H 19 || 578.01 | 836.45 | +45% || 0.20 | 0.22 | +6% | 0.0609 |
+| TPC-H 20 || 1381.34 | 1341.73 | -3% || 0.20 | 0.22 | +6% | 0.8369 |
+| TPC-H 21 || 4178.81 | 3873.26 | -7% || 0.20 | 0.21 | +6% | 0.2726 |
+| TPC-H 22 || 761.39 | 785.18 | +3% || 0.20 | 0.21 | +6% | 0.8512 |
++----------++----------+----------+--------++----------+----------+--------+---------+
+| Sum || 43862.26 | 41619.22 | -5% || | | | |
+| Geomean || | | || | | +6% | |
++----------++----------+----------+--------++----------+----------+--------+---------+
hyriseBenchmarkTPCDS - single-threaded
Sum of avg. item runtimes: +8% || Geometric mean of throughput changes: -3%
Configuration Overview - click to expand
+Configuration Overview---+---------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkTPCDS_f5bdcb3c47233e058ef9792c861ed1794fca2d18_st.json | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkTPCDS_b1462bd925a2ddf5934cba02729cf4758d1c0176_st.json |
+-------------------------+---------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------+
| GIT-HASH | f5bdcb3c47233e058ef9792c861ed1794fca2d18-dirty | b1462bd925a2ddf5934cba02729cf4758d1c0176-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2024-02-27 08:57:02 | 2024-02-27 12:41:25 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 100 | 100 |
| time_unit | ns | ns |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------+---------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------+
++---------++----------+----------+--------++----------+----------+--------+---------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++---------++----------+----------+--------++----------+----------+--------+---------+
+| 01 || 219.17 | 228.82 | +4%˄ || 4.56 | 4.37 | -4%˄ | 0.0000 |
+| 03 || 64.63 | 64.74 | +0%˄ || 15.47 | 15.44 | -0%˄ | 0.4175 |
+| 06 || 177.99 | 179.23 | +1%˄ || 5.62 | 5.58 | -1%˄ | 0.0000 |
+| 07 || 270.27 | 269.86 | -0%˄ || 3.70 | 3.71 | +0%˄ | 0.6949 |
+| 09 || 623.14 | 622.87 | -0% || 1.60 | 1.61 | +0% | 0.9123 |
+| 10 || 125.55 | 127.39 | +1%˄ || 7.96 | 7.85 | -1%˄ | 0.0000 |
+| 13 || 467.08 | 473.00 | +1%˄ || 2.14 | 2.11 | -1%˄ | 0.0004 |
+| 15 || 107.60 | 106.95 | -1%˄ || 9.29 | 9.35 | +1%˄ | 0.0001 |
+| 16 || 62.52 | 62.41 | -0%˄ || 15.99 | 16.02 | +0%˄ | 0.2188 |
+| 17 || 297.46 | 297.71 | +0%˄ || 3.36 | 3.36 | -0%˄ | 0.6278 |
+| 19 || 100.13 | 102.41 | +2%˄ || 9.99 | 9.76 | -2%˄ | 0.0000 |
+| 25 || 158.64 | 162.32 | +2%˄ || 6.30 | 6.16 | -2%˄ | 0.0000 |
+| 26 || 126.96 | 128.72 | +1%˄ || 7.88 | 7.77 | -1%˄ | 0.0000 |
+| 28 || 593.60 | 612.13 | +3%˄ || 1.68 | 1.63 | -3%˄ | 0.0000 |
+| 29 || 444.37 | 463.09 | +4%˄ || 2.25 | 2.16 | -4%˄ | 0.0000 |
+| 31 || 1256.65 | 1261.63 | +0% || 0.80 | 0.79 | -0% | 0.0131 |
+| 32 || 34.11 | 34.67 | +2%˄ || 29.32 | 28.84 | -2%˄ | 0.0000 |
+| 34 || 152.59 | 149.74 | -2%˄ || 6.55 | 6.68 | +2%˄ | 0.0000 |
+| 35 || 600.69 | 620.46 | +3%˄ || 1.66 | 1.61 | -3%˄ | 0.0000 |
+| 37 || 461.66 | 442.45 | -4%˄ || 2.17 | 2.26 | +4%˄ | 0.0007 |
+| 39a || 1513.19 | 1521.69 | +1% || 0.66 | 0.66 | -1% | 0.0497 |
+| 39b || 1503.04 | 1528.22 | +2% || 0.67 | 0.65 | -2% | 0.0000 |
+| 41 || 274.62 | 279.02 | +2%˄ || 3.64 | 3.58 | -2%˄ | 0.0000 |
+| 42 || 80.30 | 82.56 | +3%˄ || 12.45 | 12.11 | -3%˄ | 0.0000 |
+| 43 || 866.18 | 873.95 | +1% || 1.15 | 1.14 | -1% | 0.0010 |
+| 45 || 112.29 | 118.93 | +6%˄ || 8.91 | 8.41 | -6%˄ | 0.0000 |
+| 48 || 1008.02 | 1042.39 | +3% || 0.99 | 0.96 | -3% | 0.0000 |
+| 50 || 114.98 | 119.01 | +4%˄ || 8.70 | 8.40 | -3%˄ | 0.0000 |
+| 52 || 78.84 | 82.45 | +5%˄ || 12.68 | 12.13 | -4%˄ | 0.0000 |
+| 55 || 75.35 | 77.50 | +3%˄ || 13.27 | 12.90 | -3%˄ | 0.0000 |
+| 62 || 536.13 | 544.91 | +2%˄ || 1.87 | 1.84 | -2%˄ | 0.0000 |
+| 65 || 1606.19 | 1791.55 | +12% || 0.62 | 0.56 | -10% | 0.0000 |
+| 69 || 134.52 | 141.50 | +5%˄ || 7.43 | 7.07 | -5%˄ | 0.0000 |
+| 73 || 76.57 | 77.80 | +2%˄ || 13.06 | 12.85 | -2%˄ | 0.0000 |
+| 79 || 443.69 | 457.53 | +3%˄ || 2.25 | 2.19 | -3%˄ | 0.0000 |
+| 81 || 152.30 | 159.66 | +5%˄ || 6.57 | 6.26 | -5%˄ | 0.0000 |
+| 82 || 495.06 | 498.09 | +1%˄ || 2.02 | 2.01 | -1%˄ | 0.6420 |
+| 83 || 41.63 | 41.40 | -1%˄ || 24.02 | 24.15 | +1%˄ | 0.7698 |
+| 85 || 148.10 | 151.36 | +2%˄ || 6.75 | 6.61 | -2%˄ | 0.0016 |
+| 88 || 606.11 | 620.81 | +2% || 1.65 | 1.61 | -2% | 0.0000 |
+| 91 || 15.54 | 15.77 | +1%˄ || 64.34 | 63.40 | -1%˄ | 0.0000 |
+| 92 || 34.30 | 36.18 | +5%˄ || 29.15 | 27.63 | -5%˄ | 0.0000 |
+| 93 || 3548.71 | 3756.86 | +6% || 0.28 | 0.27 | -6% | 0.0000 |
+| 94 || 39.45 | 40.51 | +3%˄ || 25.34 | 24.68 | -3%˄ | 0.0000 |
+| 95 || 4587.61 | 4527.96 | -1% || 0.22 | 0.22 | +1% | 0.4203 |
+| 96 || 57.76 | 59.41 | +3%˄ || 17.31 | 16.83 | -3%˄ | 0.0004 |
+| 97 || 2517.26 | 4087.27 | +62% || 0.40 | 0.24 | -38% | 0.0000 |
+| 99 || 1009.51 | 1014.01 | +0% || 0.99 | 0.99 | -0% | 0.0004 |
++---------++----------+----------+--------++----------+----------+--------+---------+
+| Sum || 28022.09 | 30158.92 | +8% || | | | |
+| Geomean || | | || | | -3% | |
++---------++----------+----------+--------++----------+----------+--------+---------+
+| Notes || ˄ Execution stopped due to max runs reached |
++---------++----------+----------+--------++----------+----------+--------+---------+
hyriseBenchmarkTPCDS - multi-threaded, shuffled, 9 clients, 9 cores
Sum of avg. item runtimes: +4% || Geometric mean of throughput changes: -4%
Configuration Overview - click to expand
+Configuration Overview---------+---------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkTPCDS_f5bdcb3c47233e058ef9792c861ed1794fca2d18_mt.json | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkTPCDS_b1462bd925a2ddf5934cba02729cf4758d1c0176_mt.json |
+-------------------------------+---------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------+
| GIT-HASH | f5bdcb3c47233e058ef9792c861ed1794fca2d18-dirty | b1462bd925a2ddf5934cba02729cf4758d1c0176-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 9 | 9 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 9 | 9 |
| data_preparation_cores | 0 | 0 |
| date | 2024-02-27 09:22:56 | 2024-02-27 13:07:33 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [9] | [9] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+---------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------+
++---------++----------+----------+--------++----------+----------+--------+---------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++---------++----------+----------+--------++----------+----------+--------+---------+
+| 01 || 489.19 | 520.86 | +6% || 0.22 | 0.21 | -4% | 0.5892 |
+| 03 || 164.01 | 222.99 | +36% || 0.21 | 0.21 | -4% | 0.1202 |
+| 06 || 542.92 | 581.76 | +7% || 0.21 | 0.21 | -4% | 0.5746 |
+| 07 || 693.15 | 710.78 | +3% || 0.21 | 0.21 | -4% | 0.8187 |
+| 09 || 518.96 | 571.20 | +10% || 0.21 | 0.21 | -4% | 0.4255 |
+| 10 || 442.80 | 498.26 | +13% || 0.21 | 0.21 | -4% | 0.4830 |
+| 13 || 1153.03 | 1300.10 | +13% || 0.21 | 0.21 | -4% | 0.1737 |
+| 15 || 325.22 | 327.25 | +1% || 0.21 | 0.21 | -4% | 0.9756 |
+| 16 || 283.98 | 319.10 | +12% || 0.21 | 0.21 | -4% | 0.5792 |
+| 17 || 704.70 | 766.91 | +9% || 0.21 | 0.21 | -4% | 0.4640 |
+| 19 || 450.26 | 423.81 | -6% || 0.21 | 0.21 | -4% | 0.7188 |
+| 25 || 563.33 | 647.56 | +15% || 0.21 | 0.21 | -4% | 0.3787 |
+| 26 || 335.83 | 399.59 | +19% || 0.21 | 0.21 | -4% | 0.2861 |
+| 28 || 987.63 | 919.80 | -7% || 0.21 | 0.21 | -4% | 0.5021 |
+| 29 || 1010.13 | 894.08 | -11% || 0.21 | 0.21 | -4% | 0.1712 |
+| 31 || 1555.31 | 1603.36 | +3% || 0.21 | 0.21 | -4% | 0.6943 |
+| 32 || 128.68 | 119.77 | -7% || 0.21 | 0.21 | -4% | 0.7247 |
+| 34 || 627.36 | 740.94 | +18% || 0.21 | 0.21 | -4% | 0.2991 |
+| 35 || 1408.18 | 1360.01 | -3% || 0.21 | 0.21 | -4% | 0.6935 |
+| 37 || 803.35 | 781.13 | -3% || 0.21 | 0.21 | -4% | 0.8153 |
+| 39a || 1765.32 | 1924.67 | +9% || 0.21 | 0.21 | -4% | 0.1086 |
+| 39b || 1619.38 | 1705.67 | +5% || 0.21 | 0.21 | -4% | 0.3609 |
+| 41 || 2082.78 | 1925.89 | -8% || 0.21 | 0.21 | -4% | 0.3187 |
+| 42 || 302.04 | 313.61 | +4% || 0.21 | 0.21 | -4% | 0.8232 |
+| 43 || 1243.96 | 1451.44 | +17% || 0.21 | 0.21 | -4% | 0.0467 |
+| 45 || 457.16 | 442.17 | -3% || 0.21 | 0.21 | -4% | 0.8386 |
+| 48 || 1658.44 | 1688.85 | +2% || 0.21 | 0.21 | -4% | 0.8041 |
+| 50 || 587.60 | 726.66 | +24% || 0.21 | 0.21 | -4% | 0.1316 |
+| 52 || 373.17 | 275.10 | -26% || 0.21 | 0.21 | -3% | 0.1081 |
+| 55 || 345.11 | 339.62 | -2% || 0.21 | 0.21 | -4% | 0.9339 |
+| 62 || 822.01 | 858.81 | +4% || 0.21 | 0.21 | -4% | 0.6178 |
+| 65 || 2593.36 | 2799.06 | +8% || 0.21 | 0.21 | -4% | 0.0096 |
+| 69 || 516.34 | 578.38 | +12% || 0.21 | 0.21 | -4% | 0.4063 |
+| 73 || 364.45 | 317.08 | -13% || 0.21 | 0.21 | -4% | 0.4329 |
+| 79 || 1017.38 | 1035.98 | +2% || 0.21 | 0.21 | -3% | 0.8216 |
+| 81 || 397.52 | 400.29 | +1% || 0.21 | 0.21 | -4% | 0.9568 |
+| 82 || 941.59 | 855.03 | -9% || 0.21 | 0.21 | -4% | 0.4150 |
+| 83 || 191.72 | 205.34 | +7% || 0.21 | 0.21 | -4% | 0.7774 |
+| 85 || 577.54 | 507.73 | -12% || 0.21 | 0.21 | -4% | 0.4149 |
+| 88 || 1355.17 | 1399.76 | +3% || 0.21 | 0.21 | -4% | 0.7476 |
+| 91 || 126.13 | 104.48 | -17% || 0.21 | 0.21 | -4% | 0.6161 |
+| 92 || 147.72 | 198.62 | +34% || 0.21 | 0.21 | -4% | 0.2253 |
+| 93 || 2023.16 | 2087.12 | +3% || 0.21 | 0.21 | -4% | 0.6342 |
+| 94 || 216.51 | 321.26 | +48% || 0.21 | 0.21 | -4% | 0.1135 |
+| 95 || 2306.82 | 2282.99 | -1% || 0.21 | 0.21 | -4% | 0.8414 |
+| 96 || 263.35 | 256.20 | -3% || 0.21 | 0.21 | -4% | 0.8830 |
+| 97 || 2838.78 | 3117.27 | +10% || 0.21 | 0.21 | -4% | 0.0157 |
+| 99 || 1124.64 | 1249.31 | +11% || 0.21 | 0.21 | -4% | 0.1348 |
++---------++----------+----------+--------++----------+----------+--------+---------+
+| Sum || 41447.17 | 43077.62 | +4% || | | | |
+| Geomean || | | || | | -4% | |
++---------++----------+----------+--------++----------+----------+--------+---------+
hyriseBenchmarkTPCC - single-threaded
Sum of avg. item runtimes: +2% || Geometric mean of throughput changes: -3%
Configuration Overview - click to expand
+Configuration Overview---+--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkTPCC_f5bdcb3c47233e058ef9792c861ed1794fca2d18_st.json | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkTPCC_b1462bd925a2ddf5934cba02729cf4758d1c0176_st.json |
+-------------------------+--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+
| GIT-HASH | f5bdcb3c47233e058ef9792c861ed1794fca2d18-dirty | b1462bd925a2ddf5934cba02729cf4758d1c0176-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2024-02-27 09:43:17 | 2024-02-27 13:28:00 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10 | 10 |
| time_unit | ns | ns |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------+--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+
++--------------++----------+---------+--------++----------+----------+--------+----------------------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++--------------++----------+---------+--------++----------+----------+--------+----------------------+
+| Delivery || 57.48 | 58.08 | +1% || 1.70 | 1.65 | -3% | (run time too short) |
+| New-Order || 40.12 | 41.83 | +4% || 19.03 | 18.35 | -4% | 0.0013 |
+| Order-Status || 1.92 | 1.98 | +3% || 1.68 | 1.62 | -4% | (run time too short) |
+| Payment || 7.12 | 7.24 | +2% || 18.12 | 17.52 | -3% | 0.0023 |
+| Stock-Level || 3.34 | 3.51 | +5% || 1.68 | 1.65 | -2% | (run time too short) |
++--------------++----------+---------+--------++----------+----------+--------+----------------------+
+| Sum || 109.98 | 112.64 | +2% || | | | |
+| Geomean || | | || | | -3% | |
++--------------++----------+---------+--------++----------+----------+--------+----------------------+
hyriseBenchmarkTPCC - multi-threaded, shuffled, 9 clients, 9 cores
Sum of avg. item runtimes: -0% || Geometric mean of throughput changes: +0%
Configuration Overview - click to expand
+Configuration Overview---------+--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkTPCC_f5bdcb3c47233e058ef9792c861ed1794fca2d18_mt.json | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkTPCC_b1462bd925a2ddf5934cba02729cf4758d1c0176_mt.json |
+-------------------------------+--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+
| GIT-HASH | f5bdcb3c47233e058ef9792c861ed1794fca2d18-dirty | b1462bd925a2ddf5934cba02729cf4758d1c0176-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 9 | 9 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 9 | 9 |
| data_preparation_cores | 0 | 0 |
| date | 2024-02-27 09:44:24 | 2024-02-27 13:29:06 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10 | 10 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [9] | [9] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+
++--------------++----------+---------+--------++----------+----------+--------+---------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++--------------++----------+---------+--------++----------+----------+--------+---------+
+| Delivery || 100.44 | 100.62 | +0% || 8.31 | 8.34 | +0% | 0.6793 |
+| unsucc.: || 1.58 | 0.73 | -54% || 0.55 | 0.54 | -1% | |
+| New-Order || 62.19 | 61.99 | -0% || 93.28 | 93.55 | +0% | 0.0475 |
+| unsucc.: || 3.72 | 4.31 | +16% || 6.33 | 6.35 | +0% | |
+| Order-Status || 3.69 | 3.68 | -0% || 8.85 | 8.88 | +0% | 0.7392 |
+| Payment || 11.61 | 11.56 | -0% || 81.44 | 81.61 | +0% | 0.1058 |
+| unsucc.: || 1.71 | 1.71 | +0% || 13.74 | 13.85 | +1% | |
+| Stock-Level || 5.96 | 5.97 | +0% || 8.85 | 8.88 | +0% | 0.7991 |
++--------------++----------+---------+--------++----------+----------+--------+---------+
+| Sum || 183.89 | 183.81 | -0% || | | | |
+| Geomean || | | || | | +0% | |
++--------------++----------+---------+--------++----------+----------+--------+---------+
hyriseBenchmarkJoinOrder - single-threaded
Sum of avg. item runtimes: +2% || Geometric mean of throughput changes: -2%
Configuration Overview - click to expand
+Configuration Overview---+-------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkJoinOrder_f5bdcb3c47233e058ef9792c861ed1794fca2d18_st.json | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkJoinOrder_b1462bd925a2ddf5934cba02729cf4758d1c0176_st.json |
+-------------------------+-------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | f5bdcb3c47233e058ef9792c861ed1794fca2d18-dirty | b1462bd925a2ddf5934cba02729cf4758d1c0176-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2024-02-27 10:04:31 | 2024-02-27 13:49:14 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 100 | 100 |
| time_unit | ns | ns |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------+-------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------+
++---------++----------+----------+--------++----------+----------+--------+---------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++---------++----------+----------+--------++----------+----------+--------+---------+
+| 10a || 104.08 | 105.94 | +2%˄ || 9.61 | 9.44 | -2%˄ | 0.0000 |
+| 10b || 64.05 | 63.60 | -1%˄ || 15.61 | 15.72 | +1%˄ | 0.0019 |
+| 10c || 323.19 | 334.07 | +3%˄ || 3.09 | 2.99 | -3%˄ | 0.0000 |
+| 11a || 86.78 | 90.92 | +5%˄ || 11.52 | 11.00 | -5%˄ | 0.0000 |
+| 11b || 84.57 | 86.10 | +2%˄ || 11.82 | 11.61 | -2%˄ | 0.0000 |
+| 11c || 20.48 | 20.78 | +1%˄ || 48.83 | 48.12 | -1%˄ | 0.0000 |
+| 11d || 22.41 | 22.72 | +1%˄ || 44.61 | 44.01 | -1%˄ | 0.0000 |
+| 12a || 29.35 | 29.77 | +1%˄ || 34.06 | 33.59 | -1%˄ | 0.0000 |
+| 12b || 28.16 | 28.53 | +1%˄ || 35.51 | 35.05 | -1%˄ | 0.0000 |
+| 12c || 64.41 | 65.89 | +2%˄ || 15.53 | 15.17 | -2%˄ | 0.0000 |
+| 13a || 175.16 | 177.56 | +1%˄ || 5.71 | 5.63 | -1%˄ | 0.0000 |
+| 13b || 217.13 | 220.52 | +2%˄ || 4.61 | 4.53 | -2%˄ | 0.0000 |
+| 13c || 182.54 | 184.73 | +1%˄ || 5.48 | 5.41 | -1%˄ | 0.0000 |
+| 13d || 478.02 | 483.33 | +1%˄ || 2.09 | 2.07 | -1%˄ | 0.0000 |
+| 14a || 94.68 | 97.23 | +3%˄ || 10.56 | 10.28 | -3%˄ | 0.0000 |
+| 14b || 106.71 | 108.89 | +2%˄ || 9.37 | 9.18 | -2%˄ | 0.0000 |
+| 14c || 197.98 | 202.61 | +2%˄ || 5.05 | 4.94 | -2%˄ | 0.0000 |
+| 15a || 50.81 | 51.87 | +2%˄ || 19.68 | 19.28 | -2%˄ | 0.0000 |
+| 15b || 52.42 | 53.55 | +2%˄ || 19.08 | 18.67 | -2%˄ | 0.0000 |
+| 15c || 42.19 | 42.83 | +2%˄ || 23.70 | 23.34 | -1%˄ | 0.0000 |
+| 15d || 38.17 | 38.95 | +2%˄ || 26.19 | 25.67 | -2%˄ | 0.0000 |
+| 16a || 1229.15 | 1266.18 | +3% || 0.81 | 0.79 | -3% | 0.0000 |
+| 16b || 2234.13 | 2295.88 | +3% || 0.45 | 0.44 | -3% | 0.0000 |
+| 16c || 1376.01 | 1410.53 | +3% || 0.73 | 0.71 | -2% | 0.0000 |
+| 16d || 1351.94 | 1375.67 | +2% || 0.74 | 0.73 | -2% | 0.0000 |
+| 17a || 408.87 | 420.99 | +3%˄ || 2.45 | 2.38 | -3%˄ | 0.0000 |
+| 17b || 326.14 | 336.36 | +3%˄ || 3.07 | 2.97 | -3%˄ | 0.0000 |
+| 17c || 309.61 | 318.66 | +3%˄ || 3.23 | 3.14 | -3%˄ | 0.0000 |
+| 17d || 378.31 | 389.88 | +3%˄ || 2.64 | 2.56 | -3%˄ | 0.0000 |
+| 17e || 1398.83 | 1440.78 | +3% || 0.71 | 0.69 | -3% | 0.0000 |
+| 17f || 815.86 | 836.15 | +2% || 1.23 | 1.20 | -2% | 0.0000 |
+| 18a || 129.76 | 132.53 | +2%˄ || 7.71 | 7.55 | -2%˄ | 0.0000 |
+| 18b || 98.81 | 101.80 | +3%˄ || 10.12 | 9.82 | -3%˄ | 0.0000 |
+| 18c || 194.41 | 199.37 | +3%˄ || 5.14 | 5.02 | -2%˄ | 0.0000 |
+| 19a || 204.09 | 209.49 | +3%˄ || 4.90 | 4.77 | -3%˄ | 0.0000 |
+| 19b || 169.57 | 174.63 | +3%˄ || 5.90 | 5.73 | -3%˄ | 0.0000 |
+| 19c || 247.34 | 251.96 | +2%˄ || 4.04 | 3.97 | -2%˄ | 0.0000 |
+| 19d || 603.41 | 609.13 | +1%˄ || 1.66 | 1.64 | -1%˄ | 0.0000 |
+| 1a || 10.36 | 10.54 | +2%˄ || 96.49 | 94.84 | -2%˄ | 0.0000 |
+| 1b || 13.00 | 13.21 | +2%˄ || 76.91 | 75.67 | -2%˄ | 0.0000 |
+| 1c || 14.04 | 14.34 | +2%˄ || 71.22 | 69.72 | -2%˄ | 0.0000 |
+| 1d || 9.72 | 9.88 | +2%˄ || 102.81 | 101.15 | -2%˄ | 0.0000 |
+| 20a || 542.03 | 564.15 | +4%˄ || 1.84 | 1.77 | -4%˄ | 0.0000 |
+| 20b || 579.63 | 597.71 | +3%˄ || 1.73 | 1.67 | -3%˄ | 0.0000 |
+| 20c || 349.16 | 359.55 | +3%˄ || 2.86 | 2.78 | -3%˄ | 0.0000 |
+| 21a || 99.66 | 100.71 | +1%˄ || 10.03 | 9.93 | -1%˄ | 0.0000 |
+| 21b || 91.62 | 92.62 | +1%˄ || 10.91 | 10.80 | -1%˄ | 0.0000 |
+| 21c || 101.17 | 102.38 | +1%˄ || 9.88 | 9.77 | -1%˄ | 0.0000 |
+| 22a || 162.42 | 166.62 | +3%˄ || 6.16 | 6.00 | -3%˄ | 0.0000 |
+| 22b || 146.94 | 150.54 | +2%˄ || 6.81 | 6.64 | -2%˄ | 0.0000 |
+| 22c || 221.68 | 227.03 | +2%˄ || 4.51 | 4.40 | -2%˄ | 0.0000 |
+| 22d || 345.19 | 355.00 | +3%˄ || 2.90 | 2.82 | -3%˄ | 0.0000 |
+| 23a || 45.69 | 46.61 | +2%˄ || 21.88 | 21.45 | -2%˄ | 0.0000 |
+| 23b || 50.98 | 52.29 | +3%˄ || 19.61 | 19.12 | -3%˄ | 0.0000 |
+| 23c || 49.14 | 50.13 | +2%˄ || 20.35 | 19.95 | -2%˄ | 0.0000 |
+| 24a || 196.84 | 200.97 | +2%˄ || 5.08 | 4.98 | -2%˄ | 0.0000 |
+| 24b || 189.60 | 193.71 | +2%˄ || 5.27 | 5.16 | -2%˄ | 0.0000 |
+| 25a || 103.80 | 106.40 | +2%˄ || 9.63 | 9.40 | -2%˄ | 0.0000 |
+| 25b || 64.59 | 65.94 | +2%˄ || 15.48 | 15.16 | -2%˄ | 0.0000 |
+| 25c || 245.75 | 251.37 | +2%˄ || 4.07 | 3.98 | -2%˄ | 0.0000 |
+| 26a || 160.20 | 163.79 | +2%˄ || 6.24 | 6.11 | -2%˄ | 0.0000 |
+| 26b || 129.13 | 131.67 | +2%˄ || 7.74 | 7.59 | -2%˄ | 0.0000 |
+| 26c || 283.82 | 292.16 | +3%˄ || 3.52 | 3.42 | -3%˄ | 0.0000 |
+| 27a || 94.41 | 96.20 | +2%˄ || 10.59 | 10.39 | -2%˄ | 0.0000 |
+| 27b || 87.62 | 89.07 | +2%˄ || 11.41 | 11.23 | -2%˄ | 0.0000 |
+| 27c || 100.98 | 102.62 | +2%˄ || 9.90 | 9.74 | -2%˄ | 0.0000 |
+| 28a || 202.13 | 205.88 | +2%˄ || 4.95 | 4.86 | -2%˄ | 0.0000 |
+| 28b || 62.45 | 64.28 | +3%˄ || 16.01 | 15.55 | -3%˄ | 0.0000 |
+| 28c || 163.55 | 168.08 | +3%˄ || 6.11 | 5.95 | -3%˄ | 0.0000 |
+| 29a || 163.22 | 166.68 | +2%˄ || 6.13 | 6.00 | -2%˄ | 0.0000 |
+| 29b || 730.40 | 735.84 | +1% || 1.37 | 1.36 | -1% | 0.0000 |
+| 29c || 197.29 | 201.04 | +2%˄ || 5.07 | 4.97 | -2%˄ | 0.0000 |
+| 2a || 26.98 | 27.59 | +2%˄ || 37.05 | 36.25 | -2%˄ | 0.0000 |
+| 2b || 25.06 | 25.70 | +3%˄ || 39.90 | 38.91 | -2%˄ | 0.0000 |
+| 2c || 21.49 | 21.89 | +2%˄ || 46.53 | 45.68 | -2%˄ | 0.0000 |
+| 2d || 55.57 | 57.00 | +3%˄ || 17.99 | 17.54 | -3%˄ | 0.0000 |
+| 30a || 92.23 | 94.30 | +2%˄ || 10.84 | 10.60 | -2%˄ | 0.0000 |
+| 30b || 96.17 | 99.18 | +3%˄ || 10.40 | 10.08 | -3%˄ | 0.0000 |
+| 30c || 160.91 | 164.09 | +2%˄ || 6.21 | 6.09 | -2%˄ | 0.0000 |
+| 31a || 79.52 | 81.34 | +2%˄ || 12.57 | 12.29 | -2%˄ | 0.0000 |
+| 31b || 79.06 | 80.81 | +2%˄ || 12.65 | 12.37 | -2%˄ | 0.0000 |
+| 31c || 89.73 | 91.58 | +2%˄ || 11.14 | 10.92 | -2%˄ | 0.0000 |
+| 32a || 15.38 | 15.62 | +2%˄ || 65.01 | 63.99 | -2%˄ | 0.0000 |
+| 32b || 34.69 | 35.56 | +3%˄ || 28.83 | 28.12 | -2%˄ | 0.0000 |
+| 33a || 34.53 | 35.18 | +2%˄ || 28.96 | 28.43 | -2%˄ | 0.0000 |
+| 33b || 22.59 | 22.75 | +1%˄ || 44.25 | 43.96 | -1%˄ | 0.0000 |
+| 33c || 40.83 | 41.55 | +2%˄ || 24.49 | 24.06 | -2%˄ | 0.0000 |
+| 3a || 59.56 | 61.44 | +3%˄ || 16.79 | 16.27 | -3%˄ | 0.0000 |
+| 3b || 16.04 | 16.34 | +2%˄ || 62.32 | 61.19 | -2%˄ | 0.0000 |
+| 3c || 222.06 | 223.95 | +1%˄ || 4.50 | 4.47 | -1%˄ | 0.0064 |
+| 4a || 132.23 | 135.23 | +2%˄ || 7.56 | 7.39 | -2%˄ | 0.0000 |
+| 4b || 15.34 | 15.62 | +2%˄ || 65.17 | 64.01 | -2%˄ | 0.0000 |
+| 4c || 189.77 | 189.13 | -0%˄ || 5.27 | 5.29 | +0%˄ | 0.1395 |
+| 5a || 43.09 | 44.34 | +3%˄ || 23.21 | 22.55 | -3%˄ | 0.0000 |
+| 5b || 47.19 | 48.51 | +3%˄ || 21.19 | 20.61 | -3%˄ | 0.0000 |
+| 5c || 84.94 | 87.45 | +3%˄ || 11.77 | 11.44 | -3%˄ | 0.0000 |
+| 6a || 148.43 | 150.97 | +2%˄ || 6.74 | 6.62 | -2%˄ | 0.0000 |
+| 6b || 160.37 | 163.75 | +2%˄ || 6.24 | 6.11 | -2%˄ | 0.0000 |
+| 6c || 140.65 | 143.32 | +2%˄ || 7.11 | 6.98 | -2%˄ | 0.0000 |
+| 6d || 343.64 | 350.66 | +2%˄ || 2.91 | 2.85 | -2%˄ | 0.0000 |
+| 6e || 147.70 | 149.76 | +1%˄ || 6.77 | 6.68 | -1%˄ | 0.0000 |
+| 6f || 621.65 | 633.92 | +2% || 1.61 | 1.58 | -2% | 0.0000 |
+| 7a || 85.35 | 86.87 | +2%˄ || 11.72 | 11.51 | -2%˄ | 0.0000 |
+| 7b || 78.72 | 80.14 | +2%˄ || 12.70 | 12.48 | -2%˄ | 0.0000 |
+| 7c || 530.98 | 541.89 | +2%˄ || 1.88 | 1.85 | -2%˄ | 0.0000 |
+| 8a || 166.31 | 169.52 | +2%˄ || 6.01 | 5.90 | -2%˄ | 0.0000 |
+| 8b || 163.68 | 166.62 | +2%˄ || 6.11 | 6.00 | -2%˄ | 0.0000 |
+| 8c || 1698.49 | 1742.84 | +3% || 0.59 | 0.57 | -3% | 0.0000 |
+| 8d || 283.01 | 289.93 | +2%˄ || 3.53 | 3.45 | -2%˄ | 0.0000 |
+| 9a || 232.18 | 237.89 | +2%˄ || 4.31 | 4.20 | -2%˄ | 0.0000 |
+| 9b || 149.81 | 154.59 | +3%˄ || 6.68 | 6.47 | -3%˄ | 0.0000 |
+| 9c || 259.55 | 265.94 | +2%˄ || 3.85 | 3.76 | -2%˄ | 0.0000 |
+| 9d || 393.71 | 396.61 | +1%˄ || 2.54 | 2.52 | -1%˄ | 0.0000 |
++---------++----------+----------+--------++----------+----------+--------+---------+
+| Sum || 27236.97 | 27870.82 | +2% || | | | |
+| Geomean || | | || | | -2% | |
++---------++----------+----------+--------++----------+----------+--------+---------+
+| Notes || ˄ Execution stopped due to max runs reached |
++---------++----------+----------+--------++----------+----------+--------+---------+
hyriseBenchmarkJoinOrder - multi-threaded, shuffled, 9 clients, 9 cores
Sum of avg. item runtimes: -0% || Geometric mean of throughput changes: +0%
Configuration Overview - click to expand
+Configuration Overview---------+-------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkJoinOrder_f5bdcb3c47233e058ef9792c861ed1794fca2d18_mt.json | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkJoinOrder_b1462bd925a2ddf5934cba02729cf4758d1c0176_mt.json |
+-------------------------------+-------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | f5bdcb3c47233e058ef9792c861ed1794fca2d18-dirty | b1462bd925a2ddf5934cba02729cf4758d1c0176-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 9 | 9 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 9 | 9 |
| data_preparation_cores | 0 | 0 |
| date | 2024-02-27 10:42:25 | 2024-02-27 14:27:45 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [9] | [9] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+-------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------+
++---------++----------+----------+--------++----------+----------+--------+---------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++---------++----------+----------+--------++----------+----------+--------+---------+
+| 10a || 191.59 | 190.10 | -1% || 0.22 | 0.22 | +0% | 0.9687 |
+| 10b || 84.84 | 92.43 | +9% || 0.22 | 0.22 | +0% | 0.5388 |
+| 10c || 384.87 | 513.85 | +34% || 0.22 | 0.22 | +0% | 0.0090 |
+| 11a || 94.97 | 121.66 | +28% || 0.22 | 0.22 | -0% | 0.2228 |
+| 11b || 108.41 | 107.03 | -1% || 0.22 | 0.22 | +0% | 0.9608 |
+| 11c || 66.78 | 56.94 | -15% || 0.22 | 0.22 | +0% | 0.3468 |
+| 11d || 104.94 | 77.24 | -26% || 0.22 | 0.22 | +1% | 0.3186 |
+| 12a || 104.44 | 124.31 | +19% || 0.22 | 0.22 | +0% | 0.3821 |
+| 12b || 68.20 | 77.90 | +14% || 0.22 | 0.22 | -0% | 0.6037 |
+| 12c || 236.64 | 253.68 | +7% || 0.22 | 0.22 | -0% | 0.6767 |
+| 13a || 285.99 | 343.43 | +20% || 0.22 | 0.22 | -0% | 0.0780 |
+| 13b || 234.18 | 298.90 | +28% || 0.22 | 0.22 | +0% | 0.0516 |
+| 13c || 258.54 | 268.87 | +4% || 0.22 | 0.22 | -0% | 0.7951 |
+| 13d || 665.60 | 716.08 | +8% || 0.22 | 0.22 | -0% | 0.2846 |
+| 14a || 241.38 | 233.17 | -3% || 0.22 | 0.22 | -0% | 0.7775 |
+| 14b || 238.08 | 289.17 | +21% || 0.22 | 0.22 | +1% | 0.1115 |
+| 14c || 353.48 | 343.59 | -3% || 0.22 | 0.22 | -0% | 0.7783 |
+| 15a || 123.65 | 93.41 | -24% || 0.22 | 0.22 | -0% | 0.2191 |
+| 15b || 92.51 | 104.19 | +13% || 0.22 | 0.22 | -0% | 0.5792 |
+| 15c || 102.43 | 124.46 | +22% || 0.22 | 0.22 | -0% | 0.4491 |
+| 15d || 151.34 | 113.84 | -25% || 0.22 | 0.22 | +0% | 0.1413 |
+| 16a || 1368.78 | 1404.71 | +3% || 0.22 | 0.22 | +0% | 0.6441 |
+| 16b || 2598.75 | 2453.99 | -6% || 0.22 | 0.22 | +0% | 0.0622 |
+| 16c || 1495.06 | 1500.05 | +0% || 0.22 | 0.22 | -0% | 0.9434 |
+| 16d || 1529.62 | 1536.73 | +0% || 0.22 | 0.22 | +0% | 0.9281 |
+| 17a || 664.33 | 681.71 | +3% || 0.22 | 0.22 | -0% | 0.7454 |
+| 17b || 514.85 | 586.17 | +14% || 0.22 | 0.22 | +0% | 0.2014 |
+| 17c || 526.94 | 510.54 | -3% || 0.22 | 0.22 | +0% | 0.7732 |
+| 17d || 525.07 | 609.78 | +16% || 0.22 | 0.22 | +0% | 0.1436 |
+| 17e || 1354.78 | 1281.47 | -5% || 0.22 | 0.22 | -0% | 0.2388 |
+| 17f || 985.44 | 944.90 | -4% || 0.22 | 0.22 | -0% | 0.5852 |
+| 18a || 184.72 | 236.75 | +28% || 0.22 | 0.22 | +1% | 0.0932 |
+| 18b || 223.01 | 306.15 | +37% || 0.22 | 0.22 | +0% | 0.0750 |
+| 18c || 466.78 | 454.82 | -3% || 0.22 | 0.22 | +0% | 0.8247 |
+| 19a || 456.58 | 352.55 | -23% || 0.22 | 0.22 | +1% | 0.0414 |
+| 19b || 303.44 | 279.09 | -8% || 0.22 | 0.22 | -0% | 0.5489 |
+| 19c || 513.07 | 439.13 | -14% || 0.22 | 0.22 | -0% | 0.2412 |
+| 19d || 1167.17 | 1099.15 | -6% || 0.22 | 0.22 | +0% | 0.3517 |
+| 1a || 28.32 | 41.01 | +45% || 0.22 | 0.22 | +0% | 0.2842 |
+| 1b || 23.63 | 39.86 | +69% || 0.22 | 0.22 | -0% | 0.0332 |
+| 1c || 64.90 | 33.89 | -48% || 0.22 | 0.22 | -0% | 0.1115 |
+| 1d || 37.14 | 27.03 | -27% || 0.22 | 0.22 | +0% | 0.3566 |
+| 20a || 370.18 | 396.07 | +7% || 0.22 | 0.22 | +0% | 0.5279 |
+| 20b || 324.31 | 337.64 | +4% || 0.22 | 0.22 | -0% | 0.7005 |
+| 20c || 298.39 | 358.69 | +20% || 0.22 | 0.22 | -0% | 0.0914 |
+| 21a || 149.01 | 152.37 | +2% || 0.22 | 0.22 | -0% | 0.9151 |
+| 21b || 114.65 | 141.78 | +24% || 0.22 | 0.22 | -0% | 0.2932 |
+| 21c || 134.19 | 148.88 | +11% || 0.22 | 0.22 | +0% | 0.5623 |
+| 22a || 312.71 | 278.15 | -11% || 0.22 | 0.22 | +0% | 0.3643 |
+| 22b || 291.48 | 263.71 | -10% || 0.22 | 0.22 | +0% | 0.5368 |
+| 22c || 412.92 | 445.64 | +8% || 0.22 | 0.22 | -0% | 0.4762 |
+| 22d || 542.84 | 609.27 | +12% || 0.22 | 0.22 | +0% | 0.2305 |
+| 23a || 134.66 | 123.35 | -8% || 0.22 | 0.22 | +1% | 0.6472 |
+| 23b || 76.79 | 103.12 | +34% || 0.22 | 0.22 | +0% | 0.1952 |
+| 23c || 115.50 | 144.01 | +25% || 0.22 | 0.22 | -0% | 0.2323 |
+| 24a || 287.56 | 274.88 | -4% || 0.22 | 0.22 | +0% | 0.7441 |
+| 24b || 239.69 | 226.60 | -5% || 0.22 | 0.22 | +0% | 0.7347 |
+| 25a || 284.35 | 258.92 | -9% || 0.22 | 0.22 | +0% | 0.4698 |
+| 25b || 169.48 | 154.16 | -9% || 0.22 | 0.22 | -0% | 0.6418 |
+| 25c || 619.02 | 566.80 | -8% || 0.22 | 0.22 | +0% | 0.3498 |
+| 26a || 315.90 | 291.81 | -8% || 0.22 | 0.22 | -0% | 0.5177 |
+| 26b || 209.76 | 196.06 | -7% || 0.22 | 0.22 | -0% | 0.6175 |
+| 26c || 400.82 | 570.84 | +42% || 0.22 | 0.22 | -0% | 0.0003 |
+| 27a || 123.45 | 134.02 | +9% || 0.22 | 0.22 | +0% | 0.6604 |
+| 27b || 154.25 | 169.30 | +10% || 0.22 | 0.22 | -0% | 0.7057 |
+| 27c || 199.45 | 136.59 | -32% || 0.22 | 0.22 | +0% | 0.1293 |
+| 28a || 423.96 | 435.50 | +3% || 0.22 | 0.22 | +0% | 0.7994 |
+| 28b || 170.69 | 151.47 | -11% || 0.22 | 0.22 | +1% | 0.4742 |
+| 28c || 421.82 | 350.43 | -17% || 0.22 | 0.22 | +0% | 0.0972 |
+| 29a || 243.83 | 252.77 | +4% || 0.22 | 0.22 | +0% | 0.8004 |
+| 29b || 400.65 | 394.03 | -2% || 0.22 | 0.22 | +0% | 0.8859 |
+| 29c || 260.23 | 299.35 | +15% || 0.22 | 0.22 | +0% | 0.3245 |
+| 2a || 99.77 | 97.36 | -2% || 0.22 | 0.22 | +1% | 0.9001 |
+| 2b || 110.17 | 99.80 | -9% || 0.22 | 0.22 | -0% | 0.6683 |
+| 2c || 84.12 | 66.54 | -21% || 0.22 | 0.22 | +0% | 0.2799 |
+| 2d || 167.92 | 169.37 | +1% || 0.22 | 0.22 | +0% | 0.9625 |
+| 30a || 287.69 | 237.99 | -17% || 0.22 | 0.22 | +1% | 0.2733 |
+| 30b || 242.37 | 244.80 | +1% || 0.22 | 0.22 | -0% | 0.9532 |
+| 30c || 468.25 | 434.33 | -7% || 0.22 | 0.22 | -0% | 0.4917 |
+| 31a || 218.37 | 197.87 | -9% || 0.22 | 0.22 | +0% | 0.5884 |
+| 31b || 149.62 | 189.81 | +27% || 0.22 | 0.22 | +0% | 0.2075 |
+| 31c || 234.48 | 197.83 | -16% || 0.22 | 0.22 | -0% | 0.3121 |
+| 32a || 61.27 | 35.23 | -43% || 0.22 | 0.22 | +1% | 0.1210 |
+| 32b || 127.00 | 93.74 | -26% || 0.22 | 0.22 | -0% | 0.0670 |
+| 33a || 92.06 | 89.94 | -2% || 0.22 | 0.22 | +0% | 0.9411 |
+| 33b || 118.72 | 86.93 | -27% || 0.22 | 0.22 | -0% | 0.3924 |
+| 33c || 113.25 | 120.87 | +7% || 0.22 | 0.22 | -0% | 0.7819 |
+| 3a || 184.59 | 151.88 | -18% || 0.22 | 0.22 | +0% | 0.2994 |
+| 3b || 46.70 | 49.19 | +5% || 0.22 | 0.22 | +0% | 0.8259 |
+| 3c || 298.85 | 288.04 | -4% || 0.22 | 0.22 | -0% | 0.7927 |
+| 4a || 153.37 | 185.09 | +21% || 0.22 | 0.22 | +0% | 0.1350 |
+| 4b || 50.19 | 36.57 | -27% || 0.22 | 0.22 | -0% | 0.2433 |
+| 4c || 250.85 | 238.16 | -5% || 0.22 | 0.22 | +0% | 0.6658 |
+| 5a || 150.44 | 159.93 | +6% || 0.22 | 0.22 | +0% | 0.7831 |
+| 5b || 88.73 | 104.96 | +18% || 0.22 | 0.22 | -0% | 0.4441 |
+| 5c || 180.64 | 202.69 | +12% || 0.22 | 0.22 | -0% | 0.4540 |
+| 6a || 134.18 | 147.53 | +10% || 0.22 | 0.22 | -0% | 0.5593 |
+| 6b || 185.86 | 176.50 | -5% || 0.22 | 0.22 | -0% | 0.7308 |
+| 6c || 172.10 | 140.43 | -18% || 0.22 | 0.22 | -0% | 0.3426 |
+| 6d || 529.64 | 533.32 | +1% || 0.22 | 0.22 | +0% | 0.9477 |
+| 6e || 179.08 | 115.23 | -36% || 0.22 | 0.22 | +0% | 0.0408 |
+| 6f || 892.29 | 918.82 | +3% || 0.22 | 0.22 | +0% | 0.6046 |
+| 7a || 147.49 | 116.42 | -21% || 0.22 | 0.22 | +0% | 0.2553 |
+| 7b || 122.37 | 150.57 | +23% || 0.22 | 0.22 | +0% | 0.2991 |
+| 7c || 1066.16 | 975.73 | -8% || 0.22 | 0.22 | -0% | 0.2664 |
+| 8a || 198.84 | 191.07 | -4% || 0.22 | 0.22 | +0% | 0.8127 |
+| 8b || 170.21 | 155.10 | -9% || 0.22 | 0.22 | -0% | 0.5911 |
+| 8c || 1913.27 | 1908.07 | -0% || 0.22 | 0.22 | +0% | 0.9456 |
+| 8d || 472.23 | 437.90 | -7% || 0.22 | 0.22 | -0% | 0.3283 |
+| 9a || 474.42 | 491.92 | +4% || 0.22 | 0.22 | -0% | 0.7462 |
+| 9b || 278.89 | 281.53 | +1% || 0.22 | 0.22 | +0% | 0.9466 |
+| 9c || 544.96 | 483.98 | -11% || 0.22 | 0.22 | -0% | 0.2845 |
+| 9d || 826.49 | 886.73 | +7% || 0.22 | 0.22 | -0% | 0.3567 |
++---------++----------+----------+--------++----------+----------+--------+---------+
+| Sum || 39715.72 | 39619.65 | -0% || | | | |
+| Geomean || | | || | | +0% | |
++---------++----------+----------+--------++----------+----------+--------+---------+
hyriseBenchmarkStarSchema - single-threaded
Sum of avg. item runtimes: -1% || Geometric mean of throughput changes: +0%
Configuration Overview - click to expand
+Configuration Overview---+--------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkStarSchema_f5bdcb3c47233e058ef9792c861ed1794fca2d18_st.json | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkStarSchema_b1462bd925a2ddf5934cba02729cf4758d1c0176_st.json |
+-------------------------+--------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | f5bdcb3c47233e058ef9792c861ed1794fca2d18-dirty | b1462bd925a2ddf5934cba02729cf4758d1c0176-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2024-02-27 11:02:49 | 2024-02-27 14:48:06 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 100 | 100 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------+--------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------+
++---------++----------+---------+--------++----------+----------+--------+---------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++---------++----------+---------+--------++----------+----------+--------+---------+
+| 1.1 || 281.62 | 275.77 | -2%˄ || 3.55 | 3.63 | +2%˄ | 0.0865 |
+| 1.2 || 143.77 | 148.61 | +3%˄ || 6.96 | 6.73 | -3%˄ | 0.0000 |
+| 1.3 || 137.91 | 140.35 | +2%˄ || 7.25 | 7.12 | -2%˄ | 0.0004 |
+| 2.1 || 484.92 | 476.64 | -2%˄ || 2.06 | 2.10 | +2%˄ | 0.0000 |
+| 2.2 || 260.17 | 255.06 | -2%˄ || 3.84 | 3.92 | +2%˄ | 0.0000 |
+| 2.3 || 173.71 | 171.51 | -1%˄ || 5.76 | 5.83 | +1%˄ | 0.0000 |
+| 3.1 || 2693.06 | 2675.96 | -1% || 0.37 | 0.37 | +1% | 0.4392 |
+| 3.2 || 241.74 | 243.11 | +1%˄ || 4.14 | 4.11 | -1%˄ | 0.0134 |
+| 3.3 || 110.84 | 112.26 | +1%˄ || 9.02 | 8.91 | -1%˄ | 0.0000 |
+| 3.4 || 104.22 | 105.50 | +1%˄ || 9.59 | 9.48 | -1%˄ | 0.0000 |
+| 4.1 || 2564.71 | 2535.08 | -1% || 0.39 | 0.39 | +1% | 0.1941 |
+| 4.2 || 780.88 | 774.47 | -1% || 1.28 | 1.29 | +1% | 0.0522 |
+| 4.3 || 222.90 | 220.34 | -1%˄ || 4.49 | 4.54 | +1%˄ | 0.0000 |
++---------++----------+---------+--------++----------+----------+--------+---------+
+| Sum || 8200.45 | 8134.64 | -1% || | | | |
+| Geomean || | | || | | +0% | |
++---------++----------+---------+--------++----------+----------+--------+---------+
+| Notes || ˄ Execution stopped due to max runs reached |
++---------++----------+---------+--------++----------+----------+--------+---------+
hyriseBenchmarkStarSchema - multi-threaded, shuffled, 9 clients, 9 cores
Sum of avg. item runtimes: +0% || Geometric mean of throughput changes: -0%
Configuration Overview - click to expand
+Configuration Overview---------+--------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkStarSchema_f5bdcb3c47233e058ef9792c861ed1794fca2d18_mt.json | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkStarSchema_b1462bd925a2ddf5934cba02729cf4758d1c0176_mt.json |
+-------------------------------+--------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | f5bdcb3c47233e058ef9792c861ed1794fca2d18-dirty | b1462bd925a2ddf5934cba02729cf4758d1c0176-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 9 | 9 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 9 | 9 |
| data_preparation_cores | 0 | 0 |
| date | 2024-02-27 11:10:06 | 2024-02-27 14:55:23 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [9] | [9] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+--------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------+
++---------++----------+----------+--------++----------+----------+--------+---------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++---------++----------+----------+--------++----------+----------+--------+---------+
+| 1.1 || 487.92 | 534.12 | +9% || 0.81 | 0.81 | -0% | 0.1622 |
+| 1.2 || 320.52 | 323.03 | +1% || 0.81 | 0.81 | -0% | 0.9296 |
+| 1.3 || 305.72 | 312.47 | +2% || 0.81 | 0.81 | -0% | 0.8184 |
+| 2.1 || 1221.68 | 1192.51 | -2% || 0.81 | 0.81 | -0% | 0.5884 |
+| 2.2 || 672.41 | 645.14 | -4% || 0.81 | 0.81 | -0% | 0.4901 |
+| 2.3 || 299.63 | 288.71 | -4% || 0.81 | 0.81 | -0% | 0.6941 |
+| 3.1 || 2339.55 | 2455.60 | +5% || 0.81 | 0.81 | -0% | 0.0551 |
+| 3.2 || 618.20 | 632.16 | +2% || 0.81 | 0.81 | -0% | 0.7150 |
+| 3.3 || 368.06 | 350.23 | -5% || 0.81 | 0.81 | -0% | 0.5715 |
+| 3.4 || 351.48 | 319.55 | -9% || 0.81 | 0.81 | -0% | 0.2806 |
+| 4.1 || 1973.70 | 1929.62 | -2% || 0.81 | 0.81 | -0% | 0.4106 |
+| 4.2 || 1511.43 | 1601.93 | +6% || 0.81 | 0.80 | -1% | 0.1143 |
+| 4.3 || 555.34 | 489.33 | -12% || 0.81 | 0.81 | -0% | 0.0536 |
++---------++----------+----------+--------++----------+----------+--------+---------+
+| Sum || 11025.64 | 11074.39 | +0% || | | | |
+| Geomean || | | || | | -0% | |
++---------++----------+----------+--------++----------+----------+--------+---------+
Trying to address regressions in TPC-DS and TPC-C. ~Benchmarks are running.~
~Running benchmarks against new merged #2611 right now.~ Benchmarks done. But since it is a PR to improve multi-threading, I will probably wait for the merge of #2630 which changes the benchmark script.
Benchmarks (2024-03-01)
AMD
System
cx26 - click to expand
| property | value |
|---|---|
| Hostname | cx26 |
| CPU | AMD EPYC 7742 64-Core Processor |
| Memory | 513GB |
| numactl | nodebind: 0 |
| numactl | membind: 0 1 |
Commit Info and Build Time
| commit | date | message | build time |
|---|---|---|---|
| f7417f58c | 28.02.2024 10:37 | Update CI image and supported compilers (#2611) | real 440.76 user 3356.56 sys 285.71 |
| 044e600db | 29.02.2024 13:27 | Fix | real 447.03 user 3372.84 sys 293.34 |
hyriseBenchmarkTPCH - single-threaded, SF 10.0
Sum of avg. item runtimes: -1% || Geometric mean of throughput changes: +1%
Configuration Overview - click to expand
+Configuration Overview----+------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCH_f7417f58c4618845c7b8a8d4559788ad3c7a04e6_st.json | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCH_044e600db1dab827693023c0766273b0a40d4606_st.json |
+--------------------------+------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------+
| GIT-HASH | f7417f58c4618845c7b8a8d4559788ad3c7a04e6-dirty | 044e600db1dab827693023c0766273b0a40d4606-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| clustering | None | None |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2024-02-29 23:06:40 | 2024-03-01 03:11:04 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 100 | 100 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| use_prepared_statements | False | False |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+--------------------------+------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------+
++----------++----------+----------+--------++----------+----------+--------+---------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++----------++----------+----------+--------++----------+----------+--------+---------+
+| TPC-H 01 || 6243.97 | 6350.37 | +2% || 0.16 | 0.16 | -2% | 0.3726 |
+| TPC-H 02 || 49.47 | 49.30 | -0%˄ || 20.21 | 20.28 | +0%˄ | 0.8117 |
+| TPC-H 03 || 1918.27 | 1842.23 | -4% || 0.52 | 0.54 | +4% | 0.0000 |
+| TPC-H 04 || 1918.21 | 1894.75 | -1% || 0.52 | 0.53 | +1% | 0.0199 |
+| TPC-H 05 || 3386.48 | 3363.17 | -1% || 0.30 | 0.30 | +1% | 0.4866 |
+| TPC-H 06 || 227.15 | 224.69 | -1%˄ || 4.40 | 4.45 | +1%˄ | 0.1419 |
+| TPC-H 07 || 1198.51 | 1182.10 | -1% || 0.83 | 0.85 | +1% | 0.0000 |
+| TPC-H 08 || 734.49 | 742.26 | +1% || 1.36 | 1.35 | -1% | 0.0030 |
+| TPC-H 09 || 7442.15 | 7432.27 | -0% || 0.13 | 0.13 | +0% | ˅ |
+| TPC-H 10 || 2388.90 | 1861.23 | -22% || 0.42 | 0.54 | +28% | 0.0000 |
+| TPC-H 11 || 74.72 | 69.62 | -7%˄ || 13.38 | 14.36 | +7%˄ | 0.0000 |
+| TPC-H 12 || 1900.54 | 1888.85 | -1% || 0.53 | 0.53 | +1% | 0.2020 |
+| TPC-H 13 || 6730.43 | 6607.12 | -2% || 0.15 | 0.15 | +2% | ˅ |
+| TPC-H 14 || 679.16 | 684.89 | +1% || 1.47 | 1.46 | -1% | 0.0310 |
+| TPC-H 15 || 271.78 | 260.01 | -4%˄ || 3.68 | 3.85 | +5%˄ | 0.0000 |
+| TPC-H 16 || 715.57 | 723.94 | +1% || 1.40 | 1.38 | -1% | 0.0000 |
+| TPC-H 17 || 281.01 | 285.52 | +2%˄ || 3.56 | 3.50 | -2%˄ | 0.0000 |
+| TPC-H 18 || 1590.12 | 1669.31 | +5% || 0.63 | 0.60 | -5% | 0.0041 |
+| TPC-H 19 || 288.18 | 292.58 | +2%˄ || 3.47 | 3.42 | -2%˄ | 0.0007 |
+| TPC-H 20 || 765.24 | 832.40 | +9% || 1.31 | 1.20 | -8% | 0.0501 |
+| TPC-H 21 || 6006.27 | 5987.14 | -0% || 0.17 | 0.17 | +0% | 0.6629 |
+| TPC-H 22 || 628.12 | 629.43 | +0% || 1.59 | 1.59 | -0% | 0.2378 |
++----------++----------+----------+--------++----------+----------+--------+---------+
+| Sum || 45438.73 | 44873.19 | -1% || | | | |
+| Geomean || | | || | | +1% | |
++----------++----------+----------+--------++----------+----------+--------+---------+
+| Notes || ˄ Execution stopped due to max runs reached |
+| || ˅ Insufficient number of runs for p-value calculation |
++----------++----------+----------+--------++----------+----------+--------+---------+
hyriseBenchmarkTPCH - single-threaded, SF 0.01
Sum of avg. item runtimes: -3% || Geometric mean of throughput changes: +5%
Configuration Overview - click to expand
+Configuration Overview----+----------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCH_f7417f58c4618845c7b8a8d4559788ad3c7a04e6_st_s01.json | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCH_044e600db1dab827693023c0766273b0a40d4606_st_s01.json |
+--------------------------+----------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------+
| GIT-HASH | f7417f58c4618845c7b8a8d4559788ad3c7a04e6-dirty | 044e600db1dab827693023c0766273b0a40d4606-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| clustering | None | None |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2024-02-29 23:27:49 | 2024-03-01 03:32:19 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 100 | 100 |
| scale_factor | 0.009999999776482582 | 0.009999999776482582 |
| time_unit | ns | ns |
| use_prepared_statements | False | False |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+--------------------------+----------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------+
++----------++----------+---------+--------++----------+----------+--------+---------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++----------++----------+---------+--------++----------+----------+--------+---------+
+| TPC-H 01 || 9.90 | 10.30 | +4%˄ || 100.97 | 97.09 | -4%˄ | 0.0173 |
+| TPC-H 02 || 4.59 | 4.29 | -7%˄ || 217.69 | 233.25 | +7%˄ | 0.1612 |
+| TPC-H 03 || 0.69 | 0.70 | +1%˄ || 1449.58 | 1429.60 | -1%˄ | 0.0113 |
+| TPC-H 04 || 0.41 | 0.41 | +2%˄ || 2459.94 | 2416.73 | -2%˄ | 0.0000 |
+| TPC-H 05 || 1.03 | 1.02 | -1%˄ || 966.26 | 975.64 | +1%˄ | 0.6105 |
+| TPC-H 06 || 0.24 | 0.24 | +2%˄ || 4234.48 | 4152.11 | -2%˄ | 0.3194 |
+| TPC-H 07 || 10.78 | 10.78 | +0%˄ || 92.77 | 92.75 | -0%˄ | 0.9979 |
+| TPC-H 08 || 15.78 | 15.61 | -1%˄ || 63.36 | 64.07 | +1%˄ | 0.2571 |
+| TPC-H 09 || 3.86 | 3.57 | -8%˄ || 258.82 | 279.94 | +8%˄ | 0.5878 |
+| TPC-H 10 || 0.79 | 0.73 | -8%˄ || 1263.09 | 1373.00 | +9%˄ | 0.0000 |
+| TPC-H 11 || 0.20 | 0.20 | +3%˄ || 5041.28 | 4902.88 | -3%˄ | 0.0008 |
+| TPC-H 12 || 0.67 | 0.69 | +3%˄ || 1488.50 | 1445.41 | -3%˄ | 0.0000 |
+| TPC-H 13 || 2.12 | 2.13 | +0%˄ || 471.08 | 470.24 | -0%˄ | 0.5227 |
+| TPC-H 14 || 0.32 | 0.33 | +1%˄ || 3079.14 | 3035.77 | -1%˄ | 0.1624 |
+| TPC-H 15 || 1.32 | 1.33 | +1%˄ || 754.01 | 749.89 | -1%˄ | 0.0090 |
+| TPC-H 16 || 2.48 | 2.47 | -1%˄ || 402.56 | 405.15 | +1%˄ | 0.0028 |
+| TPC-H 17 || 0.75 | 0.62 | -18%˄ || 1331.03 | 1621.55 | +22%˄ | 0.1124 |
+| TPC-H 18 || 2.19 | 1.11 | -49%˄ || 456.12 | 897.75 | +97%˄ | 0.0000 |
+| TPC-H 19 || 6.90 | 6.43 | -7%˄ || 144.84 | 155.54 | +7%˄ | 0.0000 |
+| TPC-H 20 || 2.78 | 2.82 | +2%˄ || 359.88 | 354.18 | -2%˄ | 0.5831 |
+| TPC-H 21 || 1.12 | 1.10 | -2%˄ || 894.52 | 908.32 | +2%˄ | 0.6709 |
+| TPC-H 22 || 1.28 | 1.29 | +1%˄ || 780.56 | 775.60 | -1%˄ | 0.0000 |
++----------++----------+---------+--------++----------+----------+--------+---------+
+| Sum || 70.20 | 68.15 | -3% || | | | |
+| Geomean || | | || | | +5% | |
++----------++----------+---------+--------++----------+----------+--------+---------+
+| Notes || ˄ Execution stopped due to max runs reached |
++----------++----------+---------+--------++----------+----------+--------+---------+
hyriseBenchmarkTPCH - multi-threaded, ordered, 1 client, 64 cores, SF 10.0
Sum of avg. item runtimes: -5% || Geometric mean of throughput changes: +4%
Configuration Overview - click to expand
+Configuration Overview---------+--------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCH_f7417f58c4618845c7b8a8d4559788ad3c7a04e6_mt_ordered.json | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCH_044e600db1dab827693023c0766273b0a40d4606_mt_ordered.json |
+-------------------------------+--------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | f7417f58c4618845c7b8a8d4559788ad3c7a04e6-dirty | 044e600db1dab827693023c0766273b0a40d4606-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| clustering | None | None |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2024-02-29 23:28:18 | 2024-03-01 03:32:49 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| use_prepared_statements | False | False |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+--------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------+
++----------++----------+----------+--------++----------+----------+--------+----------------------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++----------++----------+----------+--------++----------+----------+--------+----------------------+
+| TPC-H 01 || 5750.65 | 5740.21 | -0% || 0.17 | 0.17 | -0% | (run time too short) |
+| TPC-H 02 || 59.29 | 60.53 | +2% || 15.58 | 15.23 | -2% | 0.0449 |
+| TPC-H 03 || 870.73 | 832.21 | -4% || 1.13 | 1.18 | +4% | 0.0000 |
+| TPC-H 04 || 803.41 | 802.70 | -0% || 1.23 | 1.23 | -0% | 0.9508 |
+| TPC-H 05 || 627.22 | 629.80 | +0% || 1.57 | 1.57 | -0% | (run time too short) |
+| TPC-H 06 || 66.77 | 67.22 | +1% || 13.87 | 13.85 | -0% | 0.0594 |
+| TPC-H 07 || 332.93 | 340.29 | +2% || 2.95 | 2.88 | -2% | 0.0005 |
+| TPC-H 08 || 285.04 | 286.69 | +1% || 3.43 | 3.42 | -0% | 0.2052 |
+| TPC-H 09 || 2745.01 | 2694.41 | -2% || 0.35 | 0.37 | +5% | (run time too short) |
+| TPC-H 10 || 1472.65 | 787.59 | -47% || 0.67 | 1.25 | +87% | (run time too short) |
+| TPC-H 11 || 73.93 | 68.82 | -7% || 12.63 | 13.50 | +7% | 0.0000 |
+| TPC-H 12 || 699.29 | 700.67 | +0% || 1.42 | 1.42 | +0% | 0.6805 |
+| TPC-H 13 || 4032.79 | 3858.44 | -4% || 0.23 | 0.25 | +7% | (run time too short) |
+| TPC-H 14 || 159.99 | 161.48 | +1% || 6.05 | 6.00 | -1% | 0.0852 |
+| TPC-H 15 || 185.67 | 170.47 | -8% || 5.23 | 5.70 | +9% | 0.0000 |
+| TPC-H 16 || 907.57 | 878.43 | -3% || 1.08 | 1.12 | +3% | (run time too short) |
+| TPC-H 17 || 91.79 | 92.36 | +1% || 10.37 | 10.25 | -1% | 0.1767 |
+| TPC-H 18 || 2674.63 | 2452.83 | -8% || 0.37 | 0.40 | +9% | (run time too short) |
+| TPC-H 19 || 126.28 | 126.56 | +0% || 7.62 | 7.62 | +0% | 0.8207 |
+| TPC-H 20 || 257.27 | 274.76 | +7% || 3.80 | 3.57 | -6% | 0.0000 |
+| TPC-H 21 || 1293.74 | 1346.28 | +4% || 0.77 | 0.73 | -4% | 0.0044 |
+| TPC-H 22 || 160.55 | 163.85 | +2% || 6.03 | 5.92 | -2% | 0.0000 |
++----------++----------+----------+--------++----------+----------+--------+----------------------+
+| Sum || 23677.22 | 22536.60 | -5% || | | | |
+| Geomean || | | || | | +4% | |
++----------++----------+----------+--------++----------+----------+--------+----------------------+
hyriseBenchmarkTPCH - multi-threaded, shuffled, 64 clients, 64 cores, SF 10.0
Sum of avg. item runtimes: -1% || Geometric mean of throughput changes: +2%
Configuration Overview - click to expand
+Configuration Overview---------+------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCH_f7417f58c4618845c7b8a8d4559788ad3c7a04e6_mt.json | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCH_044e600db1dab827693023c0766273b0a40d4606_mt.json |
+-------------------------------+------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------+
| GIT-HASH | f7417f58c4618845c7b8a8d4559788ad3c7a04e6-dirty | 044e600db1dab827693023c0766273b0a40d4606-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 64 | 64 |
| clustering | None | None |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2024-02-29 23:52:24 | 2024-03-01 03:56:58 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| use_prepared_statements | False | False |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------+
++----------++----------+----------+--------++----------+----------+--------+---------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++----------++----------+----------+--------++----------+----------+--------+---------+
+| TPC-H 01 || 6615.60 | 6507.59 | -2% || 0.99 | 1.01 | +2% | 0.2129 |
+| TPC-H 02 || 562.04 | 556.79 | -1% || 1.00 | 1.01 | +2% | 0.9500 |
+| TPC-H 03 || 3112.77 | 3115.13 | +0% || 1.00 | 1.01 | +2% | 0.9881 |
+| TPC-H 04 || 2579.39 | 2490.59 | -3% || 1.00 | 1.01 | +1% | 0.5471 |
+| TPC-H 05 || 4060.05 | 4017.22 | -1% || 1.00 | 1.01 | +2% | 0.8177 |
+| TPC-H 06 || 899.86 | 771.29 | -14% || 1.00 | 1.01 | +2% | 0.1531 |
+| TPC-H 07 || 3727.14 | 3660.49 | -2% || 1.00 | 1.01 | +2% | 0.7442 |
+| TPC-H 08 || 2345.79 | 2567.68 | +9% || 1.00 | 1.01 | +1% | 0.1379 |
+| TPC-H 09 || 6681.55 | 6722.09 | +1% || 0.99 | 1.01 | +2% | 0.8458 |
+| TPC-H 10 || 4368.92 | 3536.02 | -19% || 0.99 | 1.01 | +2% | 0.0000 |
+| TPC-H 11 || 455.14 | 532.90 | +17% || 1.00 | 1.01 | +1% | 0.2351 |
+| TPC-H 12 || 2987.96 | 2830.29 | -5% || 1.00 | 1.01 | +2% | 0.3136 |
+| TPC-H 13 || 6017.37 | 5910.08 | -2% || 0.99 | 1.01 | +2% | 0.3954 |
+| TPC-H 14 || 1121.20 | 1191.87 | +6% || 1.00 | 1.01 | +2% | 0.4787 |
+| TPC-H 15 || 801.27 | 647.35 | -19% || 1.00 | 1.01 | +2% | 0.0228 |
+| TPC-H 16 || 2536.76 | 2552.28 | +1% || 1.00 | 1.01 | +2% | 0.9109 |
+| TPC-H 17 || 791.17 | 859.09 | +9% || 1.00 | 1.01 | +2% | 0.4429 |
+| TPC-H 18 || 3761.47 | 3806.70 | +1% || 0.99 | 1.01 | +2% | 0.6881 |
+| TPC-H 19 || 1346.71 | 1288.16 | -4% || 1.00 | 1.01 | +2% | 0.6281 |
+| TPC-H 20 || 2015.88 | 1982.99 | -2% || 1.00 | 1.01 | +2% | 0.8045 |
+| TPC-H 21 || 5592.76 | 5758.39 | +3% || 0.99 | 1.01 | +2% | 0.4299 |
+| TPC-H 22 || 1032.89 | 1215.45 | +18% || 1.00 | 1.01 | +2% | 0.0771 |
++----------++----------+----------+--------++----------+----------+--------+---------+
+| Sum || 63413.68 | 62520.46 | -1% || | | | |
+| Geomean || | | || | | +2% | |
++----------++----------+----------+--------++----------+----------+--------+---------+
hyriseBenchmarkTPCDS - single-threaded
Sum of avg. item runtimes: +6% || Geometric mean of throughput changes: -2%
Configuration Overview - click to expand
+Configuration Overview---+-------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCDS_f7417f58c4618845c7b8a8d4559788ad3c7a04e6_st.json | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCDS_044e600db1dab827693023c0766273b0a40d4606_st.json |
+-------------------------+-------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------+
| GIT-HASH | f7417f58c4618845c7b8a8d4559788ad3c7a04e6-dirty | 044e600db1dab827693023c0766273b0a40d4606-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2024-03-01 00:14:35 | 2024-03-01 04:19:08 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 100 | 100 |
| time_unit | ns | ns |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------+-------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------+
++---------++----------+----------+--------++----------+----------+--------+---------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++---------++----------+----------+--------++----------+----------+--------+---------+
+| 01 || 287.05 | 306.74 | +7%˄ || 3.48 | 3.26 | -6%˄ | 0.0000 |
+| 03 || 99.26 | 98.72 | -1%˄ || 10.07 | 10.13 | +1%˄ | 0.0366 |
+| 06 || 232.61 | 233.81 | +1%˄ || 4.30 | 4.28 | -1%˄ | 0.0033 |
+| 07 || 357.20 | 366.83 | +3%˄ || 2.80 | 2.73 | -3%˄ | 0.0000 |
+| 09 || 1045.58 | 1055.32 | +1% || 0.96 | 0.95 | -1% | 0.0000 |
+| 10 || 159.16 | 156.97 | -1%˄ || 6.28 | 6.37 | +1%˄ | 0.0000 |
+| 13 || 652.62 | 662.19 | +1% || 1.53 | 1.51 | -1% | 0.0024 |
+| 15 || 134.37 | 136.12 | +1%˄ || 7.44 | 7.35 | -1%˄ | 0.0029 |
+| 16 || 67.07 | 68.41 | +2%˄ || 14.91 | 14.62 | -2%˄ | 0.0000 |
+| 17 || 411.35 | 414.40 | +1%˄ || 2.43 | 2.41 | -1%˄ | 0.0001 |
+| 19 || 133.08 | 133.74 | +0%˄ || 7.51 | 7.48 | -0%˄ | 0.0043 |
+| 25 || 198.92 | 202.32 | +2%˄ || 5.03 | 4.94 | -2%˄ | 0.0000 |
+| 26 || 146.30 | 148.50 | +2%˄ || 6.83 | 6.73 | -1%˄ | 0.0000 |
+| 28 || 794.32 | 782.11 | -2% || 1.26 | 1.28 | +2% | 0.0000 |
+| 29 || 575.41 | 586.04 | +2%˄ || 1.74 | 1.71 | -2%˄ | 0.0000 |
+| 31 || 1570.94 | 1582.71 | +1% || 0.64 | 0.63 | -1% | 0.0617 |
+| 32 || 32.98 | 33.09 | +0%˄ || 30.32 | 30.21 | -0%˄ | 0.1245 |
+| 34 || 215.23 | 213.26 | -1%˄ || 4.65 | 4.69 | +1%˄ | 0.0001 |
+| 35 || 811.93 | 803.98 | -1% || 1.23 | 1.24 | +1% | 0.0000 |
+| 37 || 838.88 | 830.11 | -1% || 1.19 | 1.20 | +1% | 0.0303 |
+| 39a || 1929.90 | 1879.21 | -3% || 0.52 | 0.53 | +3% | 0.0000 |
+| 39b || 1914.86 | 1847.66 | -4% || 0.52 | 0.54 | +4% | 0.0000 |
+| 41 || 298.81 | 307.24 | +3%˄ || 3.35 | 3.25 | -3%˄ | 0.0000 |
+| 42 || 108.68 | 109.27 | +1%˄ || 9.20 | 9.15 | -1%˄ | 0.0327 |
+| 43 || 1057.14 | 1064.22 | +1% || 0.95 | 0.94 | -1% | 0.0010 |
+| 45 || 172.50 | 174.34 | +1%˄ || 5.80 | 5.74 | -1%˄ | 0.0000 |
+| 48 || 1112.45 | 1122.10 | +1% || 0.90 | 0.89 | -1% | 0.4003 |
+| 50 || 157.41 | 157.78 | +0%˄ || 6.35 | 6.34 | -0%˄ | 0.1487 |
+| 52 || 107.59 | 108.10 | +0%˄ || 9.29 | 9.25 | -0%˄ | 0.0000 |
+| 55 || 100.77 | 106.28 | +5%˄ || 9.92 | 9.41 | -5%˄ | 0.0005 |
+| 62 || 608.21 | 607.54 | -0% || 1.64 | 1.65 | +0% | 0.4363 |
+| 65 || 2070.64 | 2340.51 | +13% || 0.48 | 0.43 | -12% | 0.0000 |
+| 69 || 171.99 | 171.74 | -0%˄ || 5.81 | 5.82 | +0%˄ | 0.4798 |
+| 73 || 101.00 | 100.66 | -0%˄ || 9.90 | 9.93 | +0%˄ | 0.1649 |
+| 79 || 602.43 | 631.24 | +5%˄ || 1.66 | 1.58 | -5%˄ | 0.0000 |
+| 81 || 199.61 | 206.51 | +3%˄ || 5.01 | 4.84 | -3%˄ | 0.0000 |
+| 82 || 887.45 | 879.21 | -1% || 1.13 | 1.14 | +1% | 0.0509 |
+| 83 || 52.62 | 52.76 | +0%˄ || 19.00 | 18.95 | -0%˄ | 0.7728 |
+| 85 || 198.64 | 201.27 | +1%˄ || 5.03 | 4.97 | -1%˄ | 0.0000 |
+| 88 || 949.07 | 914.61 | -4% || 1.05 | 1.09 | +4% | 0.0000 |
+| 91 || 20.36 | 20.65 | +1%˄ || 49.10 | 48.42 | -1%˄ | 0.0002 |
+| 92 || 53.15 | 49.26 | -7%˄ || 18.81 | 20.30 | +8%˄ | 0.0000 |
+| 93 || 5212.06 | 5169.42 | -1% || 0.19 | 0.19 | +1% | 0.0031 |
+| 94 || 50.52 | 50.50 | -0%˄ || 19.79 | 19.80 | +0%˄ | 0.9320 |
+| 95 || 4781.42 | 4630.36 | -3% || 0.21 | 0.22 | +3% | 0.0182 |
+| 96 || 79.49 | 78.94 | -1%˄ || 12.58 | 12.67 | +1%˄ | 0.3336 |
+| 97 || 2822.29 | 4790.98 | +70% || 0.35 | 0.21 | -41% | 0.0000 |
+| 99 || 1134.80 | 1115.96 | -2% || 0.88 | 0.90 | +2% | 0.0000 |
++---------++----------+----------+--------++----------+----------+--------+---------+
+| Sum || 35720.10 | 37703.70 | +6% || | | | |
+| Geomean || | | || | | -2% | |
++---------++----------+----------+--------++----------+----------+--------+---------+
+| Notes || ˄ Execution stopped due to max runs reached |
++---------++----------+----------+--------++----------+----------+--------+---------+
hyriseBenchmarkTPCDS - multi-threaded, shuffled, 64 clients, 64 cores
Sum of avg. item runtimes: +2% || Geometric mean of throughput changes: -2%
Configuration Overview - click to expand
+Configuration Overview---------+-------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCDS_f7417f58c4618845c7b8a8d4559788ad3c7a04e6_mt.json | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCDS_044e600db1dab827693023c0766273b0a40d4606_mt.json |
+-------------------------------+-------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------+
| GIT-HASH | f7417f58c4618845c7b8a8d4559788ad3c7a04e6-dirty | 044e600db1dab827693023c0766273b0a40d4606-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 64 | 64 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2024-03-01 00:43:35 | 2024-03-01 04:48:15 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+-------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------+
++---------++----------+----------+--------++----------+----------+--------+---------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++---------++----------+----------+--------++----------+----------+--------+---------+
+| 01 || 631.03 | 825.38 | +31% || 1.00 | 0.98 | -2% | 0.0000 |
+| 03 || 265.71 | 281.15 | +6% || 1.00 | 0.98 | -2% | 0.6014 |
+| 06 || 932.11 | 968.18 | +4% || 1.00 | 0.98 | -2% | 0.6059 |
+| 07 || 969.44 | 884.87 | -9% || 1.00 | 0.98 | -2% | 0.2030 |
+| 09 || 795.72 | 938.48 | +18% || 1.00 | 0.98 | -2% | 0.0280 |
+| 10 || 766.55 | 853.68 | +11% || 0.99 | 0.98 | -2% | 0.2426 |
+| 13 || 1753.55 | 1804.81 | +3% || 0.99 | 0.98 | -2% | 0.5892 |
+| 15 || 477.48 | 449.52 | -6% || 1.00 | 0.98 | -2% | 0.4685 |
+| 16 || 465.59 | 519.56 | +12% || 1.00 | 0.98 | -2% | 0.3053 |
+| 17 || 1337.77 | 1312.37 | -2% || 1.00 | 0.97 | -2% | 0.7608 |
+| 19 || 648.58 | 711.11 | +10% || 1.00 | 0.97 | -2% | 0.2950 |
+| 25 || 1041.25 | 1127.32 | +8% || 1.00 | 0.98 | -2% | 0.2827 |
+| 26 || 580.99 | 629.32 | +8% || 1.00 | 0.98 | -2% | 0.4515 |
+| 28 || 1628.57 | 1694.20 | +4% || 1.00 | 0.98 | -2% | 0.5424 |
+| 29 || 1771.81 | 1779.10 | +0% || 0.99 | 0.98 | -2% | 0.9397 |
+| 31 || 3061.40 | 2954.45 | -3% || 0.99 | 0.97 | -2% | 0.4381 |
+| 32 || 210.63 | 180.62 | -14% || 1.00 | 0.98 | -2% | 0.2883 |
+| 34 || 725.72 | 773.18 | +7% || 1.00 | 0.98 | -2% | 0.4197 |
+| 35 || 2180.09 | 2190.11 | +0% || 0.99 | 0.97 | -2% | 0.9239 |
+| 37 || 903.78 | 921.10 | +2% || 1.00 | 0.98 | -2% | 0.7731 |
+| 39a || 2658.64 | 2819.07 | +6% || 0.99 | 0.97 | -2% | 0.0882 |
+| 39b || 2702.76 | 2830.13 | +5% || 1.00 | 0.97 | -2% | 0.1809 |
+| 41 || 3763.49 | 3869.81 | +3% || 0.99 | 0.97 | -2% | 0.4722 |
+| 42 || 480.10 | 488.73 | +2% || 0.99 | 0.98 | -2% | 0.8692 |
+| 43 || 1537.25 | 1605.63 | +4% || 1.00 | 0.98 | -2% | 0.4130 |
+| 45 || 775.42 | 813.19 | +5% || 1.00 | 0.98 | -2% | 0.5565 |
+| 48 || 2467.88 | 2549.97 | +3% || 0.99 | 0.98 | -2% | 0.4651 |
+| 50 || 1036.84 | 1021.57 | -1% || 0.99 | 0.97 | -2% | 0.8259 |
+| 52 || 535.95 | 491.06 | -8% || 1.00 | 0.98 | -2% | 0.4352 |
+| 55 || 457.18 | 503.65 | +10% || 1.00 | 0.98 | -2% | 0.4017 |
+| 62 || 1043.63 | 1058.67 | +1% || 0.99 | 0.98 | -2% | 0.8040 |
+| 65 || 4485.63 | 4342.68 | -3% || 0.99 | 0.97 | -2% | 0.0874 |
+| 69 || 1032.22 | 993.63 | -4% || 0.99 | 0.98 | -2% | 0.6464 |
+| 73 || 581.55 | 469.38 | -19% || 1.00 | 0.98 | -2% | 0.0347 |
+| 79 || 1575.38 | 1560.75 | -1% || 1.00 | 0.98 | -2% | 0.8345 |
+| 81 || 668.20 | 678.02 | +1% || 1.00 | 0.98 | -2% | 0.8453 |
+| 82 || 1030.53 | 1039.44 | +1% || 1.00 | 0.98 | -2% | 0.9036 |
+| 83 || 316.30 | 349.56 | +11% || 1.00 | 0.98 | -2% | 0.4171 |
+| 85 || 878.62 | 988.56 | +13% || 1.00 | 0.97 | -2% | 0.1749 |
+| 88 || 2915.29 | 2904.55 | -0% || 1.00 | 0.97 | -2% | 0.9409 |
+| 91 || 218.15 | 286.80 | +31% || 1.00 | 0.98 | -2% | 0.1624 |
+| 92 || 269.33 | 291.76 | +8% || 1.00 | 0.98 | -2% | 0.5224 |
+| 93 || 2247.27 | 2250.19 | +0% || 0.99 | 0.98 | -2% | 0.9749 |
+| 94 || 477.66 | 562.70 | +18% || 1.00 | 0.98 | -2% | 0.1603 |
+| 95 || 2348.61 | 2298.36 | -2% || 1.00 | 0.97 | -2% | 0.6387 |
+| 96 || 387.51 | 465.27 | +20% || 1.00 | 0.98 | -2% | 0.0875 |
+| 97 || 4309.56 | 4444.45 | +3% || 0.99 | 0.97 | -2% | 0.2077 |
+| 99 || 1359.24 | 1369.38 | +1% || 1.00 | 0.98 | -2% | 0.8708 |
++---------++----------+----------+--------++----------+----------+--------+---------+
+| Sum || 63707.96 | 65145.49 | +2% || | | | |
+| Geomean || | | || | | -2% | |
++---------++----------+----------+--------++----------+----------+--------+---------+
hyriseBenchmarkTPCC - single-threaded
Sum of avg. item runtimes: -1% || Geometric mean of throughput changes: +2%
Configuration Overview - click to expand
+Configuration Overview---+------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCC_f7417f58c4618845c7b8a8d4559788ad3c7a04e6_st.json | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCC_044e600db1dab827693023c0766273b0a40d4606_st.json |
+-------------------------+------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------+
| GIT-HASH | f7417f58c4618845c7b8a8d4559788ad3c7a04e6-dirty | 044e600db1dab827693023c0766273b0a40d4606-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2024-03-01 01:04:06 | 2024-03-01 05:08:45 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10 | 10 |
| time_unit | ns | ns |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------+------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------+
++--------------++----------+---------+--------++----------+----------+--------+----------------------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++--------------++----------+---------+--------++----------+----------+--------+----------------------+
+| Delivery || 63.63 | 63.84 | +0% || 1.53 | 1.55 | +1% | (run time too short) |
+| New-Order || 44.46 | 43.21 | -3% || 17.09 | 17.51 | +2% | 0.0368 |
+| Order-Status || 2.26 | 2.08 | -8% || 1.52 | 1.55 | +2% | (run time too short) |
+| Payment || 8.19 | 8.12 | -1% || 16.21 | 16.61 | +2% | 0.2323 |
+| Stock-Level || 3.67 | 3.54 | -4% || 1.52 | 1.53 | +1% | (run time too short) |
++--------------++----------+---------+--------++----------+----------+--------+----------------------+
+| Sum || 122.21 | 120.79 | -1% || | | | |
+| Geomean || | | || | | +2% | |
++--------------++----------+---------+--------++----------+----------+--------+----------------------+
hyriseBenchmarkTPCC - multi-threaded, shuffled, 64 clients, 64 cores
Sum of avg. item runtimes: +2% || Geometric mean of throughput changes: -2%
Configuration Overview - click to expand
+Configuration Overview---------+------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCC_f7417f58c4618845c7b8a8d4559788ad3c7a04e6_mt.json | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCC_044e600db1dab827693023c0766273b0a40d4606_mt.json |
+-------------------------------+------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------+
| GIT-HASH | f7417f58c4618845c7b8a8d4559788ad3c7a04e6-dirty | 044e600db1dab827693023c0766273b0a40d4606-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 64 | 64 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2024-03-01 01:05:14 | 2024-03-01 05:09:54 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10 | 10 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------+
++--------------++----------+---------+--------++----------+----------+--------+---------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++--------------++----------+---------+--------++----------+----------+--------+---------+
+| Delivery || 311.95 | 317.17 | +2% || 18.17 | 17.83 | -2% | 0.0000 |
+| unsucc.: || 4.02 | 4.04 | +0% || 21.05 | 20.78 | -1% | |
+| New-Order || 191.62 | 194.85 | +2% || 224.87 | 222.73 | -1% | 0.0000 |
+| unsucc.: || 11.21 | 10.46 | -7% || 216.37 | 211.67 | -2% | |
+| Order-Status || 13.25 | 13.58 | +2% || 39.23 | 38.62 | -2% | 0.0082 |
+| Payment || 32.09 | 32.63 | +2% || 122.21 | 120.16 | -2% | 0.0000 |
+| unsucc.: || 7.33 | 7.45 | +2% || 299.46 | 294.96 | -2% | |
+| Stock-Level || 22.66 | 23.11 | +2% || 39.22 | 38.61 | -2% | 0.1522 |
++--------------++----------+---------+--------++----------+----------+--------+---------+
+| Sum || 571.57 | 581.34 | +2% || | | | |
+| Geomean || | | || | | -2% | |
++--------------++----------+---------+--------++----------+----------+--------+---------+
hyriseBenchmarkJoinOrder - single-threaded
Sum of avg. item runtimes: +0% || Geometric mean of throughput changes: +0%
Configuration Overview - click to expand
+Configuration Overview---+-----------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkJoinOrder_f7417f58c4618845c7b8a8d4559788ad3c7a04e6_st.json | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkJoinOrder_044e600db1dab827693023c0766273b0a40d4606_st.json |
+-------------------------+-----------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------+
| GIT-HASH | f7417f58c4618845c7b8a8d4559788ad3c7a04e6-dirty | 044e600db1dab827693023c0766273b0a40d4606-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2024-03-01 01:25:29 | 2024-03-01 05:30:09 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 100 | 100 |
| time_unit | ns | ns |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------+-----------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------+
++---------++----------+----------+--------++----------+----------+--------+---------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++---------++----------+----------+--------++----------+----------+--------+---------+
+| 10a || 132.10 | 122.96 | -7%˄ || 7.57 | 8.13 | +7%˄ | 0.0000 |
+| 10b || 89.48 | 77.37 | -14%˄ || 11.17 | 12.92 | +16%˄ | 0.0000 |
+| 10c || 439.10 | 441.53 | +1%˄ || 2.28 | 2.26 | -1%˄ | 0.0141 |
+| 11a || 131.13 | 129.43 | -1%˄ || 7.63 | 7.73 | +1%˄ | 0.0000 |
+| 11b || 125.98 | 125.47 | -0%˄ || 7.94 | 7.97 | +0%˄ | 0.0804 |
+| 11c || 28.64 | 28.66 | +0%˄ || 34.91 | 34.89 | -0%˄ | 0.5976 |
+| 11d || 31.31 | 31.38 | +0%˄ || 31.93 | 31.86 | -0%˄ | 0.0133 |
+| 12a || 41.25 | 41.23 | -0%˄ || 24.24 | 24.25 | +0%˄ | 0.6650 |
+| 12b || 33.26 | 33.35 | +0%˄ || 30.06 | 29.98 | -0%˄ | 0.0213 |
+| 12c || 105.86 | 106.46 | +1%˄ || 9.45 | 9.39 | -1%˄ | 0.1380 |
+| 13a || 237.70 | 237.31 | -0%˄ || 4.21 | 4.21 | +0%˄ | 0.0001 |
+| 13b || 290.03 | 290.96 | +0%˄ || 3.45 | 3.44 | -0%˄ | 0.0043 |
+| 13c || 233.52 | 234.02 | +0%˄ || 4.28 | 4.27 | -0%˄ | 0.5920 |
+| 13d || 615.07 | 621.56 | +1% || 1.63 | 1.61 | -1% | 0.0000 |
+| 14a || 144.01 | 145.08 | +1%˄ || 6.94 | 6.89 | -1%˄ | 0.0051 |
+| 14b || 142.80 | 143.28 | +0%˄ || 7.00 | 6.98 | -0%˄ | 0.0248 |
+| 14c || 265.00 | 246.02 | -7%˄ || 3.77 | 4.06 | +8%˄ | 0.0000 |
+| 15a || 63.55 | 63.60 | +0%˄ || 15.73 | 15.72 | -0%˄ | 0.5274 |
+| 15b || 67.93 | 68.09 | +0%˄ || 14.72 | 14.68 | -0%˄ | 0.2084 |
+| 15c || 52.11 | 51.96 | -0%˄ || 19.19 | 19.24 | +0%˄ | 0.0000 |
+| 15d || 50.96 | 50.60 | -1%˄ || 19.62 | 19.76 | +1%˄ | 0.0000 |
+| 16a || 1909.15 | 1949.57 | +2% || 0.52 | 0.51 | -2% | 0.0151 |
+| 16b || 3234.45 | 3277.68 | +1% || 0.31 | 0.31 | -1% | 0.0002 |
+| 16c || 2136.87 | 2154.96 | +1% || 0.47 | 0.46 | -1% | 0.0040 |
+| 16d || 2093.59 | 2100.67 | +0% || 0.48 | 0.48 | -0% | 0.1573 |
+| 17a || 755.99 | 762.24 | +1% || 1.32 | 1.31 | -1% | 0.0004 |
+| 17b || 627.55 | 631.40 | +1% || 1.59 | 1.58 | -1% | 0.0004 |
+| 17c || 603.89 | 606.81 | +0%˄ || 1.66 | 1.65 | -0%˄ | 0.0180 |
+| 17d || 669.97 | 672.02 | +0% || 1.49 | 1.49 | -0% | 0.0243 |
+| 17e || 2173.58 | 2189.33 | +1% || 0.46 | 0.46 | -1% | 0.0000 |
+| 17f || 1254.54 | 1261.16 | +1% || 0.80 | 0.79 | -1% | 0.0157 |
+| 18a || 149.66 | 149.37 | -0%˄ || 6.68 | 6.69 | +0%˄ | 0.0510 |
+| 18b || 142.67 | 142.13 | -0%˄ || 7.01 | 7.04 | +0%˄ | 0.0035 |
+| 18c || 291.36 | 289.71 | -1%˄ || 3.43 | 3.45 | +1%˄ | 0.0054 |
+| 19a || 268.73 | 268.80 | +0%˄ || 3.72 | 3.72 | -0%˄ | 0.7773 |
+| 19b || 230.67 | 230.91 | +0%˄ || 4.34 | 4.33 | -0%˄ | 0.5858 |
+| 19c || 316.01 | 316.42 | +0%˄ || 3.16 | 3.16 | -0%˄ | 0.3167 |
+| 19d || 818.48 | 825.03 | +1% || 1.22 | 1.21 | -1% | 0.0000 |
+| 1a || 13.49 | 13.73 | +2%˄ || 74.11 | 72.83 | -2%˄ | 0.0000 |
+| 1b || 21.02 | 21.74 | +3%˄ || 47.57 | 45.99 | -3%˄ | 0.0000 |
+| 1c || 20.89 | 20.72 | -1%˄ || 47.86 | 48.26 | +1%˄ | 0.0494 |
+| 1d || 12.76 | 13.13 | +3%˄ || 78.35 | 76.14 | -3%˄ | 0.0000 |
+| 20a || 760.79 | 761.21 | +0% || 1.31 | 1.31 | -0% | 0.6978 |
+| 20b || 792.32 | 790.09 | -0% || 1.26 | 1.27 | +0% | 0.0000 |
+| 20c || 468.27 | 466.10 | -0%˄ || 2.14 | 2.15 | +0%˄ | 0.0041 |
+| 21a || 146.77 | 145.87 | -1%˄ || 6.81 | 6.86 | +1%˄ | 0.0000 |
+| 21b || 136.38 | 135.02 | -1%˄ || 7.33 | 7.41 | +1%˄ | 0.0000 |
+| 21c || 141.85 | 140.94 | -1%˄ || 7.05 | 7.09 | +1%˄ | 0.0000 |
+| 22a || 233.65 | 233.38 | -0%˄ || 4.28 | 4.28 | +0%˄ | 0.5860 |
+| 22b || 213.22 | 213.72 | +0%˄ || 4.69 | 4.68 | -0%˄ | 0.0007 |
+| 22c || 313.91 | 315.35 | +0%˄ || 3.19 | 3.17 | -0%˄ | 0.0227 |
+| 22d || 488.69 | 484.64 | -1%˄ || 2.05 | 2.06 | +1%˄ | 0.0000 |
+| 23a || 56.41 | 56.43 | +0%˄ || 17.73 | 17.72 | -0%˄ | 0.4990 |
+| 23b || 72.21 | 72.10 | -0%˄ || 13.85 | 13.87 | +0%˄ | 0.7286 |
+| 23c || 61.90 | 62.03 | +0%˄ || 16.15 | 16.12 | -0%˄ | 0.0018 |
+| 24a || 233.01 | 233.22 | +0%˄ || 4.29 | 4.29 | -0%˄ | 0.2318 |
+| 24b || 224.61 | 224.13 | -0%˄ || 4.45 | 4.46 | +0%˄ | 0.0000 |
+| 25a || 151.87 | 152.14 | +0%˄ || 6.58 | 6.57 | -0%˄ | 0.4182 |
+| 25b || 87.09 | 87.09 | -0%˄ || 11.48 | 11.48 | -0%˄ | 0.9994 |
+| 25c || 353.02 | 354.18 | +0%˄ || 2.83 | 2.82 | -0%˄ | 0.1584 |
+| 26a || 262.78 | 262.75 | -0%˄ || 3.81 | 3.81 | +0%˄ | 0.9454 |
+| 26b || 228.50 | 228.70 | +0%˄ || 4.38 | 4.37 | -0%˄ | 0.7073 |
+| 26c || 443.90 | 442.26 | -0%˄ || 2.25 | 2.26 | +0%˄ | 0.0000 |
+| 27a || 131.34 | 137.19 | +4%˄ || 7.61 | 7.29 | -4%˄ | 0.0129 |
+| 27b || 119.63 | 120.49 | +1%˄ || 8.36 | 8.30 | -1%˄ | 0.2433 |
+| 27c || 141.74 | 140.45 | -1%˄ || 7.06 | 7.12 | +1%˄ | 0.0000 |
+| 28a || 256.91 | 256.60 | -0%˄ || 3.89 | 3.90 | +0%˄ | 0.4736 |
+| 28b || 96.17 | 96.30 | +0%˄ || 10.40 | 10.38 | -0%˄ | 0.0852 |
+| 28c || 236.28 | 235.08 | -1%˄ || 4.23 | 4.25 | +1%˄ | 0.0012 |
+| 29a || 183.68 | 183.97 | +0%˄ || 5.44 | 5.44 | -0%˄ | 0.0701 |
+| 29b || 871.19 | 847.66 | -3% || 1.15 | 1.18 | +3% | 0.0000 |
+| 29c || 238.18 | 238.11 | -0%˄ || 4.20 | 4.20 | +0%˄ | 0.6604 |
+| 2a || 43.86 | 44.07 | +0%˄ || 22.80 | 22.69 | -0%˄ | 0.0000 |
+| 2b || 40.24 | 40.43 | +0%˄ || 24.85 | 24.73 | -0%˄ | 0.0000 |
+| 2c || 34.27 | 34.30 | +0%˄ || 29.18 | 29.15 | -0%˄ | 0.1668 |
+| 2d || 86.51 | 85.68 | -1%˄ || 11.56 | 11.67 | +1%˄ | 0.0660 |
+| 30a || 129.87 | 129.15 | -1%˄ || 7.70 | 7.74 | +1%˄ | 0.0007 |
+| 30b || 130.94 | 129.73 | -1%˄ || 7.64 | 7.71 | +1%˄ | 0.0017 |
+| 30c || 230.11 | 230.70 | +0%˄ || 4.35 | 4.33 | -0%˄ | 0.0015 |
+| 31a || 107.70 | 107.81 | +0%˄ || 9.28 | 9.28 | -0%˄ | 0.7762 |
+| 31b || 104.74 | 104.68 | -0%˄ || 9.55 | 9.55 | +0%˄ | 0.4076 |
+| 31c || 120.66 | 120.39 | -0%˄ || 8.29 | 8.31 | +0%˄ | 0.4121 |
+| 32a || 23.02 | 23.11 | +0%˄ || 43.43 | 43.26 | -0%˄ | 0.0038 |
+| 32b || 53.45 | 52.35 | -2%˄ || 18.71 | 19.10 | +2%˄ | 0.0000 |
+| 33a || 46.01 | 45.94 | -0%˄ || 21.73 | 21.76 | +0%˄ | 0.3984 |
+| 33b || 28.11 | 28.14 | +0%˄ || 35.57 | 35.53 | -0%˄ | 0.3009 |
+| 33c || 59.64 | 59.38 | -0%˄ || 16.77 | 16.84 | +0%˄ | 0.0016 |
+| 3a || 102.73 | 102.64 | -0%˄ || 9.73 | 9.74 | +0%˄ | 0.4675 |
+| 3b || 23.31 | 23.37 | +0%˄ || 42.88 | 42.78 | -0%˄ | 0.2443 |
+| 3c || 297.54 | 297.83 | +0%˄ || 3.36 | 3.36 | -0%˄ | 0.6943 |
+| 4a || 197.84 | 198.46 | +0%˄ || 5.05 | 5.04 | -0%˄ | 0.1230 |
+| 4b || 21.76 | 21.54 | -1%˄ || 45.94 | 46.42 | +1%˄ | 0.0029 |
+| 4c || 250.09 | 252.12 | +1%˄ || 4.00 | 3.97 | -1%˄ | 0.0003 |
+| 5a || 65.19 | 66.70 | +2%˄ || 15.34 | 14.99 | -2%˄ | 0.0000 |
+| 5b || 61.90 | 62.40 | +1%˄ || 16.15 | 16.02 | -1%˄ | 0.0000 |
+| 5c || 112.81 | 112.71 | -0%˄ || 8.86 | 8.87 | +0%˄ | 0.2695 |
+| 6a || 220.55 | 221.69 | +1%˄ || 4.53 | 4.51 | -1%˄ | 0.0310 |
+| 6b || 238.20 | 239.02 | +0%˄ || 4.20 | 4.18 | -0%˄ | 0.0103 |
+| 6c || 206.80 | 207.52 | +0%˄ || 4.84 | 4.82 | -0%˄ | 0.1242 |
+| 6d || 559.58 | 559.06 | -0%˄ || 1.79 | 1.79 | +0%˄ | 0.3767 |
+| 6e || 217.56 | 216.43 | -1%˄ || 4.60 | 4.62 | +1%˄ | 0.0779 |
+| 6f || 1044.38 | 1049.12 | +0% || 0.96 | 0.95 | -0% | 0.0397 |
+| 7a || 93.02 | 93.11 | +0%˄ || 10.75 | 10.74 | -0%˄ | 0.2268 |
+| 7b || 84.64 | 84.23 | -0%˄ || 11.81 | 11.87 | +0%˄ | 0.0000 |
+| 7c || 717.92 | 722.65 | +1% || 1.39 | 1.38 | -1% | 0.0013 |
+| 8a || 186.84 | 187.80 | +1%˄ || 5.35 | 5.32 | -1%˄ | 0.0000 |
+| 8b || 180.67 | 180.83 | +0%˄ || 5.53 | 5.53 | -0%˄ | 0.1899 |
+| 8c || 2215.17 | 2225.88 | +0% || 0.45 | 0.45 | -0% | 0.0398 |
+| 8d || 360.87 | 365.19 | +1%˄ || 2.77 | 2.74 | -1%˄ | 0.0000 |
+| 9a || 324.11 | 323.64 | -0%˄ || 3.09 | 3.09 | +0%˄ | 0.0526 |
+| 9b || 214.82 | 214.30 | -0%˄ || 4.65 | 4.67 | +0%˄ | 0.0000 |
+| 9c || 351.18 | 349.86 | -0%˄ || 2.85 | 2.86 | +0%˄ | 0.0008 |
+| 9d || 565.91 | 570.41 | +1%˄ || 1.77 | 1.75 | -1%˄ | 0.0000 |
++---------++----------+----------+--------++----------+----------+--------+---------+
+| Sum || 39366.93 | 39489.40 | +0% || | | | |
+| Geomean || | | || | | +0% | |
++---------++----------+----------+--------++----------+----------+--------+---------+
+| Notes || ˄ Execution stopped due to max runs reached |
++---------++----------+----------+--------++----------+----------+--------+---------+
hyriseBenchmarkJoinOrder - multi-threaded, shuffled, 64 clients, 64 cores
Sum of avg. item runtimes: +0% || Geometric mean of throughput changes: +0%
Configuration Overview - click to expand
+Configuration Overview---------+-----------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkJoinOrder_f7417f58c4618845c7b8a8d4559788ad3c7a04e6_mt.json | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkJoinOrder_044e600db1dab827693023c0766273b0a40d4606_mt.json |
+-------------------------------+-----------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------+
| GIT-HASH | f7417f58c4618845c7b8a8d4559788ad3c7a04e6-dirty | 044e600db1dab827693023c0766273b0a40d4606-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 64 | 64 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2024-03-01 02:13:12 | 2024-03-01 06:17:47 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+-----------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------+
++---------++----------+----------+--------++----------+----------+--------+---------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++---------++----------+----------+--------++----------+----------+--------+---------+
+| 10a || 213.44 | 232.58 | +9% || 1.11 | 1.11 | +0% | 0.4070 |
+| 10b || 165.64 | 139.36 | -16% || 1.11 | 1.11 | +0% | 0.1550 |
+| 10c || 594.67 | 600.95 | +1% || 1.11 | 1.11 | -0% | 0.8366 |
+| 11a || 143.97 | 146.08 | +1% || 1.11 | 1.11 | -0% | 0.9158 |
+| 11b || 131.78 | 108.23 | -18% || 1.11 | 1.11 | +0% | 0.1437 |
+| 11c || 95.95 | 97.18 | +1% || 1.11 | 1.11 | +0% | 0.9066 |
+| 11d || 102.49 | 97.52 | -5% || 1.11 | 1.11 | +0% | 0.6748 |
+| 12a || 177.09 | 169.01 | -5% || 1.11 | 1.11 | -0% | 0.6843 |
+| 12b || 100.54 | 104.69 | +4% || 1.11 | 1.11 | +0% | 0.8111 |
+| 12c || 403.67 | 384.14 | -5% || 1.11 | 1.11 | +0% | 0.5066 |
+| 13a || 533.59 | 559.34 | +5% || 1.11 | 1.11 | +0% | 0.4344 |
+| 13b || 368.70 | 385.80 | +5% || 1.11 | 1.11 | -0% | 0.5432 |
+| 13c || 386.59 | 350.69 | -9% || 1.11 | 1.11 | +0% | 0.2445 |
+| 13d || 1088.37 | 1008.16 | -7% || 1.11 | 1.11 | +0% | 0.0542 |
+| 14a || 491.58 | 507.98 | +3% || 1.11 | 1.11 | +0% | 0.6594 |
+| 14b || 457.70 | 439.17 | -4% || 1.11 | 1.11 | +0% | 0.5148 |
+| 14c || 638.94 | 676.83 | +6% || 1.11 | 1.11 | +0% | 0.3245 |
+| 15a || 130.21 | 126.89 | -3% || 1.11 | 1.11 | -0% | 0.7965 |
+| 15b || 145.52 | 122.01 | -16% || 1.11 | 1.11 | -0% | 0.2389 |
+| 15c || 164.82 | 144.36 | -12% || 1.11 | 1.11 | +0% | 0.2258 |
+| 15d || 164.56 | 167.13 | +2% || 1.11 | 1.11 | +0% | 0.8916 |
+| 16a || 1684.78 | 1763.86 | +5% || 1.11 | 1.11 | -0% | 0.1234 |
+| 16b || 3266.72 | 3255.80 | -0% || 1.11 | 1.11 | +0% | 0.8313 |
+| 16c || 1983.91 | 1951.45 | -2% || 1.11 | 1.11 | +0% | 0.5185 |
+| 16d || 1949.47 | 1944.00 | -0% || 1.11 | 1.11 | +0% | 0.9181 |
+| 17a || 953.27 | 1011.47 | +6% || 1.11 | 1.11 | +0% | 0.2042 |
+| 17b || 684.86 | 685.21 | +0% || 1.11 | 1.11 | +0% | 0.9921 |
+| 17c || 625.41 | 669.96 | +7% || 1.11 | 1.11 | +0% | 0.2107 |
+| 17d || 646.70 | 668.28 | +3% || 1.11 | 1.11 | +0% | 0.5763 |
+| 17e || 1783.03 | 1769.32 | -1% || 1.11 | 1.11 | +0% | 0.7609 |
+| 17f || 1257.23 | 1274.67 | +1% || 1.11 | 1.11 | +0% | 0.7249 |
+| 18a || 293.26 | 303.58 | +4% || 1.11 | 1.11 | +0% | 0.7054 |
+| 18b || 436.43 | 466.02 | +7% || 1.11 | 1.11 | -0% | 0.3985 |
+| 18c || 710.38 | 729.35 | +3% || 1.11 | 1.11 | +0% | 0.6805 |
+| 19a || 681.01 | 613.34 | -10% || 1.11 | 1.11 | +0% | 0.1137 |
+| 19b || 444.11 | 454.10 | +2% || 1.11 | 1.11 | +0% | 0.7700 |
+| 19c || 745.29 | 737.48 | -1% || 1.11 | 1.11 | +0% | 0.8554 |
+| 19d || 1509.10 | 1598.59 | +6% || 1.11 | 1.11 | +0% | 0.0908 |
+| 1a || 50.64 | 44.10 | -13% || 1.11 | 1.11 | +0% | 0.4922 |
+| 1b || 64.77 | 64.27 | -1% || 1.11 | 1.11 | +0% | 0.9747 |
+| 1c || 62.02 | 57.92 | -7% || 1.11 | 1.11 | -0% | 0.6864 |
+| 1d || 38.69 | 36.40 | -6% || 1.11 | 1.11 | +0% | 0.7382 |
+| 20a || 518.67 | 481.80 | -7% || 1.11 | 1.11 | +0% | 0.2817 |
+| 20b || 441.38 | 448.59 | +2% || 1.11 | 1.11 | +0% | 0.8164 |
+| 20c || 367.68 | 420.13 | +14% || 1.11 | 1.11 | +0% | 0.0512 |
+| 21a || 216.48 | 201.73 | -7% || 1.11 | 1.11 | +0% | 0.5556 |
+| 21b || 168.16 | 155.39 | -8% || 1.11 | 1.11 | +0% | 0.5547 |
+| 21c || 202.61 | 219.98 | +9% || 1.11 | 1.11 | +0% | 0.4612 |
+| 22a || 555.46 | 611.09 | +10% || 1.11 | 1.11 | -0% | 0.1974 |
+| 22b || 465.32 | 443.93 | -5% || 1.11 | 1.11 | +0% | 0.5510 |
+| 22c || 776.01 | 754.78 | -3% || 1.11 | 1.11 | +0% | 0.5975 |
+| 22d || 1041.02 | 1036.29 | -0% || 1.11 | 1.11 | +0% | 0.9202 |
+| 23a || 172.08 | 204.63 | +19% || 1.11 | 1.11 | +0% | 0.1842 |
+| 23b || 137.51 | 133.07 | -3% || 1.11 | 1.11 | +0% | 0.7905 |
+| 23c || 205.36 | 185.98 | -9% || 1.11 | 1.11 | +0% | 0.3845 |
+| 24a || 471.10 | 455.78 | -3% || 1.11 | 1.11 | +0% | 0.6750 |
+| 24b || 345.02 | 367.03 | +6% || 1.11 | 1.11 | -0% | 0.5098 |
+| 25a || 523.68 | 464.37 | -11% || 1.11 | 1.11 | -0% | 0.0934 |
+| 25b || 246.00 | 253.27 | +3% || 1.11 | 1.11 | -0% | 0.7945 |
+| 25c || 994.34 | 962.19 | -3% || 1.11 | 1.11 | +0% | 0.4905 |
+| 26a || 434.88 | 400.43 | -8% || 1.11 | 1.11 | +0% | 0.1650 |
+| 26b || 305.18 | 288.72 | -5% || 1.11 | 1.11 | -0% | 0.5269 |
+| 26c || 618.77 | 633.89 | +2% || 1.11 | 1.11 | +0% | 0.6268 |
+| 27a || 191.92 | 218.64 | +14% || 1.11 | 1.11 | -0% | 0.2451 |
+| 27b || 214.33 | 185.64 | -13% || 1.11 | 1.11 | +0% | 0.2151 |
+| 27c || 234.48 | 223.15 | -5% || 1.11 | 1.11 | +0% | 0.6778 |
+| 28a || 727.85 | 738.26 | +1% || 1.11 | 1.11 | +0% | 0.7883 |
+| 28b || 279.13 | 300.82 | +8% || 1.11 | 1.11 | +0% | 0.4053 |
+| 28c || 757.53 | 704.76 | -7% || 1.11 | 1.11 | +0% | 0.2165 |
+| 29a || 309.10 | 319.78 | +3% || 1.11 | 1.11 | +0% | 0.7093 |
+| 29b || 437.48 | 394.95 | -10% || 1.11 | 1.11 | +0% | 0.2165 |
+| 29c || 436.52 | 427.97 | -2% || 1.11 | 1.11 | +0% | 0.8020 |
+| 2a || 156.69 | 153.99 | -2% || 1.11 | 1.11 | +0% | 0.8760 |
+| 2b || 143.49 | 143.65 | +0% || 1.11 | 1.11 | +0% | 0.9923 |
+| 2c || 101.77 | 111.72 | +10% || 1.11 | 1.11 | +0% | 0.4277 |
+| 2d || 257.71 | 263.62 | +2% || 1.11 | 1.11 | +0% | 0.7980 |
+| 30a || 372.12 | 449.61 | +21% || 1.11 | 1.11 | -0% | 0.0219 |
+| 30b || 392.54 | 402.31 | +2% || 1.11 | 1.11 | +0% | 0.7615 |
+| 30c || 744.33 | 731.29 | -2% || 1.11 | 1.11 | +0% | 0.7545 |
+| 31a || 302.69 | 338.54 | +12% || 1.11 | 1.11 | +0% | 0.2193 |
+| 31b || 317.33 | 269.03 | -15% || 1.11 | 1.11 | +0% | 0.1157 |
+| 31c || 424.85 | 361.86 | -15% || 1.11 | 1.11 | +0% | 0.0647 |
+| 32a || 53.46 | 60.73 | +14% || 1.11 | 1.11 | +0% | 0.4404 |
+| 32b || 169.80 | 216.60 | +28% || 1.11 | 1.11 | +0% | 0.0195 |
+| 33a || 143.95 | 175.26 | +22% || 1.11 | 1.11 | +0% | 0.1506 |
+| 33b || 123.62 | 100.66 | -19% || 1.11 | 1.11 | +0% | 0.1980 |
+| 33c || 180.39 | 193.91 | +7% || 1.11 | 1.11 | +0% | 0.5601 |
+| 3a || 315.91 | 325.91 | +3% || 1.11 | 1.11 | +0% | 0.7307 |
+| 3b || 97.43 | 71.51 | -27% || 1.11 | 1.11 | +0% | 0.0781 |
+| 3c || 476.10 | 551.15 | +16% || 1.11 | 1.11 | +0% | 0.0568 |
+| 4a || 322.26 | 336.70 | +4% || 1.11 | 1.11 | -0% | 0.6435 |
+| 4b || 67.82 | 71.51 | +5% || 1.11 | 1.11 | +0% | 0.7891 |
+| 4c || 381.98 | 366.04 | -4% || 1.11 | 1.11 | +0% | 0.5947 |
+| 5a || 274.01 | 266.02 | -3% || 1.11 | 1.11 | +0% | 0.7962 |
+| 5b || 157.42 | 179.08 | +14% || 1.11 | 1.11 | +0% | 0.3341 |
+| 5c || 367.47 | 388.51 | +6% || 1.11 | 1.11 | -0% | 0.5632 |
+| 6a || 154.70 | 184.21 | +19% || 1.11 | 1.11 | +0% | 0.1401 |
+| 6b || 212.13 | 206.01 | -3% || 1.11 | 1.11 | +0% | 0.7611 |
+| 6c || 140.54 | 144.18 | +3% || 1.11 | 1.11 | +0% | 0.8450 |
+| 6d || 564.04 | 571.93 | +1% || 1.11 | 1.11 | +0% | 0.8108 |
+| 6e || 181.36 | 150.05 | -17% || 1.11 | 1.11 | +0% | 0.1371 |
+| 6f || 1216.50 | 1294.34 | +6% || 1.11 | 1.11 | +0% | 0.0511 |
+| 7a || 186.16 | 188.80 | +1% || 1.11 | 1.11 | +0% | 0.9076 |
+| 7b || 185.07 | 199.07 | +8% || 1.11 | 1.11 | +0% | 0.5682 |
+| 7c || 1170.12 | 1233.87 | +5% || 1.11 | 1.11 | +0% | 0.1988 |
+| 8a || 251.09 | 235.07 | -6% || 1.11 | 1.11 | +0% | 0.5476 |
+| 8b || 224.19 | 206.17 | -8% || 1.11 | 1.11 | +0% | 0.4923 |
+| 8c || 2476.17 | 2455.45 | -1% || 1.11 | 1.11 | +0% | 0.6860 |
+| 8d || 697.47 | 710.68 | +2% || 1.11 | 1.11 | -0% | 0.6896 |
+| 9a || 752.15 | 724.70 | -4% || 1.11 | 1.11 | +0% | 0.5162 |
+| 9b || 506.30 | 450.76 | -11% || 1.11 | 1.11 | +0% | 0.0744 |
+| 9c || 823.24 | 762.39 | -7% || 1.11 | 1.11 | +0% | 0.1923 |
+| 9d || 1252.15 | 1274.79 | +2% || 1.11 | 1.11 | +0% | 0.6554 |
++---------++----------+----------+--------++----------+----------+--------+---------+
+| Sum || 56704.42 | 56826.05 | +0% || | | | |
+| Geomean || | | || | | +0% | |
++---------++----------+----------+--------++----------+----------+--------+---------+
hyriseBenchmarkStarSchema - single-threaded
Sum of avg. item runtimes: +0% || Geometric mean of throughput changes: -1%
Configuration Overview - click to expand
+Configuration Overview---+------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkStarSchema_f7417f58c4618845c7b8a8d4559788ad3c7a04e6_st.json | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkStarSchema_044e600db1dab827693023c0766273b0a40d4606_st.json |
+-------------------------+------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | f7417f58c4618845c7b8a8d4559788ad3c7a04e6-dirty | 044e600db1dab827693023c0766273b0a40d4606-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2024-03-01 02:33:47 | 2024-03-01 06:38:15 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 100 | 100 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------+------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------+
++---------++----------+----------+--------++----------+----------+--------+---------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++---------++----------+----------+--------++----------+----------+--------+---------+
+| 1.1 || 474.18 | 480.71 | +1%˄ || 2.11 | 2.08 | -1%˄ | 0.0595 |
+| 1.2 || 244.49 | 258.55 | +6%˄ || 4.09 | 3.87 | -5%˄ | 0.0000 |
+| 1.3 || 234.16 | 244.12 | +4%˄ || 4.27 | 4.10 | -4%˄ | 0.0000 |
+| 2.1 || 823.41 | 829.77 | +1% || 1.21 | 1.21 | -1% | 0.0005 |
+| 2.2 || 438.64 | 437.39 | -0%˄ || 2.28 | 2.29 | +0%˄ | 0.0039 |
+| 2.3 || 258.70 | 257.24 | -1%˄ || 3.87 | 3.89 | +1%˄ | 0.4630 |
+| 3.1 || 3229.06 | 3252.48 | +1% || 0.31 | 0.31 | -1% | 0.5632 |
+| 3.2 || 418.55 | 420.50 | +0%˄ || 2.39 | 2.38 | -0%˄ | 0.0146 |
+| 3.3 || 164.90 | 167.53 | +2%˄ || 6.06 | 5.97 | -2%˄ | 0.0507 |
+| 3.4 || 152.63 | 154.50 | +1%˄ || 6.55 | 6.47 | -1%˄ | 0.0000 |
+| 4.1 || 3518.27 | 3445.52 | -2% || 0.28 | 0.29 | +2% | 0.3203 |
+| 4.2 || 1041.86 | 1079.97 | +4% || 0.96 | 0.93 | -4% | 0.0001 |
+| 4.3 || 315.92 | 317.38 | +0%˄ || 3.17 | 3.15 | -0%˄ | 0.0359 |
++---------++----------+----------+--------++----------+----------+--------+---------+
+| Sum || 11314.77 | 11345.68 | +0% || | | | |
+| Geomean || | | || | | -1% | |
++---------++----------+----------+--------++----------+----------+--------+---------+
+| Notes || ˄ Execution stopped due to max runs reached |
++---------++----------+----------+--------++----------+----------+--------+---------+
hyriseBenchmarkStarSchema - multi-threaded, shuffled, 64 clients, 64 cores
Sum of avg. item runtimes: -1% || Geometric mean of throughput changes: +1%
Configuration Overview - click to expand
+Configuration Overview---------+------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkStarSchema_f7417f58c4618845c7b8a8d4559788ad3c7a04e6_mt.json | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkStarSchema_044e600db1dab827693023c0766273b0a40d4606_mt.json |
+-------------------------------+------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | f7417f58c4618845c7b8a8d4559788ad3c7a04e6-dirty | 044e600db1dab827693023c0766273b0a40d4606-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 64 | 64 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2024-03-01 02:43:06 | 2024-03-01 06:47:38 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------+
++---------++----------+----------+--------++----------+----------+--------+---------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++---------++----------+----------+--------++----------+----------+--------+---------+
+| 1.1 || 882.59 | 910.87 | +3% || 3.56 | 3.60 | +1% | 0.3058 |
+| 1.2 || 520.34 | 503.70 | -3% || 3.56 | 3.60 | +1% | 0.4050 |
+| 1.3 || 473.24 | 484.97 | +2% || 3.57 | 3.60 | +1% | 0.5495 |
+| 2.1 || 2266.58 | 2240.60 | -1% || 3.56 | 3.59 | +1% | 0.5532 |
+| 2.2 || 1245.28 | 1263.43 | +1% || 3.56 | 3.60 | +1% | 0.6007 |
+| 2.3 || 417.72 | 403.05 | -4% || 3.56 | 3.60 | +1% | 0.3557 |
+| 3.1 || 3248.50 | 3214.77 | -1% || 3.56 | 3.59 | +1% | 0.4199 |
+| 3.2 || 1133.73 | 1141.52 | +1% || 3.56 | 3.60 | +1% | 0.7997 |
+| 3.3 || 567.94 | 570.51 | +0% || 3.56 | 3.60 | +1% | 0.9080 |
+| 3.4 || 571.71 | 553.25 | -3% || 3.56 | 3.60 | +1% | 0.4211 |
+| 4.1 || 3093.53 | 3011.10 | -3% || 3.56 | 3.60 | +1% | 0.0491 |
+| 4.2 || 2618.30 | 2551.97 | -3% || 3.56 | 3.59 | +1% | 0.1388 |
+| 4.3 || 814.90 | 832.13 | +2% || 3.57 | 3.60 | +1% | 0.4995 |
++---------++----------+----------+--------++----------+----------+--------+---------+
+| Sum || 17854.37 | 17681.86 | -1% || | | | |
+| Geomean || | | || | | +1% | |
++---------++----------+----------+--------++----------+----------+--------+---------+
Intel
System
cx01 - click to expand
| property | value |
|---|---|
| Hostname | cx01 |
| CPU | Intel(R) Xeon(R) Gold 5220S CPU @ 2.70GHz |
| Memory | 176GB |
| numactl | nodebind: 0 1 |
| numactl | membind: 0 1 2 3 |
Commit Info and Build Time
| commit | date | message | build time |
|---|---|---|---|
| f7417f58c | 28.02.2024 10:37 | Update CI image and supported compilers (#2611) | real 377.50 user 4216.62 sys 156.44 |
| 044e600db | 29.02.2024 13:27 | Fix | real 386.15 user 4227.83 sys 156.73 |
hyriseBenchmarkTPCH - single-threaded, SF 10.0
Sum of avg. item runtimes: -3% || Geometric mean of throughput changes: +2%
Configuration Overview - click to expand
+Configuration Overview----+--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkTPCH_f7417f58c4618845c7b8a8d4559788ad3c7a04e6_st.json | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkTPCH_044e600db1dab827693023c0766273b0a40d4606_st.json |
+--------------------------+--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+
| GIT-HASH | f7417f58c4618845c7b8a8d4559788ad3c7a04e6-dirty | 044e600db1dab827693023c0766273b0a40d4606-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| clustering | None | None |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2024-02-29 23:34:18 | 2024-03-01 03:20:05 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 100 | 100 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| use_prepared_statements | False | False |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+--------------------------+--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+
++----------++----------+----------+--------++----------+----------+--------+---------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++----------++----------+----------+--------++----------+----------+--------+---------+
+| TPC-H 01 || 5879.13 | 5666.51 | -4% || 0.17 | 0.18 | +4% | 0.0064 |
+| TPC-H 02 || 42.47 | 42.64 | +0%˄ || 23.54 | 23.45 | -0%˄ | 0.7292 |
+| TPC-H 03 || 1250.83 | 1194.66 | -4% || 0.80 | 0.84 | +5% | 0.0000 |
+| TPC-H 04 || 1368.09 | 1269.10 | -7% || 0.73 | 0.79 | +8% | 0.0000 |
+| TPC-H 05 || 2029.74 | 1965.61 | -3% || 0.49 | 0.51 | +3% | 0.0000 |
+| TPC-H 06 || 145.70 | 147.94 | +2%˄ || 6.86 | 6.76 | -2%˄ | 0.0120 |
+| TPC-H 07 || 751.51 | 744.08 | -1% || 1.33 | 1.34 | +1% | 0.0027 |
+| TPC-H 08 || 465.65 | 472.75 | +2%˄ || 2.15 | 2.12 | -2%˄ | 0.0000 |
+| TPC-H 09 || 4782.99 | 4726.16 | -1% || 0.21 | 0.21 | +1% | 0.0006 |
+| TPC-H 10 || 1583.17 | 1179.03 | -26% || 0.63 | 0.85 | +34% | 0.0000 |
+| TPC-H 11 || 57.45 | 55.52 | -3%˄ || 17.40 | 18.01 | +3%˄ | 0.0000 |
+| TPC-H 12 || 867.12 | 859.37 | -1% || 1.15 | 1.16 | +1% | 0.0000 |
+| TPC-H 13 || 4628.60 | 4609.00 | -0% || 0.22 | 0.22 | +0% | 0.5886 |
+| TPC-H 14 || 393.57 | 389.40 | -1%˄ || 2.54 | 2.57 | +1%˄ | 0.0028 |
+| TPC-H 15 || 180.83 | 170.22 | -6%˄ || 5.53 | 5.87 | +6%˄ | 0.0000 |
+| TPC-H 16 || 546.17 | 542.90 | -1%˄ || 1.83 | 1.84 | +1%˄ | 0.0000 |
+| TPC-H 17 || 201.08 | 198.64 | -1%˄ || 4.97 | 5.03 | +1%˄ | 0.0000 |
+| TPC-H 18 || 1539.98 | 1537.94 | -0% || 0.65 | 0.65 | +0% | 0.9283 |
+| TPC-H 19 || 189.84 | 194.68 | +3%˄ || 5.27 | 5.14 | -2%˄ | 0.0002 |
+| TPC-H 20 || 448.86 | 474.62 | +6%˄ || 2.23 | 2.11 | -5%˄ | 0.1201 |
+| TPC-H 21 || 3524.01 | 3533.68 | +0% || 0.28 | 0.28 | -0% | 0.7492 |
+| TPC-H 22 || 409.43 | 408.75 | -0%˄ || 2.44 | 2.45 | +0%˄ | 0.2514 |
++----------++----------+----------+--------++----------+----------+--------+---------+
+| Sum || 31286.22 | 30383.19 | -3% || | | | |
+| Geomean || | | || | | +2% | |
++----------++----------+----------+--------++----------+----------+--------+---------+
+| Notes || ˄ Execution stopped due to max runs reached |
++----------++----------+----------+--------++----------+----------+--------+---------+
hyriseBenchmarkTPCH - single-threaded, SF 0.01
Sum of avg. item runtimes: -3% || Geometric mean of throughput changes: +1%
Configuration Overview - click to expand
+Configuration Overview----+------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkTPCH_f7417f58c4618845c7b8a8d4559788ad3c7a04e6_st_s01.json | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkTPCH_044e600db1dab827693023c0766273b0a40d4606_st_s01.json |
+--------------------------+------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | f7417f58c4618845c7b8a8d4559788ad3c7a04e6-dirty | 044e600db1dab827693023c0766273b0a40d4606-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| clustering | None | None |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2024-02-29 23:52:52 | 2024-03-01 03:38:42 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 100 | 100 |
| scale_factor | 0.009999999776482582 | 0.009999999776482582 |
| time_unit | ns | ns |
| use_prepared_statements | False | False |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+--------------------------+------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------+
++----------++----------+---------+--------++----------+----------+--------+---------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++----------++----------+---------+--------++----------+----------+--------+---------+
+| TPC-H 01 || 5.07 | 5.01 | -1%˄ || 197.32 | 199.72 | +1%˄ | 0.0000 |
+| TPC-H 02 || 4.04 | 4.05 | +0%˄ || 247.19 | 246.70 | -0%˄ | 0.9726 |
+| TPC-H 03 || 0.54 | 0.55 | +2%˄ || 1832.25 | 1797.67 | -2%˄ | 0.0011 |
+| TPC-H 04 || 0.39 | 0.39 | +1%˄ || 2559.21 | 2536.29 | -1%˄ | 0.0091 |
+| TPC-H 05 || 0.96 | 0.96 | -0%˄ || 1038.37 | 1041.58 | +0%˄ | 0.8632 |
+| TPC-H 06 || 0.17 | 0.18 | +2%˄ || 5722.27 | 5583.81 | -2%˄ | 0.0000 |
+| TPC-H 07 || 11.84 | 10.24 | -13%˄ || 84.48 | 97.60 | +16%˄ | 0.0108 |
+| TPC-H 08 || 15.00 | 15.01 | +0%˄ || 66.65 | 66.60 | -0%˄ | 0.9764 |
+| TPC-H 09 || 3.25 | 3.26 | +0%˄ || 307.56 | 306.22 | -0%˄ | 0.9767 |
+| TPC-H 10 || 0.73 | 0.62 | -15%˄ || 1372.90 | 1606.55 | +17%˄ | 0.0000 |
+| TPC-H 11 || 0.19 | 0.20 | +2%˄ || 5118.58 | 5016.88 | -2%˄ | 0.0121 |
+| TPC-H 12 || 0.57 | 0.58 | +2%˄ || 1745.01 | 1708.51 | -2%˄ | 0.0000 |
+| TPC-H 13 || 1.96 | 1.93 | -1%˄ || 510.64 | 518.30 | +2%˄ | 0.0000 |
+| TPC-H 14 || 0.32 | 0.32 | +2%˄ || 3153.90 | 3090.14 | -2%˄ | 0.0176 |
+| TPC-H 15 || 1.30 | 1.32 | +1%˄ || 764.69 | 757.91 | -1%˄ | 0.0001 |
+| TPC-H 16 || 2.26 | 2.26 | +0%˄ || 443.07 | 442.01 | -0%˄ | 0.2304 |
+| TPC-H 17 || 0.64 | 0.67 | +6%˄ || 1562.39 | 1480.17 | -5%˄ | 0.6640 |
+| TPC-H 18 || 1.14 | 1.07 | -6%˄ || 873.81 | 933.38 | +7%˄ | 0.0000 |
+| TPC-H 19 || 5.82 | 5.80 | -0%˄ || 171.84 | 172.25 | +0%˄ | 0.0007 |
+| TPC-H 20 || 2.67 | 2.60 | -2%˄ || 374.78 | 384.10 | +2%˄ | 0.3627 |
+| TPC-H 21 || 1.00 | 0.99 | -2%˄ || 994.31 | 1009.82 | +2%˄ | 0.6705 |
+| TPC-H 22 || 1.20 | 1.19 | -1%˄ || 834.28 | 839.47 | +1%˄ | 0.0005 |
++----------++----------+---------+--------++----------+----------+--------+---------+
+| Sum || 61.06 | 59.22 | -3% || | | | |
+| Geomean || | | || | | +1% | |
++----------++----------+---------+--------++----------+----------+--------+---------+
+| Notes || ˄ Execution stopped due to max runs reached |
++----------++----------+---------+--------++----------+----------+--------+---------+
hyriseBenchmarkTPCH - multi-threaded, ordered, 1 client, 9 cores, SF 10.0
Sum of avg. item runtimes: -6% || Geometric mean of throughput changes: +4%
Configuration Overview - click to expand
+Configuration Overview---------+----------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkTPCH_f7417f58c4618845c7b8a8d4559788ad3c7a04e6_mt_ordered.json | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkTPCH_044e600db1dab827693023c0766273b0a40d4606_mt_ordered.json |
+-------------------------------+----------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | f7417f58c4618845c7b8a8d4559788ad3c7a04e6-dirty | 044e600db1dab827693023c0766273b0a40d4606-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| clustering | None | None |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 9 | 9 |
| data_preparation_cores | 0 | 0 |
| date | 2024-02-29 23:53:20 | 2024-03-01 03:39:10 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| use_prepared_statements | False | False |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [9] | [9] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+----------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------+
++----------++----------+----------+--------++----------+----------+--------+----------------------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++----------++----------+----------+--------++----------+----------+--------+----------------------+
+| TPC-H 01 || 4508.33 | 4465.80 | -1% || 0.22 | 0.22 | +0% | (run time too short) |
+| TPC-H 02 || 25.74 | 25.54 | -1% || 31.51 | 31.97 | +1% | 0.3156 |
+| TPC-H 03 || 419.21 | 406.48 | -3% || 2.35 | 2.42 | +3% | 0.0000 |
+| TPC-H 04 || 386.58 | 387.07 | +0% || 2.55 | 2.55 | -0% | 0.8857 |
+| TPC-H 05 || 369.21 | 365.36 | -1% || 2.67 | 2.68 | +1% | 0.0096 |
+| TPC-H 06 || 41.42 | 41.48 | +0% || 20.93 | 21.03 | +0% | 0.4135 |
+| TPC-H 07 || 208.22 | 206.72 | -1% || 4.68 | 4.72 | +1% | 0.1229 |
+| TPC-H 08 || 156.39 | 156.60 | +0% || 6.20 | 6.20 | -0% | 0.6389 |
+| TPC-H 09 || 1398.29 | 1382.16 | -1% || 0.70 | 0.72 | +2% | (run time too short) |
+| TPC-H 10 || 787.34 | 393.27 | -50% || 1.25 | 2.50 | +100% | (run time too short) |
+| TPC-H 11 || 37.94 | 39.88 | +5% || 24.17 | 22.70 | -6% | 0.0000 |
+| TPC-H 12 || 336.05 | 334.41 | -0% || 2.92 | 2.93 | +1% | 0.0165 |
+| TPC-H 13 || 2448.59 | 2389.27 | -2% || 0.40 | 0.42 | +4% | (run time too short) |
+| TPC-H 14 || 85.58 | 85.65 | +0% || 11.02 | 11.01 | -0% | 0.5407 |
+| TPC-H 15 || 116.43 | 109.41 | -6% || 8.20 | 8.78 | +7% | 0.0000 |
+| TPC-H 16 || 410.80 | 407.54 | -1% || 2.40 | 2.42 | +1% | 0.0305 |
+| TPC-H 17 || 57.05 | 57.63 | +1% || 16.33 | 16.13 | -1% | 0.0000 |
+| TPC-H 18 || 1974.01 | 1660.16 | -16% || 0.50 | 0.60 | +20% | 0.0000 |
+| TPC-H 19 || 68.15 | 68.61 | +1% || 13.91 | 13.83 | -1% | 0.0050 |
+| TPC-H 20 || 150.91 | 160.21 | +6% || 6.38 | 6.03 | -5% | 0.0000 |
+| TPC-H 21 || 681.34 | 683.57 | +0% || 1.45 | 1.45 | +0% | 0.4787 |
+| TPC-H 22 || 117.03 | 116.98 | -0% || 8.22 | 8.20 | -0% | 0.8446 |
++----------++----------+----------+--------++----------+----------+--------+----------------------+
+| Sum || 14784.62 | 13943.81 | -6% || | | | |
+| Geomean || | | || | | +4% | |
++----------++----------+----------+--------++----------+----------+--------+----------------------+
hyriseBenchmarkTPCH - multi-threaded, shuffled, 9 clients, 9 cores, SF 10.0
Sum of avg. item runtimes: -5% || Geometric mean of throughput changes: +5%
Configuration Overview - click to expand
+Configuration Overview---------+--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkTPCH_f7417f58c4618845c7b8a8d4559788ad3c7a04e6_mt.json | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkTPCH_044e600db1dab827693023c0766273b0a40d4606_mt.json |
+-------------------------------+--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+
| GIT-HASH | f7417f58c4618845c7b8a8d4559788ad3c7a04e6-dirty | 044e600db1dab827693023c0766273b0a40d4606-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 9 | 9 |
| clustering | None | None |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 9 | 9 |
| data_preparation_cores | 0 | 0 |
| date | 2024-03-01 00:16:59 | 2024-03-01 04:02:54 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| use_prepared_statements | False | False |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [9] | [9] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+
++----------++----------+----------+--------++----------+----------+--------+---------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++----------++----------+----------+--------++----------+----------+--------+---------+
+| TPC-H 01 || 6042.07 | 5989.97 | -1% || 0.21 | 0.22 | +5% | 0.7469 |
+| TPC-H 02 || 345.05 | 165.01 | -52% || 0.21 | 0.22 | +6% | 0.1025 |
+| TPC-H 03 || 1737.42 | 1889.43 | +9% || 0.21 | 0.22 | +5% | 0.4215 |
+| TPC-H 04 || 1866.25 | 1602.02 | -14% || 0.21 | 0.22 | +5% | 0.1599 |
+| TPC-H 05 || 2949.31 | 2510.90 | -15% || 0.21 | 0.22 | +5% | 0.0621 |
+| TPC-H 06 || 464.64 | 697.72 | +50% || 0.21 | 0.22 | +5% | 0.0529 |
+| TPC-H 07 || 2188.62 | 1984.03 | -9% || 0.21 | 0.22 | +5% | 0.3937 |
+| TPC-H 08 || 1420.86 | 1611.30 | +13% || 0.21 | 0.22 | +5% | 0.3571 |
+| TPC-H 09 || 4271.22 | 3869.66 | -9% || 0.21 | 0.22 | +5% | 0.0997 |
+| TPC-H 10 || 2874.37 | 2179.96 | -24% || 0.21 | 0.22 | +5% | 0.0027 |
+| TPC-H 11 || 246.00 | 315.95 | +28% || 0.21 | 0.22 | +5% | 0.3267 |
+| TPC-H 12 || 1792.71 | 1997.11 | +11% || 0.21 | 0.22 | +5% | 0.3759 |
+| TPC-H 13 || 4397.96 | 4286.30 | -3% || 0.20 | 0.22 | +6% | 0.5147 |
+| TPC-H 14 || 654.11 | 706.07 | +8% || 0.21 | 0.22 | +5% | 0.5908 |
+| TPC-H 15 || 383.59 | 458.23 | +19% || 0.21 | 0.22 | +5% | 0.3419 |
+| TPC-H 16 || 1390.70 | 1307.46 | -6% || 0.21 | 0.22 | +5% | 0.6020 |
+| TPC-H 17 || 531.35 | 591.86 | +11% || 0.21 | 0.22 | +5% | 0.5959 |
+| TPC-H 18 || 2696.36 | 2702.40 | +0% || 0.21 | 0.22 | +5% | 0.9631 |
+| TPC-H 19 || 742.11 | 709.50 | -4% || 0.21 | 0.22 | +5% | 0.8129 |
+| TPC-H 20 || 1360.10 | 1288.56 | -5% || 0.21 | 0.22 | +5% | 0.6852 |
+| TPC-H 21 || 4261.23 | 3730.95 | -12% || 0.21 | 0.22 | +5% | 0.0559 |
+| TPC-H 22 || 828.76 | 703.05 | -15% || 0.21 | 0.22 | +6% | 0.3452 |
++----------++----------+----------+--------++----------+----------+--------+---------+
+| Sum || 43444.79 | 41297.44 | -5% || | | | |
+| Geomean || | | || | | +5% | |
++----------++----------+----------+--------++----------+----------+--------+---------+
hyriseBenchmarkTPCDS - single-threaded
Sum of avg. item runtimes: +2% || Geometric mean of throughput changes: +2%
Configuration Overview - click to expand
+Configuration Overview---+---------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkTPCDS_f7417f58c4618845c7b8a8d4559788ad3c7a04e6_st.json | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkTPCDS_044e600db1dab827693023c0766273b0a40d4606_st.json |
+-------------------------+---------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------+
| GIT-HASH | f7417f58c4618845c7b8a8d4559788ad3c7a04e6-dirty | 044e600db1dab827693023c0766273b0a40d4606-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2024-03-01 00:38:41 | 2024-03-01 04:24:30 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 100 | 100 |
| time_unit | ns | ns |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------+---------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------+
++---------++----------+----------+--------++----------+----------+--------+---------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++---------++----------+----------+--------++----------+----------+--------+---------+
+| 01 || 228.66 | 226.07 | -1%˄ || 4.37 | 4.42 | +1%˄ | 0.0000 |
+| 03 || 66.59 | 64.30 | -3%˄ || 15.02 | 15.55 | +4%˄ | 0.0000 |
+| 06 || 182.05 | 176.86 | -3%˄ || 5.49 | 5.65 | +3%˄ | 0.0000 |
+| 07 || 283.13 | 274.60 | -3%˄ || 3.53 | 3.64 | +3%˄ | 0.0000 |
+| 09 || 617.66 | 605.70 | -2%˄ || 1.62 | 1.65 | +2%˄ | 0.0000 |
+| 10 || 127.65 | 124.86 | -2%˄ || 7.83 | 8.01 | +2%˄ | 0.0000 |
+| 13 || 489.19 | 469.41 | -4%˄ || 2.04 | 2.13 | +4%˄ | 0.0000 |
+| 15 || 110.94 | 105.71 | -5%˄ || 9.01 | 9.46 | +5%˄ | 0.0000 |
+| 16 || 65.13 | 61.77 | -5%˄ || 15.35 | 16.19 | +5%˄ | 0.0000 |
+| 17 || 309.02 | 298.06 | -4%˄ || 3.24 | 3.36 | +4%˄ | 0.0000 |
+| 19 || 103.17 | 100.32 | -3%˄ || 9.69 | 9.97 | +3%˄ | 0.0000 |
+| 25 || 167.37 | 164.85 | -2%˄ || 5.97 | 6.07 | +2%˄ | 0.0000 |
+| 26 || 132.82 | 129.52 | -2%˄ || 7.53 | 7.72 | +3%˄ | 0.0000 |
+| 28 || 602.52 | 580.24 | -4%˄ || 1.66 | 1.72 | +4%˄ | 0.0000 |
+| 29 || 460.62 | 441.89 | -4%˄ || 2.17 | 2.26 | +4%˄ | 0.0000 |
+| 31 || 1274.38 | 1211.88 | -5% || 0.78 | 0.83 | +5% | 0.0000 |
+| 32 || 35.28 | 33.03 | -6%˄ || 28.34 | 30.27 | +7%˄ | 0.0000 |
+| 34 || 153.30 | 145.33 | -5%˄ || 6.52 | 6.88 | +5%˄ | 0.0000 |
+| 35 || 620.67 | 595.43 | -4%˄ || 1.61 | 1.68 | +4%˄ | 0.0000 |
+| 37 || 462.82 | 457.08 | -1%˄ || 2.16 | 2.19 | +1%˄ | 0.3870 |
+| 39a || 1569.56 | 1475.34 | -6% || 0.64 | 0.68 | +6% | 0.0000 |
+| 39b || 1546.12 | 1457.24 | -6% || 0.65 | 0.69 | +6% | 0.0000 |
+| 41 || 288.11 | 293.52 | +2%˄ || 3.47 | 3.41 | -2%˄ | 0.0000 |
+| 42 || 81.17 | 80.27 | -1%˄ || 12.32 | 12.46 | +1%˄ | 0.0000 |
+| 43 || 869.97 | 849.32 | -2% || 1.15 | 1.18 | +2% | 0.0000 |
+| 45 || 119.66 | 112.04 | -6%˄ || 8.36 | 8.93 | +7%˄ | 0.0000 |
+| 48 || 1040.76 | 986.71 | -5% || 0.96 | 1.01 | +5% | 0.0000 |
+| 50 || 117.87 | 114.52 | -3%˄ || 8.48 | 8.73 | +3%˄ | 0.0000 |
+| 52 || 80.60 | 78.50 | -3%˄ || 12.41 | 12.74 | +3%˄ | 0.0000 |
+| 55 || 76.76 | 74.86 | -2%˄ || 13.03 | 13.36 | +3%˄ | 0.0000 |
+| 62 || 549.01 | 532.01 | -3%˄ || 1.82 | 1.88 | +3%˄ | 0.0000 |
+| 65 || 1677.96 | 1724.69 | +3% || 0.60 | 0.58 | -3% | 0.0000 |
+| 69 || 137.07 | 134.77 | -2%˄ || 7.30 | 7.42 | +2%˄ | 0.0000 |
+| 73 || 77.78 | 75.76 | -3%˄ || 12.86 | 13.20 | +3%˄ | 0.0000 |
+| 79 || 456.34 | 444.70 | -3%˄ || 2.19 | 2.25 | +3%˄ | 0.0000 |
+| 81 || 156.29 | 153.93 | -2%˄ || 6.40 | 6.50 | +2%˄ | 0.0000 |
+| 82 || 509.66 | 509.88 | +0%˄ || 1.96 | 1.96 | -0%˄ | 0.9711 |
+| 83 || 43.84 | 39.13 | -11%˄ || 22.81 | 25.55 | +12%˄ | 0.0000 |
+| 85 || 148.26 | 148.14 | -0%˄ || 6.74 | 6.75 | +0%˄ | 0.8800 |
+| 88 || 617.69 | 607.17 | -2% || 1.62 | 1.65 | +2% | 0.0000 |
+| 91 || 15.69 | 15.24 | -3%˄ || 63.71 | 65.59 | +3%˄ | 0.0000 |
+| 92 || 35.73 | 34.82 | -3%˄ || 27.99 | 28.71 | +3%˄ | 0.0000 |
+| 93 || 3728.13 | 3522.71 | -6% || 0.27 | 0.28 | +6% | 0.0000 |
+| 94 || 40.20 | 39.28 | -2%˄ || 24.88 | 25.45 | +2%˄ | 0.0003 |
+| 95 || 4589.84 | 4426.48 | -4% || 0.22 | 0.23 | +4% | 0.0151 |
+| 96 || 59.09 | 57.60 | -3%˄ || 16.92 | 17.36 | +3%˄ | 0.0013 |
+| 97 || 2658.65 | 4106.60 | +54% || 0.38 | 0.24 | -35% | 0.0000 |
+| 99 || 1021.37 | 998.70 | -2% || 0.98 | 1.00 | +2% | 0.0000 |
++---------++----------+----------+--------++----------+----------+--------+---------+
+| Sum || 28806.14 | 29360.82 | +2% || | | | |
+| Geomean || | | || | | +2% | |
++---------++----------+----------+--------++----------+----------+--------+---------+
+| Notes || ˄ Execution stopped due to max runs reached |
++---------++----------+----------+--------++----------+----------+--------+---------+
hyriseBenchmarkTPCDS - multi-threaded, shuffled, 9 clients, 9 cores
Sum of avg. item runtimes: +5% || Geometric mean of throughput changes: -5%
Configuration Overview - click to expand
+Configuration Overview---------+---------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkTPCDS_f7417f58c4618845c7b8a8d4559788ad3c7a04e6_mt.json | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkTPCDS_044e600db1dab827693023c0766273b0a40d4606_mt.json |
+-------------------------------+---------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------+
| GIT-HASH | f7417f58c4618845c7b8a8d4559788ad3c7a04e6-dirty | 044e600db1dab827693023c0766273b0a40d4606-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 9 | 9 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 9 | 9 |
| data_preparation_cores | 0 | 0 |
| date | 2024-03-01 01:05:00 | 2024-03-01 04:50:27 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [9] | [9] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+---------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------+
++---------++----------+----------+--------++----------+----------+--------+---------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++---------++----------+----------+--------++----------+----------+--------+---------+
+| 01 || 455.27 | 443.44 | -3% || 0.22 | 0.21 | -4% | 0.8190 |
+| 03 || 194.05 | 225.70 | +16% || 0.22 | 0.21 | -5% | 0.4413 |
+| 06 || 492.98 | 495.09 | +0% || 0.22 | 0.21 | -4% | 0.9689 |
+| 07 || 777.81 | 614.17 | -21% || 0.22 | 0.21 | -4% | 0.0607 |
+| 09 || 542.48 | 534.97 | -1% || 0.22 | 0.21 | -4% | 0.9042 |
+| 10 || 350.86 | 524.93 | +50% || 0.22 | 0.21 | -4% | 0.0283 |
+| 13 || 1212.44 | 1250.99 | +3% || 0.22 | 0.21 | -4% | 0.7586 |
+| 15 || 298.10 | 353.84 | +19% || 0.22 | 0.21 | -4% | 0.3349 |
+| 16 || 266.81 | 290.96 | +9% || 0.22 | 0.21 | -4% | 0.6693 |
+| 17 || 835.64 | 769.65 | -8% || 0.22 | 0.21 | -5% | 0.5489 |
+| 19 || 460.00 | 401.09 | -13% || 0.22 | 0.21 | -4% | 0.4338 |
+| 25 || 578.10 | 587.65 | +2% || 0.22 | 0.21 | -4% | 0.9089 |
+| 26 || 355.57 | 380.03 | +7% || 0.21 | 0.21 | -4% | 0.6562 |
+| 28 || 910.02 | 985.64 | +8% || 0.22 | 0.21 | -5% | 0.4673 |
+| 29 || 946.16 | 1162.26 | +23% || 0.22 | 0.21 | -5% | 0.0201 |
+| 31 || 1692.21 | 1700.51 | +0% || 0.22 | 0.21 | -5% | 0.9526 |
+| 32 || 162.84 | 124.37 | -24% || 0.22 | 0.21 | -5% | 0.2803 |
+| 34 || 489.43 | 618.33 | +26% || 0.22 | 0.21 | -5% | 0.0798 |
+| 35 || 1211.92 | 1246.77 | +3% || 0.22 | 0.21 | -5% | 0.7207 |
+| 37 || 893.98 | 728.98 | -18% || 0.22 | 0.21 | -5% | 0.0882 |
+| 39a || 1693.25 | 2010.09 | +19% || 0.22 | 0.21 | -5% | 0.0044 |
+| 39b || 1878.05 | 1754.58 | -7% || 0.22 | 0.21 | -5% | 0.3291 |
+| 41 || 1900.50 | 2064.84 | +9% || 0.21 | 0.21 | -4% | 0.3180 |
+| 42 || 274.00 | 410.88 | +50% || 0.22 | 0.21 | -4% | 0.0324 |
+| 43 || 1315.12 | 1312.62 | -0% || 0.21 | 0.21 | -4% | 0.9804 |
+| 45 || 384.88 | 471.15 | +22% || 0.21 | 0.21 | -4% | 0.2063 |
+| 48 || 1804.39 | 1756.47 | -3% || 0.22 | 0.21 | -5% | 0.7168 |
+| 50 || 516.09 | 745.39 | +44% || 0.22 | 0.21 | -5% | 0.0159 |
+| 52 || 330.04 | 308.26 | -7% || 0.22 | 0.21 | -5% | 0.6765 |
+| 55 || 247.87 | 334.62 | +35% || 0.22 | 0.21 | -4% | 0.1609 |
+| 62 || 857.22 | 1028.65 | +20% || 0.22 | 0.21 | -5% | 0.0712 |
+| 65 || 2593.23 | 2660.97 | +3% || 0.21 | 0.21 | -4% | 0.4081 |
+| 69 || 535.75 | 561.92 | +5% || 0.22 | 0.21 | -4% | 0.7436 |
+| 73 || 331.45 | 322.52 | -3% || 0.22 | 0.21 | -5% | 0.8855 |
+| 79 || 1006.40 | 1030.47 | +2% || 0.22 | 0.21 | -5% | 0.7557 |
+| 81 || 410.91 | 523.62 | +27% || 0.22 | 0.21 | -4% | 0.1396 |
+| 82 || 837.00 | 938.74 | +12% || 0.22 | 0.21 | -4% | 0.2924 |
+| 83 || 208.09 | 165.88 | -20% || 0.22 | 0.21 | -5% | 0.3165 |
+| 85 || 446.17 | 532.75 | +19% || 0.22 | 0.21 | -4% | 0.2223 |
+| 88 || 1424.96 | 1388.93 | -3% || 0.22 | 0.21 | -5% | 0.8147 |
+| 91 || 155.97 | 129.76 | -17% || 0.22 | 0.21 | -5% | 0.5967 |
+| 92 || 196.51 | 241.81 | +23% || 0.22 | 0.21 | -5% | 0.4896 |
+| 93 || 1868.97 | 1880.09 | +1% || 0.22 | 0.21 | -5% | 0.9099 |
+| 94 || 232.55 | 223.93 | -4% || 0.22 | 0.21 | -4% | 0.8735 |
+| 95 || 2256.44 | 2025.69 | -10% || 0.22 | 0.21 | -5% | 0.0231 |
+| 96 || 348.03 | 252.68 | -27% || 0.22 | 0.21 | -4% | 0.0964 |
+| 97 || 2870.12 | 3593.46 | +25% || 0.22 | 0.21 | -5% | 0.0000 |
+| 99 || 1240.03 | 1110.34 | -10% || 0.22 | 0.21 | -5% | 0.1341 |
++---------++----------+----------+--------++----------+----------+--------+---------+
+| Sum || 41290.62 | 43220.46 | +5% || | | | |
+| Geomean || | | || | | -5% | |
++---------++----------+----------+--------++----------+----------+--------+---------+
hyriseBenchmarkTPCC - single-threaded
Sum of avg. item runtimes: -2% || Geometric mean of throughput changes: +2%
Configuration Overview - click to expand
+Configuration Overview---+--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkTPCC_f7417f58c4618845c7b8a8d4559788ad3c7a04e6_st.json | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkTPCC_044e600db1dab827693023c0766273b0a40d4606_st.json |
+-------------------------+--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+
| GIT-HASH | f7417f58c4618845c7b8a8d4559788ad3c7a04e6-dirty | 044e600db1dab827693023c0766273b0a40d4606-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2024-03-01 01:25:23 | 2024-03-01 05:10:47 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10 | 10 |
| time_unit | ns | ns |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------+--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+
++--------------++----------+---------+--------++----------+----------+--------+----------------------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++--------------++----------+---------+--------++----------+----------+--------+----------------------+
+| Delivery || 57.89 | 57.49 | -1% || 1.63 | 1.67 | +2% | (run time too short) |
+| New-Order || 42.18 | 40.80 | -3% || 18.26 | 18.75 | +3% | 0.0109 |
+| Order-Status || 2.01 | 1.96 | -3% || 1.65 | 1.67 | +1% | (run time too short) |
+| Payment || 7.18 | 7.22 | +1% || 17.45 | 17.92 | +3% | 0.2482 |
+| Stock-Level || 3.46 | 3.37 | -3% || 1.62 | 1.67 | +3% | (run time too short) |
++--------------++----------+---------+--------++----------+----------+--------+----------------------+
+| Sum || 112.72 | 110.84 | -2% || | | | |
+| Geomean || | | || | | +2% | |
++--------------++----------+---------+--------++----------+----------+--------+----------------------+
hyriseBenchmarkTPCC - multi-threaded, shuffled, 9 clients, 9 cores
Sum of avg. item runtimes: +1% || Geometric mean of throughput changes: -1%
Configuration Overview - click to expand
+Configuration Overview---------+--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkTPCC_f7417f58c4618845c7b8a8d4559788ad3c7a04e6_mt.json | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkTPCC_044e600db1dab827693023c0766273b0a40d4606_mt.json |
+-------------------------------+--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+
| GIT-HASH | f7417f58c4618845c7b8a8d4559788ad3c7a04e6-dirty | 044e600db1dab827693023c0766273b0a40d4606-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 9 | 9 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 9 | 9 |
| data_preparation_cores | 0 | 0 |
| date | 2024-03-01 01:26:30 | 2024-03-01 05:11:55 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10 | 10 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [9] | [9] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+--------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------+
++--------------++----------+---------+--------++----------+----------+--------+---------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++--------------++----------+---------+--------++----------+----------+--------+---------+
+| Delivery || 99.82 | 100.22 | +0% || 8.36 | 8.24 | -1% | 0.3470 |
+| unsucc.: || 0.73 | 1.03 | +41% || 0.54 | 0.52 | -4% | |
+| New-Order || 61.84 | 63.18 | +2% || 93.81 | 92.42 | -1% | 0.0000 |
+| unsucc.: || 4.69 | 3.92 | -16% || 6.31 | 6.12 | -3% | |
+| Order-Status || 3.68 | 3.64 | -1% || 8.90 | 8.76 | -2% | 0.0005 |
+| Payment || 11.52 | 11.56 | +0% || 81.87 | 80.74 | -1% | 0.2015 |
+| unsucc.: || 1.70 | 1.70 | -0% || 13.80 | 13.43 | -3% | |
+| Stock-Level || 5.85 | 5.88 | +0% || 8.90 | 8.76 | -2% | 0.0999 |
++--------------++----------+---------+--------++----------+----------+--------+---------+
+| Sum || 182.71 | 184.48 | +1% || | | | |
+| Geomean || | | || | | -1% | |
++--------------++----------+---------+--------++----------+----------+--------+---------+
hyriseBenchmarkJoinOrder - single-threaded
Sum of avg. item runtimes: -4% || Geometric mean of throughput changes: +4%
Configuration Overview - click to expand
+Configuration Overview---+-------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkJoinOrder_f7417f58c4618845c7b8a8d4559788ad3c7a04e6_st.json | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkJoinOrder_044e600db1dab827693023c0766273b0a40d4606_st.json |
+-------------------------+-------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | f7417f58c4618845c7b8a8d4559788ad3c7a04e6-dirty | 044e600db1dab827693023c0766273b0a40d4606-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2024-03-01 01:46:37 | 2024-03-01 05:32:02 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 100 | 100 |
| time_unit | ns | ns |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------+-------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------+
++---------++----------+----------+--------++----------+----------+--------+---------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++---------++----------+----------+--------++----------+----------+--------+---------+
+| 10a || 107.37 | 104.36 | -3%˄ || 9.31 | 9.58 | +3%˄ | 0.0000 |
+| 10b || 65.46 | 61.69 | -6%˄ || 15.28 | 16.21 | +6%˄ | 0.0000 |
+| 10c || 337.57 | 322.17 | -5%˄ || 2.96 | 3.10 | +5%˄ | 0.0000 |
+| 11a || 87.58 | 85.92 | -2%˄ || 11.42 | 11.64 | +2%˄ | 0.0000 |
+| 11b || 85.76 | 84.54 | -1%˄ || 11.66 | 11.83 | +1%˄ | 0.0000 |
+| 11c || 21.16 | 20.46 | -3%˄ || 47.24 | 48.87 | +3%˄ | 0.0000 |
+| 11d || 23.15 | 22.32 | -4%˄ || 43.20 | 44.79 | +4%˄ | 0.0000 |
+| 12a || 29.86 | 28.82 | -3%˄ || 33.48 | 34.69 | +4%˄ | 0.0000 |
+| 12b || 28.99 | 28.09 | -3%˄ || 34.49 | 35.60 | +3%˄ | 0.0000 |
+| 12c || 66.66 | 63.82 | -4%˄ || 15.00 | 15.67 | +4%˄ | 0.0000 |
+| 13a || 180.89 | 173.88 | -4%˄ || 5.53 | 5.75 | +4%˄ | 0.0000 |
+| 13b || 223.89 | 217.33 | -3%˄ || 4.47 | 4.60 | +3%˄ | 0.0000 |
+| 13c || 188.34 | 181.42 | -4%˄ || 5.31 | 5.51 | +4%˄ | 0.0000 |
+| 13d || 491.15 | 474.70 | -3%˄ || 2.04 | 2.11 | +3%˄ | 0.0000 |
+| 14a || 100.80 | 97.21 | -4%˄ || 9.92 | 10.29 | +4%˄ | 0.0000 |
+| 14b || 111.09 | 107.08 | -4%˄ || 9.00 | 9.34 | +4%˄ | 0.0000 |
+| 14c || 207.35 | 200.02 | -4%˄ || 4.82 | 5.00 | +4%˄ | 0.0000 |
+| 15a || 52.85 | 51.32 | -3%˄ || 18.92 | 19.48 | +3%˄ | 0.0000 |
+| 15b || 54.15 | 52.72 | -3%˄ || 18.47 | 18.97 | +3%˄ | 0.0000 |
+| 15c || 44.05 | 42.87 | -3%˄ || 22.70 | 23.32 | +3%˄ | 0.0000 |
+| 15d || 39.86 | 38.62 | -3%˄ || 25.08 | 25.89 | +3%˄ | 0.0000 |
+| 16a || 1306.35 | 1238.94 | -5% || 0.77 | 0.81 | +5% | 0.0000 |
+| 16b || 2356.87 | 2271.05 | -4% || 0.42 | 0.44 | +4% | 0.0000 |
+| 16c || 1445.14 | 1376.54 | -5% || 0.69 | 0.73 | +5% | 0.0000 |
+| 16d || 1408.55 | 1343.32 | -5% || 0.71 | 0.74 | +5% | 0.0000 |
+| 17a || 431.35 | 408.58 | -5%˄ || 2.32 | 2.45 | +6%˄ | 0.0000 |
+| 17b || 343.63 | 323.83 | -6%˄ || 2.91 | 3.09 | +6%˄ | 0.0000 |
+| 17c || 325.08 | 306.86 | -6%˄ || 3.08 | 3.26 | +6%˄ | 0.0000 |
+| 17d || 396.03 | 375.56 | -5%˄ || 2.53 | 2.66 | +5%˄ | 0.0000 |
+| 17e || 1486.36 | 1434.15 | -4% || 0.67 | 0.70 | +4% | 0.0000 |
+| 17f || 852.77 | 819.80 | -4% || 1.17 | 1.22 | +4% | 0.0000 |
+| 18a || 133.28 | 129.90 | -3%˄ || 7.50 | 7.70 | +3%˄ | 0.0000 |
+| 18b || 103.84 | 100.29 | -3%˄ || 9.63 | 9.97 | +4%˄ | 0.0000 |
+| 18c || 204.39 | 195.96 | -4%˄ || 4.89 | 5.10 | +4%˄ | 0.0000 |
+| 19a || 215.59 | 209.02 | -3%˄ || 4.64 | 4.78 | +3%˄ | 0.0000 |
+| 19b || 178.29 | 171.19 | -4%˄ || 5.61 | 5.84 | +4%˄ | 0.0000 |
+| 19c || 259.37 | 251.07 | -3%˄ || 3.86 | 3.98 | +3%˄ | 0.0000 |
+| 19d || 622.40 | 606.82 | -3% || 1.61 | 1.65 | +3% | 0.0000 |
+| 1a || 10.73 | 10.34 | -4%˄ || 93.14 | 96.69 | +4%˄ | 0.0000 |
+| 1b || 13.15 | 12.71 | -3%˄ || 76.00 | 78.66 | +3%˄ | 0.0000 |
+| 1c || 14.91 | 14.45 | -3%˄ || 67.07 | 69.20 | +3%˄ | 0.0000 |
+| 1d || 10.01 | 9.70 | -3%˄ || 99.84 | 103.11 | +3%˄ | 0.0000 |
+| 20a || 587.06 | 555.51 | -5%˄ || 1.70 | 1.80 | +6%˄ | 0.0000 |
+| 20b || 623.16 | 591.97 | -5%˄ || 1.60 | 1.69 | +5%˄ | 0.0000 |
+| 20c || 362.73 | 349.60 | -4%˄ || 2.76 | 2.86 | +4%˄ | 0.0000 |
+| 21a || 102.16 | 98.83 | -3%˄ || 9.79 | 10.12 | +3%˄ | 0.0000 |
+| 21b || 93.13 | 90.63 | -3%˄ || 10.74 | 11.03 | +3%˄ | 0.0000 |
+| 21c || 103.25 | 100.74 | -2%˄ || 9.69 | 9.93 | +2%˄ | 0.0000 |
+| 22a || 170.41 | 164.03 | -4%˄ || 5.87 | 6.10 | +4%˄ | 0.0000 |
+| 22b || 154.54 | 148.66 | -4%˄ || 6.47 | 6.73 | +4%˄ | 0.0000 |
+| 22c || 231.76 | 223.68 | -3%˄ || 4.31 | 4.47 | +4%˄ | 0.0000 |
+| 22d || 362.34 | 347.60 | -4%˄ || 2.76 | 2.88 | +4%˄ | 0.0000 |
+| 23a || 47.69 | 46.35 | -3%˄ || 20.97 | 21.57 | +3%˄ | 0.0000 |
+| 23b || 54.98 | 52.82 | -4%˄ || 18.19 | 18.93 | +4%˄ | 0.0000 |
+| 23c || 51.35 | 49.82 | -3%˄ || 19.47 | 20.07 | +3%˄ | 0.0000 |
+| 24a || 208.07 | 202.97 | -2%˄ || 4.81 | 4.93 | +3%˄ | 0.0000 |
+| 24b || 202.29 | 196.53 | -3%˄ || 4.94 | 5.09 | +3%˄ | 0.0000 |
+| 25a || 111.48 | 107.57 | -4%˄ || 8.97 | 9.30 | +4%˄ | 0.0000 |
+| 25b || 70.63 | 68.06 | -4%˄ || 14.16 | 14.69 | +4%˄ | 0.0000 |
+| 25c || 261.45 | 249.51 | -5%˄ || 3.82 | 4.01 | +5%˄ | 0.0000 |
+| 26a || 167.89 | 160.57 | -4%˄ || 5.96 | 6.23 | +5%˄ | 0.0000 |
+| 26b || 135.85 | 130.29 | -4%˄ || 7.36 | 7.67 | +4%˄ | 0.0000 |
+| 26c || 302.05 | 286.85 | -5%˄ || 3.31 | 3.49 | +5%˄ | 0.0000 |
+| 27a || 96.19 | 93.55 | -3%˄ || 10.40 | 10.69 | +3%˄ | 0.0000 |
+| 27b || 89.33 | 87.02 | -3%˄ || 11.19 | 11.49 | +3%˄ | 0.0000 |
+| 27c || 103.29 | 100.76 | -2%˄ || 9.68 | 9.92 | +3%˄ | 0.0000 |
+| 28a || 211.25 | 202.78 | -4%˄ || 4.73 | 4.93 | +4%˄ | 0.0000 |
+| 28b || 66.97 | 64.47 | -4%˄ || 14.93 | 15.51 | +4%˄ | 0.0000 |
+| 28c || 171.87 | 164.85 | -4%˄ || 5.82 | 6.07 | +4%˄ | 0.0000 |
+| 29a || 172.17 | 167.96 | -2%˄ || 5.81 | 5.95 | +3%˄ | 0.0000 |
+| 29b || 804.00 | 735.88 | -8% || 1.24 | 1.36 | +9% | 0.0000 |
+| 29c || 207.56 | 202.66 | -2%˄ || 4.82 | 4.93 | +2%˄ | 0.0000 |
+| 2a || 28.28 | 26.94 | -5%˄ || 35.36 | 37.12 | +5%˄ | 0.0000 |
+| 2b || 26.19 | 25.05 | -4%˄ || 38.18 | 39.92 | +5%˄ | 0.0000 |
+| 2c || 22.38 | 21.44 | -4%˄ || 44.68 | 46.64 | +4%˄ | 0.0000 |
+| 2d || 58.04 | 55.33 | -5%˄ || 17.23 | 18.07 | +5%˄ | 0.0000 |
+| 30a || 99.63 | 95.72 | -4%˄ || 10.04 | 10.45 | +4%˄ | 0.0000 |
+| 30b || 104.20 | 99.23 | -5%˄ || 9.60 | 10.08 | +5%˄ | 0.0000 |
+| 30c || 171.01 | 163.23 | -5%˄ || 5.85 | 6.13 | +5%˄ | 0.0000 |
+| 31a || 86.14 | 82.99 | -4%˄ || 11.61 | 12.05 | +4%˄ | 0.0000 |
+| 31b || 85.20 | 82.14 | -4%˄ || 11.74 | 12.17 | +4%˄ | 0.0000 |
+| 31c || 96.81 | 93.17 | -4%˄ || 10.33 | 10.73 | +4%˄ | 0.0000 |
+| 32a || 15.76 | 15.25 | -3%˄ || 63.45 | 65.54 | +3%˄ | 0.0000 |
+| 32b || 36.74 | 34.56 | -6%˄ || 27.21 | 28.93 | +6%˄ | 0.0000 |
+| 33a || 35.14 | 34.00 | -3%˄ || 28.45 | 29.41 | +3%˄ | 0.0000 |
+| 33b || 22.95 | 22.11 | -4%˄ || 43.57 | 45.23 | +4%˄ | 0.0000 |
+| 33c || 41.51 | 40.45 | -3%˄ || 24.09 | 24.72 | +3%˄ | 0.0000 |
+| 3a || 62.74 | 60.41 | -4%˄ || 15.94 | 16.55 | +4%˄ | 0.0000 |
+| 3b || 16.95 | 16.45 | -3%˄ || 58.99 | 60.78 | +3%˄ | 0.0000 |
+| 3c || 229.49 | 223.28 | -3%˄ || 4.36 | 4.48 | +3%˄ | 0.0000 |
+| 4a || 136.40 | 131.96 | -3%˄ || 7.33 | 7.58 | +3%˄ | 0.0000 |
+| 4b || 16.03 | 15.52 | -3%˄ || 62.37 | 64.44 | +3%˄ | 0.0000 |
+| 4c || 193.80 | 189.34 | -2%˄ || 5.16 | 5.28 | +2%˄ | 0.0000 |
+| 5a || 45.33 | 43.54 | -4%˄ || 22.06 | 22.96 | +4%˄ | 0.0000 |
+| 5b || 48.61 | 47.45 | -2%˄ || 20.57 | 21.07 | +2%˄ | 0.0000 |
+| 5c || 87.96 | 85.04 | -3%˄ || 11.37 | 11.76 | +3%˄ | 0.0000 |
+| 6a || 151.88 | 147.61 | -3%˄ || 6.58 | 6.77 | +3%˄ | 0.0000 |
+| 6b || 166.64 | 161.34 | -3%˄ || 6.00 | 6.20 | +3%˄ | 0.0000 |
+| 6c || 144.00 | 140.16 | -3%˄ || 6.94 | 7.13 | +3%˄ | 0.0000 |
+| 6d || 357.53 | 341.63 | -4%˄ || 2.80 | 2.93 | +5%˄ | 0.0000 |
+| 6e || 150.04 | 145.80 | -3%˄ || 6.66 | 6.86 | +3%˄ | 0.0000 |
+| 6f || 656.30 | 624.92 | -5% || 1.52 | 1.60 | +5% | 0.0000 |
+| 7a || 87.15 | 85.20 | -2%˄ || 11.47 | 11.74 | +2%˄ | 0.0000 |
+| 7b || 80.24 | 78.73 | -2%˄ || 12.46 | 12.70 | +2%˄ | 0.0000 |
+| 7c || 544.96 | 527.38 | -3%˄ || 1.83 | 1.90 | +3%˄ | 0.0000 |
+| 8a || 170.72 | 167.27 | -2%˄ || 5.86 | 5.98 | +2%˄ | 0.0000 |
+| 8b || 167.98 | 164.36 | -2%˄ || 5.95 | 6.08 | +2%˄ | 0.0000 |
+| 8c || 1785.52 | 1710.35 | -4% || 0.56 | 0.58 | +4% | 0.0000 |
+| 8d || 294.71 | 282.86 | -4%˄ || 3.39 | 3.54 | +4%˄ | 0.0000 |
+| 9a || 245.68 | 236.77 | -4%˄ || 4.07 | 4.22 | +4%˄ | 0.0000 |
+| 9b || 156.74 | 150.46 | -4%˄ || 6.38 | 6.65 | +4%˄ | 0.0000 |
+| 9c || 274.30 | 264.78 | -3%˄ || 3.65 | 3.78 | +4%˄ | 0.0000 |
+| 9d || 410.18 | 396.10 | -3%˄ || 2.44 | 2.52 | +4%˄ | 0.0000 |
++---------++----------+----------+--------++----------+----------+--------+---------+
+| Sum || 28604.92 | 27442.26 | -4% || | | | |
+| Geomean || | | || | | +4% | |
++---------++----------+----------+--------++----------+----------+--------+---------+
+| Notes || ˄ Execution stopped due to max runs reached |
++---------++----------+----------+--------++----------+----------+--------+---------+
hyriseBenchmarkJoinOrder - multi-threaded, shuffled, 9 clients, 9 cores
Sum of avg. item runtimes: -0% || Geometric mean of throughput changes: +0%
Configuration Overview - click to expand
+Configuration Overview---------+-------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkJoinOrder_f7417f58c4618845c7b8a8d4559788ad3c7a04e6_mt.json | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkJoinOrder_044e600db1dab827693023c0766273b0a40d4606_mt.json |
+-------------------------------+-------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | f7417f58c4618845c7b8a8d4559788ad3c7a04e6-dirty | 044e600db1dab827693023c0766273b0a40d4606-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 9 | 9 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 9 | 9 |
| data_preparation_cores | 0 | 0 |
| date | 2024-03-01 02:25:40 | 2024-03-01 06:10:08 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [9] | [9] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+-------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------+
++---------++----------+----------+--------++----------+----------+--------+---------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++---------++----------+----------+--------++----------+----------+--------+---------+
+| 10a || 173.28 | 171.16 | -1% || 0.22 | 0.22 | +0% | 0.9524 |
+| 10b || 119.20 | 103.93 | -13% || 0.22 | 0.22 | +0% | 0.5132 |
+| 10c || 431.39 | 371.55 | -14% || 0.22 | 0.22 | +0% | 0.1617 |
+| 11a || 85.97 | 103.05 | +20% || 0.22 | 0.22 | +1% | 0.2339 |
+| 11b || 147.84 | 108.82 | -26% || 0.22 | 0.22 | +0% | 0.3375 |
+| 11c || 82.15 | 96.89 | +18% || 0.22 | 0.22 | +0% | 0.4891 |
+| 11d || 119.08 | 75.84 | -36% || 0.22 | 0.22 | +0% | 0.1239 |
+| 12a || 99.81 | 121.70 | +22% || 0.22 | 0.22 | +0% | 0.3779 |
+| 12b || 59.92 | 98.52 | +64% || 0.22 | 0.22 | +0% | 0.0641 |
+| 12c || 211.52 | 206.86 | -2% || 0.22 | 0.22 | +0% | 0.8616 |
+| 13a || 336.95 | 292.48 | -13% || 0.22 | 0.22 | +0% | 0.1286 |
+| 13b || 278.89 | 278.37 | -0% || 0.22 | 0.22 | +0% | 0.9901 |
+| 13c || 228.43 | 213.15 | -7% || 0.22 | 0.22 | +0% | 0.5150 |
+| 13d || 630.38 | 663.64 | +5% || 0.22 | 0.22 | +0% | 0.3737 |
+| 14a || 252.90 | 316.95 | +25% || 0.22 | 0.22 | +0% | 0.1178 |
+| 14b || 257.97 | 272.73 | +6% || 0.22 | 0.22 | +0% | 0.7122 |
+| 14c || 370.85 | 341.12 | -8% || 0.22 | 0.22 | +1% | 0.3808 |
+| 15a || 104.71 | 123.41 | +18% || 0.22 | 0.22 | +0% | 0.3574 |
+| 15b || 89.79 | 115.64 | +29% || 0.22 | 0.22 | +0% | 0.2467 |
+| 15c || 122.65 | 93.71 | -24% || 0.22 | 0.22 | +1% | 0.1877 |
+| 15d || 93.41 | 112.25 | +20% || 0.22 | 0.22 | +0% | 0.3317 |
+| 16a || 1377.45 | 1282.01 | -7% || 0.22 | 0.22 | +1% | 0.1745 |
+| 16b || 2475.89 | 2611.49 | +5% || 0.22 | 0.22 | +0% | 0.0745 |
+| 16c || 1449.96 | 1469.08 | +1% || 0.22 | 0.22 | +1% | 0.7662 |
+| 16d || 1500.94 | 1510.60 | +1% || 0.22 | 0.22 | +0% | 0.8985 |
+| 17a || 759.38 | 812.93 | +7% || 0.22 | 0.22 | +1% | 0.4528 |
+| 17b || 525.44 | 609.53 | +16% || 0.22 | 0.22 | +0% | 0.0961 |
+| 17c || 609.15 | 536.03 | -12% || 0.22 | 0.22 | +0% | 0.2333 |
+| 17d || 561.25 | 523.28 | -7% || 0.22 | 0.22 | +1% | 0.4826 |
+| 17e || 1454.96 | 1421.03 | -2% || 0.22 | 0.22 | +0% | 0.6435 |
+| 17f || 980.81 | 959.22 | -2% || 0.22 | 0.22 | +0% | 0.7432 |
+| 18a || 216.53 | 209.56 | -3% || 0.22 | 0.22 | +0% | 0.8429 |
+| 18b || 283.65 | 278.10 | -2% || 0.22 | 0.22 | +0% | 0.8965 |
+| 18c || 392.62 | 482.29 | +23% || 0.22 | 0.22 | +0% | 0.0700 |
+| 19a || 424.36 | 457.36 | +8% || 0.22 | 0.22 | +0% | 0.4608 |
+| 19b || 301.51 | 344.81 | +14% || 0.22 | 0.22 | +1% | 0.3140 |
+| 19c || 474.26 | 497.28 | +5% || 0.22 | 0.22 | +0% | 0.6753 |
+| 19d || 1066.98 | 1036.71 | -3% || 0.22 | 0.22 | +0% | 0.6163 |
+| 1a || 24.28 | 41.75 | +72% || 0.22 | 0.22 | +0% | 0.2120 |
+| 1b || 46.61 | 36.62 | -21% || 0.22 | 0.22 | +0% | 0.5697 |
+| 1c || 72.88 | 36.80 | -50% || 0.22 | 0.22 | +0% | 0.1074 |
+| 1d || 47.73 | 27.73 | -42% || 0.22 | 0.22 | +0% | 0.1025 |
+| 20a || 415.29 | 407.98 | -2% || 0.22 | 0.22 | +0% | 0.8816 |
+| 20b || 315.52 | 403.31 | +28% || 0.22 | 0.22 | +0% | 0.0428 |
+| 20c || 343.53 | 302.86 | -12% || 0.22 | 0.22 | +0% | 0.2391 |
+| 21a || 143.13 | 111.44 | -22% || 0.22 | 0.22 | +0% | 0.2360 |
+| 21b || 151.42 | 97.12 | -36% || 0.22 | 0.22 | +0% | 0.0304 |
+| 21c || 135.38 | 154.43 | +14% || 0.22 | 0.22 | +0% | 0.5100 |
+| 22a || 277.19 | 344.74 | +24% || 0.22 | 0.22 | +0% | 0.0877 |
+| 22b || 294.44 | 277.51 | -6% || 0.22 | 0.22 | +0% | 0.6821 |
+| 22c || 498.59 | 369.23 | -26% || 0.22 | 0.22 | +0% | 0.0160 |
+| 22d || 565.34 | 619.61 | +10% || 0.22 | 0.22 | +0% | 0.3498 |
+| 23a || 123.01 | 106.09 | -14% || 0.22 | 0.22 | +0% | 0.4905 |
+| 23b || 86.02 | 128.07 | +49% || 0.22 | 0.22 | +0% | 0.0748 |
+| 23c || 88.68 | 140.48 | +58% || 0.22 | 0.22 | +1% | 0.0106 |
+| 24a || 360.28 | 273.54 | -24% || 0.22 | 0.22 | +0% | 0.0664 |
+| 24b || 314.75 | 232.82 | -26% || 0.22 | 0.22 | +0% | 0.0656 |
+| 25a || 235.78 | 266.54 | +13% || 0.22 | 0.22 | +0% | 0.3886 |
+| 25b || 138.33 | 172.63 | +25% || 0.22 | 0.22 | +1% | 0.1951 |
+| 25c || 583.29 | 605.05 | +4% || 0.22 | 0.22 | +0% | 0.6796 |
+| 26a || 299.20 | 322.12 | +8% || 0.22 | 0.22 | +0% | 0.5471 |
+| 26b || 213.90 | 210.02 | -2% || 0.22 | 0.22 | +0% | 0.8885 |
+| 26c || 450.61 | 466.00 | +3% || 0.22 | 0.22 | +0% | 0.6988 |
+| 27a || 123.84 | 146.18 | +18% || 0.22 | 0.22 | +0% | 0.3540 |
+| 27b || 173.43 | 120.81 | -30% || 0.22 | 0.22 | +0% | 0.1001 |
+| 27c || 133.51 | 136.68 | +2% || 0.22 | 0.22 | +1% | 0.8965 |
+| 28a || 384.25 | 368.97 | -4% || 0.22 | 0.22 | +0% | 0.6422 |
+| 28b || 192.93 | 174.08 | -10% || 0.22 | 0.22 | +1% | 0.6223 |
+| 28c || 392.00 | 399.02 | +2% || 0.22 | 0.22 | +0% | 0.8737 |
+| 29a || 241.87 | 232.64 | -4% || 0.22 | 0.22 | +1% | 0.7764 |
+| 29b || 423.69 | 446.22 | +5% || 0.22 | 0.22 | +0% | 0.6539 |
+| 29c || 332.94 | 295.84 | -11% || 0.22 | 0.22 | +1% | 0.4246 |
+| 2a || 96.89 | 90.31 | -7% || 0.22 | 0.22 | +0% | 0.6706 |
+| 2b || 120.64 | 111.79 | -7% || 0.22 | 0.22 | +0% | 0.7550 |
+| 2c || 70.43 | 81.88 | +16% || 0.22 | 0.22 | +0% | 0.5524 |
+| 2d || 159.83 | 138.20 | -14% || 0.22 | 0.22 | +0% | 0.3295 |
+| 30a || 240.68 | 204.87 | -15% || 0.22 | 0.22 | +0% | 0.2788 |
+| 30b || 241.95 | 240.64 | -1% || 0.22 | 0.22 | +0% | 0.9752 |
+| 30c || 477.54 | 430.51 | -10% || 0.22 | 0.22 | +0% | 0.3628 |
+| 31a || 170.68 | 204.87 | +20% || 0.22 | 0.22 | +1% | 0.3003 |
+| 31b || 152.11 | 184.47 | +21% || 0.22 | 0.22 | +1% | 0.3791 |
+| 31c || 198.08 | 227.53 | +15% || 0.22 | 0.22 | +0% | 0.3214 |
+| 32a || 43.91 | 42.01 | -4% || 0.22 | 0.22 | +0% | 0.8286 |
+| 32b || 181.80 | 104.88 | -42% || 0.22 | 0.22 | +0% | 0.0193 |
+| 33a || 79.88 | 97.25 | +22% || 0.22 | 0.22 | +0% | 0.3265 |
+| 33b || 80.23 | 62.01 | -23% || 0.22 | 0.22 | +0% | 0.3861 |
+| 33c || 157.24 | 134.17 | -15% || 0.22 | 0.22 | +0% | 0.5135 |
+| 3a || 169.03 | 201.09 | +19% || 0.22 | 0.22 | +1% | 0.3497 |
+| 3b || 58.88 | 52.49 | -11% || 0.22 | 0.22 | +0% | 0.7119 |
+| 3c || 310.43 | 370.92 | +19% || 0.22 | 0.22 | +0% | 0.2159 |
+| 4a || 234.90 | 194.67 | -17% || 0.22 | 0.22 | +0% | 0.2891 |
+| 4b || 39.06 | 41.07 | +5% || 0.22 | 0.22 | +0% | 0.8689 |
+| 4c || 215.04 | 231.10 | +7% || 0.22 | 0.22 | +0% | 0.5803 |
+| 5a || 127.03 | 155.40 | +22% || 0.22 | 0.22 | +0% | 0.4148 |
+| 5b || 110.61 | 112.76 | +2% || 0.22 | 0.22 | +0% | 0.9286 |
+| 5c || 264.21 | 198.93 | -25% || 0.22 | 0.22 | +0% | 0.1478 |
+| 6a || 147.98 | 147.33 | -0% || 0.22 | 0.22 | +0% | 0.9827 |
+| 6b || 187.99 | 174.85 | -7% || 0.22 | 0.22 | +0% | 0.6842 |
+| 6c || 124.28 | 154.54 | +24% || 0.22 | 0.22 | +0% | 0.2352 |
+| 6d || 482.90 | 428.11 | -11% || 0.22 | 0.22 | +0% | 0.1740 |
+| 6e || 162.46 | 117.29 | -28% || 0.22 | 0.22 | +0% | 0.0796 |
+| 6f || 936.44 | 910.02 | -3% || 0.22 | 0.22 | +0% | 0.5919 |
+| 7a || 147.41 | 141.85 | -4% || 0.22 | 0.22 | +0% | 0.8287 |
+| 7b || 122.72 | 159.90 | +30% || 0.22 | 0.22 | +0% | 0.1019 |
+| 7c || 960.66 | 948.50 | -1% || 0.22 | 0.22 | +1% | 0.8592 |
+| 8a || 204.15 | 189.99 | -7% || 0.22 | 0.22 | +1% | 0.7063 |
+| 8b || 143.37 | 191.81 | +34% || 0.22 | 0.22 | +0% | 0.0958 |
+| 8c || 1872.59 | 1779.89 | -5% || 0.22 | 0.22 | +0% | 0.1526 |
+| 8d || 494.11 | 490.94 | -1% || 0.22 | 0.22 | +0% | 0.9411 |
+| 9a || 516.94 | 539.54 | +4% || 0.22 | 0.22 | +0% | 0.7116 |
+| 9b || 383.43 | 337.95 | -12% || 0.22 | 0.22 | +1% | 0.3286 |
+| 9c || 511.70 | 554.95 | +8% || 0.22 | 0.22 | +1% | 0.4998 |
+| 9d || 790.74 | 838.40 | +6% || 0.22 | 0.22 | +0% | 0.4293 |
++---------++----------+----------+--------++----------+----------+--------+---------+
+| Sum || 39966.84 | 39817.70 | -0% || | | | |
+| Geomean || | | || | | +0% | |
++---------++----------+----------+--------++----------+----------+--------+---------+
hyriseBenchmarkStarSchema - single-threaded
Sum of avg. item runtimes: -1% || Geometric mean of throughput changes: +0%
Configuration Overview - click to expand
+Configuration Overview---+--------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkStarSchema_f7417f58c4618845c7b8a8d4559788ad3c7a04e6_st.json | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkStarSchema_044e600db1dab827693023c0766273b0a40d4606_st.json |
+-------------------------+--------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | f7417f58c4618845c7b8a8d4559788ad3c7a04e6-dirty | 044e600db1dab827693023c0766273b0a40d4606-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2024-03-01 02:46:04 | 2024-03-01 06:30:32 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 100 | 100 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------+--------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------+
++---------++----------+---------+--------++----------+----------+--------+---------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++---------++----------+---------+--------++----------+----------+--------+---------+
+| 1.1 || 255.51 | 270.49 | +6%˄ || 3.91 | 3.70 | -6%˄ | 0.0000 |
+| 1.2 || 134.95 | 138.89 | +3%˄ || 7.41 | 7.20 | -3%˄ | 0.0000 |
+| 1.3 || 132.23 | 133.69 | +1%˄ || 7.56 | 7.48 | -1%˄ | 0.0835 |
+| 2.1 || 481.35 | 474.74 | -1%˄ || 2.08 | 2.11 | +1%˄ | 0.0000 |
+| 2.2 || 257.95 | 253.96 | -2%˄ || 3.88 | 3.94 | +2%˄ | 0.0000 |
+| 2.3 || 172.70 | 170.77 | -1%˄ || 5.79 | 5.86 | +1%˄ | 0.0000 |
+| 3.1 || 2668.04 | 2639.71 | -1% || 0.37 | 0.38 | +1% | 0.3184 |
+| 3.2 || 242.77 | 238.67 | -2%˄ || 4.12 | 4.19 | +2%˄ | 0.0000 |
+| 3.3 || 111.90 | 111.24 | -1%˄ || 8.94 | 8.99 | +1%˄ | 0.1610 |
+| 3.4 || 105.33 | 104.77 | -1%˄ || 9.49 | 9.54 | +1%˄ | 0.0443 |
+| 4.1 || 2517.84 | 2477.95 | -2% || 0.40 | 0.40 | +2% | 0.0264 |
+| 4.2 || 770.41 | 760.16 | -1% || 1.30 | 1.32 | +1% | 0.0011 |
+| 4.3 || 221.27 | 215.23 | -3%˄ || 4.52 | 4.65 | +3%˄ | 0.0000 |
++---------++----------+---------+--------++----------+----------+--------+---------+
+| Sum || 8072.26 | 7990.27 | -1% || | | | |
+| Geomean || | | || | | +0% | |
++---------++----------+---------+--------++----------+----------+--------+---------+
+| Notes || ˄ Execution stopped due to max runs reached |
++---------++----------+---------+--------++----------+----------+--------+---------+
hyriseBenchmarkStarSchema - multi-threaded, shuffled, 9 clients, 9 cores
Sum of avg. item runtimes: -0% || Geometric mean of throughput changes: -0%
Configuration Overview - click to expand
+Configuration Overview---------+--------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkStarSchema_f7417f58c4618845c7b8a8d4559788ad3c7a04e6_mt.json | /hyrise/rel_intel/benchmark_all_results/hyriseBenchmarkStarSchema_044e600db1dab827693023c0766273b0a40d4606_mt.json |
+-------------------------------+--------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | f7417f58c4618845c7b8a8d4559788ad3c7a04e6-dirty | 044e600db1dab827693023c0766273b0a40d4606-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 9 | 9 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 9 | 9 |
| data_preparation_cores | 0 | 0 |
| date | 2024-03-01 02:53:16 | 2024-03-01 06:37:45 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [9] | [9] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+--------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------+
++---------++----------+----------+--------++----------+----------+--------+---------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++---------++----------+----------+--------++----------+----------+--------+---------+
+| 1.1 || 530.79 | 511.03 | -4% || 0.81 | 0.81 | -0% | 0.5650 |
+| 1.2 || 306.12 | 339.09 | +11% || 0.81 | 0.81 | -0% | 0.2007 |
+| 1.3 || 287.89 | 299.42 | +4% || 0.81 | 0.81 | +0% | 0.6306 |
+| 2.1 || 1192.90 | 1198.42 | +0% || 0.81 | 0.81 | +0% | 0.9147 |
+| 2.2 || 687.51 | 708.48 | +3% || 0.81 | 0.81 | +0% | 0.6088 |
+| 2.3 || 277.83 | 267.79 | -4% || 0.81 | 0.81 | -0% | 0.6442 |
+| 3.1 || 2388.89 | 2448.66 | +3% || 0.81 | 0.81 | +0% | 0.3363 |
+| 3.2 || 608.79 | 608.42 | -0% || 0.81 | 0.81 | +0% | 0.9919 |
+| 3.3 || 369.64 | 323.83 | -12% || 0.81 | 0.81 | +0% | 0.1665 |
+| 3.4 || 320.36 | 293.43 | -8% || 0.81 | 0.81 | +0% | 0.2650 |
+| 4.1 || 2018.84 | 2001.65 | -1% || 0.81 | 0.81 | -0% | 0.7809 |
+| 4.2 || 1502.52 | 1467.74 | -2% || 0.81 | 0.81 | -0% | 0.5178 |
+| 4.3 || 482.83 | 506.19 | +5% || 0.81 | 0.81 | +0% | 0.4879 |
++---------++----------+----------+--------++----------+----------+--------+---------+
+| Sum || 10974.90 | 10974.16 | -0% || | | | |
+| Geomean || | | || | | -0% | |
++---------++----------+----------+--------++----------+----------+--------+---------+
But since it is a PR to improve multi-threading, I will probably wait for the merge of https://github.com/hyrise/hyrise/pull/2630 which changes the benchmark script.
Will take a few more days, still benchmarking #2630 and it seems to be a bit flaky (probably due to the fewer runs).
Will take a few more days, still benchmarking #2630 and it seems to be a bit flaky (probably due to the fewer runs).
Does it help if I run some tests in the DELab?
@dey4ss : the PR is still blocked by others (benchmarking script). But in case you're bored: is there anything that would block this PR here?
Re-running benchmarks. The following on AMD show some weird results (SSB gets slower in queries where the aggregate takes <1 %; I cannot reproduce that).
System
cx27 - click to expand
| property | value |
|---|---|
| Hostname | cx27 |
| CPU | AMD EPYC 7742 64-Core Processor |
| Memory | 488GB |
| numactl | nodebind: 0 |
| numactl | membind: 0 |
Commit Info and Build Time
| commit | date | message | build time |
|---|---|---|---|
| 8783047e4 | 03.04.2024 13:25 | Benchmark Runner: Do not sleep (#2635) | real 434.95 user 3399.21 sys 272.60 |
| 5e7efa90a | 04.04.2024 04:59 | Merge, merge, merge | real 446.48 user 3404.88 sys 267.31 |
hyriseBenchmarkTPCH - single-threaded, SF 10.0
Sum of avg. item runtimes: -0% || Geometric mean of throughput changes: -1%
Configuration Overview - click to expand
+Configuration Overview----+------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCH_8783047e4e0ff8b49ba8c88a4c818c5abb34e9b7_st.json | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCH_5e7efa90aabc372c3617bd3f8b7208688ac51f13_st.json |
+--------------------------+------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 8783047e4e0ff8b49ba8c88a4c818c5abb34e9b7-dirty | 5e7efa90aabc372c3617bd3f8b7208688ac51f13-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| clustering | None | None |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2024-04-04 05:15:13 | 2024-04-04 09:17:15 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| use_prepared_statements | False | False |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+--------------------------+------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------+
++----------++----------+----------+--------++----------+----------+--------+----------------------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++----------++----------+----------+--------++----------+----------+--------+----------------------+
+| TPC-H 01 || 6252.65 | 6186.03 | -1% || 0.16 | 0.16 | +1% | 0.3096 |
+| TPC-H 02 || 49.39 | 50.12 | +1%˄ || 20.24 | 19.94 | -1%˄ | (run time too short) |
+| TPC-H 03 || 1881.96 | 1844.22 | -2% || 0.53 | 0.54 | +2% | 0.0002 |
+| TPC-H 04 || 1903.55 | 1884.24 | -1% || 0.53 | 0.53 | +1% | 0.0357 |
+| TPC-H 05 || 3352.23 | 3601.07 | +7% || 0.30 | 0.28 | -7% | 0.0000 |
+| TPC-H 06 || 204.10 | 212.85 | +4%˄ || 4.90 | 4.70 | -4%˄ | (run time too short) |
+| TPC-H 07 || 1154.75 | 1217.10 | +5%˄ || 0.87 | 0.82 | -5%˄ | (run time too short) |
+| TPC-H 08 || 734.13 | 743.76 | +1%˄ || 1.36 | 1.34 | -1%˄ | (run time too short) |
+| TPC-H 09 || 7394.62 | 7653.00 | +3% || 0.14 | 0.13 | -3% | ˅ |
+| TPC-H 10 || 2363.73 | 1857.45 | -21% || 0.42 | 0.54 | +27% | 0.0000 |
+| TPC-H 11 || 74.80 | 80.13 | +7%˄ || 13.37 | 12.48 | -7%˄ | (run time too short) |
+| TPC-H 12 || 1754.11 | 1900.53 | +8% || 0.57 | 0.53 | -8% | 0.0000 |
+| TPC-H 13 || 7048.11 | 6606.38 | -6% || 0.14 | 0.15 | +7% | ˅ |
+| TPC-H 14 || 678.96 | 677.23 | -0%˄ || 1.47 | 1.48 | +0%˄ | (run time too short) |
+| TPC-H 15 || 267.85 | 254.15 | -5%˄ || 3.73 | 3.93 | +5%˄ | (run time too short) |
+| TPC-H 16 || 725.07 | 713.08 | -2%˄ || 1.38 | 1.40 | +2%˄ | (run time too short) |
+| TPC-H 17 || 286.97 | 292.83 | +2%˄ || 3.48 | 3.41 | -2%˄ | (run time too short) |
+| TPC-H 18 || 1617.92 | 1667.04 | +3% || 0.62 | 0.60 | -3% | 0.0240 |
+| TPC-H 19 || 278.34 | 295.48 | +6%˄ || 3.59 | 3.38 | -6%˄ | (run time too short) |
+| TPC-H 20 || 681.61 | 828.59 | +22%˄ || 1.47 | 1.21 | -18%˄ | (run time too short) |
+| TPC-H 21 || 6091.03 | 6156.66 | +1% || 0.16 | 0.16 | -1% | 0.1054 |
+| TPC-H 22 || 625.67 | 631.55 | +1%˄ || 1.60 | 1.58 | -1%˄ | (run time too short) |
++----------++----------+----------+--------++----------+----------+--------+----------------------+
+| Sum || 45421.55 | 45353.51 | -0% || | | | |
+| Geomean || | | || | | -1% | |
++----------++----------+----------+--------++----------+----------+--------+----------------------+
+| Notes || ˄ Execution stopped due to max runs reached |
+| || ˅ Insufficient number of runs for p-value calculation |
++----------++----------+----------+--------++----------+----------+--------+----------------------+
hyriseBenchmarkTPCH - single-threaded, SF 0.01
Sum of avg. item runtimes: +1% || Geometric mean of throughput changes: -1%
Configuration Overview - click to expand
+Configuration Overview----+----------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCH_8783047e4e0ff8b49ba8c88a4c818c5abb34e9b7_st_s01.json | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCH_5e7efa90aabc372c3617bd3f8b7208688ac51f13_st_s01.json |
+--------------------------+----------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 8783047e4e0ff8b49ba8c88a4c818c5abb34e9b7-dirty | 5e7efa90aabc372c3617bd3f8b7208688ac51f13-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| clustering | None | None |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2024-04-04 05:33:18 | 2024-04-04 09:35:24 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| scale_factor | 0.009999999776482582 | 0.009999999776482582 |
| time_unit | ns | ns |
| use_prepared_statements | False | False |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+--------------------------+----------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------+
++----------++----------+---------+--------++----------+----------+--------+----------------------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++----------++----------+---------+--------++----------+----------+--------+----------------------+
+| TPC-H 01 || 10.67 | 10.68 | +0%˄ || 93.70 | 93.63 | -0%˄ | (run time too short) |
+| TPC-H 02 || 4.50 | 4.63 | +3%˄ || 222.17 | 216.07 | -3%˄ | (run time too short) |
+| TPC-H 03 || 0.68 | 0.67 | -2%˄ || 1458.50 | 1492.90 | +2%˄ | (run time too short) |
+| TPC-H 04 || 0.41 | 0.42 | +3%˄ || 2437.90 | 2375.96 | -3%˄ | (run time too short) |
+| TPC-H 05 || 0.99 | 1.03 | +4%˄ || 1010.12 | 971.19 | -4%˄ | (run time too short) |
+| TPC-H 06 || 0.22 | 0.22 | +4%˄ || 4614.00 | 4441.45 | -4%˄ | (run time too short) |
+| TPC-H 07 || 11.23 | 11.20 | -0%˄ || 89.06 | 89.25 | +0%˄ | (run time too short) |
+| TPC-H 08 || 15.38 | 15.57 | +1%˄ || 65.02 | 64.21 | -1%˄ | (run time too short) |
+| TPC-H 09 || 4.57 | 4.66 | +2%˄ || 218.51 | 214.69 | -2%˄ | (run time too short) |
+| TPC-H 10 || 0.79 | 0.72 | -9%˄ || 1262.74 | 1389.59 | +10%˄ | (run time too short) |
+| TPC-H 11 || 0.19 | 0.20 | +6%˄ || 5210.61 | 4902.33 | -6%˄ | (run time too short) |
+| TPC-H 12 || 0.68 | 0.73 | +7%˄ || 1466.05 | 1368.10 | -7%˄ | (run time too short) |
+| TPC-H 13 || 2.13 | 2.13 | -0%˄ || 468.34 | 469.53 | +0%˄ | (run time too short) |
+| TPC-H 14 || 0.31 | 0.32 | +1%˄ || 3189.14 | 3147.66 | -1%˄ | (run time too short) |
+| TPC-H 15 || 1.32 | 1.33 | +1%˄ || 753.38 | 747.36 | -1%˄ | (run time too short) |
+| TPC-H 16 || 2.56 | 2.47 | -3%˄ || 390.24 | 403.69 | +3%˄ | (run time too short) |
+| TPC-H 17 || 0.68 | 0.74 | +9%˄ || 1467.04 | 1341.56 | -9%˄ | (run time too short) |
+| TPC-H 18 || 1.15 | 1.12 | -3%˄ || 865.38 | 889.75 | +3%˄ | (run time too short) |
+| TPC-H 19 || 6.51 | 6.80 | +4%˄ || 153.52 | 147.02 | -4%˄ | (run time too short) |
+| TPC-H 20 || 2.89 | 2.92 | +1%˄ || 345.53 | 342.27 | -1%˄ | (run time too short) |
+| TPC-H 21 || 1.08 | 1.08 | -0%˄ || 920.33 | 921.48 | +0%˄ | (run time too short) |
+| TPC-H 22 || 1.27 | 1.28 | +1%˄ || 782.82 | 777.63 | -1%˄ | (run time too short) |
++----------++----------+---------+--------++----------+----------+--------+----------------------+
+| Sum || 70.22 | 70.91 | +1% || | | | |
+| Geomean || | | || | | -1% | |
++----------++----------+---------+--------++----------+----------+--------+----------------------+
+| Notes || ˄ Execution stopped due to max runs reached |
++----------++----------+---------+--------++----------+----------+--------+----------------------+
hyriseBenchmarkTPCH - multi-threaded, ordered, 1 client, 64 cores, SF 10.0
Sum of avg. item runtimes: -5% || Geometric mean of throughput changes: +3%
Configuration Overview - click to expand
+Configuration Overview---------+--------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCH_8783047e4e0ff8b49ba8c88a4c818c5abb34e9b7_mt_ordered.json | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCH_5e7efa90aabc372c3617bd3f8b7208688ac51f13_mt_ordered.json |
+-------------------------------+--------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 8783047e4e0ff8b49ba8c88a4c818c5abb34e9b7-dirty | 5e7efa90aabc372c3617bd3f8b7208688ac51f13-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| clustering | None | None |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2024-04-04 05:33:44 | 2024-04-04 09:35:50 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| use_prepared_statements | False | False |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------------+--------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------+
++----------++----------+----------+--------++----------+----------+--------+----------------------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++----------++----------+----------+--------++----------+----------+--------+----------------------+
+| TPC-H 01 || 5835.09 | 5800.16 | -1% || 0.17 | 0.17 | +1% | 0.7425 |
+| TPC-H 02 || 67.06 | 74.53 | +11%˄ || 14.87 | 13.39 | -10%˄ | (run time too short) |
+| TPC-H 03 || 884.82 | 825.19 | -7%˄ || 1.15 | 1.21 | +5%˄ | (run time too short) |
+| TPC-H 04 || 824.43 | 828.62 | +1%˄ || 1.21 | 1.21 | -1%˄ | (run time too short) |
+| TPC-H 05 || 632.72 | 669.49 | +6%˄ || 1.58 | 1.49 | -5%˄ | (run time too short) |
+| TPC-H 06 || 65.61 | 67.11 | +2%˄ || 15.21 | 14.87 | -2%˄ | (run time too short) |
+| TPC-H 07 || 336.49 | 335.50 | -0%˄ || 2.97 | 2.98 | +0%˄ | (run time too short) |
+| TPC-H 08 || 291.01 | 293.67 | +1%˄ || 3.43 | 3.40 | -1%˄ | (run time too short) |
+| TPC-H 09 || 2763.66 | 2738.17 | -1% || 0.36 | 0.37 | +1% | 0.2823 |
+| TPC-H 10 || 1485.25 | 785.49 | -47%˄ || 0.67 | 1.27 | +89%˄ | (run time too short) |
+| TPC-H 11 || 80.57 | 76.09 | -6%˄ || 12.39 | 13.12 | +6%˄ | (run time too short) |
+| TPC-H 12 || 698.61 | 705.56 | +1%˄ || 1.43 | 1.42 | -1%˄ | (run time too short) |
+| TPC-H 13 || 4145.75 | 3917.99 | -5% || 0.24 | 0.26 | +6% | 0.0000 |
+| TPC-H 14 || 162.61 | 163.94 | +1%˄ || 6.14 | 6.09 | -1%˄ | (run time too short) |
+| TPC-H 15 || 184.39 | 168.23 | -9%˄ || 5.42 | 5.94 | +10%˄ | (run time too short) |
+| TPC-H 16 || 876.82 | 881.09 | +0%˄ || 1.14 | 1.13 | -0%˄ | (run time too short) |
+| TPC-H 17 || 97.55 | 101.98 | +5%˄ || 10.24 | 9.79 | -4%˄ | (run time too short) |
+| TPC-H 18 || 2745.23 | 2514.72 | -8% || 0.36 | 0.40 | +9% | 0.0049 |
+| TPC-H 19 || 133.79 | 132.10 | -1%˄ || 7.47 | 7.56 | +1%˄ | (run time too short) |
+| TPC-H 20 || 250.39 | 269.88 | +8%˄ || 3.99 | 3.70 | -7%˄ | (run time too short) |
+| TPC-H 21 || 1320.16 | 1341.52 | +2% || 0.76 | 0.75 | -2% | 0.1342 |
+| TPC-H 22 || 162.29 | 165.23 | +2%˄ || 6.16 | 6.05 | -2%˄ | (run time too short) |
++----------++----------+----------+--------++----------+----------+--------+----------------------+
+| Sum || 24044.29 | 22856.28 | -5% || | | | |
+| Geomean || | | || | | +3% | |
++----------++----------+----------+--------++----------+----------+--------+----------------------+
+| Notes || ˄ Execution stopped due to max runs reached |
++----------++----------+----------+--------++----------+----------+--------+----------------------+
hyriseBenchmarkTPCH - multi-threaded, shuffled, 64 clients, 64 cores, SF 10.0
Sum of avg. item runtimes: -1% || Geometric mean of throughput changes: +1%
Configuration Overview - click to expand
+Configuration Overview---------+------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCH_8783047e4e0ff8b49ba8c88a4c818c5abb34e9b7_mt.json | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCH_5e7efa90aabc372c3617bd3f8b7208688ac51f13_mt.json |
+-------------------------------+------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 8783047e4e0ff8b49ba8c88a4c818c5abb34e9b7-dirty | 5e7efa90aabc372c3617bd3f8b7208688ac51f13-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 64 | 64 |
| clustering | None | None |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2024-04-04 05:48:08 | 2024-04-04 09:49:50 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| use_prepared_statements | False | False |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------+
++----------++----------+----------+--------++----------+----------+--------+---------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++----------++----------+----------+--------++----------+----------+--------+---------+
+| TPC-H 01 || 6658.15 | 6519.61 | -2% || 0.99 | 1.00 | +1% | 0.1300 |
+| TPC-H 02 || 643.78 | 517.46 | -20% || 1.00 | 1.01 | +1% | 0.0748 |
+| TPC-H 03 || 2911.27 | 2885.19 | -1% || 1.00 | 1.01 | +1% | 0.8523 |
+| TPC-H 04 || 2413.60 | 2590.60 | +7% || 1.00 | 1.01 | +1% | 0.1866 |
+| TPC-H 05 || 4206.09 | 4291.18 | +2% || 1.00 | 1.00 | +1% | 0.6573 |
+| TPC-H 06 || 832.13 | 862.09 | +4% || 1.00 | 1.01 | +1% | 0.7383 |
+| TPC-H 07 || 3435.14 | 3553.27 | +3% || 1.00 | 1.01 | +1% | 0.5366 |
+| TPC-H 08 || 2519.67 | 2509.11 | -0% || 1.00 | 1.01 | +1% | 0.9428 |
+| TPC-H 09 || 6748.61 | 6803.49 | +1% || 0.99 | 1.00 | +1% | 0.8000 |
+| TPC-H 10 || 4600.27 | 3704.25 | -19% || 1.00 | 1.00 | +1% | 0.0000 |
+| TPC-H 11 || 420.91 | 596.77 | +42% || 1.00 | 1.01 | +1% | 0.0047 |
+| TPC-H 12 || 2641.06 | 2954.07 | +12% || 1.00 | 1.01 | +1% | 0.0238 |
+| TPC-H 13 || 6197.30 | 5811.09 | -6% || 0.99 | 1.01 | +1% | 0.0012 |
+| TPC-H 14 || 1175.64 | 1317.06 | +12% || 1.00 | 1.01 | +1% | 0.1788 |
+| TPC-H 15 || 685.37 | 704.16 | +3% || 1.00 | 1.01 | +1% | 0.7764 |
+| TPC-H 16 || 2471.34 | 2457.11 | -1% || 1.00 | 1.01 | +1% | 0.9123 |
+| TPC-H 17 || 885.58 | 848.42 | -4% || 1.00 | 1.01 | +1% | 0.6818 |
+| TPC-H 18 || 3663.19 | 3674.57 | +0% || 1.00 | 1.01 | +1% | 0.9046 |
+| TPC-H 19 || 1153.76 | 1194.75 | +4% || 1.00 | 1.01 | +1% | 0.6915 |
+| TPC-H 20 || 2189.92 | 2116.80 | -3% || 1.00 | 1.01 | +1% | 0.6220 |
+| TPC-H 21 || 6012.18 | 5706.30 | -5% || 0.99 | 1.00 | +1% | 0.1617 |
+| TPC-H 22 || 1234.51 | 1359.47 | +10% || 1.00 | 1.01 | +1% | 0.3127 |
++----------++----------+----------+--------++----------+----------+--------+---------+
+| Sum || 63699.49 | 62976.84 | -1% || | | | |
+| Geomean || | | || | | +1% | |
++----------++----------+----------+--------++----------+----------+--------+---------+
hyriseBenchmarkTPCDS - single-threaded
Sum of avg. item runtimes: +5% || Geometric mean of throughput changes: -1%
Configuration Overview - click to expand
+Configuration Overview---+-------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCDS_8783047e4e0ff8b49ba8c88a4c818c5abb34e9b7_st.json | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCDS_5e7efa90aabc372c3617bd3f8b7208688ac51f13_st.json |
+-------------------------+-------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 8783047e4e0ff8b49ba8c88a4c818c5abb34e9b7-dirty | 5e7efa90aabc372c3617bd3f8b7208688ac51f13-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2024-04-04 06:10:19 | 2024-04-04 10:11:56 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| time_unit | ns | ns |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------+-------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------+
++---------++----------+----------+--------++----------+----------+--------+----------------------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++---------++----------+----------+--------++----------+----------+--------+----------------------+
+| 01 || 290.63 | 318.96 | +10%˄ || 3.44 | 3.13 | -9%˄ | (run time too short) |
+| 03 || 100.76 | 100.70 | -0%˄ || 9.92 | 9.93 | +0%˄ | (run time too short) |
+| 06 || 233.66 | 235.85 | +1%˄ || 4.28 | 4.24 | -1%˄ | (run time too short) |
+| 07 || 367.83 | 384.07 | +4%˄ || 2.72 | 2.60 | -4%˄ | (run time too short) |
+| 09 || 1100.72 | 1074.29 | -2%˄ || 0.91 | 0.93 | +2%˄ | (run time too short) |
+| 10 || 160.95 | 162.70 | +1%˄ || 6.21 | 6.15 | -1%˄ | (run time too short) |
+| 13 || 674.40 | 687.71 | +2%˄ || 1.48 | 1.45 | -2%˄ | (run time too short) |
+| 15 || 136.35 | 138.55 | +2%˄ || 7.33 | 7.22 | -2%˄ | (run time too short) |
+| 16 || 70.12 | 67.62 | -4%˄ || 14.26 | 14.78 | +4%˄ | (run time too short) |
+| 17 || 420.19 | 425.93 | +1%˄ || 2.38 | 2.35 | -1%˄ | (run time too short) |
+| 19 || 135.23 | 138.36 | +2%˄ || 7.39 | 7.23 | -2%˄ | (run time too short) |
+| 25 || 205.26 | 213.62 | +4%˄ || 4.87 | 4.68 | -4%˄ | (run time too short) |
+| 26 || 152.18 | 152.74 | +0%˄ || 6.57 | 6.55 | -0%˄ | (run time too short) |
+| 28 || 819.94 | 801.74 | -2%˄ || 1.22 | 1.25 | +2%˄ | (run time too short) |
+| 29 || 600.31 | 592.54 | -1%˄ || 1.67 | 1.69 | +1%˄ | (run time too short) |
+| 31 || 1587.35 | 1579.46 | -0% || 0.63 | 0.63 | +0% | 0.1768 |
+| 32 || 34.16 | 34.74 | +2%˄ || 29.25 | 28.77 | -2%˄ | (run time too short) |
+| 34 || 225.36 | 231.09 | +3%˄ || 4.44 | 4.33 | -2%˄ | (run time too short) |
+| 35 || 820.06 | 828.33 | +1%˄ || 1.22 | 1.21 | -1%˄ | (run time too short) |
+| 37 || 822.76 | 793.11 | -4%˄ || 1.22 | 1.26 | +4%˄ | (run time too short) |
+| 39a || 1954.70 | 1896.19 | -3% || 0.51 | 0.53 | +3% | 0.0274 |
+| 39b || 2000.50 | 1894.44 | -5% || 0.50 | 0.53 | +6% | 0.0000 |
+| 41 || 336.25 | 299.97 | -11%˄ || 2.97 | 3.33 | +12%˄ | (run time too short) |
+| 42 || 113.06 | 113.72 | +1%˄ || 8.84 | 8.79 | -1%˄ | (run time too short) |
+| 43 || 1076.06 | 1045.40 | -3%˄ || 0.93 | 0.96 | +3%˄ | (run time too short) |
+| 45 || 176.20 | 173.73 | -1%˄ || 5.67 | 5.76 | +1%˄ | (run time too short) |
+| 48 || 1143.99 | 1143.70 | -0%˄ || 0.87 | 0.87 | +0%˄ | (run time too short) |
+| 50 || 161.20 | 160.58 | -0%˄ || 6.20 | 6.23 | +0%˄ | (run time too short) |
+| 52 || 111.57 | 113.02 | +1%˄ || 8.96 | 8.85 | -1%˄ | (run time too short) |
+| 55 || 104.72 | 105.37 | +1%˄ || 9.55 | 9.49 | -1%˄ | (run time too short) |
+| 62 || 589.38 | 593.29 | +1%˄ || 1.70 | 1.69 | -1%˄ | (run time too short) |
+| 65 || 2117.37 | 2405.35 | +14% || 0.47 | 0.42 | -12% | 0.0000 |
+| 69 || 180.45 | 178.28 | -1%˄ || 5.54 | 5.61 | +1%˄ | (run time too short) |
+| 73 || 106.38 | 105.86 | -0%˄ || 9.40 | 9.44 | +0%˄ | (run time too short) |
+| 79 || 613.67 | 627.96 | +2%˄ || 1.63 | 1.59 | -2%˄ | (run time too short) |
+| 81 || 202.03 | 208.20 | +3%˄ || 4.95 | 4.80 | -3%˄ | (run time too short) |
+| 82 || 867.16 | 842.71 | -3%˄ || 1.15 | 1.19 | +3%˄ | (run time too short) |
+| 83 || 53.18 | 53.95 | +1%˄ || 18.80 | 18.53 | -1%˄ | (run time too short) |
+| 85 || 209.20 | 208.04 | -1%˄ || 4.78 | 4.81 | +1%˄ | (run time too short) |
+| 88 || 955.23 | 944.41 | -1%˄ || 1.05 | 1.06 | +1%˄ | (run time too short) |
+| 91 || 21.22 | 21.39 | +1%˄ || 47.07 | 46.71 | -1%˄ | (run time too short) |
+| 92 || 53.98 | 50.20 | -7%˄ || 18.52 | 19.91 | +8%˄ | (run time too short) |
+| 93 || 5234.44 | 5220.77 | -0% || 0.19 | 0.19 | +0% | 0.3792 |
+| 94 || 52.38 | 54.03 | +3%˄ || 19.08 | 18.50 | -3%˄ | (run time too short) |
+| 95 || 4838.12 | 4758.57 | -2% || 0.21 | 0.21 | +2% | 0.1495 |
+| 96 || 84.76 | 83.52 | -1%˄ || 11.80 | 11.97 | +1%˄ | (run time too short) |
+| 97 || 2924.89 | 4805.02 | +64% || 0.34 | 0.21 | -39% | 0.0000 |
+| 99 || 1099.43 | 1079.27 | -2%˄ || 0.91 | 0.93 | +2%˄ | (run time too short) |
++---------++----------+----------+--------++----------+----------+--------+----------------------+
+| Sum || 36339.74 | 38149.03 | +5% || | | | |
+| Geomean || | | || | | -1% | |
++---------++----------+----------+--------++----------+----------+--------+----------------------+
+| Notes || ˄ Execution stopped due to max runs reached |
++---------++----------+----------+--------++----------+----------+--------+----------------------+
hyriseBenchmarkTPCDS - multi-threaded, ordered, 1 client, 64 cores
Sum of avg. item runtimes: -3% || Geometric mean of throughput changes: +1%
Configuration Overview - click to expand
+Configuration Overview---------+---------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCDS_8783047e4e0ff8b49ba8c88a4c818c5abb34e9b7_mt_ordered.json | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCDS_5e7efa90aabc372c3617bd3f8b7208688ac51f13_mt_ordered.json |
+-------------------------------+---------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 8783047e4e0ff8b49ba8c88a4c818c5abb34e9b7-dirty | 5e7efa90aabc372c3617bd3f8b7208688ac51f13-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2024-04-04 06:32:08 | 2024-04-04 10:33:43 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------------+---------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------+
++---------++----------+----------+--------++----------+----------+--------+----------------------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++---------++----------+----------+--------++----------+----------+--------+----------------------+
+| 01 || 348.31 | 313.87 | -10%˄ || 2.87 | 3.18 | +11%˄ | (run time too short) |
+| 03 || 43.81 | 35.82 | -18%˄ || 22.79 | 27.85 | +22%˄ | (run time too short) |
+| 06 || 204.71 | 206.32 | +1%˄ || 4.88 | 4.84 | -1%˄ | (run time too short) |
+| 07 || 249.35 | 252.64 | +1%˄ || 4.01 | 3.96 | -1%˄ | (run time too short) |
+| 09 || 121.97 | 121.73 | -0%˄ || 8.19 | 8.21 | +0%˄ | (run time too short) |
+| 10 || 37.83 | 39.18 | +4%˄ || 26.39 | 25.48 | -3%˄ | (run time too short) |
+| 13 || 314.22 | 325.43 | +4%˄ || 3.18 | 3.07 | -3%˄ | (run time too short) |
+| 15 || 79.55 | 81.07 | +2%˄ || 12.55 | 12.32 | -2%˄ | (run time too short) |
+| 16 || 37.86 | 37.46 | -1%˄ || 26.37 | 26.65 | +1%˄ | (run time too short) |
+| 17 || 157.92 | 160.06 | +1%˄ || 6.33 | 6.24 | -1%˄ | (run time too short) |
+| 19 || 80.31 | 81.58 | +2%˄ || 12.44 | 12.25 | -2%˄ | (run time too short) |
+| 25 || 121.18 | 124.64 | +3%˄ || 8.24 | 8.02 | -3%˄ | (run time too short) |
+| 26 || 132.69 | 134.12 | +1%˄ || 7.53 | 7.45 | -1%˄ | (run time too short) |
+| 28 || 168.18 | 168.25 | +0%˄ || 5.94 | 5.94 | -0%˄ | (run time too short) |
+| 29 || 449.87 | 457.30 | +2%˄ || 2.22 | 2.19 | -2%˄ | (run time too short) |
+| 31 || 665.91 | 634.64 | -5%˄ || 1.50 | 1.58 | +5%˄ | (run time too short) |
+| 32 || 31.04 | 30.52 | -2%˄ || 32.11 | 32.64 | +2%˄ | (run time too short) |
+| 34 || 102.90 | 103.98 | +1%˄ || 9.71 | 9.61 | -1%˄ | (run time too short) |
+| 35 || 569.39 | 555.27 | -2%˄ || 1.76 | 1.80 | +3%˄ | (run time too short) |
+| 37 || 217.38 | 222.81 | +2%˄ || 4.60 | 4.49 | -2%˄ | (run time too short) |
+| 39a || 1106.82 | 1075.21 | -3%˄ || 0.90 | 0.93 | +3%˄ | (run time too short) |
+| 39b || 1159.11 | 1028.70 | -11%˄ || 0.86 | 0.97 | +13%˄ | (run time too short) |
+| 41 || 568.90 | 604.70 | +6%˄ || 1.76 | 1.65 | -6%˄ | (run time too short) |
+| 42 || 55.59 | 55.12 | -1%˄ || 17.97 | 18.11 | +1%˄ | (run time too short) |
+| 43 || 611.13 | 606.53 | -1%˄ || 1.64 | 1.65 | +1%˄ | (run time too short) |
+| 45 || 64.82 | 66.26 | +2%˄ || 15.41 | 15.08 | -2%˄ | (run time too short) |
+| 48 || 558.97 | 552.81 | -1%˄ || 1.79 | 1.81 | +1%˄ | (run time too short) |
+| 50 || 126.69 | 125.27 | -1%˄ || 7.89 | 7.98 | +1%˄ | (run time too short) |
+| 52 || 56.65 | 58.50 | +3%˄ || 17.63 | 17.07 | -3%˄ | (run time too short) |
+| 55 || 49.80 | 50.30 | +1%˄ || 20.05 | 19.85 | -1%˄ | (run time too short) |
+| 62 || 448.47 | 461.77 | +3%˄ || 2.23 | 2.16 | -3%˄ | (run time too short) |
+| 65 || 2522.95 | 2303.19 | -9% || 0.40 | 0.43 | +10% | 0.0002 |
+| 69 || 81.11 | 80.31 | -1%˄ || 12.32 | 12.44 | +1%˄ | (run time too short) |
+| 73 || 62.11 | 61.03 | -2%˄ || 16.08 | 16.36 | +2%˄ | (run time too short) |
+| 79 || 738.64 | 740.34 | +0%˄ || 1.35 | 1.35 | -0%˄ | (run time too short) |
+| 81 || 252.01 | 232.49 | -8%˄ || 3.97 | 4.30 | +8%˄ | (run time too short) |
+| 82 || 242.27 | 247.56 | +2%˄ || 4.13 | 4.04 | -2%˄ | (run time too short) |
+| 83 || 48.54 | 48.78 | +0%˄ || 20.55 | 20.46 | -0%˄ | (run time too short) |
+| 85 || 70.92 | 70.55 | -1%˄ || 14.08 | 14.15 | +1%˄ | (run time too short) |
+| 88 || 72.20 | 72.49 | +0%˄ || 13.83 | 13.78 | -0%˄ | (run time too short) |
+| 91 || 16.74 | 16.87 | +1%˄ || 59.50 | 58.98 | -1%˄ | (run time too short) |
+| 92 || 51.47 | 49.71 | -3%˄ || 19.37 | 20.05 | +4%˄ | (run time too short) |
+| 93 || 1020.28 | 1025.99 | +1%˄ || 0.98 | 0.97 | -1%˄ | (run time too short) |
+| 94 || 35.18 | 37.21 | +6%˄ || 28.38 | 26.82 | -5%˄ | (run time too short) |
+| 95 || 953.40 | 953.15 | -0%˄ || 1.05 | 1.05 | +0%˄ | (run time too short) |
+| 96 || 50.20 | 54.54 | +9%˄ || 19.89 | 18.30 | -8%˄ | (run time too short) |
+| 97 || 2306.95 | 2058.05 | -11% || 0.43 | 0.49 | +12% | 0.0000 |
+| 99 || 828.69 | 873.37 | +5%˄ || 1.21 | 1.14 | -5%˄ | (run time too short) |
++---------++----------+----------+--------++----------+----------+--------+----------------------+
+| Sum || 18294.95 | 17697.54 | -3% || | | | |
+| Geomean || | | || | | +1% | |
++---------++----------+----------+--------++----------+----------+--------+----------------------+
+| Notes || ˄ Execution stopped due to max runs reached |
++---------++----------+----------+--------++----------+----------+--------+----------------------+
hyriseBenchmarkTPCDS - multi-threaded, shuffled, 64 clients, 64 cores
Sum of avg. item runtimes: +2% || Geometric mean of throughput changes: -2%
Configuration Overview - click to expand
+Configuration Overview---------+-------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCDS_8783047e4e0ff8b49ba8c88a4c818c5abb34e9b7_mt.json | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCDS_5e7efa90aabc372c3617bd3f8b7208688ac51f13_mt.json |
+-------------------------------+-------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 8783047e4e0ff8b49ba8c88a4c818c5abb34e9b7-dirty | 5e7efa90aabc372c3617bd3f8b7208688ac51f13-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 64 | 64 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2024-04-04 06:47:27 | 2024-04-04 10:48:55 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+-------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------+
++---------++----------+----------+--------++----------+----------+--------+---------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++---------++----------+----------+--------++----------+----------+--------+---------+
+| 01 || 692.18 | 902.71 | +30% || 1.00 | 0.97 | -2% | 0.0004 |
+| 03 || 318.12 | 303.95 | -4% || 1.00 | 0.97 | -2% | 0.6938 |
+| 06 || 1024.78 | 972.62 | -5% || 0.99 | 0.97 | -2% | 0.4670 |
+| 07 || 908.36 | 1031.77 | +14% || 0.99 | 0.97 | -2% | 0.0478 |
+| 09 || 898.63 | 925.10 | +3% || 0.99 | 0.97 | -2% | 0.6893 |
+| 10 || 862.02 | 818.32 | -5% || 0.99 | 0.97 | -2% | 0.5318 |
+| 13 || 1842.51 | 1915.20 | +4% || 0.99 | 0.97 | -2% | 0.4590 |
+| 15 || 517.32 | 593.36 | +15% || 0.99 | 0.97 | -2% | 0.1617 |
+| 16 || 534.68 | 517.73 | -3% || 0.99 | 0.97 | -2% | 0.7586 |
+| 17 || 1407.49 | 1556.05 | +11% || 0.99 | 0.97 | -2% | 0.1168 |
+| 19 || 738.60 | 654.54 | -11% || 0.99 | 0.97 | -2% | 0.1406 |
+| 25 || 1127.59 | 1230.87 | +9% || 0.99 | 0.97 | -2% | 0.1945 |
+| 26 || 479.95 | 554.37 | +16% || 0.99 | 0.97 | -2% | 0.0827 |
+| 28 || 1650.89 | 1637.74 | -1% || 0.99 | 0.97 | -2% | 0.8940 |
+| 29 || 1797.54 | 1962.68 | +9% || 0.99 | 0.97 | -2% | 0.0946 |
+| 31 || 2793.27 | 2962.09 | +6% || 0.99 | 0.97 | -2% | 0.1814 |
+| 32 || 193.66 | 228.16 | +18% || 0.99 | 0.97 | -2% | 0.4524 |
+| 34 || 840.31 | 683.94 | -19% || 0.99 | 0.97 | -2% | 0.0033 |
+| 35 || 2391.26 | 2354.08 | -2% || 0.99 | 0.97 | -2% | 0.7245 |
+| 37 || 901.70 | 841.23 | -7% || 0.99 | 0.97 | -2% | 0.2780 |
+| 39a || 2935.14 | 2942.79 | +0% || 0.99 | 0.97 | -2% | 0.9364 |
+| 39b || 2740.81 | 3002.77 | +10% || 0.99 | 0.97 | -2% | 0.0068 |
+| 41 || 2167.80 | 2253.09 | +4% || 0.99 | 0.97 | -2% | 0.4069 |
+| 42 || 518.12 | 526.91 | +2% || 1.00 | 0.97 | -2% | 0.8546 |
+| 43 || 1529.00 | 1564.43 | +2% || 0.99 | 0.97 | -2% | 0.6537 |
+| 45 || 801.27 | 961.54 | +20% || 1.00 | 0.97 | -2% | 0.0244 |
+| 48 || 2756.84 | 2610.20 | -5% || 0.99 | 0.97 | -2% | 0.1616 |
+| 50 || 1026.08 | 1129.16 | +10% || 1.00 | 0.97 | -2% | 0.1275 |
+| 52 || 502.38 | 514.15 | +2% || 1.00 | 0.97 | -2% | 0.8056 |
+| 55 || 464.72 | 473.35 | +2% || 0.99 | 0.97 | -2% | 0.8559 |
+| 62 || 1100.07 | 1039.01 | -6% || 0.99 | 0.97 | -2% | 0.2627 |
+| 65 || 4561.60 | 4430.10 | -3% || 0.99 | 0.97 | -2% | 0.0726 |
+| 69 || 1075.37 | 1110.71 | +3% || 0.99 | 0.97 | -2% | 0.6763 |
+| 73 || 504.55 | 565.24 | +12% || 0.99 | 0.97 | -2% | 0.2284 |
+| 79 || 1559.55 | 1627.66 | +4% || 0.99 | 0.97 | -2% | 0.3343 |
+| 81 || 651.19 | 746.36 | +15% || 0.99 | 0.97 | -2% | 0.0736 |
+| 82 || 1086.82 | 1066.02 | -2% || 0.99 | 0.97 | -2% | 0.7446 |
+| 83 || 319.72 | 390.17 | +22% || 0.99 | 0.97 | -2% | 0.1561 |
+| 85 || 1011.26 | 873.05 | -14% || 0.99 | 0.97 | -2% | 0.0540 |
+| 88 || 2885.30 | 2873.87 | -0% || 0.99 | 0.97 | -2% | 0.9332 |
+| 91 || 191.72 | 212.65 | +11% || 1.00 | 0.97 | -2% | 0.5334 |
+| 92 || 340.83 | 356.07 | +4% || 1.00 | 0.97 | -2% | 0.7389 |
+| 93 || 2209.76 | 2329.10 | +5% || 0.99 | 0.97 | -2% | 0.1613 |
+| 94 || 452.27 | 454.42 | +0% || 0.99 | 0.97 | -2% | 0.9630 |
+| 95 || 2437.37 | 2285.66 | -6% || 0.99 | 0.97 | -2% | 0.1036 |
+| 96 || 448.23 | 448.07 | -0% || 0.99 | 0.97 | -2% | 0.9972 |
+| 97 || 4545.53 | 4643.09 | +2% || 0.99 | 0.97 | -2% | 0.3745 |
+| 99 || 1380.68 | 1442.16 | +4% || 0.99 | 0.97 | -2% | 0.3209 |
++---------++----------+----------+--------++----------+----------+--------+---------+
+| Sum || 64124.84 | 65518.31 | +2% || | | | |
+| Geomean || | | || | | -2% | |
++---------++----------+----------+--------++----------+----------+--------+---------+
hyriseBenchmarkTPCC - single-threaded
Sum of avg. item runtimes: +1% || Geometric mean of throughput changes: +4%
Configuration Overview - click to expand
+Configuration Overview---+------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCC_8783047e4e0ff8b49ba8c88a4c818c5abb34e9b7_st.json | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCC_5e7efa90aabc372c3617bd3f8b7208688ac51f13_st.json |
+-------------------------+------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 8783047e4e0ff8b49ba8c88a4c818c5abb34e9b7-dirty | 5e7efa90aabc372c3617bd3f8b7208688ac51f13-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2024-04-04 07:08:00 | 2024-04-04 11:09:24 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10 | 10 |
| time_unit | ns | ns |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------+------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------+
++--------------++----------+---------+--------++----------+----------+--------+----------------------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++--------------++----------+---------+--------++----------+----------+--------+----------------------+
+| Delivery || 65.66 | 66.58 | +1% || 1.58 | 1.67 | +5% | (run time too short) |
+| New-Order || 44.83 | 45.37 | +1% || 16.80 | 16.28 | -3% | 0.3877 |
+| Order-Status || 2.29 | 2.26 | -1% || 1.48 | 1.78 | +20% | (run time too short) |
+| Payment || 8.37 | 8.30 | -1% || 15.88 | 16.86 | +6% | 0.2179 |
+| Stock-Level || 3.74 | 3.68 | -2% || 1.57 | 1.45 | -7% | (run time too short) |
++--------------++----------+---------+--------++----------+----------+--------+----------------------+
+| Sum || 124.88 | 126.19 | +1% || | | | |
+| Geomean || | | || | | +4% | |
++--------------++----------+---------+--------++----------+----------+--------+----------------------+
hyriseBenchmarkTPCC - multi-threaded, shuffled, 64 clients, 10 warehouses, 64 cores (high contention)
Sum of avg. item runtimes: +1% || Geometric mean of throughput changes: -1%
Configuration Overview - click to expand
+Configuration Overview---------+---------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCC_8783047e4e0ff8b49ba8c88a4c818c5abb34e9b7_mt_highcont.json | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCC_5e7efa90aabc372c3617bd3f8b7208688ac51f13_mt_highcont.json |
+-------------------------------+---------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 8783047e4e0ff8b49ba8c88a4c818c5abb34e9b7-dirty | 5e7efa90aabc372c3617bd3f8b7208688ac51f13-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 64 | 64 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2024-04-04 07:09:09 | 2024-04-04 11:10:33 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 600000000000 | 600000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10 | 10 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+---------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------+
++--------------++----------+---------+--------++----------+----------+--------+---------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++--------------++----------+---------+--------++----------+----------+--------+---------+
+| Delivery || 362.88 | 366.73 | +1% || 16.50 | 16.31 | -1% | 0.0189 |
+| unsucc.: || 4.47 | 4.53 | +1% || 23.65 | 23.21 | -2% | |
+| New-Order || 223.36 | 224.63 | +1% || 210.60 | 208.47 | -1% | 0.0012 |
+| unsucc.: || 11.18 | 12.14 | +9% || 239.14 | 239.68 | +0% | |
+| Order-Status || 15.76 | 16.20 | +3% || 39.85 | 39.89 | +0% | 0.0951 |
+| Payment || 36.74 | 36.86 | +0% || 108.90 | 108.19 | -1% | 0.4404 |
+| unsucc.: || 8.13 | 8.10 | -0% || 320.31 | 320.46 | +0% | |
+| Stock-Level || 22.25 | 22.18 | -0% || 40.03 | 39.24 | -2% | 0.8776 |
++--------------++----------+---------+--------++----------+----------+--------+---------+
+| Sum || 660.99 | 666.60 | +1% || | | | |
+| Geomean || | | || | | -1% | |
++--------------++----------+---------+--------++----------+----------+--------+---------+
hyriseBenchmarkTPCC - multi-threaded, shuffled, 10 clients, 10 warehouses, 64 cores (low contention)
Sum of avg. item runtimes: -0% || Geometric mean of throughput changes: -0%
Configuration Overview - click to expand
+Configuration Overview---------+--------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCC_8783047e4e0ff8b49ba8c88a4c818c5abb34e9b7_mt_lowcont.json | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCC_5e7efa90aabc372c3617bd3f8b7208688ac51f13_mt_lowcont.json |
+-------------------------------+--------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 8783047e4e0ff8b49ba8c88a4c818c5abb34e9b7-dirty | 5e7efa90aabc372c3617bd3f8b7208688ac51f13-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 10 | 10 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2024-04-04 07:19:21 | 2024-04-04 11:20:46 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 600000000000 | 600000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10 | 10 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+--------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------+
++--------------++----------+---------+--------++----------+----------+--------+---------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++--------------++----------+---------+--------++----------+----------+--------+---------+
+| Delivery || 140.91 | 141.00 | +0% || 7.26 | 7.22 | -1% | 0.5223 |
+| unsucc.: || 0.78 | 0.97 | +24% || 0.74 | 0.72 | -2% | |
+| New-Order || 91.93 | 91.45 | -1% || 80.76 | 81.30 | +1% | 0.0070 |
+| unsucc.: || 6.82 | 8.04 | +18% || 8.70 | 8.88 | +2% | |
+| Order-Status || 5.99 | 5.96 | -0% || 7.81 | 7.87 | +1% | 0.2916 |
+| Payment || 19.04 | 18.85 | -1% || 69.75 | 69.59 | -0% | 0.0000 |
+| unsucc.: || 2.38 | 2.34 | -1% || 16.03 | 16.18 | +1% | |
+| Stock-Level || 8.55 | 8.59 | +0% || 8.02 | 7.90 | -1% | 0.0610 |
++--------------++----------+---------+--------++----------+----------+--------+---------+
+| Sum || 266.41 | 265.85 | -0% || | | | |
+| Geomean || | | || | | -0% | |
++--------------++----------+---------+--------++----------+----------+--------+---------+
hyriseBenchmarkJoinOrder - single-threaded
Sum of avg. item runtimes: +2% || Geometric mean of throughput changes: -1%
Configuration Overview - click to expand
+Configuration Overview---+-----------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkJoinOrder_8783047e4e0ff8b49ba8c88a4c818c5abb34e9b7_st.json | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkJoinOrder_5e7efa90aabc372c3617bd3f8b7208688ac51f13_st.json |
+-------------------------+-----------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 8783047e4e0ff8b49ba8c88a4c818c5abb34e9b7-dirty | 5e7efa90aabc372c3617bd3f8b7208688ac51f13-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2024-04-04 07:29:31 | 2024-04-04 11:30:56 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| time_unit | ns | ns |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------+-----------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------+
++---------++----------+----------+--------++----------+----------+--------+----------------------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++---------++----------+----------+--------++----------+----------+--------+----------------------+
+| 10a || 124.84 | 121.35 | -3%˄ || 8.01 | 8.24 | +3%˄ | (run time too short) |
+| 10b || 88.50 | 79.24 | -10%˄ || 11.30 | 12.62 | +12%˄ | (run time too short) |
+| 10c || 444.02 | 447.74 | +1%˄ || 2.25 | 2.23 | -1%˄ | (run time too short) |
+| 11a || 135.07 | 134.17 | -1%˄ || 7.40 | 7.45 | +1%˄ | (run time too short) |
+| 11b || 130.18 | 128.86 | -1%˄ || 7.68 | 7.76 | +1%˄ | (run time too short) |
+| 11c || 29.37 | 30.26 | +3%˄ || 34.02 | 33.03 | -3%˄ | (run time too short) |
+| 11d || 32.12 | 32.95 | +3%˄ || 31.11 | 30.33 | -3%˄ | (run time too short) |
+| 12a || 42.04 | 41.85 | -0%˄ || 23.78 | 23.88 | +0%˄ | (run time too short) |
+| 12b || 33.88 | 33.69 | -1%˄ || 29.50 | 29.67 | +1%˄ | (run time too short) |
+| 12c || 107.53 | 108.01 | +0%˄ || 9.30 | 9.26 | -0%˄ | (run time too short) |
+| 13a || 239.26 | 243.82 | +2%˄ || 4.18 | 4.10 | -2%˄ | (run time too short) |
+| 13b || 291.90 | 292.77 | +0%˄ || 3.43 | 3.42 | -0%˄ | (run time too short) |
+| 13c || 232.42 | 231.83 | -0%˄ || 4.30 | 4.31 | +0%˄ | (run time too short) |
+| 13d || 626.90 | 638.00 | +2%˄ || 1.60 | 1.57 | -2%˄ | (run time too short) |
+| 14a || 143.81 | 145.56 | +1%˄ || 6.95 | 6.87 | -1%˄ | (run time too short) |
+| 14b || 141.66 | 144.22 | +2%˄ || 7.06 | 6.93 | -2%˄ | (run time too short) |
+| 14c || 252.28 | 247.71 | -2%˄ || 3.96 | 4.04 | +2%˄ | (run time too short) |
+| 15a || 63.15 | 63.10 | -0%˄ || 15.83 | 15.84 | +0%˄ | (run time too short) |
+| 15b || 68.71 | 67.59 | -2%˄ || 14.55 | 14.79 | +2%˄ | (run time too short) |
+| 15c || 52.24 | 51.64 | -1%˄ || 19.13 | 19.36 | +1%˄ | (run time too short) |
+| 15d || 50.27 | 50.47 | +0%˄ || 19.89 | 19.81 | -0%˄ | (run time too short) |
+| 16a || 1943.15 | 1968.84 | +1% || 0.51 | 0.51 | -1% | 0.0002 |
+| 16b || 3256.03 | 3344.90 | +3% || 0.31 | 0.30 | -3% | 0.0087 |
+| 16c || 2152.72 | 2185.12 | +2% || 0.46 | 0.46 | -1% | 0.0000 |
+| 16d || 2113.02 | 2145.28 | +2% || 0.47 | 0.47 | -2% | 0.0000 |
+| 17a || 760.81 | 817.21 | +7%˄ || 1.31 | 1.22 | -7%˄ | (run time too short) |
+| 17b || 634.42 | 700.04 | +10%˄ || 1.58 | 1.43 | -9%˄ | (run time too short) |
+| 17c || 608.31 | 665.22 | +9%˄ || 1.64 | 1.50 | -9%˄ | (run time too short) |
+| 17d || 672.49 | 724.80 | +8%˄ || 1.49 | 1.38 | -7%˄ | (run time too short) |
+| 17e || 2206.84 | 2208.86 | +0% || 0.45 | 0.45 | -0% | 0.6958 |
+| 17f || 1265.31 | 1309.29 | +3% || 0.79 | 0.76 | -3% | 0.0000 |
+| 18a || 151.83 | 153.33 | +1%˄ || 6.59 | 6.52 | -1%˄ | (run time too short) |
+| 18b || 143.09 | 143.33 | +0%˄ || 6.99 | 6.98 | -0%˄ | (run time too short) |
+| 18c || 291.50 | 293.80 | +1%˄ || 3.43 | 3.40 | -1%˄ | (run time too short) |
+| 19a || 272.14 | 272.57 | +0%˄ || 3.67 | 3.67 | -0%˄ | (run time too short) |
+| 19b || 231.96 | 231.95 | -0%˄ || 4.31 | 4.31 | +0%˄ | (run time too short) |
+| 19c || 317.74 | 320.15 | +1%˄ || 3.15 | 3.12 | -1%˄ | (run time too short) |
+| 19d || 829.97 | 827.53 | -0%˄ || 1.20 | 1.21 | +0%˄ | (run time too short) |
+| 1a || 13.61 | 13.66 | +0%˄ || 73.36 | 73.12 | -0%˄ | (run time too short) |
+| 1b || 22.38 | 21.47 | -4%˄ || 44.64 | 46.53 | +4%˄ | (run time too short) |
+| 1c || 19.61 | 20.37 | +4%˄ || 50.94 | 49.05 | -4%˄ | (run time too short) |
+| 1d || 12.95 | 12.94 | -0%˄ || 77.10 | 77.20 | +0%˄ | (run time too short) |
+| 20a || 765.70 | 776.74 | +1%˄ || 1.31 | 1.29 | -1%˄ | (run time too short) |
+| 20b || 794.32 | 799.71 | +1%˄ || 1.26 | 1.25 | -1%˄ | (run time too short) |
+| 20c || 470.00 | 474.37 | +1%˄ || 2.13 | 2.11 | -1%˄ | (run time too short) |
+| 21a || 149.47 | 147.87 | -1%˄ || 6.69 | 6.76 | +1%˄ | (run time too short) |
+| 21b || 136.67 | 137.11 | +0%˄ || 7.32 | 7.29 | -0%˄ | (run time too short) |
+| 21c || 142.89 | 142.77 | -0%˄ || 7.00 | 7.00 | +0%˄ | (run time too short) |
+| 22a || 231.98 | 234.25 | +1%˄ || 4.31 | 4.27 | -1%˄ | (run time too short) |
+| 22b || 212.25 | 213.94 | +1%˄ || 4.71 | 4.67 | -1%˄ | (run time too short) |
+| 22c || 317.02 | 314.96 | -1%˄ || 3.15 | 3.17 | +1%˄ | (run time too short) |
+| 22d || 482.95 | 490.93 | +2%˄ || 2.07 | 2.04 | -2%˄ | (run time too short) |
+| 23a || 56.54 | 57.28 | +1%˄ || 17.68 | 17.45 | -1%˄ | (run time too short) |
+| 23b || 72.37 | 72.15 | -0%˄ || 13.81 | 13.86 | +0%˄ | (run time too short) |
+| 23c || 61.34 | 62.88 | +3%˄ || 16.30 | 15.90 | -2%˄ | (run time too short) |
+| 24a || 233.21 | 238.15 | +2%˄ || 4.29 | 4.20 | -2%˄ | (run time too short) |
+| 24b || 224.89 | 226.74 | +1%˄ || 4.45 | 4.41 | -1%˄ | (run time too short) |
+| 25a || 153.33 | 155.79 | +2%˄ || 6.52 | 6.42 | -2%˄ | (run time too short) |
+| 25b || 87.61 | 87.70 | +0%˄ || 11.41 | 11.40 | -0%˄ | (run time too short) |
+| 25c || 355.79 | 359.05 | +1%˄ || 2.81 | 2.78 | -1%˄ | (run time too short) |
+| 26a || 266.47 | 267.72 | +0%˄ || 3.75 | 3.73 | -0%˄ | (run time too short) |
+| 26b || 229.98 | 229.66 | -0%˄ || 4.35 | 4.35 | +0%˄ | (run time too short) |
+| 26c || 444.30 | 450.55 | +1%˄ || 2.25 | 2.22 | -1%˄ | (run time too short) |
+| 27a || 140.07 | 139.55 | -0%˄ || 7.14 | 7.17 | +0%˄ | (run time too short) |
+| 27b || 121.68 | 122.32 | +1%˄ || 8.22 | 8.17 | -1%˄ | (run time too short) |
+| 27c || 143.01 | 142.24 | -1%˄ || 6.99 | 7.03 | +1%˄ | (run time too short) |
+| 28a || 258.42 | 259.68 | +0%˄ || 3.87 | 3.85 | -0%˄ | (run time too short) |
+| 28b || 93.25 | 96.35 | +3%˄ || 10.72 | 10.38 | -3%˄ | (run time too short) |
+| 28c || 234.99 | 236.33 | +1%˄ || 4.26 | 4.23 | -1%˄ | (run time too short) |
+| 29a || 184.85 | 185.85 | +1%˄ || 5.41 | 5.38 | -1%˄ | (run time too short) |
+| 29b || 874.46 | 868.04 | -1%˄ || 1.14 | 1.15 | +1%˄ | (run time too short) |
+| 29c || 239.85 | 241.85 | +1%˄ || 4.17 | 4.13 | -1%˄ | (run time too short) |
+| 2a || 44.18 | 46.39 | +5%˄ || 22.62 | 21.55 | -5%˄ | (run time too short) |
+| 2b || 39.73 | 42.85 | +8%˄ || 25.16 | 23.33 | -7%˄ | (run time too short) |
+| 2c || 34.50 | 36.55 | +6%˄ || 28.97 | 27.34 | -6%˄ | (run time too short) |
+| 2d || 86.58 | 90.25 | +4%˄ || 11.55 | 11.08 | -4%˄ | (run time too short) |
+| 30a || 129.76 | 133.88 | +3%˄ || 7.71 | 7.47 | -3%˄ | (run time too short) |
+| 30b || 129.82 | 136.10 | +5%˄ || 7.70 | 7.35 | -5%˄ | (run time too short) |
+| 30c || 229.86 | 233.50 | +2%˄ || 4.35 | 4.28 | -2%˄ | (run time too short) |
+| 31a || 108.99 | 109.53 | +0%˄ || 9.17 | 9.13 | -0%˄ | (run time too short) |
+| 31b || 105.70 | 106.54 | +1%˄ || 9.46 | 9.38 | -1%˄ | (run time too short) |
+| 31c || 121.36 | 121.62 | +0%˄ || 8.24 | 8.22 | -0%˄ | (run time too short) |
+| 32a || 23.35 | 23.26 | -0%˄ || 42.80 | 42.95 | +0%˄ | (run time too short) |
+| 32b || 51.85 | 56.70 | +9%˄ || 19.28 | 17.63 | -9%˄ | (run time too short) |
+| 33a || 45.50 | 46.18 | +1%˄ || 21.97 | 21.65 | -1%˄ | (run time too short) |
+| 33b || 27.70 | 28.21 | +2%˄ || 36.08 | 35.43 | -2%˄ | (run time too short) |
+| 33c || 59.33 | 59.66 | +1%˄ || 16.85 | 16.76 | -1%˄ | (run time too short) |
+| 3a || 101.43 | 102.45 | +1%˄ || 9.86 | 9.76 | -1%˄ | (run time too short) |
+| 3b || 22.05 | 22.97 | +4%˄ || 45.32 | 43.49 | -4%˄ | (run time too short) |
+| 3c || 295.43 | 297.56 | +1%˄ || 3.38 | 3.36 | -1%˄ | (run time too short) |
+| 4a || 197.64 | 196.51 | -1%˄ || 5.06 | 5.09 | +1%˄ | (run time too short) |
+| 4b || 20.64 | 21.30 | +3%˄ || 48.41 | 46.91 | -3%˄ | (run time too short) |
+| 4c || 251.76 | 250.59 | -0%˄ || 3.97 | 3.99 | +0%˄ | (run time too short) |
+| 5a || 64.47 | 66.02 | +2%˄ || 15.51 | 15.14 | -2%˄ | (run time too short) |
+| 5b || 61.10 | 61.71 | +1%˄ || 16.36 | 16.20 | -1%˄ | (run time too short) |
+| 5c || 112.71 | 113.12 | +0%˄ || 8.87 | 8.84 | -0%˄ | (run time too short) |
+| 6a || 221.76 | 223.63 | +1%˄ || 4.51 | 4.47 | -1%˄ | (run time too short) |
+| 6b || 240.79 | 241.05 | +0%˄ || 4.15 | 4.15 | -0%˄ | (run time too short) |
+| 6c || 208.97 | 209.44 | +0%˄ || 4.78 | 4.77 | -0%˄ | (run time too short) |
+| 6d || 565.00 | 609.13 | +8%˄ || 1.77 | 1.64 | -7%˄ | (run time too short) |
+| 6e || 218.10 | 220.25 | +1%˄ || 4.58 | 4.54 | -1%˄ | (run time too short) |
+| 6f || 1056.63 | 1086.90 | +3%˄ || 0.95 | 0.92 | -3%˄ | (run time too short) |
+| 7a || 94.96 | 94.37 | -1%˄ || 10.53 | 10.59 | +1%˄ | (run time too short) |
+| 7b || 85.83 | 85.48 | -0%˄ || 11.65 | 11.70 | +0%˄ | (run time too short) |
+| 7c || 743.00 | 732.85 | -1%˄ || 1.35 | 1.36 | +1%˄ | (run time too short) |
+| 8a || 188.25 | 189.83 | +1%˄ || 5.31 | 5.27 | -1%˄ | (run time too short) |
+| 8b || 181.22 | 181.99 | +0%˄ || 5.52 | 5.49 | -0%˄ | (run time too short) |
+| 8c || 2244.26 | 2279.07 | +2% || 0.45 | 0.44 | -2% | 0.0000 |
+| 8d || 362.83 | 367.66 | +1%˄ || 2.76 | 2.72 | -1%˄ | (run time too short) |
+| 9a || 326.65 | 328.34 | +1%˄ || 3.06 | 3.05 | -1%˄ | (run time too short) |
+| 9b || 214.67 | 215.91 | +1%˄ || 4.66 | 4.63 | -1%˄ | (run time too short) |
+| 9c || 348.57 | 353.09 | +1%˄ || 2.87 | 2.83 | -1%˄ | (run time too short) |
+| 9d || 569.29 | 575.06 | +1%˄ || 1.76 | 1.74 | -1%˄ | (run time too short) |
++---------++----------+----------+--------++----------+----------+--------+----------------------+
+| Sum || 39665.89 | 40345.50 | +2% || | | | |
+| Geomean || | | || | | -1% | |
++---------++----------+----------+--------++----------+----------+--------+----------------------+
+| Notes || ˄ Execution stopped due to max runs reached |
++---------++----------+----------+--------++----------+----------+--------+----------------------+
hyriseBenchmarkJoinOrder - multi-threaded, ordered, 1 client, 64 cores
Sum of avg. item runtimes: +0% || Geometric mean of throughput changes: -0%
Configuration Overview - click to expand
+Configuration Overview---------+-------------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkJoinOrder_8783047e4e0ff8b49ba8c88a4c818c5abb34e9b7_mt_ordered.json | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkJoinOrder_5e7efa90aabc372c3617bd3f8b7208688ac51f13_mt_ordered.json |
+-------------------------------+-------------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 8783047e4e0ff8b49ba8c88a4c818c5abb34e9b7-dirty | 5e7efa90aabc372c3617bd3f8b7208688ac51f13-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2024-04-04 07:59:47 | 2024-04-04 12:01:36 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------------+-------------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------------+
++---------++----------+----------+--------++----------+----------+--------+----------------------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++---------++----------+----------+--------++----------+----------+--------+----------------------+
+| 10a || 41.03 | 40.91 | -0%˄ || 24.33 | 24.39 | +0%˄ | (run time too short) |
+| 10b || 19.13 | 19.25 | +1%˄ || 52.14 | 51.81 | -1%˄ | (run time too short) |
+| 10c || 138.30 | 139.88 | +1%˄ || 7.22 | 7.14 | -1%˄ | (run time too short) |
+| 11a || 25.73 | 24.69 | -4%˄ || 38.78 | 40.38 | +4%˄ | (run time too short) |
+| 11b || 21.65 | 21.56 | -0%˄ || 46.08 | 46.27 | +0%˄ | (run time too short) |
+| 11c || 23.73 | 23.68 | -0%˄ || 42.00 | 42.09 | +0%˄ | (run time too short) |
+| 11d || 29.28 | 29.81 | +2%˄ || 34.04 | 33.42 | -2%˄ | (run time too short) |
+| 12a || 26.13 | 26.55 | +2%˄ || 38.16 | 37.55 | -2%˄ | (run time too short) |
+| 12b || 12.86 | 14.00 | +9%˄ || 77.44 | 71.10 | -8%˄ | (run time too short) |
+| 12c || 61.51 | 60.47 | -2%˄ || 16.23 | 16.51 | +2%˄ | (run time too short) |
+| 13a || 186.98 | 188.42 | +1%˄ || 5.34 | 5.30 | -1%˄ | (run time too short) |
+| 13b || 108.03 | 107.31 | -1%˄ || 9.25 | 9.31 | +1%˄ | (run time too short) |
+| 13c || 89.81 | 85.31 | -5%˄ || 11.12 | 11.71 | +5%˄ | (run time too short) |
+| 13d || 581.99 | 590.00 | +1%˄ || 1.72 | 1.69 | -1%˄ | (run time too short) |
+| 14a || 71.81 | 71.92 | +0%˄ || 13.91 | 13.89 | -0%˄ | (run time too short) |
+| 14b || 87.56 | 87.68 | +0%˄ || 11.41 | 11.39 | -0%˄ | (run time too short) |
+| 14c || 176.45 | 176.73 | +0%˄ || 5.66 | 5.65 | -0%˄ | (run time too short) |
+| 15a || 34.00 | 33.07 | -3%˄ || 29.33 | 30.16 | +3%˄ | (run time too short) |
+| 15b || 26.85 | 25.99 | -3%˄ || 37.13 | 38.38 | +3%˄ | (run time too short) |
+| 15c || 25.38 | 24.89 | -2%˄ || 39.32 | 40.09 | +2%˄ | (run time too short) |
+| 15d || 31.74 | 32.00 | +1%˄ || 31.45 | 31.20 | -1%˄ | (run time too short) |
+| 16a || 912.30 | 927.54 | +2%˄ || 1.10 | 1.08 | -2%˄ | (run time too short) |
+| 16b || 2538.13 | 2498.56 | -2% || 0.39 | 0.40 | +2% | 0.0789 |
+| 16c || 1163.07 | 1166.92 | +0%˄ || 0.86 | 0.86 | -0%˄ | (run time too short) |
+| 16d || 1101.18 | 1117.54 | +1%˄ || 0.91 | 0.89 | -1%˄ | (run time too short) |
+| 17a || 249.27 | 254.15 | +2%˄ || 4.01 | 3.93 | -2%˄ | (run time too short) |
+| 17b || 189.96 | 199.86 | +5%˄ || 5.26 | 5.00 | -5%˄ | (run time too short) |
+| 17c || 161.88 | 169.57 | +5%˄ || 6.17 | 5.89 | -5%˄ | (run time too short) |
+| 17d || 139.19 | 145.34 | +4%˄ || 7.18 | 6.88 | -4%˄ | (run time too short) |
+| 17e || 1140.15 | 1132.27 | -1%˄ || 0.88 | 0.88 | +1%˄ | (run time too short) |
+| 17f || 483.17 | 488.42 | +1%˄ || 2.07 | 2.05 | -1%˄ | (run time too short) |
+| 18a || 60.01 | 60.68 | +1%˄ || 16.64 | 16.45 | -1%˄ | (run time too short) |
+| 18b || 62.07 | 61.36 | -1%˄ || 16.09 | 16.28 | +1%˄ | (run time too short) |
+| 18c || 114.45 | 113.90 | -0%˄ || 8.73 | 8.77 | +0%˄ | (run time too short) |
+| 19a || 110.56 | 110.64 | +0%˄ || 9.04 | 9.03 | -0%˄ | (run time too short) |
+| 19b || 69.35 | 69.09 | -0%˄ || 14.40 | 14.46 | +0%˄ | (run time too short) |
+| 19c || 142.81 | 143.43 | +0%˄ || 7.00 | 6.97 | -0%˄ | (run time too short) |
+| 19d || 901.22 | 887.44 | -2%˄ || 1.11 | 1.13 | +2%˄ | (run time too short) |
+| 1a || 7.93 | 7.48 | -6%˄ || 124.73 | 132.90 | +7%˄ | (run time too short) |
+| 1b || 5.25 | 5.12 | -2%˄ || 188.68 | 193.48 | +3%˄ | (run time too short) |
+| 1c || 4.41 | 4.53 | +3%˄ || 224.38 | 218.25 | -3%˄ | (run time too short) |
+| 1d || 6.17 | 6.12 | -1%˄ || 160.83 | 162.09 | +1%˄ | (run time too short) |
+| 20a || 93.43 | 91.85 | -2%˄ || 10.69 | 10.88 | +2%˄ | (run time too short) |
+| 20b || 74.04 | 76.96 | +4%˄ || 13.49 | 12.98 | -4%˄ | (run time too short) |
+| 20c || 90.82 | 91.85 | +1%˄ || 11.00 | 10.88 | -1%˄ | (run time too short) |
+| 21a || 31.94 | 31.67 | -1%˄ || 31.24 | 31.51 | +1%˄ | (run time too short) |
+| 21b || 26.74 | 26.58 | -1%˄ || 37.31 | 37.54 | +1%˄ | (run time too short) |
+| 21c || 34.30 | 34.14 | -0%˄ || 29.09 | 29.23 | +0%˄ | (run time too short) |
+| 22a || 90.70 | 92.49 | +2%˄ || 11.02 | 10.80 | -2%˄ | (run time too short) |
+| 22b || 70.89 | 66.97 | -6%˄ || 14.09 | 14.91 | +6%˄ | (run time too short) |
+| 22c || 155.59 | 158.56 | +2%˄ || 6.42 | 6.30 | -2%˄ | (run time too short) |
+| 22d || 255.72 | 263.98 | +3%˄ || 3.91 | 3.79 | -3%˄ | (run time too short) |
+| 23a || 19.24 | 19.35 | +1%˄ || 51.81 | 51.52 | -1%˄ | (run time too short) |
+| 23b || 30.26 | 30.18 | -0%˄ || 32.96 | 33.04 | +0%˄ | (run time too short) |
+| 23c || 22.42 | 22.12 | -1%˄ || 44.49 | 45.08 | +1%˄ | (run time too short) |
+| 24a || 64.12 | 63.77 | -1%˄ || 15.58 | 15.66 | +1%˄ | (run time too short) |
+| 24b || 62.75 | 65.47 | +4%˄ || 15.91 | 15.25 | -4%˄ | (run time too short) |
+| 25a || 71.53 | 71.23 | -0%˄ || 13.97 | 14.02 | +0%˄ | (run time too short) |
+| 25b || 39.06 | 38.85 | -1%˄ || 25.55 | 25.69 | +1%˄ | (run time too short) |
+| 25c || 220.91 | 221.66 | +0%˄ || 4.52 | 4.51 | -0%˄ | (run time too short) |
+| 26a || 96.42 | 101.83 | +6%˄ || 10.36 | 9.81 | -5%˄ | (run time too short) |
+| 26b || 70.13 | 69.93 | -0%˄ || 14.24 | 14.28 | +0%˄ | (run time too short) |
+| 26c || 155.86 | 156.70 | +1%˄ || 6.41 | 6.38 | -1%˄ | (run time too short) |
+| 27a || 28.06 | 27.21 | -3%˄ || 35.55 | 36.66 | +3%˄ | (run time too short) |
+| 27b || 26.60 | 26.89 | +1%˄ || 37.50 | 37.08 | -1%˄ | (run time too short) |
+| 27c || 33.18 | 32.81 | -1%˄ || 30.07 | 30.41 | +1%˄ | (run time too short) |
+| 28a || 155.88 | 154.65 | -1%˄ || 6.41 | 6.46 | +1%˄ | (run time too short) |
+| 28b || 34.84 | 34.76 | -0%˄ || 28.65 | 28.71 | +0%˄ | (run time too short) |
+| 28c || 136.90 | 136.46 | -0%˄ || 7.30 | 7.32 | +0%˄ | (run time too short) |
+| 29a || 59.69 | 60.74 | +2%˄ || 16.73 | 16.43 | -2%˄ | (run time too short) |
+| 29b || 212.65 | 172.84 | -19%˄ || 4.70 | 5.78 | +23%˄ | (run time too short) |
+| 29c || 70.96 | 71.02 | +0%˄ || 14.07 | 14.06 | -0%˄ | (run time too short) |
+| 2a || 28.47 | 29.06 | +2%˄ || 35.06 | 34.35 | -2%˄ | (run time too short) |
+| 2b || 24.71 | 24.78 | +0%˄ || 40.39 | 40.26 | -0%˄ | (run time too short) |
+| 2c || 17.08 | 17.45 | +2%˄ || 58.35 | 57.13 | -2%˄ | (run time too short) |
+| 2d || 67.39 | 66.98 | -1%˄ || 14.78 | 14.88 | +1%˄ | (run time too short) |
+| 30a || 60.06 | 61.07 | +2%˄ || 16.63 | 16.35 | -2%˄ | (run time too short) |
+| 30b || 45.55 | 46.30 | +2%˄ || 21.91 | 21.56 | -2%˄ | (run time too short) |
+| 30c || 144.81 | 142.33 | -2%˄ || 6.90 | 7.02 | +2%˄ | (run time too short) |
+| 31a || 45.32 | 45.63 | +1%˄ || 22.02 | 21.88 | -1%˄ | (run time too short) |
+| 31b || 40.25 | 40.40 | +0%˄ || 24.80 | 24.70 | -0%˄ | (run time too short) |
+| 31c || 50.37 | 50.99 | +1%˄ || 19.82 | 19.58 | -1%˄ | (run time too short) |
+| 32a || 7.86 | 8.22 | +5%˄ || 126.43 | 120.81 | -4%˄ | (run time too short) |
+| 32b || 38.98 | 39.52 | +1%˄ || 25.61 | 25.27 | -1%˄ | (run time too short) |
+| 33a || 13.10 | 12.91 | -1%˄ || 75.98 | 77.10 | +1%˄ | (run time too short) |
+| 33b || 10.08 | 10.23 | +1%˄ || 98.62 | 97.20 | -1%˄ | (run time too short) |
+| 33c || 22.04 | 22.08 | +0%˄ || 45.24 | 45.16 | -0%˄ | (run time too short) |
+| 3a || 47.72 | 47.78 | +0%˄ || 20.91 | 20.89 | -0%˄ | (run time too short) |
+| 3b || 8.03 | 7.96 | -1%˄ || 123.74 | 124.82 | +1%˄ | (run time too short) |
+| 3c || 89.00 | 89.87 | +1%˄ || 11.22 | 11.12 | -1%˄ | (run time too short) |
+| 4a || 77.10 | 77.07 | -0%˄ || 12.95 | 12.96 | +0%˄ | (run time too short) |
+| 4b || 6.34 | 6.16 | -3%˄ || 156.68 | 161.30 | +3%˄ | (run time too short) |
+| 4c || 98.99 | 100.60 | +2%˄ || 10.09 | 9.93 | -2%˄ | (run time too short) |
+| 5a || 31.02 | 31.08 | +0%˄ || 32.16 | 32.11 | -0%˄ | (run time too short) |
+| 5b || 24.73 | 24.52 | -1%˄ || 40.34 | 40.69 | +1%˄ | (run time too short) |
+| 5c || 59.63 | 59.56 | -0%˄ || 16.75 | 16.77 | +0%˄ | (run time too short) |
+| 6a || 28.07 | 28.72 | +2%˄ || 35.54 | 34.74 | -2%˄ | (run time too short) |
+| 6b || 56.77 | 56.98 | +0%˄ || 17.59 | 17.52 | -0%˄ | (run time too short) |
+| 6c || 26.93 | 26.91 | -0%˄ || 37.01 | 37.04 | +0%˄ | (run time too short) |
+| 6d || 156.61 | 164.13 | +5%˄ || 6.38 | 6.09 | -5%˄ | (run time too short) |
+| 6e || 28.72 | 29.80 | +4%˄ || 34.74 | 33.47 | -4%˄ | (run time too short) |
+| 6f || 727.49 | 749.30 | +3%˄ || 1.37 | 1.33 | -3%˄ | (run time too short) |
+| 7a || 26.93 | 26.82 | -0%˄ || 37.04 | 37.20 | +0%˄ | (run time too short) |
+| 7b || 28.01 | 28.13 | +0%˄ || 35.61 | 35.47 | -0%˄ | (run time too short) |
+| 7c || 354.04 | 358.55 | +1%˄ || 2.82 | 2.79 | -1%˄ | (run time too short) |
+| 8a || 39.29 | 39.30 | +0%˄ || 25.40 | 25.39 | -0%˄ | (run time too short) |
+| 8b || 36.15 | 36.30 | +0%˄ || 27.60 | 27.49 | -0%˄ | (run time too short) |
+| 8c || 1812.96 | 1809.51 | -0% || 0.55 | 0.55 | +0% | 0.8668 |
+| 8d || 322.74 | 320.82 | -1%˄ || 3.10 | 3.12 | +1%˄ | (run time too short) |
+| 9a || 160.85 | 169.75 | +6%˄ || 6.21 | 5.89 | -5%˄ | (run time too short) |
+| 9b || 95.53 | 95.89 | +0%˄ || 10.46 | 10.42 | -0%˄ | (run time too short) |
+| 9c || 178.89 | 178.16 | -0%˄ || 5.59 | 5.61 | +0%˄ | (run time too short) |
+| 9d || 592.05 | 598.72 | +1%˄ || 1.69 | 1.67 | -1%˄ | (run time too short) |
++---------++----------+----------+--------++----------+----------+--------+----------------------+
+| Sum || 19648.81 | 19687.90 | +0% || | | | |
+| Geomean || | | || | | -0% | |
++---------++----------+----------+--------++----------+----------+--------+----------------------+
+| Notes || ˄ Execution stopped due to max runs reached |
++---------++----------+----------+--------++----------+----------+--------+----------------------+
hyriseBenchmarkJoinOrder - multi-threaded, shuffled, 64 clients, 64 cores
Sum of avg. item runtimes: +0% || Geometric mean of throughput changes: -0%
Configuration Overview - click to expand
+Configuration Overview---------+-----------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkJoinOrder_8783047e4e0ff8b49ba8c88a4c818c5abb34e9b7_mt.json | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkJoinOrder_5e7efa90aabc372c3617bd3f8b7208688ac51f13_mt.json |
+-------------------------------+-----------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 8783047e4e0ff8b49ba8c88a4c818c5abb34e9b7-dirty | 5e7efa90aabc372c3617bd3f8b7208688ac51f13-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 64 | 64 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2024-04-04 08:17:50 | 2024-04-04 12:19:47 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+-----------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------+
++---------++----------+----------+--------++----------+----------+--------+---------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++---------++----------+----------+--------++----------+----------+--------+---------+
+| 10a || 251.04 | 223.33 | -11% || 1.12 | 1.11 | -0% | 0.2749 |
+| 10b || 157.89 | 177.81 | +13% || 1.12 | 1.12 | -0% | 0.3448 |
+| 10c || 692.42 | 643.85 | -7% || 1.12 | 1.12 | -0% | 0.2241 |
+| 11a || 162.19 | 141.42 | -13% || 1.12 | 1.11 | -0% | 0.3463 |
+| 11b || 120.34 | 108.62 | -10% || 1.12 | 1.12 | -0% | 0.4632 |
+| 11c || 114.45 | 106.57 | -7% || 1.12 | 1.12 | -0% | 0.6288 |
+| 11d || 111.11 | 118.30 | +6% || 1.12 | 1.11 | -0% | 0.6349 |
+| 12a || 184.18 | 175.39 | -5% || 1.12 | 1.12 | -0% | 0.6482 |
+| 12b || 113.36 | 102.12 | -10% || 1.12 | 1.11 | -0% | 0.5146 |
+| 12c || 398.75 | 416.21 | +4% || 1.12 | 1.11 | -0% | 0.5680 |
+| 13a || 539.49 | 507.75 | -6% || 1.12 | 1.11 | -0% | 0.3240 |
+| 13b || 425.82 | 414.99 | -3% || 1.12 | 1.11 | -0% | 0.7410 |
+| 13c || 379.69 | 367.05 | -3% || 1.12 | 1.12 | -0% | 0.6805 |
+| 13d || 995.89 | 983.99 | -1% || 1.12 | 1.11 | -0% | 0.7367 |
+| 14a || 494.61 | 504.65 | +2% || 1.12 | 1.11 | -0% | 0.7790 |
+| 14b || 505.82 | 432.92 | -14% || 1.12 | 1.11 | -0% | 0.0226 |
+| 14c || 666.75 | 623.02 | -7% || 1.12 | 1.11 | -0% | 0.2365 |
+| 15a || 143.79 | 136.50 | -5% || 1.12 | 1.12 | -0% | 0.6605 |
+| 15b || 148.96 | 129.23 | -13% || 1.12 | 1.11 | -0% | 0.3025 |
+| 15c || 149.20 | 141.39 | -5% || 1.12 | 1.11 | -0% | 0.6238 |
+| 15d || 176.80 | 174.42 | -1% || 1.12 | 1.12 | -0% | 0.8958 |
+| 16a || 1793.49 | 1834.84 | +2% || 1.12 | 1.11 | -0% | 0.4123 |
+| 16b || 3313.63 | 3437.57 | +4% || 1.11 | 1.11 | -0% | 0.0217 |
+| 16c || 2028.57 | 2032.50 | +0% || 1.12 | 1.11 | -0% | 0.9350 |
+| 16d || 1985.13 | 1997.54 | +1% || 1.11 | 1.11 | -0% | 0.7988 |
+| 17a || 949.69 | 947.42 | -0% || 1.12 | 1.11 | -0% | 0.9576 |
+| 17b || 701.64 | 704.31 | +0% || 1.12 | 1.11 | -0% | 0.9407 |
+| 17c || 652.37 | 704.13 | +8% || 1.12 | 1.11 | -0% | 0.1880 |
+| 17d || 696.31 | 662.66 | -5% || 1.12 | 1.11 | -0% | 0.4057 |
+| 17e || 1827.31 | 1843.13 | +1% || 1.12 | 1.11 | -0% | 0.7393 |
+| 17f || 1259.76 | 1259.23 | -0% || 1.12 | 1.11 | -0% | 0.9911 |
+| 18a || 282.37 | 316.15 | +12% || 1.12 | 1.12 | -0% | 0.1853 |
+| 18b || 425.81 | 502.71 | +18% || 1.12 | 1.11 | -0% | 0.0462 |
+| 18c || 718.95 | 726.77 | +1% || 1.12 | 1.11 | -0% | 0.8513 |
+| 19a || 657.52 | 609.92 | -7% || 1.12 | 1.11 | -0% | 0.2322 |
+| 19b || 415.17 | 423.42 | +2% || 1.12 | 1.11 | -0% | 0.7796 |
+| 19c || 712.70 | 663.88 | -7% || 1.12 | 1.11 | -0% | 0.2099 |
+| 19d || 1594.27 | 1595.93 | +0% || 1.12 | 1.11 | -0% | 0.9740 |
+| 1a || 56.19 | 36.31 | -35% || 1.12 | 1.11 | -0% | 0.0229 |
+| 1b || 53.58 | 57.97 | +8% || 1.12 | 1.11 | -0% | 0.6460 |
+| 1c || 56.44 | 74.91 | +33% || 1.12 | 1.11 | -0% | 0.0711 |
+| 1d || 45.29 | 40.75 | -10% || 1.12 | 1.12 | -0% | 0.5593 |
+| 20a || 477.19 | 496.83 | +4% || 1.12 | 1.11 | -0% | 0.5270 |
+| 20b || 466.58 | 456.98 | -2% || 1.12 | 1.11 | -0% | 0.7782 |
+| 20c || 451.08 | 408.01 | -10% || 1.12 | 1.11 | -0% | 0.1447 |
+| 21a || 220.61 | 217.29 | -2% || 1.12 | 1.11 | -0% | 0.8919 |
+| 21b || 147.98 | 146.56 | -1% || 1.12 | 1.11 | -0% | 0.9339 |
+| 21c || 251.42 | 259.57 | +3% || 1.12 | 1.11 | -0% | 0.7698 |
+| 22a || 517.36 | 551.12 | +7% || 1.12 | 1.11 | -0% | 0.3398 |
+| 22b || 523.87 | 450.55 | -14% || 1.12 | 1.11 | -0% | 0.0530 |
+| 22c || 710.45 | 769.01 | +8% || 1.12 | 1.11 | -0% | 0.1323 |
+| 22d || 1032.09 | 1049.79 | +2% || 1.12 | 1.11 | -0% | 0.7129 |
+| 23a || 169.63 | 166.93 | -2% || 1.12 | 1.11 | -0% | 0.8846 |
+| 23b || 112.77 | 149.09 | +32% || 1.12 | 1.11 | -0% | 0.0299 |
+| 23c || 184.70 | 208.81 | +13% || 1.12 | 1.11 | -0% | 0.2565 |
+| 24a || 457.31 | 483.01 | +6% || 1.12 | 1.12 | -0% | 0.5072 |
+| 24b || 358.58 | 365.75 | +2% || 1.12 | 1.11 | -0% | 0.8238 |
+| 25a || 476.07 | 466.43 | -2% || 1.12 | 1.11 | -0% | 0.7759 |
+| 25b || 236.28 | 260.62 | +10% || 1.12 | 1.11 | -0% | 0.3853 |
+| 25c || 1015.76 | 1028.65 | +1% || 1.12 | 1.11 | -0% | 0.7884 |
+| 26a || 444.85 | 438.17 | -1% || 1.12 | 1.11 | -0% | 0.8163 |
+| 26b || 298.37 | 296.69 | -1% || 1.12 | 1.11 | -0% | 0.9447 |
+| 26c || 683.65 | 663.09 | -3% || 1.12 | 1.11 | -0% | 0.5424 |
+| 27a || 223.07 | 210.80 | -5% || 1.12 | 1.11 | -0% | 0.6195 |
+| 27b || 212.58 | 195.77 | -8% || 1.12 | 1.11 | -0% | 0.4770 |
+| 27c || 222.44 | 255.99 | +15% || 1.12 | 1.11 | -0% | 0.2100 |
+| 28a || 733.79 | 747.98 | +2% || 1.12 | 1.11 | -0% | 0.7297 |
+| 28b || 361.26 | 269.97 | -25% || 1.12 | 1.12 | -0% | 0.0018 |
+| 28c || 688.17 | 761.04 | +11% || 1.12 | 1.11 | -0% | 0.0905 |
+| 29a || 290.90 | 294.70 | +1% || 1.12 | 1.11 | -0% | 0.8731 |
+| 29b || 391.35 | 377.79 | -3% || 1.12 | 1.11 | -0% | 0.6487 |
+| 29c || 398.45 | 394.15 | -1% || 1.12 | 1.11 | -0% | 0.8910 |
+| 2a || 134.00 | 160.23 | +20% || 1.12 | 1.11 | -0% | 0.0629 |
+| 2b || 129.22 | 129.20 | -0% || 1.12 | 1.11 | -0% | 0.9990 |
+| 2c || 101.42 | 108.19 | +7% || 1.12 | 1.11 | -0% | 0.5801 |
+| 2d || 268.73 | 249.90 | -7% || 1.12 | 1.12 | -0% | 0.3633 |
+| 30a || 425.82 | 360.42 | -15% || 1.12 | 1.11 | -0% | 0.0305 |
+| 30b || 409.56 | 400.14 | -2% || 1.12 | 1.12 | -0% | 0.7766 |
+| 30c || 688.99 | 696.09 | +1% || 1.12 | 1.11 | -0% | 0.8481 |
+| 31a || 347.62 | 317.42 | -9% || 1.12 | 1.11 | -0% | 0.3578 |
+| 31b || 287.81 | 345.86 | +20% || 1.12 | 1.12 | -0% | 0.0603 |
+| 31c || 405.36 | 361.93 | -11% || 1.12 | 1.11 | -0% | 0.1799 |
+| 32a || 60.98 | 49.05 | -20% || 1.12 | 1.11 | -0% | 0.3375 |
+| 32b || 160.77 | 197.79 | +23% || 1.12 | 1.12 | -0% | 0.0287 |
+| 33a || 160.48 | 152.03 | -5% || 1.12 | 1.11 | -0% | 0.6968 |
+| 33b || 86.75 | 118.58 | +37% || 1.12 | 1.11 | -0% | 0.0222 |
+| 33c || 203.91 | 193.15 | -5% || 1.12 | 1.11 | -0% | 0.6410 |
+| 3a || 309.72 | 310.00 | +0% || 1.12 | 1.11 | -0% | 0.9925 |
+| 3b || 101.12 | 101.06 | -0% || 1.12 | 1.12 | -0% | 0.9969 |
+| 3c || 547.24 | 533.56 | -2% || 1.12 | 1.11 | -0% | 0.7435 |
+| 4a || 305.81 | 317.41 | +4% || 1.12 | 1.11 | -0% | 0.6358 |
+| 4b || 76.13 | 59.87 | -21% || 1.12 | 1.11 | -0% | 0.2063 |
+| 4c || 370.13 | 369.31 | -0% || 1.12 | 1.11 | -0% | 0.9766 |
+| 5a || 253.65 | 251.66 | -1% || 1.12 | 1.11 | -0% | 0.9404 |
+| 5b || 168.59 | 158.53 | -6% || 1.12 | 1.11 | -0% | 0.5654 |
+| 5c || 404.81 | 386.14 | -5% || 1.12 | 1.11 | -0% | 0.5905 |
+| 6a || 163.45 | 144.49 | -12% || 1.12 | 1.11 | -0% | 0.2444 |
+| 6b || 213.72 | 197.78 | -7% || 1.12 | 1.12 | -0% | 0.3282 |
+| 6c || 124.31 | 126.75 | +2% || 1.12 | 1.11 | -0% | 0.8733 |
+| 6d || 572.72 | 575.67 | +1% || 1.12 | 1.12 | -0% | 0.9210 |
+| 6e || 152.28 | 154.56 | +1% || 1.12 | 1.11 | -0% | 0.8995 |
+| 6f || 1280.25 | 1258.63 | -2% || 1.12 | 1.11 | -0% | 0.5276 |
+| 7a || 159.88 | 196.58 | +23% || 1.12 | 1.11 | -0% | 0.0593 |
+| 7b || 169.10 | 185.72 | +10% || 1.12 | 1.11 | -0% | 0.4613 |
+| 7c || 1166.01 | 1171.47 | +0% || 1.12 | 1.11 | -0% | 0.9021 |
+| 8a || 267.32 | 230.79 | -14% || 1.12 | 1.12 | -0% | 0.1495 |
+| 8b || 217.34 | 198.25 | -9% || 1.12 | 1.12 | -0% | 0.3648 |
+| 8c || 2457.62 | 2554.48 | +4% || 1.12 | 1.11 | -0% | 0.0502 |
+| 8d || 718.19 | 709.12 | -1% || 1.12 | 1.11 | -0% | 0.7782 |
+| 9a || 772.72 | 742.58 | -4% || 1.12 | 1.11 | -0% | 0.4804 |
+| 9b || 519.96 | 518.52 | -0% || 1.12 | 1.11 | -0% | 0.9672 |
+| 9c || 694.09 | 746.50 | +8% || 1.12 | 1.11 | -0% | 0.1595 |
+| 9d || 1162.38 | 1244.44 | +7% || 1.12 | 1.11 | -0% | 0.0696 |
++---------++----------+----------+--------++----------+----------+--------+---------+
+| Sum || 57137.32 | 57226.57 | +0% || | | | |
+| Geomean || | | || | | -0% | |
++---------++----------+----------+--------++----------+----------+--------+---------+
hyriseBenchmarkStarSchema - single-threaded
Sum of avg. item runtimes: +3% || Geometric mean of throughput changes: -5%
Configuration Overview - click to expand
+Configuration Overview---+------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkStarSchema_8783047e4e0ff8b49ba8c88a4c818c5abb34e9b7_st.json | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkStarSchema_5e7efa90aabc372c3617bd3f8b7208688ac51f13_st.json |
+-------------------------+------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 8783047e4e0ff8b49ba8c88a4c818c5abb34e9b7-dirty | 5e7efa90aabc372c3617bd3f8b7208688ac51f13-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2024-04-04 08:38:22 | 2024-04-04 12:40:19 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------+------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------+
++---------++----------+----------+--------++----------+----------+--------+----------------------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++---------++----------+----------+--------++----------+----------+--------+----------------------+
+| 1.1 || 503.62 | 497.23 | -1%˄ || 1.99 | 2.01 | +1%˄ | (run time too short) |
+| 1.2 || 266.14 | 262.21 | -1%˄ || 3.76 | 3.81 | +1%˄ | (run time too short) |
+| 1.3 || 253.56 | 247.78 | -2%˄ || 3.94 | 4.04 | +2%˄ | (run time too short) |
+| 2.1 || 830.56 | 897.66 | +8%˄ || 1.20 | 1.11 | -7%˄ | (run time too short) |
+| 2.2 || 443.72 | 447.11 | +1%˄ || 2.25 | 2.24 | -1%˄ | (run time too short) |
+| 2.3 || 262.55 | 261.26 | -0%˄ || 3.81 | 3.83 | +0%˄ | (run time too short) |
+| 3.1 || 3266.95 | 3340.86 | +2% || 0.31 | 0.30 | -2% | 0.0093 |
+| 3.2 || 426.20 | 490.69 | +15%˄ || 2.35 | 2.04 | -13%˄ | (run time too short) |
+| 3.3 || 162.70 | 174.85 | +7%˄ || 6.15 | 5.72 | -7%˄ | (run time too short) |
+| 3.4 || 131.75 | 162.12 | +23%˄ || 7.59 | 6.17 | -19%˄ | (run time too short) |
+| 4.1 || 3671.60 | 3660.18 | -0% || 0.27 | 0.27 | +0% | 0.8286 |
+| 4.2 || 1094.41 | 1167.47 | +7%˄ || 0.91 | 0.86 | -6%˄ | (run time too short) |
+| 4.3 || 318.42 | 382.38 | +20%˄ || 3.14 | 2.62 | -17%˄ | (run time too short) |
++---------++----------+----------+--------++----------+----------+--------+----------------------+
+| Sum || 11632.17 | 11991.80 | +3% || | | | |
+| Geomean || | | || | | -5% | |
++---------++----------+----------+--------++----------+----------+--------+----------------------+
+| Notes || ˄ Execution stopped due to max runs reached |
++---------++----------+----------+--------++----------+----------+--------+----------------------+
hyriseBenchmarkStarSchema - multi-threaded, ordered, 1 client, 64 cores
Sum of avg. item runtimes: +1% || Geometric mean of throughput changes: -2%
Configuration Overview - click to expand
+Configuration Overview---------+--------------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkStarSchema_8783047e4e0ff8b49ba8c88a4c818c5abb34e9b7_mt_ordered.json | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkStarSchema_5e7efa90aabc372c3617bd3f8b7208688ac51f13_mt_ordered.json |
+-------------------------------+--------------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 8783047e4e0ff8b49ba8c88a4c818c5abb34e9b7-dirty | 5e7efa90aabc372c3617bd3f8b7208688ac51f13-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2024-04-04 08:45:07 | 2024-04-04 12:47:17 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------------+--------------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------------+
++---------++----------+---------+--------++----------+----------+--------+----------------------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++---------++----------+---------+--------++----------+----------+--------+----------------------+
+| 1.1 || 135.36 | 132.26 | -2%˄ || 7.38 | 7.55 | +2%˄ | (run time too short) |
+| 1.2 || 92.21 | 89.61 | -3%˄ || 10.83 | 11.15 | +3%˄ | (run time too short) |
+| 1.3 || 89.82 | 88.06 | -2%˄ || 11.12 | 11.34 | +2%˄ | (run time too short) |
+| 2.1 || 405.25 | 419.96 | +4%˄ || 2.47 | 2.38 | -4%˄ | (run time too short) |
+| 2.2 || 193.71 | 198.89 | +3%˄ || 5.16 | 5.03 | -3%˄ | (run time too short) |
+| 2.3 || 71.97 | 71.01 | -1%˄ || 13.88 | 14.06 | +1%˄ | (run time too short) |
+| 3.1 || 1183.77 | 1136.35 | -4%˄ || 0.84 | 0.88 | +4%˄ | (run time too short) |
+| 3.2 || 184.77 | 196.95 | +7%˄ || 5.41 | 5.07 | -6%˄ | (run time too short) |
+| 3.3 || 87.63 | 89.29 | +2%˄ || 11.40 | 11.19 | -2%˄ | (run time too short) |
+| 3.4 || 80.37 | 81.94 | +2%˄ || 12.43 | 12.19 | -2%˄ | (run time too short) |
+| 4.1 || 999.77 | 1002.91 | +0%˄ || 1.00 | 1.00 | -0%˄ | (run time too short) |
+| 4.2 || 419.20 | 447.45 | +7%˄ || 2.38 | 2.23 | -6%˄ | (run time too short) |
+| 4.3 || 115.07 | 130.90 | +14%˄ || 8.68 | 7.63 | -12%˄ | (run time too short) |
++---------++----------+---------+--------++----------+----------+--------+----------------------+
+| Sum || 4058.89 | 4085.59 | +1% || | | | |
+| Geomean || | | || | | -2% | |
++---------++----------+---------+--------++----------+----------+--------+----------------------+
+| Notes || ˄ Execution stopped due to max runs reached |
++---------++----------+---------+--------++----------+----------+--------+----------------------+
hyriseBenchmarkStarSchema - multi-threaded, shuffled, 64 clients, 64 cores
Sum of avg. item runtimes: +1% || Geometric mean of throughput changes: -0%
Configuration Overview - click to expand
+Configuration Overview---------+------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkStarSchema_8783047e4e0ff8b49ba8c88a4c818c5abb34e9b7_mt.json | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkStarSchema_5e7efa90aabc372c3617bd3f8b7208688ac51f13_mt.json |
+-------------------------------+------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 8783047e4e0ff8b49ba8c88a4c818c5abb34e9b7-dirty | 5e7efa90aabc372c3617bd3f8b7208688ac51f13-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 64 | 64 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2024-04-04 08:49:18 | 2024-04-04 12:51:29 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------+
++---------++----------+----------+--------++----------+----------+--------+---------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++---------++----------+----------+--------++----------+----------+--------+---------+
+| 1.1 || 886.13 | 893.14 | +1% || 3.58 | 3.57 | -0% | 0.7592 |
+| 1.2 || 484.45 | 496.03 | +2% || 3.58 | 3.57 | -0% | 0.4721 |
+| 1.3 || 440.59 | 439.27 | -0% || 3.58 | 3.57 | -0% | 0.9272 |
+| 2.1 || 2228.11 | 2250.49 | +1% || 3.58 | 3.56 | -0% | 0.5771 |
+| 2.2 || 1168.60 | 1169.69 | +0% || 3.58 | 3.57 | -0% | 0.9684 |
+| 2.3 || 385.00 | 396.28 | +3% || 3.58 | 3.57 | -0% | 0.4361 |
+| 3.1 || 3456.81 | 3452.71 | -0% || 3.57 | 3.56 | -0% | 0.9162 |
+| 3.2 || 1068.97 | 1097.49 | +3% || 3.58 | 3.57 | -0% | 0.2845 |
+| 3.3 || 535.29 | 542.60 | +1% || 3.58 | 3.57 | -0% | 0.6981 |
+| 3.4 || 494.11 | 522.45 | +6% || 3.58 | 3.57 | -0% | 0.1191 |
+| 4.1 || 3240.39 | 3228.44 | -0% || 3.57 | 3.56 | -0% | 0.7513 |
+| 4.2 || 2613.44 | 2618.97 | +0% || 3.58 | 3.56 | -0% | 0.8885 |
+| 4.3 || 810.72 | 802.53 | -1% || 3.58 | 3.57 | -0% | 0.7212 |
++---------++----------+----------+--------++----------+----------+--------+---------+
+| Sum || 17812.61 | 17910.10 | +1% || | | | |
+| Geomean || | | || | | -0% | |
++---------++----------+----------+--------++----------+----------+--------+---------+
~I am waiting for the DELab which might still be down for a couple of days.~
Nobody knows when it's coming back.
Intel - Nemea
System
nemea - click to expand
| property | value |
|---|---|
| Hostname | nemea |
| CPU | Intel(R) Xeon(R) Platinum 8180 CPU @ 2.50GHz |
| Memory | 627GB |
| numactl | nodebind: 3 |
| numactl | membind: 3 |
Commit Info and Build Time
| commit | date | message | build time |
|---|---|---|---|
| 43b228e1b | 03.05.2024 12:47 | Add ABS function (#2641) |
real 340.83 user 3282.00 sys 110.65 |
| 556e8941a | 03.05.2024 11:13 | Merge branch 'master' into martiin/perf/aggregate_output | real 358.51 user 3288.82 sys 112.21 |
hyriseBenchmarkTPCH - single-threaded, SF 10.0
Sum of avg. item runtimes: -1% || Geometric mean of throughput changes: +1%
Configuration Overview - click to expand
+Configuration Overview----+-----------------------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /home/Martin.Boissier/hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCH_43b228e1bc09ffbd5956577684cb99d0e060df1c_st.json | /home/Martin.Boissier/hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCH_556e8941a1168263ed4aedb7bf6bb4aaf25e8e28_st.json |
+--------------------------+-----------------------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 43b228e1bc09ffbd5956577684cb99d0e060df1c-dirty | 556e8941a1168263ed4aedb7bf6bb4aaf25e8e28-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| clustering | None | None |
| compiler | clang 15.0.7 | clang 15.0.7 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2024-05-05 23:09:02 | 2024-05-06 02:48:04 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| use_prepared_statements | False | False |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+--------------------------+-----------------------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------+
+----------++----------+----------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+----------++----------+----------+--------++----------+----------+--------+----------------------+
| TPC-H 01 || 6499.71 | 6421.73 | -1% || 0.15 | 0.16 | +1% | 0.5867 |
| TPC-H 02 || 49.64 | 48.93 | -1%˄ || 20.14 | 20.43 | +1%˄ | (run time too short) |
| TPC-H 03 || 1320.45 | 1332.59 | +1% || 0.76 | 0.75 | -1% | 0.4410 |
+| TPC-H 04 || 1399.07 | 1330.07 | -5% || 0.71 | 0.75 | +5% | 0.0006 |
| TPC-H 05 || 2217.48 | 2211.98 | -0% || 0.45 | 0.45 | +0% | 0.7011 |
| TPC-H 06 || 159.77 | 154.79 | -3%˄ || 6.26 | 6.46 | +3%˄ | (run time too short) |
| TPC-H 07 || 833.44 | 823.48 | -1%˄ || 1.20 | 1.21 | +1%˄ | (run time too short) |
| TPC-H 08 || 515.98 | 525.45 | +2%˄ || 1.94 | 1.90 | -2%˄ | (run time too short) |
| TPC-H 09 || 5097.73 | 5115.40 | +0% || 0.20 | 0.20 | -0% | 0.5663 |
+| TPC-H 10 || 1730.98 | 1277.14 | -26% || 0.58 | 0.78 | +36% | 0.0000 |
| TPC-H 11 || 64.99 | 62.97 | -3%˄ || 15.39 | 15.88 | +3%˄ | (run time too short) |
| TPC-H 12 || 927.89 | 932.86 | +1%˄ || 1.08 | 1.07 | -1%˄ | (run time too short) |
| TPC-H 13 || 5048.13 | 4918.39 | -3% || 0.20 | 0.20 | +3% | 0.0184 |
| TPC-H 14 || 414.49 | 413.34 | -0%˄ || 2.41 | 2.42 | +0%˄ | (run time too short) |
+| TPC-H 15 || 195.72 | 186.93 | -4%˄ || 5.11 | 5.35 | +5%˄ | (run time too short) |
| TPC-H 16 || 551.87 | 553.78 | +0%˄ || 1.81 | 1.81 | -0%˄ | (run time too short) |
| TPC-H 17 || 222.62 | 223.99 | +1%˄ || 4.49 | 4.46 | -1%˄ | (run time too short) |
-| TPC-H 18 || 1658.21 | 1858.42 | +12% || 0.60 | 0.54 | -11% | 0.0000 |
| TPC-H 19 || 217.53 | 213.99 | -2%˄ || 4.60 | 4.67 | +2%˄ | (run time too short) |
-| TPC-H 20 || 491.05 | 556.23 | +13%˄ || 2.04 | 1.80 | -12%˄ | (run time too short) |
-| TPC-H 21 || 3794.57 | 3968.33 | +5% || 0.26 | 0.25 | -4% | 0.0017 |
| TPC-H 22 || 440.06 | 434.99 | -1%˄ || 2.27 | 2.30 | +1%˄ | (run time too short) |
+----------++----------+----------+--------++----------+----------+--------+----------------------+
| Sum || 33851.37 | 33565.78 | -1% || | | | |
| Geomean || | | || | | +1% | |
+----------++----------+----------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+----------++----------+----------+--------++----------+----------+--------+----------------------+
hyriseBenchmarkTPCH - single-threaded, SF 0.01
Sum of avg. item runtimes: +1% || Geometric mean of throughput changes: +1%
Configuration Overview - click to expand
+Configuration Overview----+---------------------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /home/Martin.Boissier/hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCH_43b228e1bc09ffbd5956577684cb99d0e060df1c_st_s01.json | /home/Martin.Boissier/hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCH_556e8941a1168263ed4aedb7bf6bb4aaf25e8e28_st_s01.json |
+--------------------------+---------------------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 43b228e1bc09ffbd5956577684cb99d0e060df1c-dirty | 556e8941a1168263ed4aedb7bf6bb4aaf25e8e28-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| clustering | None | None |
| compiler | clang 15.0.7 | clang 15.0.7 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2024-05-05 23:24:47 | 2024-05-06 03:03:59 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| scale_factor | 0.009999999776482582 | 0.009999999776482582 |
| time_unit | ns | ns |
| use_prepared_statements | False | False |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+--------------------------+---------------------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------+
+----------++----------+---------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+----------++----------+---------+--------++----------+----------+--------+----------------------+
| TPC-H 01 || 5.22 | 5.28 | +1%˄ || 191.40 | 189.29 | -1%˄ | (run time too short) |
+| TPC-H 02 || 4.32 | 3.85 | -11%˄ || 231.46 | 259.66 | +12%˄ | (run time too short) |
| TPC-H 03 || 0.56 | 0.58 | +3%˄ || 1779.37 | 1725.93 | -3%˄ | (run time too short) |
| TPC-H 04 || 0.43 | 0.44 | +3%˄ || 2346.09 | 2280.88 | -3%˄ | (run time too short) |
| TPC-H 05 || 1.01 | 1.05 | +4%˄ || 989.06 | 946.77 | -4%˄ | (run time too short) |
| TPC-H 06 || 0.18 | 0.18 | +0%˄ || 5594.45 | 5580.32 | -0%˄ | (run time too short) |
| TPC-H 07 || 11.47 | 11.52 | +0%˄ || 87.18 | 86.80 | -0%˄ | (run time too short) |
| TPC-H 08 || 16.12 | 16.53 | +3%˄ || 62.03 | 60.48 | -2%˄ | (run time too short) |
-| TPC-H 09 || 3.50 | 4.09 | +17%˄ || 285.21 | 244.37 | -14%˄ | (run time too short) |
+| TPC-H 10 || 0.78 | 0.66 | -15%˄ || 1285.22 | 1517.15 | +18%˄ | (run time too short) |
| TPC-H 11 || 0.20 | 0.20 | +1%˄ || 4905.55 | 4847.90 | -1%˄ | (run time too short) |
-| TPC-H 12 || 0.59 | 0.62 | +6%˄ || 1693.97 | 1599.13 | -6%˄ | (run time too short) |
| TPC-H 13 || 2.03 | 2.04 | +0%˄ || 491.24 | 489.77 | -0%˄ | (run time too short) |
| TPC-H 14 || 0.33 | 0.33 | +0%˄ || 3040.16 | 3031.53 | -0%˄ | (run time too short) |
| TPC-H 15 || 1.32 | 1.34 | +1%˄ || 756.22 | 745.95 | -1%˄ | (run time too short) |
| TPC-H 16 || 2.30 | 2.31 | +0%˄ || 434.11 | 433.39 | -0%˄ | (run time too short) |
+| TPC-H 17 || 0.76 | 0.63 | -18%˄ || 1306.16 | 1585.53 | +21%˄ | (run time too short) |
+| TPC-H 18 || 1.21 | 1.16 | -4%˄ || 824.78 | 863.38 | +5%˄ | (run time too short) |
| TPC-H 19 || 5.92 | 5.94 | +0%˄ || 168.85 | 168.36 | -0%˄ | (run time too short) |
| TPC-H 20 || 2.79 | 2.78 | -0%˄ || 358.74 | 359.44 | +0%˄ | (run time too short) |
| TPC-H 21 || 1.06 | 1.04 | -2%˄ || 937.86 | 955.74 | +2%˄ | (run time too short) |
| TPC-H 22 || 1.19 | 1.20 | +1%˄ || 839.58 | 834.28 | -1%˄ | (run time too short) |
+----------++----------+---------+--------++----------+----------+--------+----------------------+
| Sum || 63.29 | 63.76 | +1% || | | | |
| Geomean || | | || | | +1% | |
+----------++----------+---------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+----------++----------+---------+--------++----------+----------+--------+----------------------+
hyriseBenchmarkTPCH - multi-threaded, ordered, 1 client, 28 cores, SF 10.0
Sum of avg. item runtimes: -6% || Geometric mean of throughput changes: +5%
Configuration Overview - click to expand
+Configuration Overview---------+-------------------------------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /home/Martin.Boissier/hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCH_43b228e1bc09ffbd5956577684cb99d0e060df1c_mt_ordered.json | /home/Martin.Boissier/hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCH_556e8941a1168263ed4aedb7bf6bb4aaf25e8e28_mt_ordered.json |
+-------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 43b228e1bc09ffbd5956577684cb99d0e060df1c-dirty | 556e8941a1168263ed4aedb7bf6bb4aaf25e8e28-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| clustering | None | None |
| compiler | clang 15.0.7 | clang 15.0.7 |
| cores | 28 | 28 |
| data_preparation_cores | 0 | 0 |
| date | 2024-05-05 23:25:12 | 2024-05-06 03:04:24 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| use_prepared_statements | False | False |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [0, 0, 0, 28] | [0, 0, 0, 28] |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------+
+----------++----------+----------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+----------++----------+----------+--------++----------+----------+--------+----------------------+
| TPC-H 01 || 4641.16 | 4598.50 | -1% || 0.22 | 0.22 | +1% | 0.1638 |
+| TPC-H 02 || 66.14 | 61.10 | -8%˄ || 15.08 | 16.32 | +8%˄ | (run time too short) |
| TPC-H 03 || 593.65 | 588.18 | -1%˄ || 1.68 | 1.70 | +1%˄ | (run time too short) |
| TPC-H 04 || 514.51 | 517.18 | +1%˄ || 1.94 | 1.93 | -1%˄ | (run time too short) |
| TPC-H 05 || 521.35 | 507.68 | -3%˄ || 1.92 | 1.97 | +3%˄ | (run time too short) |
| TPC-H 06 || 61.40 | 60.99 | -1%˄ || 16.24 | 16.35 | +1%˄ | (run time too short) |
| TPC-H 07 || 271.45 | 269.59 | -1%˄ || 3.68 | 3.71 | +1%˄ | (run time too short) |
| TPC-H 08 || 252.26 | 249.80 | -1%˄ || 3.96 | 4.00 | +1%˄ | (run time too short) |
| TPC-H 09 || 1681.85 | 1650.72 | -2% || 0.59 | 0.61 | +2% | 0.0146 |
+| TPC-H 10 || 996.83 | 538.83 | -46%˄ || 1.00 | 1.86 | +85%˄ | (run time too short) |
-| TPC-H 11 || 59.15 | 63.53 | +7%˄ || 16.86 | 15.71 | -7%˄ | (run time too short) |
| TPC-H 12 || 454.82 | 451.58 | -1%˄ || 2.20 | 2.21 | +1%˄ | (run time too short) |
| TPC-H 13 || 2294.99 | 2198.25 | -4% || 0.44 | 0.45 | +4% | 0.0000 |
| TPC-H 14 || 145.38 | 144.16 | -1%˄ || 6.87 | 6.93 | +1%˄ | (run time too short) |
| TPC-H 15 || 146.55 | 141.74 | -3%˄ || 6.82 | 7.05 | +3%˄ | (run time too short) |
| TPC-H 16 || 628.02 | 621.81 | -1%˄ || 1.59 | 1.61 | +1%˄ | (run time too short) |
| TPC-H 17 || 77.15 | 77.33 | +0%˄ || 12.94 | 12.90 | -0%˄ | (run time too short) |
+| TPC-H 18 || 2570.65 | 2168.44 | -16% || 0.39 | 0.46 | +19% | 0.0000 |
+| TPC-H 19 || 131.82 | 124.58 | -5%˄ || 7.58 | 8.02 | +6%˄ | (run time too short) |
| TPC-H 20 || 203.41 | 203.52 | +0%˄ || 4.91 | 4.91 | -0%˄ | (run time too short) |
| TPC-H 21 || 862.13 | 866.75 | +1%˄ || 1.16 | 1.15 | -1%˄ | (run time too short) |
| TPC-H 22 || 143.25 | 147.60 | +3%˄ || 6.97 | 6.77 | -3%˄ | (run time too short) |
+----------++----------+----------+--------++----------+----------+--------+----------------------+
+| Sum || 17317.92 | 16251.86 | -6% || | | | |
+| Geomean || | | || | | +5% | |
+----------++----------+----------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+----------++----------+----------+--------++----------+----------+--------+----------------------+
hyriseBenchmarkTPCH - multi-threaded, shuffled, 28 clients, 28 cores, SF 10.0
Sum of avg. item runtimes: -1% || Geometric mean of throughput changes: +2%
Configuration Overview - click to expand
+Configuration Overview---------+-----------------------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /home/Martin.Boissier/hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCH_43b228e1bc09ffbd5956577684cb99d0e060df1c_mt.json | /home/Martin.Boissier/hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCH_556e8941a1168263ed4aedb7bf6bb4aaf25e8e28_mt.json |
+-------------------------------+-----------------------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 43b228e1bc09ffbd5956577684cb99d0e060df1c-dirty | 556e8941a1168263ed4aedb7bf6bb4aaf25e8e28-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 28 | 28 |
| clustering | None | None |
| compiler | clang 15.0.7 | clang 15.0.7 |
| cores | 28 | 28 |
| data_preparation_cores | 0 | 0 |
| date | 2024-05-05 23:37:03 | 2024-05-06 03:15:50 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| use_prepared_statements | False | False |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [0, 0, 0, 28] | [0, 0, 0, 28] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+-----------------------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------+
+----------++----------+----------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+----------++----------+----------+--------++----------+----------+--------+---------+
| TPC-H 01 || 6050.40 | 6013.76 | -1% || 0.58 | 0.58 | +2% | 0.6628 |
| TPC-H 02 || 348.73 | 357.92 | +3% || 0.58 | 0.59 | +2% | 0.8886 |
+| TPC-H 03 || 2329.40 | 2068.79 | -11% || 0.58 | 0.58 | +2% | 0.0704 |
| TPC-H 04 || 1920.64 | 1981.10 | +3% || 0.58 | 0.59 | +1% | 0.6729 |
| TPC-H 05 || 3164.51 | 3192.20 | +1% || 0.58 | 0.59 | +2% | 0.8936 |
+| TPC-H 06 || 651.69 | 614.51 | -6% || 0.58 | 0.59 | +2% | 0.6667 |
| TPC-H 07 || 2538.50 | 2612.20 | +3% || 0.58 | 0.58 | +1% | 0.6679 |
-| TPC-H 08 || 1660.99 | 1987.32 | +20% || 0.58 | 0.59 | +2% | 0.0272 |
| TPC-H 09 || 4629.78 | 4558.91 | -2% || 0.57 | 0.58 | +2% | 0.6865 |
+| TPC-H 10 || 3285.06 | 2485.86 | -24% || 0.58 | 0.58 | +2% | 0.0000 |
-| TPC-H 11 || 325.71 | 380.74 | +17% || 0.58 | 0.59 | +1% | 0.2826 |
+| TPC-H 12 || 2036.60 | 1925.33 | -5% || 0.58 | 0.59 | +1% | 0.3939 |
| TPC-H 13 || 4754.28 | 4894.79 | +3% || 0.58 | 0.58 | +1% | 0.3010 |
-| TPC-H 14 || 745.95 | 861.27 | +15% || 0.58 | 0.59 | +2% | 0.1479 |
| TPC-H 15 || 556.05 | 571.09 | +3% || 0.58 | 0.59 | +2% | 0.8124 |
| TPC-H 16 || 1672.99 | 1699.92 | +2% || 0.58 | 0.59 | +2% | 0.8083 |
| TPC-H 17 || 661.52 | 645.65 | -2% || 0.58 | 0.59 | +2% | 0.8509 |
+| TPC-H 18 || 3442.09 | 3249.03 | -6% || 0.58 | 0.58 | +2% | 0.0270 |
+| TPC-H 19 || 953.50 | 885.17 | -7% || 0.58 | 0.59 | +2% | 0.5098 |
| TPC-H 20 || 1512.70 | 1523.03 | +1% || 0.58 | 0.58 | +1% | 0.9369 |
| TPC-H 21 || 4091.52 | 4090.75 | -0% || 0.58 | 0.58 | +2% | 0.9969 |
| TPC-H 22 || 922.30 | 936.45 | +2% || 0.58 | 0.59 | +2% | 0.8981 |
+----------++----------+----------+--------++----------+----------+--------+---------+
| Sum || 48254.91 | 47535.79 | -1% || | | | |
| Geomean || | | || | | +2% | |
+----------++----------+----------+--------++----------+----------+--------+---------+
hyriseBenchmarkTPCDS - single-threaded
Sum of avg. item runtimes: +6% || Geometric mean of throughput changes: -1%
Configuration Overview - click to expand
+Configuration Overview---+------------------------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /home/Martin.Boissier/hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCDS_43b228e1bc09ffbd5956577684cb99d0e060df1c_st.json | /home/Martin.Boissier/hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCDS_556e8941a1168263ed4aedb7bf6bb4aaf25e8e28_st.json |
+-------------------------+------------------------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 43b228e1bc09ffbd5956577684cb99d0e060df1c-dirty | 556e8941a1168263ed4aedb7bf6bb4aaf25e8e28-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 15.0.7 | clang 15.0.7 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2024-05-05 23:58:41 | 2024-05-06 03:37:30 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| time_unit | ns | ns |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------+------------------------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------+
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| 01 || 235.54 | 245.37 | +4%˄ || 4.25 | 4.08 | -4%˄ | (run time too short) |
| 03 || 80.92 | 80.37 | -1%˄ || 12.36 | 12.44 | +1%˄ | (run time too short) |
| 06 || 198.51 | 198.06 | -0%˄ || 5.04 | 5.05 | +0%˄ | (run time too short) |
| 07 || 318.12 | 323.51 | +2%˄ || 3.14 | 3.09 | -2%˄ | (run time too short) |
| 09 || 683.46 | 681.75 | -0%˄ || 1.46 | 1.47 | +0%˄ | (run time too short) |
| 10 || 173.02 | 168.37 | -3%˄ || 5.78 | 5.94 | +3%˄ | (run time too short) |
| 13 || 531.99 | 516.72 | -3%˄ || 1.88 | 1.94 | +3%˄ | (run time too short) |
| 15 || 113.99 | 114.52 | +0%˄ || 8.77 | 8.73 | -0%˄ | (run time too short) |
| 16 || 82.76 | 82.17 | -1%˄ || 12.08 | 12.17 | +1%˄ | (run time too short) |
| 17 || 342.89 | 339.55 | -1%˄ || 2.92 | 2.94 | +1%˄ | (run time too short) |
| 19 || 120.23 | 120.09 | -0%˄ || 8.32 | 8.33 | +0%˄ | (run time too short) |
| 25 || 198.39 | 197.27 | -1%˄ || 5.04 | 5.07 | +1%˄ | (run time too short) |
| 26 || 146.14 | 143.65 | -2%˄ || 6.84 | 6.96 | +2%˄ | (run time too short) |
| 28 || 595.66 | 601.26 | +1%˄ || 1.68 | 1.66 | -1%˄ | (run time too short) |
| 29 || 492.14 | 502.30 | +2%˄ || 2.03 | 1.99 | -2%˄ | (run time too short) |
| 31 || 1350.73 | 1355.55 | +0% || 0.74 | 0.74 | -0% | 0.1508 |
| 32 || 41.39 | 42.07 | +2%˄ || 24.16 | 23.77 | -2%˄ | (run time too short) |
| 34 || 178.68 | 180.43 | +1%˄ || 5.60 | 5.54 | -1%˄ | (run time too short) |
| 35 || 639.57 | 639.00 | -0%˄ || 1.56 | 1.56 | +0%˄ | (run time too short) |
| 37 || 539.05 | 561.38 | +4%˄ || 1.86 | 1.78 | -4%˄ | (run time too short) |
| 39a || 1778.41 | 1728.31 | -3% || 0.56 | 0.58 | +3% | 0.0000 |
| 39b || 1782.31 | 1732.82 | -3% || 0.56 | 0.58 | +3% | 0.0000 |
-| 41 || 281.73 | 295.00 | +5%˄ || 3.55 | 3.39 | -4%˄ | (run time too short) |
| 42 || 101.87 | 103.55 | +2%˄ || 9.82 | 9.66 | -2%˄ | (run time too short) |
| 43 || 992.09 | 980.48 | -1%˄ || 1.01 | 1.02 | +1%˄ | (run time too short) |
| 45 || 120.23 | 120.30 | +0%˄ || 8.32 | 8.31 | -0%˄ | (run time too short) |
| 48 || 1043.64 | 1033.68 | -1%˄ || 0.96 | 0.97 | +1%˄ | (run time too short) |
| 50 || 136.86 | 136.12 | -1%˄ || 7.31 | 7.35 | +1%˄ | (run time too short) |
| 52 || 100.28 | 98.42 | -2%˄ || 9.97 | 10.16 | +2%˄ | (run time too short) |
| 55 || 96.78 | 95.52 | -1%˄ || 10.33 | 10.47 | +1%˄ | (run time too short) |
| 62 || 543.94 | 561.81 | +3%˄ || 1.84 | 1.78 | -3%˄ | (run time too short) |
-| 65 || 1651.14 | 1778.92 | +8% || 0.61 | 0.56 | -7% | 0.0000 |
| 69 || 174.91 | 171.91 | -2%˄ || 5.72 | 5.82 | +2%˄ | (run time too short) |
| 73 || 98.77 | 95.37 | -3%˄ || 10.12 | 10.48 | +4%˄ | (run time too short) |
| 79 || 489.85 | 488.46 | -0%˄ || 2.04 | 2.05 | +0%˄ | (run time too short) |
| 81 || 152.34 | 152.49 | +0%˄ || 6.56 | 6.56 | -0%˄ | (run time too short) |
| 82 || 628.15 | 619.75 | -1%˄ || 1.59 | 1.61 | +1%˄ | (run time too short) |
+| 83 || 37.70 | 35.89 | -5%˄ || 26.52 | 27.86 | +5%˄ | (run time too short) |
| 84 || 13.16 | 13.18 | +0%˄ || 75.99 | 75.89 | -0%˄ | (run time too short) |
| 85 || 157.67 | 157.80 | +0%˄ || 6.34 | 6.34 | -0%˄ | (run time too short) |
| 88 || 783.94 | 776.46 | -1%˄ || 1.28 | 1.29 | +1%˄ | (run time too short) |
| 91 || 14.80 | 14.42 | -3%˄ || 67.58 | 69.34 | +3%˄ | (run time too short) |
| 92 || 29.92 | 30.14 | +1%˄ || 33.42 | 33.18 | -1%˄ | (run time too short) |
| 93 || 3847.05 | 3790.97 | -1% || 0.26 | 0.26 | +1% | 0.0000 |
| 94 || 47.52 | 47.10 | -1%˄ || 21.04 | 21.23 | +1%˄ | (run time too short) |
| 95 || 4832.40 | 5043.25 | +4% || 0.21 | 0.20 | -4% | 0.1194 |
| 96 || 81.44 | 79.49 | -2%˄ || 12.28 | 12.58 | +2%˄ | (run time too short) |
-| 97 || 2759.20 | 4272.43 | +55% || 0.36 | 0.23 | -35% | 0.0000 |
| 99 || 1042.00 | 1067.61 | +2%˄ || 0.96 | 0.94 | -2%˄ | (run time too short) |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
-| Sum || 30883.26 | 32615.05 | +6% || | | | |
| Geomean || | | || | | -1% | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
hyriseBenchmarkTPCDS - multi-threaded, ordered, 1 client, 28 cores
Sum of avg. item runtimes: -4% || Geometric mean of throughput changes: +0%
Configuration Overview - click to expand
+Configuration Overview---------+--------------------------------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /home/Martin.Boissier/hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCDS_43b228e1bc09ffbd5956577684cb99d0e060df1c_mt_ordered.json | /home/Martin.Boissier/hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCDS_556e8941a1168263ed4aedb7bf6bb4aaf25e8e28_mt_ordered.json |
+-------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 43b228e1bc09ffbd5956577684cb99d0e060df1c-dirty | 556e8941a1168263ed4aedb7bf6bb4aaf25e8e28-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 15.0.7 | clang 15.0.7 |
| cores | 28 | 28 |
| data_preparation_cores | 0 | 0 |
| date | 2024-05-06 00:18:01 | 2024-05-06 03:56:53 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [0, 0, 0, 28] | [0, 0, 0, 28] |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------+
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
-| 01 || 210.37 | 228.83 | +9%˄ || 4.75 | 4.37 | -8%˄ | (run time too short) |
| 03 || 39.64 | 40.64 | +3%˄ || 25.13 | 24.50 | -3%˄ | (run time too short) |
| 06 || 194.94 | 194.38 | -0%˄ || 5.13 | 5.14 | +0%˄ | (run time too short) |
| 07 || 175.01 | 178.33 | +2%˄ || 5.71 | 5.60 | -2%˄ | (run time too short) |
| 09 || 100.57 | 101.06 | +0%˄ || 9.93 | 9.88 | -0%˄ | (run time too short) |
| 10 || 48.68 | 48.65 | -0%˄ || 20.50 | 20.51 | +0%˄ | (run time too short) |
| 13 || 258.25 | 257.97 | -0%˄ || 3.87 | 3.87 | +0%˄ | (run time too short) |
| 15 || 69.91 | 69.64 | -0%˄ || 14.27 | 14.32 | +0%˄ | (run time too short) |
| 16 || 44.34 | 44.88 | +1%˄ || 22.50 | 22.24 | -1%˄ | (run time too short) |
| 17 || 149.56 | 147.98 | -1%˄ || 6.68 | 6.75 | +1%˄ | (run time too short) |
| 19 || 71.26 | 71.36 | +0%˄ || 14.00 | 13.99 | -0%˄ | (run time too short) |
| 25 || 113.14 | 113.53 | +0%˄ || 8.83 | 8.80 | -0%˄ | (run time too short) |
| 26 || 93.27 | 94.30 | +1%˄ || 10.70 | 10.59 | -1%˄ | (run time too short) |
| 28 || 89.42 | 91.39 | +2%˄ || 11.17 | 10.93 | -2%˄ | (run time too short) |
| 29 || 400.67 | 398.43 | -1%˄ || 2.50 | 2.51 | +1%˄ | (run time too short) |
| 31 || 460.83 | 461.63 | +0%˄ || 2.17 | 2.17 | -0%˄ | (run time too short) |
| 32 || 38.50 | 37.23 | -3%˄ || 25.87 | 26.76 | +3%˄ | (run time too short) |
| 34 || 98.55 | 94.50 | -4%˄ || 10.13 | 10.57 | +4%˄ | (run time too short) |
| 35 || 375.20 | 370.40 | -1%˄ || 2.66 | 2.70 | +1%˄ | (run time too short) |
| 37 || 157.30 | 156.38 | -1%˄ || 6.35 | 6.39 | +1%˄ | (run time too short) |
+| 39a || 828.14 | 773.93 | -7%˄ || 1.21 | 1.29 | +7%˄ | (run time too short) |
+| 39b || 761.97 | 722.54 | -5%˄ || 1.31 | 1.38 | +5%˄ | (run time too short) |
-| 41 || 336.86 | 361.00 | +7%˄ || 2.97 | 2.77 | -7%˄ | (run time too short) |
| 42 || 57.25 | 57.08 | -0%˄ || 17.42 | 17.47 | +0%˄ | (run time too short) |
| 43 || 427.25 | 429.19 | +0%˄ || 2.34 | 2.33 | -0%˄ | (run time too short) |
| 45 || 56.34 | 56.48 | +0%˄ || 17.71 | 17.66 | -0%˄ | (run time too short) |
| 48 || 441.60 | 446.02 | +1%˄ || 2.26 | 2.24 | -1%˄ | (run time too short) |
| 50 || 105.66 | 105.37 | -0%˄ || 9.45 | 9.47 | +0%˄ | (run time too short) |
| 52 || 58.42 | 58.40 | -0%˄ || 17.07 | 17.08 | +0%˄ | (run time too short) |
| 55 || 53.11 | 54.27 | +2%˄ || 18.77 | 18.37 | -2%˄ | (run time too short) |
| 62 || 308.03 | 311.78 | +1%˄ || 3.24 | 3.21 | -1%˄ | (run time too short) |
+| 65 || 1722.86 | 1478.03 | -14% || 0.58 | 0.68 | +17% | 0.0000 |
| 69 || 77.38 | 77.24 | -0%˄ || 12.90 | 12.92 | +0%˄ | (run time too short) |
| 73 || 63.02 | 61.11 | -3%˄ || 15.84 | 16.33 | +3%˄ | (run time too short) |
| 79 || 435.71 | 430.70 | -1%˄ || 2.29 | 2.32 | +1%˄ | (run time too short) |
| 81 || 190.35 | 191.78 | +1%˄ || 5.25 | 5.21 | -1%˄ | (run time too short) |
| 82 || 188.07 | 191.03 | +2%˄ || 5.31 | 5.23 | -2%˄ | (run time too short) |
| 83 || 45.65 | 46.43 | +2%˄ || 21.83 | 21.47 | -2%˄ | (run time too short) |
| 84 || 16.10 | 16.65 | +3%˄ || 61.64 | 59.47 | -4%˄ | (run time too short) |
| 85 || 63.91 | 64.77 | +1%˄ || 15.61 | 15.40 | -1%˄ | (run time too short) |
| 88 || 79.54 | 82.91 | +4%˄ || 12.56 | 12.05 | -4%˄ | (run time too short) |
-| 91 || 19.44 | 20.49 | +5%˄ || 51.16 | 48.49 | -5%˄ | (run time too short) |
| 92 || 35.94 | 37.33 | +4%˄ || 27.73 | 26.68 | -4%˄ | (run time too short) |
| 93 || 631.43 | 623.35 | -1%˄ || 1.58 | 1.60 | +1%˄ | (run time too short) |
+| 94 || 43.18 | 41.32 | -4%˄ || 23.08 | 24.12 | +5%˄ | (run time too short) |
| 95 || 656.07 | 654.57 | -0%˄ || 1.52 | 1.53 | +0%˄ | (run time too short) |
| 96 || 54.52 | 53.25 | -2%˄ || 18.31 | 18.75 | +2%˄ | (run time too short) |
+| 97 || 1682.20 | 1502.70 | -11% || 0.59 | 0.67 | +12% | 0.0000 |
| 99 || 597.86 | 599.61 | +0%˄ || 1.67 | 1.67 | -0%˄ | (run time too short) |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Sum || 13227.27 | 12750.85 | -4% || | | | |
| Geomean || | | || | | +0% | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
hyriseBenchmarkTPCDS - multi-threaded, shuffled, 28 clients, 28 cores
Sum of avg. item runtimes: +3% || Geometric mean of throughput changes: -3%
Configuration Overview - click to expand
+Configuration Overview---------+------------------------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /home/Martin.Boissier/hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCDS_43b228e1bc09ffbd5956577684cb99d0e060df1c_mt.json | /home/Martin.Boissier/hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCDS_556e8941a1168263ed4aedb7bf6bb4aaf25e8e28_mt.json |
+-------------------------------+------------------------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 43b228e1bc09ffbd5956577684cb99d0e060df1c-dirty | 556e8941a1168263ed4aedb7bf6bb4aaf25e8e28-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 28 | 28 |
| compiler | clang 15.0.7 | clang 15.0.7 |
| cores | 28 | 28 |
| data_preparation_cores | 0 | 0 |
| date | 2024-05-06 00:29:57 | 2024-05-06 04:08:45 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [0, 0, 0, 28] | [0, 0, 0, 28] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+------------------------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------+
+---------++----------+----------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+---------+
-| 01 || 584.81 | 648.45 | +11% || 0.58 | 0.57 | -3% | 0.2713 |
-| 03 || 225.94 | 296.51 | +31% || 0.59 | 0.57 | -3% | 0.0608 |
| 06 || 719.51 | 749.53 | +4% || 0.58 | 0.57 | -3% | 0.6372 |
-| 07 || 778.38 | 818.67 | +5% || 0.58 | 0.57 | -3% | 0.5185 |
| 09 || 645.69 | 634.89 | -2% || 0.59 | 0.57 | -3% | 0.8445 |
-| 10 || 590.07 | 663.18 | +12% || 0.58 | 0.57 | -3% | 0.2425 |
+| 13 || 1487.21 | 1344.15 | -10% || 0.58 | 0.57 | -3% | 0.0967 |
| 15 || 386.73 | 372.44 | -4% || 0.59 | 0.57 | -3% | 0.7347 |
+| 16 || 400.71 | 362.07 | -10% || 0.58 | 0.57 | -3% | 0.3637 |
-| 17 || 967.33 | 1058.45 | +9% || 0.58 | 0.57 | -3% | 0.2393 |
+| 19 || 608.50 | 532.14 | -13% || 0.58 | 0.57 | -3% | 0.1918 |
| 25 || 821.81 | 841.11 | +2% || 0.58 | 0.57 | -3% | 0.7746 |
| 26 || 426.18 | 407.00 | -4% || 0.58 | 0.57 | -3% | 0.6734 |
-| 28 || 1116.10 | 1197.30 | +7% || 0.58 | 0.57 | -3% | 0.3716 |
-| 29 || 1258.32 | 1363.73 | +8% || 0.58 | 0.57 | -3% | 0.2046 |
| 31 || 1998.58 | 2013.25 | +1% || 0.59 | 0.57 | -3% | 0.8886 |
+| 32 || 194.06 | 171.64 | -12% || 0.58 | 0.57 | -3% | 0.4719 |
+| 34 || 714.62 | 638.48 | -11% || 0.58 | 0.57 | -3% | 0.2217 |
| 35 || 1608.52 | 1591.21 | -1% || 0.59 | 0.57 | -3% | 0.8367 |
-| 37 || 691.13 | 768.33 | +11% || 0.58 | 0.57 | -3% | 0.1400 |
-| 39a || 2055.17 | 2187.26 | +6% || 0.58 | 0.57 | -3% | 0.1088 |
-| 39b || 2066.44 | 2175.64 | +5% || 0.58 | 0.57 | -3% | 0.1755 |
-| 41 || 1566.47 | 1895.97 | +21% || 0.58 | 0.57 | -3% | 0.0005 |
-| 42 || 350.64 | 405.44 | +16% || 0.59 | 0.57 | -3% | 0.1628 |
-| 43 || 1362.74 | 1459.53 | +7% || 0.58 | 0.57 | -3% | 0.1985 |
-| 45 || 586.50 | 621.30 | +6% || 0.58 | 0.57 | -3% | 0.5623 |
| 48 || 2011.96 | 2089.34 | +4% || 0.58 | 0.57 | -3% | 0.4649 |
+| 50 || 891.67 | 842.28 | -6% || 0.58 | 0.57 | -3% | 0.4887 |
+| 52 || 430.09 | 391.00 | -9% || 0.58 | 0.57 | -3% | 0.3795 |
-| 55 || 334.54 | 381.13 | +14% || 0.58 | 0.57 | -3% | 0.2423 |
-| 62 || 785.76 | 916.39 | +17% || 0.58 | 0.57 | -3% | 0.0059 |
| 65 || 3178.25 | 3093.83 | -3% || 0.58 | 0.57 | -3% | 0.0989 |
-| 69 || 714.92 | 898.08 | +26% || 0.58 | 0.57 | -3% | 0.0117 |
+| 73 || 482.27 | 459.42 | -5% || 0.58 | 0.57 | -3% | 0.6717 |
| 79 || 1228.11 | 1228.73 | +0% || 0.59 | 0.57 | -3% | 0.9921 |
-| 81 || 457.71 | 542.28 | +18% || 0.58 | 0.57 | -3% | 0.0610 |
| 82 || 848.17 | 850.48 | +0% || 0.58 | 0.57 | -3% | 0.9710 |
-| 83 || 255.71 | 305.87 | +20% || 0.59 | 0.57 | -3% | 0.1797 |
-| 84 || 96.28 | 120.01 | +25% || 0.59 | 0.57 | -3% | 0.2503 |
| 85 || 756.52 | 750.90 | -1% || 0.58 | 0.57 | -3% | 0.9438 |
| 88 || 1837.70 | 1877.88 | +2% || 0.58 | 0.57 | -3% | 0.7228 |
-| 91 || 180.07 | 190.37 | +6% || 0.58 | 0.57 | -3% | 0.7500 |
-| 92 || 238.62 | 251.33 | +5% || 0.58 | 0.57 | -3% | 0.7133 |
| 93 || 1665.36 | 1602.67 | -4% || 0.58 | 0.57 | -3% | 0.3806 |
-| 94 || 335.83 | 359.66 | +7% || 0.58 | 0.57 | -3% | 0.5945 |
| 95 || 1833.48 | 1807.25 | -1% || 0.58 | 0.57 | -3% | 0.7471 |
+| 96 || 421.38 | 303.49 | -28% || 0.59 | 0.57 | -3% | 0.0100 |
| 97 || 3370.84 | 3463.70 | +3% || 0.58 | 0.57 | -3% | 0.2895 |
| 99 || 1179.40 | 1197.26 | +2% || 0.58 | 0.57 | -3% | 0.7445 |
+---------++----------+----------+--------++----------+----------+--------+---------+
| Sum || 47746.79 | 49141.05 | +3% || | | | |
| Geomean || | | || | | -3% | |
+---------++----------+----------+--------++----------+----------+--------+---------+
hyriseBenchmarkTPCC - single-threaded
Sum of avg. item runtimes: -1% || Geometric mean of throughput changes: -0%
Configuration Overview - click to expand
+Configuration Overview---+-----------------------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /home/Martin.Boissier/hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCC_43b228e1bc09ffbd5956577684cb99d0e060df1c_st.json | /home/Martin.Boissier/hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCC_556e8941a1168263ed4aedb7bf6bb4aaf25e8e28_st.json |
+-------------------------+-----------------------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 43b228e1bc09ffbd5956577684cb99d0e060df1c-dirty | 556e8941a1168263ed4aedb7bf6bb4aaf25e8e28-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 15.0.7 | clang 15.0.7 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2024-05-06 00:50:20 | 2024-05-06 04:29:07 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10 | 10 |
| time_unit | ns | ns |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------+-----------------------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------+
+--------------++----------+---------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+--------------++----------+---------+--------++----------+----------+--------+----------------------+
+| Delivery || 57.42 | 57.11 | -1% || 1.78 | 2.10 | +18% | 0.2594 |
| New-Order || 42.14 | 41.34 | -2% || 17.91 | 18.13 | +1% | 0.1415 |
-| Order-Status || 1.90 | 1.90 | -0% || 1.70 | 1.50 | -12% | (run time too short) |
-| Payment || 7.27 | 7.25 | -0% || 18.35 | 16.78 | -9% | 0.6491 |
| Stock-Level || 3.46 | 3.40 | -2% || 1.53 | 1.58 | +3% | (run time too short) |
+--------------++----------+---------+--------++----------+----------+--------+----------------------+
| Sum || 112.19 | 110.99 | -1% || | | | |
| Geomean || | | || | | -0% | |
+--------------++----------+---------+--------++----------+----------+--------+----------------------+
hyriseBenchmarkTPCC - multi-threaded, shuffled, 28 clients, 10 warehouses, 28 cores (high contention)
Sum of avg. item runtimes: -2% || Geometric mean of throughput changes: +1%
Configuration Overview - click to expand
+Configuration Overview---------+--------------------------------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /home/Martin.Boissier/hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCC_43b228e1bc09ffbd5956577684cb99d0e060df1c_mt_highcont.json | /home/Martin.Boissier/hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCC_556e8941a1168263ed4aedb7bf6bb4aaf25e8e28_mt_highcont.json |
+-------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 43b228e1bc09ffbd5956577684cb99d0e060df1c-dirty | 556e8941a1168263ed4aedb7bf6bb4aaf25e8e28-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 28 | 28 |
| compiler | clang 15.0.7 | clang 15.0.7 |
| cores | 28 | 28 |
| data_preparation_cores | 0 | 0 |
| date | 2024-05-06 00:51:27 | 2024-05-06 04:30:14 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 600000000000 | 600000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10 | 10 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [0, 0, 0, 28] | [0, 0, 0, 28] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------+
+--------------++----------+---------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+--------------++----------+---------+--------++----------+----------+--------+---------+
| Delivery || 125.54 | 123.22 | -2% || 23.38 | 23.71 | +1% | 0.0002 |
| unsucc.: || 2.10 | 1.55 | -26% || 9.03 | 9.41 | +4% | |
| New-Order || 75.35 | 74.32 | -1% || 274.65 | 278.25 | +1% | 0.0000 |
| unsucc.: || 6.42 | 6.47 | +1% || 90.43 | 93.19 | +3% | |
| Order-Status || 6.19 | 6.07 | -2% || 32.45 | 33.01 | +2% | 0.3980 |
| Payment || 14.20 | 14.02 | -1% || 194.86 | 198.65 | +2% | 0.0015 |
| unsucc.: || 2.92 | 2.83 | -3% || 153.14 | 156.72 | +2% | |
| Stock-Level || 10.15 | 9.89 | -3% || 32.87 | 33.06 | +1% | 0.2191 |
+--------------++----------+---------+--------++----------+----------+--------+---------+
| Sum || 231.42 | 227.53 | -2% || | | | |
| Geomean || | | || | | +1% | |
+--------------++----------+---------+--------++----------+----------+--------+---------+
hyriseBenchmarkTPCC - multi-threaded, shuffled, 10 clients, 10 warehouses, 28 cores (low contention)
Sum of avg. item runtimes: -1% || Geometric mean of throughput changes: +1%
Configuration Overview - click to expand
+Configuration Overview---------+-------------------------------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /home/Martin.Boissier/hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCC_43b228e1bc09ffbd5956577684cb99d0e060df1c_mt_lowcont.json | /home/Martin.Boissier/hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCC_556e8941a1168263ed4aedb7bf6bb4aaf25e8e28_mt_lowcont.json |
+-------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 43b228e1bc09ffbd5956577684cb99d0e060df1c-dirty | 556e8941a1168263ed4aedb7bf6bb4aaf25e8e28-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 10 | 10 |
| compiler | clang 15.0.7 | clang 15.0.7 |
| cores | 28 | 28 |
| data_preparation_cores | 0 | 0 |
| date | 2024-05-06 01:01:36 | 2024-05-06 04:40:23 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 600000000000 | 600000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10 | 10 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [0, 0, 0, 28] | [0, 0, 0, 28] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------+
+--------------++----------+---------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+--------------++----------+---------+--------++----------+----------+--------+---------+
| Delivery || 91.47 | 90.85 | -1% || 9.62 | 9.58 | -0% | 0.0000 |
| unsucc.: || 0.98 | 0.88 | -10% || 0.86 | 0.89 | +3% | |
| New-Order || 65.99 | 64.47 | -2% || 107.65 | 109.68 | +2% | 0.0000 |
| unsucc.: || 3.97 | 4.46 | +12% || 10.68 | 10.86 | +2% | |
| Order-Status || 6.81 | 6.83 | +0% || 10.33 | 10.64 | +3% | 0.6690 |
| Payment || 19.81 | 19.77 | -0% || 87.55 | 89.59 | +2% | 0.2405 |
| unsucc.: || 2.29 | 2.27 | -1% || 25.10 | 25.52 | +2% | |
| Stock-Level || 9.64 | 9.43 | -2% || 10.57 | 10.48 | -1% | 0.0001 |
+--------------++----------+---------+--------++----------+----------+--------+---------+
| Sum || 193.72 | 191.35 | -1% || | | | |
| Geomean || | | || | | +1% | |
+--------------++----------+---------+--------++----------+----------+--------+---------+
hyriseBenchmarkJoinOrder - single-threaded
Sum of avg. item runtimes: -1% || Geometric mean of throughput changes: -0%
Configuration Overview - click to expand
+Configuration Overview---+----------------------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /home/Martin.Boissier/hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkJoinOrder_43b228e1bc09ffbd5956577684cb99d0e060df1c_st.json | /home/Martin.Boissier/hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkJoinOrder_556e8941a1168263ed4aedb7bf6bb4aaf25e8e28_st.json |
+-------------------------+----------------------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 43b228e1bc09ffbd5956577684cb99d0e060df1c-dirty | 556e8941a1168263ed4aedb7bf6bb4aaf25e8e28-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 15.0.7 | clang 15.0.7 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2024-05-06 01:11:44 | 2024-05-06 04:50:31 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| time_unit | ns | ns |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------+----------------------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------+
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| 10a || 110.59 | 109.52 | -1%˄ || 9.04 | 9.13 | +1%˄ | (run time too short) |
+| 10b || 70.43 | 66.78 | -5%˄ || 14.20 | 14.97 | +5%˄ | (run time too short) |
| 10c || 336.68 | 340.38 | +1%˄ || 2.97 | 2.94 | -1%˄ | (run time too short) |
| 11a || 94.31 | 95.27 | +1%˄ || 10.60 | 10.50 | -1%˄ | (run time too short) |
| 11b || 90.58 | 90.70 | +0%˄ || 11.04 | 11.03 | -0%˄ | (run time too short) |
| 11c || 25.30 | 25.12 | -1%˄ || 39.52 | 39.81 | +1%˄ | (run time too short) |
| 11d || 27.36 | 27.17 | -1%˄ || 36.55 | 36.81 | +1%˄ | (run time too short) |
| 12a || 29.29 | 29.06 | -1%˄ || 34.13 | 34.41 | +1%˄ | (run time too short) |
| 12b || 40.23 | 39.98 | -1%˄ || 24.85 | 25.01 | +1%˄ | (run time too short) |
| 12c || 62.83 | 62.42 | -1%˄ || 15.91 | 16.02 | +1%˄ | (run time too short) |
| 13a || 192.83 | 193.05 | +0%˄ || 5.19 | 5.18 | -0%˄ | (run time too short) |
| 13b || 232.66 | 234.84 | +1%˄ || 4.30 | 4.26 | -1%˄ | (run time too short) |
| 13c || 196.65 | 199.26 | +1%˄ || 5.09 | 5.02 | -1%˄ | (run time too short) |
| 13d || 500.78 | 501.95 | +0%˄ || 2.00 | 1.99 | -0%˄ | (run time too short) |
| 14a || 98.89 | 99.56 | +1%˄ || 10.11 | 10.04 | -1%˄ | (run time too short) |
| 14b || 113.37 | 112.83 | -0%˄ || 8.82 | 8.86 | +0%˄ | (run time too short) |
| 14c || 208.98 | 207.59 | -1%˄ || 4.79 | 4.82 | +1%˄ | (run time too short) |
| 15a || 55.38 | 55.14 | -0%˄ || 18.06 | 18.13 | +0%˄ | (run time too short) |
| 15b || 55.72 | 55.66 | -0%˄ || 17.95 | 17.97 | +0%˄ | (run time too short) |
| 15c || 46.66 | 46.61 | -0%˄ || 21.43 | 21.45 | +0%˄ | (run time too short) |
| 15d || 44.07 | 44.05 | -0%˄ || 22.69 | 22.70 | +0%˄ | (run time too short) |
| 16a || 1335.71 | 1321.84 | -1% || 0.75 | 0.76 | +1% | 0.0375 |
| 16b || 2500.17 | 2403.70 | -4% || 0.40 | 0.42 | +4% | 0.0000 |
+| 16c || 1541.29 | 1465.99 | -5% || 0.65 | 0.68 | +5% | 0.0000 |
| 16d || 1474.35 | 1438.30 | -2% || 0.68 | 0.70 | +3% | 0.0000 |
| 17a || 456.28 | 458.51 | +0%˄ || 2.19 | 2.18 | -0%˄ | (run time too short) |
| 17b || 373.82 | 374.73 | +0%˄ || 2.68 | 2.67 | -0%˄ | (run time too short) |
| 17c || 357.59 | 357.83 | +0%˄ || 2.80 | 2.79 | -0%˄ | (run time too short) |
| 17d || 424.68 | 427.50 | +1%˄ || 2.35 | 2.34 | -1%˄ | (run time too short) |
| 17e || 1539.99 | 1502.31 | -2% || 0.65 | 0.67 | +3% | 0.0000 |
| 17f || 887.90 | 883.12 | -1%˄ || 1.13 | 1.13 | +1%˄ | (run time too short) |
| 18a || 141.86 | 144.53 | +2%˄ || 7.05 | 6.92 | -2%˄ | (run time too short) |
| 18b || 102.69 | 104.58 | +2%˄ || 9.74 | 9.56 | -2%˄ | (run time too short) |
| 18c || 202.66 | 203.00 | +0%˄ || 4.93 | 4.93 | -0%˄ | (run time too short) |
| 19a || 224.59 | 230.08 | +2%˄ || 4.45 | 4.35 | -2%˄ | (run time too short) |
| 19b || 187.65 | 190.74 | +2%˄ || 5.33 | 5.24 | -2%˄ | (run time too short) |
| 19c || 268.04 | 273.77 | +2%˄ || 3.73 | 3.65 | -2%˄ | (run time too short) |
| 19d || 654.14 | 655.05 | +0%˄ || 1.53 | 1.53 | -0%˄ | (run time too short) |
| 1a || 12.39 | 12.40 | +0%˄ || 80.69 | 80.62 | -0%˄ | (run time too short) |
| 1b || 14.11 | 14.08 | -0%˄ || 70.85 | 70.99 | +0%˄ | (run time too short) |
| 1c || 13.78 | 14.22 | +3%˄ || 72.56 | 70.33 | -3%˄ | (run time too short) |
| 1d || 11.85 | 11.86 | +0%˄ || 84.35 | 84.33 | -0%˄ | (run time too short) |
| 20a || 625.72 | 620.53 | -1%˄ || 1.60 | 1.61 | +1%˄ | (run time too short) |
| 20b || 667.99 | 655.06 | -2%˄ || 1.50 | 1.53 | +2%˄ | (run time too short) |
| 20c || 375.45 | 381.04 | +1%˄ || 2.66 | 2.62 | -1%˄ | (run time too short) |
| 21a || 109.98 | 108.97 | -1%˄ || 9.09 | 9.18 | +1%˄ | (run time too short) |
| 21b || 102.00 | 101.80 | -0%˄ || 9.80 | 9.82 | +0%˄ | (run time too short) |
| 21c || 113.08 | 112.52 | -0%˄ || 8.84 | 8.89 | +1%˄ | (run time too short) |
| 22a || 174.94 | 173.50 | -1%˄ || 5.72 | 5.76 | +1%˄ | (run time too short) |
| 22b || 159.99 | 158.06 | -1%˄ || 6.25 | 6.33 | +1%˄ | (run time too short) |
| 22c || 234.55 | 233.91 | -0%˄ || 4.26 | 4.28 | +0%˄ | (run time too short) |
| 22d || 355.42 | 356.67 | +0%˄ || 2.81 | 2.80 | -0%˄ | (run time too short) |
| 23a || 49.27 | 49.55 | +1%˄ || 20.30 | 20.18 | -1%˄ | (run time too short) |
| 23b || 53.75 | 53.88 | +0%˄ || 18.60 | 18.56 | -0%˄ | (run time too short) |
| 23c || 51.82 | 52.04 | +0%˄ || 19.30 | 19.21 | -0%˄ | (run time too short) |
| 24a || 218.61 | 225.62 | +3%˄ || 4.57 | 4.43 | -3%˄ | (run time too short) |
| 24b || 213.30 | 219.73 | +3%˄ || 4.69 | 4.55 | -3%˄ | (run time too short) |
| 25a || 112.20 | 114.73 | +2%˄ || 8.91 | 8.72 | -2%˄ | (run time too short) |
| 25b || 70.16 | 72.48 | +3%˄ || 14.25 | 13.80 | -3%˄ | (run time too short) |
| 25c || 254.93 | 254.93 | -0%˄ || 3.92 | 3.92 | +0%˄ | (run time too short) |
| 26a || 184.54 | 184.59 | +0%˄ || 5.42 | 5.42 | -0%˄ | (run time too short) |
| 26b || 153.09 | 154.18 | +1%˄ || 6.53 | 6.49 | -1%˄ | (run time too short) |
| 26c || 311.91 | 312.23 | +0%˄ || 3.21 | 3.20 | -0%˄ | (run time too short) |
| 27a || 104.66 | 104.73 | +0%˄ || 9.55 | 9.55 | -0%˄ | (run time too short) |
| 27b || 97.34 | 96.74 | -1%˄ || 10.27 | 10.34 | +1%˄ | (run time too short) |
| 27c || 113.14 | 112.51 | -1%˄ || 8.84 | 8.89 | +1%˄ | (run time too short) |
| 28a || 210.96 | 208.10 | -1%˄ || 4.74 | 4.81 | +1%˄ | (run time too short) |
| 28b || 65.86 | 65.83 | -0%˄ || 15.18 | 15.19 | +0%˄ | (run time too short) |
| 28c || 172.87 | 173.42 | +0%˄ || 5.78 | 5.77 | -0%˄ | (run time too short) |
| 29a || 183.82 | 189.58 | +3%˄ || 5.44 | 5.27 | -3%˄ | (run time too short) |
| 29b || 776.05 | 786.66 | +1%˄ || 1.29 | 1.27 | -1%˄ | (run time too short) |
| 29c || 220.86 | 227.16 | +3%˄ || 4.53 | 4.40 | -3%˄ | (run time too short) |
| 2a || 31.11 | 31.06 | -0%˄ || 32.14 | 32.19 | +0%˄ | (run time too short) |
| 2b || 29.22 | 29.16 | -0%˄ || 34.22 | 34.29 | +0%˄ | (run time too short) |
| 2c || 25.83 | 25.86 | +0%˄ || 38.72 | 38.66 | -0%˄ | (run time too short) |
| 2d || 53.17 | 52.99 | -0%˄ || 18.80 | 18.87 | +0%˄ | (run time too short) |
| 30a || 104.45 | 106.08 | +2%˄ || 9.57 | 9.43 | -2%˄ | (run time too short) |
| 30b || 110.01 | 111.37 | +1%˄ || 9.09 | 8.98 | -1%˄ | (run time too short) |
| 30c || 172.53 | 174.71 | +1%˄ || 5.80 | 5.72 | -1%˄ | (run time too short) |
| 31a || 91.16 | 93.08 | +2%˄ || 10.97 | 10.74 | -2%˄ | (run time too short) |
| 31b || 88.61 | 90.67 | +2%˄ || 11.28 | 11.03 | -2%˄ | (run time too short) |
| 31c || 104.06 | 105.41 | +1%˄ || 9.61 | 9.49 | -1%˄ | (run time too short) |
| 32a || 17.03 | 17.08 | +0%˄ || 58.72 | 58.54 | -0%˄ | (run time too short) |
| 32b || 33.22 | 33.39 | +1%˄ || 30.10 | 29.95 | -1%˄ | (run time too short) |
| 33a || 38.14 | 38.01 | -0%˄ || 26.22 | 26.31 | +0%˄ | (run time too short) |
| 33b || 26.15 | 26.13 | -0%˄ || 38.23 | 38.26 | +0%˄ | (run time too short) |
| 33c || 44.20 | 44.81 | +1%˄ || 22.62 | 22.31 | -1%˄ | (run time too short) |
| 3a || 61.31 | 61.36 | +0%˄ || 16.31 | 16.30 | -0%˄ | (run time too short) |
| 3b || 17.90 | 18.56 | +4%˄ || 55.86 | 53.89 | -4%˄ | (run time too short) |
| 3c || 226.85 | 224.67 | -1%˄ || 4.41 | 4.45 | +1%˄ | (run time too short) |
| 4a || 136.39 | 136.64 | +0%˄ || 7.33 | 7.32 | -0%˄ | (run time too short) |
| 4b || 17.10 | 17.83 | +4%˄ || 58.47 | 56.09 | -4%˄ | (run time too short) |
| 4c || 194.02 | 191.60 | -1%˄ || 5.15 | 5.22 | +1%˄ | (run time too short) |
| 5a || 42.93 | 43.00 | +0%˄ || 23.29 | 23.25 | -0%˄ | (run time too short) |
| 5b || 46.81 | 47.54 | +2%˄ || 21.36 | 21.03 | -2%˄ | (run time too short) |
| 5c || 88.95 | 88.24 | -1%˄ || 11.24 | 11.33 | +1%˄ | (run time too short) |
| 6a || 177.87 | 172.21 | -3%˄ || 5.62 | 5.81 | +3%˄ | (run time too short) |
| 6b || 189.44 | 183.14 | -3%˄ || 5.28 | 5.46 | +3%˄ | (run time too short) |
| 6c || 170.74 | 164.22 | -4%˄ || 5.86 | 6.09 | +4%˄ | (run time too short) |
| 6d || 394.59 | 389.04 | -1%˄ || 2.53 | 2.57 | +1%˄ | (run time too short) |
| 6e || 178.08 | 171.71 | -4%˄ || 5.62 | 5.82 | +4%˄ | (run time too short) |
| 6f || 697.24 | 690.20 | -1%˄ || 1.43 | 1.45 | +1%˄ | (run time too short) |
| 7a || 109.85 | 110.96 | +1%˄ || 9.10 | 9.01 | -1%˄ | (run time too short) |
| 7b || 103.27 | 104.46 | +1%˄ || 9.68 | 9.57 | -1%˄ | (run time too short) |
| 7c || 578.00 | 587.97 | +2%˄ || 1.73 | 1.70 | -2%˄ | (run time too short) |
| 8a || 169.15 | 172.09 | +2%˄ || 5.91 | 5.81 | -2%˄ | (run time too short) |
| 8b || 164.94 | 167.53 | +2%˄ || 6.06 | 5.97 | -2%˄ | (run time too short) |
| 8c || 1852.58 | 1858.06 | +0% || 0.54 | 0.54 | -0% | 0.2862 |
| 8d || 323.99 | 321.95 | -1%˄ || 3.09 | 3.11 | +1%˄ | (run time too short) |
| 9a || 244.34 | 251.10 | +3%˄ || 4.09 | 3.98 | -3%˄ | (run time too short) |
| 9b || 152.01 | 155.08 | +2%˄ || 6.58 | 6.45 | -2%˄ | (run time too short) |
| 9c || 272.04 | 278.09 | +2%˄ || 3.68 | 3.60 | -2%˄ | (run time too short) |
| 9d || 420.06 | 421.73 | +0%˄ || 2.38 | 2.37 | -0%˄ | (run time too short) |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Sum || 29896.75 | 29694.57 | -1% || | | | |
| Geomean || | | || | | -0% | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
hyriseBenchmarkJoinOrder - multi-threaded, ordered, 1 client, 28 cores
Sum of avg. item runtimes: -0% || Geometric mean of throughput changes: +0%
Configuration Overview - click to expand
+Configuration Overview---------+------------------------------------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /home/Martin.Boissier/hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkJoinOrder_43b228e1bc09ffbd5956577684cb99d0e060df1c_mt_ordered.json | /home/Martin.Boissier/hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkJoinOrder_556e8941a1168263ed4aedb7bf6bb4aaf25e8e28_mt_ordered.json |
+-------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 43b228e1bc09ffbd5956577684cb99d0e060df1c-dirty | 556e8941a1168263ed4aedb7bf6bb4aaf25e8e28-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 15.0.7 | clang 15.0.7 |
| cores | 28 | 28 |
| data_preparation_cores | 0 | 0 |
| date | 2024-05-06 01:36:47 | 2024-05-06 05:15:32 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [0, 0, 0, 28] | [0, 0, 0, 28] |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------+
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| 10a || 43.85 | 43.24 | -1%˄ || 22.74 | 23.06 | +1%˄ | (run time too short) |
| 10b || 24.39 | 25.06 | +3%˄ || 40.80 | 39.70 | -3%˄ | (run time too short) |
| 10c || 143.12 | 143.02 | -0%˄ || 6.98 | 6.98 | +0%˄ | (run time too short) |
| 11a || 28.02 | 28.16 | +0%˄ || 35.58 | 35.43 | -0%˄ | (run time too short) |
| 11b || 25.98 | 26.29 | +1%˄ || 38.34 | 37.91 | -1%˄ | (run time too short) |
| 11c || 30.03 | 30.03 | +0%˄ || 33.14 | 33.13 | -0%˄ | (run time too short) |
| 11d || 34.59 | 34.47 | -0%˄ || 28.77 | 28.87 | +0%˄ | (run time too short) |
+| 12a || 30.49 | 29.10 | -5%˄ || 32.62 | 34.21 | +5%˄ | (run time too short) |
| 12b || 20.16 | 20.22 | +0%˄ || 49.26 | 49.16 | -0%˄ | (run time too short) |
| 12c || 60.51 | 60.36 | -0%˄ || 16.48 | 16.52 | +0%˄ | (run time too short) |
| 13a || 144.86 | 144.77 | -0%˄ || 6.90 | 6.90 | +0%˄ | (run time too short) |
+| 13b || 109.64 | 103.95 | -5%˄ || 9.11 | 9.61 | +5%˄ | (run time too short) |
| 13c || 96.85 | 98.40 | +2%˄ || 10.31 | 10.15 | -2%˄ | (run time too short) |
| 13d || 388.69 | 385.64 | -1%˄ || 2.57 | 2.59 | +1%˄ | (run time too short) |
| 14a || 62.08 | 62.75 | +1%˄ || 16.08 | 15.90 | -1%˄ | (run time too short) |
| 14b || 75.12 | 73.68 | -2%˄ || 13.29 | 13.55 | +2%˄ | (run time too short) |
| 14c || 186.76 | 184.87 | -1%˄ || 5.35 | 5.40 | +1%˄ | (run time too short) |
| 15a || 33.60 | 33.75 | +0%˄ || 29.64 | 29.53 | -0%˄ | (run time too short) |
| 15b || 29.32 | 29.93 | +2%˄ || 33.93 | 33.25 | -2%˄ | (run time too short) |
| 15c || 31.17 | 30.52 | -2%˄ || 31.91 | 32.61 | +2%˄ | (run time too short) |
| 15d || 36.60 | 36.60 | +0%˄ || 27.20 | 27.20 | -0%˄ | (run time too short) |
| 16a || 740.14 | 743.48 | +0%˄ || 1.35 | 1.34 | -0%˄ | (run time too short) |
| 16b || 1800.92 | 1780.23 | -1% || 0.56 | 0.56 | +1% | 0.0163 |
| 16c || 897.51 | 896.87 | -0%˄ || 1.11 | 1.11 | +0%˄ | (run time too short) |
| 16d || 868.28 | 867.68 | -0%˄ || 1.15 | 1.15 | +0%˄ | (run time too short) |
| 17a || 207.60 | 210.60 | +1%˄ || 4.81 | 4.74 | -1%˄ | (run time too short) |
| 17b || 180.77 | 179.88 | -0%˄ || 5.53 | 5.55 | +0%˄ | (run time too short) |
| 17c || 151.44 | 152.57 | +1%˄ || 6.60 | 6.55 | -1%˄ | (run time too short) |
| 17d || 149.42 | 149.13 | -0%˄ || 6.68 | 6.70 | +0%˄ | (run time too short) |
| 17e || 742.77 | 741.39 | -0%˄ || 1.35 | 1.35 | +0%˄ | (run time too short) |
| 17f || 333.25 | 328.93 | -1%˄ || 3.00 | 3.04 | +1%˄ | (run time too short) |
| 18a || 61.52 | 61.49 | -0%˄ || 16.22 | 16.23 | +0%˄ | (run time too short) |
| 18b || 58.66 | 57.84 | -1%˄ || 17.01 | 17.25 | +1%˄ | (run time too short) |
| 18c || 94.73 | 94.24 | -1%˄ || 10.54 | 10.59 | +1%˄ | (run time too short) |
| 19a || 115.40 | 117.29 | +2%˄ || 8.66 | 8.52 | -2%˄ | (run time too short) |
| 19b || 77.83 | 78.59 | +1%˄ || 12.83 | 12.71 | -1%˄ | (run time too short) |
| 19c || 129.37 | 129.96 | +0%˄ || 7.72 | 7.69 | -0%˄ | (run time too short) |
| 19d || 517.85 | 512.97 | -1%˄ || 1.93 | 1.95 | +1%˄ | (run time too short) |
| 1a || 11.16 | 11.07 | -1%˄ || 88.42 | 89.16 | +1%˄ | (run time too short) |
| 1b || 6.48 | 6.51 | +0%˄ || 151.21 | 150.60 | -0%˄ | (run time too short) |
| 1c || 6.38 | 6.38 | -0%˄ || 153.26 | 153.01 | -0%˄ | (run time too short) |
| 1d || 9.06 | 9.00 | -1%˄ || 108.59 | 109.49 | +1%˄ | (run time too short) |
| 20a || 87.17 | 87.10 | -0%˄ || 11.46 | 11.47 | +0%˄ | (run time too short) |
-| 20b || 64.66 | 68.50 | +6%˄ || 15.45 | 14.58 | -6%˄ | (run time too short) |
| 20c || 86.34 | 85.94 | -0%˄ || 11.56 | 11.61 | +0%˄ | (run time too short) |
| 21a || 32.37 | 32.04 | -1%˄ || 30.79 | 31.09 | +1%˄ | (run time too short) |
| 21b || 29.93 | 30.32 | +1%˄ || 33.29 | 32.87 | -1%˄ | (run time too short) |
| 21c || 34.03 | 34.15 | +0%˄ || 29.28 | 29.16 | -0%˄ | (run time too short) |
| 22a || 70.29 | 69.18 | -2%˄ || 14.20 | 14.42 | +2%˄ | (run time too short) |
| 22b || 58.93 | 59.18 | +0%˄ || 16.94 | 16.87 | -0%˄ | (run time too short) |
| 22c || 136.29 | 135.05 | -1%˄ || 7.33 | 7.40 | +1%˄ | (run time too short) |
| 22d || 241.62 | 241.27 | -0%˄ || 4.14 | 4.14 | +0%˄ | (run time too short) |
| 23a || 24.33 | 24.07 | -1%˄ || 40.89 | 41.34 | +1%˄ | (run time too short) |
-| 23b || 32.93 | 34.46 | +5%˄ || 30.27 | 28.92 | -4%˄ | (run time too short) |
| 23c || 26.23 | 26.78 | +2%˄ || 37.94 | 37.15 | -2%˄ | (run time too short) |
| 24a || 68.85 | 69.10 | +0%˄ || 14.50 | 14.45 | -0%˄ | (run time too short) |
| 24b || 62.74 | 62.42 | -1%˄ || 15.90 | 15.99 | +1%˄ | (run time too short) |
| 25a || 59.89 | 61.08 | +2%˄ || 16.65 | 16.32 | -2%˄ | (run time too short) |
| 25b || 40.13 | 38.74 | -3%˄ || 24.82 | 25.72 | +4%˄ | (run time too short) |
| 25c || 163.21 | 160.97 | -1%˄ || 6.12 | 6.21 | +1%˄ | (run time too short) |
| 26a || 92.04 | 92.02 | -0%˄ || 10.85 | 10.85 | +0%˄ | (run time too short) |
| 26b || 71.17 | 71.12 | -0%˄ || 14.02 | 14.03 | +0%˄ | (run time too short) |
| 26c || 151.02 | 150.16 | -1%˄ || 6.61 | 6.65 | +1%˄ | (run time too short) |
| 27a || 30.59 | 30.77 | +1%˄ || 32.56 | 32.38 | -1%˄ | (run time too short) |
| 27b || 30.74 | 30.66 | -0%˄ || 32.40 | 32.48 | +0%˄ | (run time too short) |
| 27c || 34.34 | 34.12 | -1%˄ || 29.02 | 29.21 | +1%˄ | (run time too short) |
| 28a || 151.88 | 149.75 | -1%˄ || 6.58 | 6.67 | +1%˄ | (run time too short) |
| 28b || 34.96 | 34.54 | -1%˄ || 28.50 | 28.85 | +1%˄ | (run time too short) |
| 28c || 119.72 | 119.65 | -0%˄ || 8.34 | 8.35 | +0%˄ | (run time too short) |
| 29a || 63.89 | 64.53 | +1%˄ || 15.63 | 15.47 | -1%˄ | (run time too short) |
| 29b || 110.99 | 111.31 | +0%˄ || 9.00 | 8.97 | -0%˄ | (run time too short) |
| 29c || 66.82 | 68.13 | +2%˄ || 14.93 | 14.64 | -2%˄ | (run time too short) |
| 2a || 32.78 | 33.04 | +1%˄ || 30.36 | 30.12 | -1%˄ | (run time too short) |
| 2b || 30.63 | 30.24 | -1%˄ || 32.47 | 32.89 | +1%˄ | (run time too short) |
| 2c || 23.13 | 23.13 | +0%˄ || 42.93 | 42.95 | +0%˄ | (run time too short) |
| 2d || 58.36 | 58.02 | -1%˄ || 17.09 | 17.18 | +1%˄ | (run time too short) |
| 30a || 53.62 | 54.43 | +2%˄ || 18.60 | 18.32 | -1%˄ | (run time too short) |
| 30b || 44.86 | 45.61 | +2%˄ || 22.23 | 21.86 | -2%˄ | (run time too short) |
| 30c || 114.23 | 113.51 | -1%˄ || 8.74 | 8.80 | +1%˄ | (run time too short) |
| 31a || 40.85 | 40.85 | -0%˄ || 24.40 | 24.38 | -0%˄ | (run time too short) |
| 31b || 38.90 | 38.64 | -1%˄ || 25.62 | 25.79 | +1%˄ | (run time too short) |
| 31c || 47.16 | 46.82 | -1%˄ || 21.14 | 21.29 | +1%˄ | (run time too short) |
| 32a || 11.61 | 11.59 | -0%˄ || 85.00 | 85.17 | +0%˄ | (run time too short) |
| 32b || 40.15 | 40.37 | +1%˄ || 24.80 | 24.67 | -1%˄ | (run time too short) |
| 33a || 15.94 | 16.35 | +3%˄ || 62.16 | 60.64 | -2%˄ | (run time too short) |
| 33b || 13.89 | 13.73 | -1%˄ || 71.22 | 72.09 | +1%˄ | (run time too short) |
| 33c || 23.60 | 24.54 | +4%˄ || 42.14 | 40.49 | -4%˄ | (run time too short) |
| 3a || 42.76 | 44.18 | +3%˄ || 23.31 | 22.56 | -3%˄ | (run time too short) |
| 3b || 10.85 | 10.81 | -0%˄ || 91.07 | 91.48 | +0%˄ | (run time too short) |
| 3c || 89.69 | 87.50 | -2%˄ || 11.13 | 11.41 | +3%˄ | (run time too short) |
| 4a || 78.47 | 75.98 | -3%˄ || 12.72 | 13.13 | +3%˄ | (run time too short) |
| 4b || 9.32 | 9.03 | -3%˄ || 105.68 | 108.96 | +3%˄ | (run time too short) |
+| 4c || 99.29 | 94.06 | -5%˄ || 10.05 | 10.61 | +6%˄ | (run time too short) |
| 5a || 33.28 | 33.28 | -0%˄ || 29.94 | 29.94 | +0%˄ | (run time too short) |
| 5b || 27.61 | 27.74 | +0%˄ || 36.05 | 35.88 | -0%˄ | (run time too short) |
| 5c || 55.72 | 53.54 | -4%˄ || 17.90 | 18.64 | +4%˄ | (run time too short) |
| 6a || 33.30 | 33.33 | +0%˄ || 29.95 | 29.92 | -0%˄ | (run time too short) |
| 6b || 57.14 | 57.86 | +1%˄ || 17.47 | 17.26 | -1%˄ | (run time too short) |
| 6c || 31.15 | 31.21 | +0%˄ || 32.01 | 31.95 | -0%˄ | (run time too short) |
| 6d || 160.23 | 160.78 | +0%˄ || 6.23 | 6.21 | -0%˄ | (run time too short) |
| 6e || 32.99 | 33.16 | +1%˄ || 30.22 | 30.09 | -0%˄ | (run time too short) |
| 6f || 484.46 | 481.13 | -1%˄ || 2.06 | 2.08 | +1%˄ | (run time too short) |
| 7a || 33.77 | 33.87 | +0%˄ || 29.52 | 29.44 | -0%˄ | (run time too short) |
| 7b || 33.31 | 33.68 | +1%˄ || 29.90 | 29.60 | -1%˄ | (run time too short) |
| 7c || 318.17 | 316.30 | -1%˄ || 3.14 | 3.16 | +1%˄ | (run time too short) |
| 8a || 40.46 | 40.78 | +1%˄ || 24.63 | 24.44 | -1%˄ | (run time too short) |
| 8b || 37.56 | 37.31 | -1%˄ || 26.53 | 26.72 | +1%˄ | (run time too short) |
| 8c || 1188.01 | 1174.34 | -1%˄ || 0.84 | 0.85 | +1%˄ | (run time too short) |
| 8d || 247.47 | 246.91 | -0%˄ || 4.04 | 4.05 | +0%˄ | (run time too short) |
| 9a || 147.83 | 147.68 | -0%˄ || 6.76 | 6.77 | +0%˄ | (run time too short) |
| 9b || 85.30 | 86.54 | +1%˄ || 11.70 | 11.54 | -1%˄ | (run time too short) |
| 9c || 143.91 | 144.48 | +0%˄ || 6.94 | 6.91 | -0%˄ | (run time too short) |
| 9d || 342.65 | 341.29 | -0%˄ || 2.92 | 2.93 | +0%˄ | (run time too short) |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Sum || 15528.88 | 15465.72 | -0% || | | | |
| Geomean || | | || | | +0% | |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+---------++----------+----------+--------++----------+----------+--------+----------------------+
hyriseBenchmarkJoinOrder - multi-threaded, shuffled, 28 clients, 28 cores
Sum of avg. item runtimes: -0% || Geometric mean of throughput changes: +0%
Configuration Overview - click to expand
+Configuration Overview---------+----------------------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /home/Martin.Boissier/hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkJoinOrder_43b228e1bc09ffbd5956577684cb99d0e060df1c_mt.json | /home/Martin.Boissier/hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkJoinOrder_556e8941a1168263ed4aedb7bf6bb4aaf25e8e28_mt.json |
+-------------------------------+----------------------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 43b228e1bc09ffbd5956577684cb99d0e060df1c-dirty | 556e8941a1168263ed4aedb7bf6bb4aaf25e8e28-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 28 | 28 |
| compiler | clang 15.0.7 | clang 15.0.7 |
| cores | 28 | 28 |
| data_preparation_cores | 0 | 0 |
| date | 2024-05-06 01:52:15 | 2024-05-06 05:30:59 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [0, 0, 0, 28] | [0, 0, 0, 28] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+----------------------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------+
+---------++----------+----------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+---------+
+| 10a || 185.65 | 163.02 | -12% || 0.63 | 0.63 | +1% | 0.2646 |
| 10b || 120.09 | 120.07 | -0% || 0.63 | 0.63 | +0% | 0.9993 |
+| 10c || 479.92 | 455.75 | -5% || 0.63 | 0.63 | +0% | 0.4748 |
-| 11a || 97.93 | 104.67 | +7% || 0.63 | 0.63 | +0% | 0.6781 |
-| 11b || 91.62 | 100.22 | +9% || 0.63 | 0.63 | +0% | 0.5835 |
| 11c || 91.56 | 90.46 | -1% || 0.63 | 0.63 | +0% | 0.9343 |
-| 11d || 83.47 | 96.57 | +16% || 0.63 | 0.63 | +0% | 0.3042 |
| 12a || 154.23 | 160.56 | +4% || 0.63 | 0.63 | +0% | 0.7626 |
| 12b || 87.74 | 88.40 | +1% || 0.63 | 0.63 | +0% | 0.9696 |
-| 12c || 269.66 | 290.28 | +8% || 0.63 | 0.63 | +0% | 0.4283 |
| 13a || 389.61 | 399.23 | +2% || 0.63 | 0.63 | +1% | 0.7220 |
-| 13b || 282.95 | 364.24 | +29% || 0.63 | 0.63 | +0% | 0.0120 |
+| 13c || 296.80 | 245.90 | -17% || 0.63 | 0.63 | +0% | 0.0283 |
| 13d || 757.65 | 760.03 | +0% || 0.63 | 0.63 | +0% | 0.9467 |
| 14a || 369.74 | 361.64 | -2% || 0.63 | 0.63 | +1% | 0.8211 |
+| 14b || 381.45 | 358.00 | -6% || 0.63 | 0.63 | +0% | 0.4786 |
+| 14c || 498.20 | 457.83 | -8% || 0.63 | 0.63 | +0% | 0.2251 |
| 15a || 118.20 | 114.74 | -3% || 0.63 | 0.63 | +0% | 0.8532 |
-| 15b || 106.54 | 114.61 | +8% || 0.63 | 0.63 | +0% | 0.6175 |
+| 15c || 125.52 | 115.62 | -8% || 0.63 | 0.63 | +0% | 0.5369 |
-| 15d || 129.20 | 140.26 | +9% || 0.63 | 0.63 | +0% | 0.5198 |
| 16a || 1368.82 | 1347.48 | -2% || 0.63 | 0.63 | +1% | 0.6384 |
| 16b || 2606.60 | 2631.52 | +1% || 0.63 | 0.63 | +1% | 0.5921 |
| 16c || 1561.28 | 1540.71 | -1% || 0.63 | 0.63 | +0% | 0.6642 |
+| 16d || 1585.04 | 1484.96 | -6% || 0.63 | 0.63 | +0% | 0.0518 |
| 17a || 705.91 | 729.27 | +3% || 0.63 | 0.63 | +0% | 0.5429 |
+| 17b || 596.22 | 529.97 | -11% || 0.63 | 0.63 | +0% | 0.0618 |
+| 17c || 568.70 | 515.70 | -9% || 0.63 | 0.63 | +0% | 0.1469 |
| 17d || 547.52 | 551.17 | +1% || 0.63 | 0.63 | +0% | 0.9247 |
| 17e || 1383.87 | 1366.51 | -1% || 0.63 | 0.63 | +0% | 0.7096 |
| 17f || 966.66 | 1006.81 | +4% || 0.63 | 0.63 | +0% | 0.3987 |
-| 18a || 226.84 | 238.45 | +5% || 0.63 | 0.63 | +0% | 0.6037 |
-| 18b || 331.15 | 366.69 | +11% || 0.63 | 0.63 | +0% | 0.2749 |
-| 18c || 495.27 | 537.43 | +9% || 0.63 | 0.63 | +1% | 0.2666 |
| 19a || 533.33 | 510.62 | -4% || 0.63 | 0.63 | +0% | 0.5691 |
+| 19b || 336.53 | 319.27 | -5% || 0.63 | 0.63 | +0% | 0.5517 |
+| 19c || 577.65 | 550.24 | -5% || 0.63 | 0.63 | +0% | 0.5065 |
+| 19d || 1223.09 | 1160.15 | -5% || 0.63 | 0.63 | +0% | 0.1671 |
+| 1a || 43.14 | 39.28 | -9% || 0.63 | 0.63 | +0% | 0.7237 |
+| 1b || 42.56 | 34.07 | -20% || 0.63 | 0.63 | +0% | 0.1829 |
+| 1c || 51.60 | 42.56 | -18% || 0.63 | 0.63 | +0% | 0.3954 |
| 1d || 39.21 | 38.85 | -1% || 0.63 | 0.63 | +0% | 0.9645 |
-| 20a || 411.37 | 440.16 | +7% || 0.63 | 0.63 | +0% | 0.4051 |
+| 20b || 400.56 | 375.51 | -6% || 0.63 | 0.63 | +0% | 0.4950 |
+| 20c || 372.97 | 320.56 | -14% || 0.63 | 0.63 | +0% | 0.0701 |
| 21a || 172.27 | 174.39 | +1% || 0.63 | 0.63 | +0% | 0.9317 |
+| 21b || 160.29 | 129.95 | -19% || 0.63 | 0.63 | +0% | 0.1678 |
| 21c || 163.57 | 167.49 | +2% || 0.63 | 0.63 | +0% | 0.8709 |
+| 22a || 446.08 | 379.44 | -15% || 0.63 | 0.63 | +0% | 0.0750 |
-| 22b || 327.10 | 368.42 | +13% || 0.63 | 0.63 | +0% | 0.2410 |
+| 22c || 589.68 | 544.44 | -8% || 0.63 | 0.63 | +0% | 0.2907 |
| 22d || 710.08 | 733.46 | +3% || 0.63 | 0.63 | +0% | 0.6002 |
-| 23a || 127.21 | 133.01 | +5% || 0.63 | 0.63 | +0% | 0.7416 |
+| 23b || 134.37 | 118.55 | -12% || 0.63 | 0.63 | +0% | 0.4695 |
| 23c || 160.08 | 158.92 | -1% || 0.63 | 0.63 | +0% | 0.9570 |
-| 24a || 345.77 | 400.77 | +16% || 0.63 | 0.63 | +0% | 0.0848 |
| 24b || 271.87 | 274.67 | +1% || 0.63 | 0.63 | +1% | 0.9248 |
+| 25a || 366.67 | 328.68 | -10% || 0.63 | 0.63 | +0% | 0.2236 |
+| 25b || 205.40 | 180.88 | -12% || 0.63 | 0.63 | +0% | 0.3271 |
-| 25c || 689.03 | 753.49 | +9% || 0.63 | 0.63 | +0% | 0.1308 |
| 26a || 356.75 | 346.67 | -3% || 0.63 | 0.63 | +0% | 0.7472 |
| 26b || 231.05 | 220.76 | -4% || 0.63 | 0.63 | +0% | 0.6293 |
| 26c || 489.62 | 501.65 | +2% || 0.63 | 0.63 | +0% | 0.6902 |
| 27a || 172.19 | 171.76 | -0% || 0.63 | 0.63 | +0% | 0.9858 |
+| 27b || 161.59 | 151.18 | -6% || 0.63 | 0.63 | +0% | 0.6242 |
+| 27c || 187.66 | 172.61 | -8% || 0.63 | 0.63 | +0% | 0.5849 |
| 28a || 555.54 | 577.76 | +4% || 0.63 | 0.63 | +0% | 0.5562 |
+| 28b || 234.85 | 208.64 | -11% || 0.63 | 0.63 | +0% | 0.3237 |
| 28c || 481.20 | 502.18 | +4% || 0.63 | 0.63 | +0% | 0.5499 |
-| 29a || 274.30 | 298.25 | +9% || 0.63 | 0.63 | +1% | 0.4117 |
-| 29b || 336.03 | 365.97 | +9% || 0.63 | 0.63 | +1% | 0.3824 |
-| 29c || 326.57 | 397.40 | +22% || 0.63 | 0.63 | +0% | 0.0503 |
+| 2a || 126.69 | 89.70 | -29% || 0.63 | 0.63 | +0% | 0.0035 |
+| 2b || 125.23 | 117.56 | -6% || 0.63 | 0.63 | +0% | 0.6812 |
-| 2c || 81.25 | 101.68 | +25% || 0.63 | 0.63 | +0% | 0.1186 |
-| 2d || 187.19 | 205.64 | +10% || 0.63 | 0.63 | +0% | 0.3630 |
+| 30a || 322.58 | 262.34 | -19% || 0.63 | 0.63 | +1% | 0.0558 |
| 30b || 288.90 | 281.80 | -2% || 0.63 | 0.63 | +0% | 0.8104 |
-| 30c || 539.30 | 569.94 | +6% || 0.63 | 0.63 | +0% | 0.4398 |
| 31a || 267.30 | 257.68 | -4% || 0.63 | 0.63 | +0% | 0.7810 |
-| 31b || 213.11 | 259.59 | +22% || 0.63 | 0.63 | +1% | 0.1327 |
| 31c || 294.52 | 300.47 | +2% || 0.63 | 0.63 | +0% | 0.8572 |
-| 32a || 37.11 | 49.73 | +34% || 0.63 | 0.63 | +0% | 0.0851 |
| 32b || 137.75 | 134.05 | -3% || 0.63 | 0.63 | +1% | 0.8110 |
-| 33a || 128.91 | 135.97 | +5% || 0.63 | 0.63 | +0% | 0.7593 |
-| 33b || 74.03 | 87.78 | +19% || 0.63 | 0.63 | +0% | 0.3395 |
+| 33c || 171.80 | 133.24 | -22% || 0.63 | 0.63 | +0% | 0.1336 |
+| 3a || 248.67 | 237.06 | -5% || 0.63 | 0.63 | +0% | 0.6992 |
+| 3b || 87.44 | 67.90 | -22% || 0.63 | 0.63 | +0% | 0.2563 |
+| 3c || 392.10 | 362.47 | -8% || 0.63 | 0.63 | +0% | 0.4355 |
-| 4a || 227.02 | 250.25 | +10% || 0.63 | 0.63 | +0% | 0.3191 |
-| 4b || 55.60 | 65.85 | +18% || 0.63 | 0.63 | +0% | 0.4713 |
+| 4c || 290.22 | 275.06 | -5% || 0.63 | 0.63 | +0% | 0.6149 |
-| 5a || 170.93 | 186.97 | +9% || 0.63 | 0.63 | +0% | 0.4911 |
| 5b || 129.13 | 129.48 | +0% || 0.63 | 0.63 | +0% | 0.9840 |
+| 5c || 257.93 | 230.12 | -11% || 0.63 | 0.63 | +1% | 0.2966 |
-| 6a || 121.46 | 132.21 | +9% || 0.63 | 0.63 | +0% | 0.5459 |
| 6b || 168.38 | 161.90 | -4% || 0.63 | 0.63 | +0% | 0.7158 |
-| 6c || 96.09 | 127.83 | +33% || 0.63 | 0.63 | +0% | 0.0220 |
+| 6d || 507.12 | 479.35 | -5% || 0.63 | 0.63 | +0% | 0.4340 |
+| 6e || 136.32 | 128.92 | -5% || 0.63 | 0.63 | +0% | 0.6728 |
-| 6f || 956.37 | 1019.48 | +7% || 0.63 | 0.63 | +0% | 0.0753 |
+| 7a || 210.32 | 176.12 | -16% || 0.63 | 0.63 | +0% | 0.1892 |
-| 7b || 151.78 | 180.83 | +19% || 0.63 | 0.63 | +0% | 0.2097 |
| 7c || 933.14 | 973.09 | +4% || 0.63 | 0.63 | +0% | 0.3646 |
-| 8a || 193.15 | 224.86 | +16% || 0.63 | 0.63 | +0% | 0.2027 |
+| 8b || 167.04 | 138.72 | -17% || 0.63 | 0.63 | +0% | 0.2262 |
| 8c || 1839.36 | 1905.08 | +4% || 0.63 | 0.63 | +0% | 0.1435 |
+| 8d || 604.67 | 540.94 | -11% || 0.63 | 0.63 | +0% | 0.0687 |
| 9a || 572.68 | 598.05 | +4% || 0.63 | 0.63 | +0% | 0.5436 |
+| 9b || 463.05 | 421.96 | -9% || 0.63 | 0.63 | +0% | 0.2720 |
-| 9c || 559.36 | 628.08 | +12% || 0.63 | 0.63 | +0% | 0.0999 |
+| 9d || 983.99 | 924.57 | -6% || 0.63 | 0.63 | +0% | 0.1856 |
+---------++----------+----------+--------++----------+----------+--------+---------+
| Sum || 44289.45 | 44095.70 | -0% || | | | |
| Geomean || | | || | | +0% | |
+---------++----------+----------+--------++----------+----------+--------+---------+
hyriseBenchmarkStarSchema - single-threaded
Sum of avg. item runtimes: -1% || Geometric mean of throughput changes: +1%
Configuration Overview - click to expand
+Configuration Overview---+-----------------------------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /home/Martin.Boissier/hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkStarSchema_43b228e1bc09ffbd5956577684cb99d0e060df1c_st.json | /home/Martin.Boissier/hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkStarSchema_556e8941a1168263ed4aedb7bf6bb4aaf25e8e28_st.json |
+-------------------------+-----------------------------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 43b228e1bc09ffbd5956577684cb99d0e060df1c-dirty | 556e8941a1168263ed4aedb7bf6bb4aaf25e8e28-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 15.0.7 | clang 15.0.7 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2024-05-06 02:12:42 | 2024-05-06 05:51:25 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------+-----------------------------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------+
+---------++----------+---------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+---------+--------++----------+----------+--------+----------------------+
| 1.1 || 329.33 | 332.50 | +1%˄ || 3.04 | 3.01 | -1%˄ | (run time too short) |
| 1.2 || 156.11 | 159.02 | +2%˄ || 6.41 | 6.29 | -2%˄ | (run time too short) |
+| 1.3 || 157.34 | 145.97 | -7%˄ || 6.36 | 6.85 | +8%˄ | (run time too short) |
| 2.1 || 559.94 | 557.42 | -0%˄ || 1.79 | 1.79 | +0%˄ | (run time too short) |
| 2.2 || 298.40 | 295.01 | -1%˄ || 3.35 | 3.39 | +1%˄ | (run time too short) |
| 2.3 || 200.77 | 198.97 | -1%˄ || 4.98 | 5.03 | +1%˄ | (run time too short) |
| 3.1 || 3031.41 | 3005.88 | -1% || 0.33 | 0.33 | +1% | 0.5178 |
| 3.2 || 300.69 | 297.14 | -1%˄ || 3.33 | 3.37 | +1%˄ | (run time too short) |
| 3.3 || 153.06 | 149.53 | -2%˄ || 6.53 | 6.69 | +2%˄ | (run time too short) |
| 3.4 || 145.34 | 142.55 | -2%˄ || 6.88 | 7.01 | +2%˄ | (run time too short) |
| 4.1 || 2992.40 | 2972.08 | -1% || 0.33 | 0.34 | +1% | 0.3774 |
| 4.2 || 878.17 | 883.71 | +1%˄ || 1.14 | 1.13 | -1%˄ | (run time too short) |
| 4.3 || 274.01 | 267.48 | -2%˄ || 3.65 | 3.74 | +2%˄ | (run time too short) |
+---------++----------+---------+--------++----------+----------+--------+----------------------+
| Sum || 9476.96 | 9407.28 | -1% || | | | |
| Geomean || | | || | | +1% | |
+---------++----------+---------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+---------++----------+---------+--------++----------+----------+--------+----------------------+
hyriseBenchmarkStarSchema - multi-threaded, ordered, 1 client, 28 cores
Sum of avg. item runtimes: -0% || Geometric mean of throughput changes: +0%
Configuration Overview - click to expand
+Configuration Overview---------+-------------------------------------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /home/Martin.Boissier/hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkStarSchema_43b228e1bc09ffbd5956577684cb99d0e060df1c_mt_ordered.json | /home/Martin.Boissier/hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkStarSchema_556e8941a1168263ed4aedb7bf6bb4aaf25e8e28_mt_ordered.json |
+-------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 43b228e1bc09ffbd5956577684cb99d0e060df1c-dirty | 556e8941a1168263ed4aedb7bf6bb4aaf25e8e28-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 15.0.7 | clang 15.0.7 |
| cores | 28 | 28 |
| data_preparation_cores | 0 | 0 |
| date | 2024-05-06 02:18:18 | 2024-05-06 05:56:59 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [0, 0, 0, 28] | [0, 0, 0, 28] |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------+
+---------++----------+---------+--------++----------+----------+--------+----------------------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+---------+--------++----------+----------+--------+----------------------+
| 1.1 || 102.47 | 104.37 | +2%˄ || 9.75 | 9.57 | -2%˄ | (run time too short) |
| 1.2 || 88.55 | 90.26 | +2%˄ || 11.27 | 11.06 | -2%˄ | (run time too short) |
| 1.3 || 84.95 | 84.30 | -1%˄ || 11.75 | 11.84 | +1%˄ | (run time too short) |
| 2.1 || 337.10 | 341.55 | +1%˄ || 2.97 | 2.93 | -1%˄ | (run time too short) |
| 2.2 || 166.48 | 164.66 | -1%˄ || 6.00 | 6.07 | +1%˄ | (run time too short) |
| 2.3 || 60.34 | 59.19 | -2%˄ || 16.53 | 16.86 | +2%˄ | (run time too short) |
| 3.1 || 831.80 | 840.04 | +1%˄ || 1.20 | 1.19 | -1%˄ | (run time too short) |
| 3.2 || 158.18 | 157.50 | -0%˄ || 6.32 | 6.34 | +0%˄ | (run time too short) |
| 3.3 || 81.19 | 80.34 | -1%˄ || 12.29 | 12.42 | +1%˄ | (run time too short) |
| 3.4 || 76.16 | 75.36 | -1%˄ || 13.11 | 13.25 | +1%˄ | (run time too short) |
| 4.1 || 704.89 | 694.92 | -1%˄ || 1.42 | 1.44 | +1%˄ | (run time too short) |
| 4.2 || 389.69 | 390.18 | +0%˄ || 2.57 | 2.56 | -0%˄ | (run time too short) |
| 4.3 || 117.29 | 114.96 | -2%˄ || 8.51 | 8.69 | +2%˄ | (run time too short) |
+---------++----------+---------+--------++----------+----------+--------+----------------------+
| Sum || 3199.10 | 3197.62 | -0% || | | | |
| Geomean || | | || | | +0% | |
+---------++----------+---------+--------++----------+----------+--------+----------------------+
| Notes || ˄ Execution stopped due to max runs reached |
+---------++----------+---------+--------++----------+----------+--------+----------------------+
hyriseBenchmarkStarSchema - multi-threaded, shuffled, 28 clients, 28 cores
Sum of avg. item runtimes: -0% || Geometric mean of throughput changes: +0%
Configuration Overview - click to expand
+Configuration Overview---------+-----------------------------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /home/Martin.Boissier/hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkStarSchema_43b228e1bc09ffbd5956577684cb99d0e060df1c_mt.json | /home/Martin.Boissier/hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkStarSchema_556e8941a1168263ed4aedb7bf6bb4aaf25e8e28_mt.json |
+-------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 43b228e1bc09ffbd5956577684cb99d0e060df1c-dirty | 556e8941a1168263ed4aedb7bf6bb4aaf25e8e28-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 28 | 28 |
| compiler | clang 15.0.7 | clang 15.0.7 |
| cores | 28 | 28 |
| data_preparation_cores | 0 | 0 |
| date | 2024-05-06 02:21:41 | 2024-05-06 06:00:22 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [0, 0, 0, 28] | [0, 0, 0, 28] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------+
+---------++----------+----------+--------++----------+----------+--------+---------+
| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
| || old | new | || old | new | | |
+---------++----------+----------+--------++----------+----------+--------+---------+
| 1.1 || 632.85 | 632.78 | -0% || 2.17 | 2.17 | +0% | 0.9976 |
-| 1.2 || 357.54 | 396.27 | +11% || 2.17 | 2.17 | +0% | 0.0297 |
| 1.3 || 341.91 | 348.70 | +2% || 2.17 | 2.17 | +0% | 0.6732 |
| 2.1 || 1611.31 | 1576.18 | -2% || 2.16 | 2.17 | +0% | 0.3418 |
| 2.2 || 839.49 | 852.46 | +2% || 2.16 | 2.17 | +0% | 0.6349 |
| 2.3 || 296.67 | 291.10 | -2% || 2.17 | 2.17 | +0% | 0.6995 |
| 3.1 || 2531.29 | 2544.61 | +1% || 2.16 | 2.17 | +0% | 0.7268 |
| 3.2 || 765.15 | 764.89 | -0% || 2.16 | 2.17 | +0% | 0.9912 |
| 3.3 || 391.00 | 407.56 | +4% || 2.17 | 2.17 | +0% | 0.3771 |
+| 3.4 || 428.03 | 401.59 | -6% || 2.17 | 2.17 | +0% | 0.1771 |
| 4.1 || 2196.09 | 2187.26 | -0% || 2.16 | 2.17 | +0% | 0.8125 |
| 4.2 || 1939.11 | 1857.37 | -4% || 2.16 | 2.17 | +0% | 0.0431 |
| 4.3 || 577.74 | 600.66 | +4% || 2.17 | 2.17 | +0% | 0.2694 |
+---------++----------+----------+--------++----------+----------+--------+---------+
| Sum || 12908.18 | 12861.42 | -0% || | | | |
| Geomean || | | || | | +0% | |
+---------++----------+----------+--------++----------+----------+--------+---------+
AMD - Koroniea
System
koroneia - click to expand
| property | value |
|---|---|
| Hostname | koroneia |
| CPU | AMD EPYC 7F72 24-Core Processor |
| Memory | 480GB |
| numactl | nodebind: 0 |
| numactl | membind: 0 |
Commit Info and Build Time
| commit | date | message | build time |
|---|---|---|---|
| 43b228e1b | 03.05.2024 12:47 | Add ABS function (#2641) |
real 326.97 user 2881.47 sys 76.06 |
| 556e8941a | 03.05.2024 11:13 | Merge branch 'master' into martiin/perf/aggregate_output | real 342.77 user 2872.37 sys 79.02 |
hyriseBenchmarkTPCH - single-threaded, SF 10.0
Sum of avg. item runtimes: -2% || Geometric mean of throughput changes: -0%
Configuration Overview - click to expand
+Configuration Overview----+-----------------------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /home/Martin.Boissier/hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCH_43b228e1bc09ffbd5956577684cb99d0e060df1c_st.json | /home/Martin.Boissier/hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCH_556e8941a1168263ed4aedb7bf6bb4aaf25e8e28_st.json |
+--------------------------+-----------------------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 43b228e1bc09ffbd5956577684cb99d0e060df1c-dirty | 556e8941a1168263ed4aedb7bf6bb4aaf25e8e28-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| clustering | None | None |
| compiler | clang 14.0.0 | clang 14.0.0 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2024-05-06 00:02:51 | 2024-05-06 04:00:03 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| use_prepared_statements | False | False |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+--------------------------+-----------------------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------+
++----------++----------+----------+--------++----------+----------+--------+----------------------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++----------++----------+----------+--------++----------+----------+--------+----------------------+
+| TPC-H 01 || 5277.44 | 5643.52 | +7% || 0.19 | 0.18 | -6% | 0.0000 |
+| TPC-H 02 || 43.74 | 43.98 | +1%˄ || 22.86 | 22.73 | -1%˄ | (run time too short) |
+| TPC-H 03 || 1394.96 | 1443.65 | +3% || 0.72 | 0.69 | -3% | 0.0000 |
+| TPC-H 04 || 1408.90 | 1476.91 | +5% || 0.71 | 0.68 | -5% | 0.0000 |
+| TPC-H 05 || 2260.35 | 2328.20 | +3% || 0.44 | 0.43 | -3% | 0.0000 |
+| TPC-H 06 || 168.86 | 183.51 | +9%˄ || 5.92 | 5.45 | -8%˄ | (run time too short) |
+| TPC-H 07 || 756.87 | 798.56 | +6%˄ || 1.32 | 1.25 | -5%˄ | (run time too short) |
+| TPC-H 08 || 550.03 | 564.89 | +3%˄ || 1.82 | 1.77 | -3%˄ | (run time too short) |
+| TPC-H 09 || 5925.37 | 5833.95 | -2% || 0.17 | 0.17 | +2% | 0.0001 |
+| TPC-H 10 || 1772.99 | 1375.66 | -22% || 0.56 | 0.73 | +29% | 0.0000 |
+| TPC-H 11 || 50.14 | 49.13 | -2%˄ || 19.94 | 20.35 | +2%˄ | (run time too short) |
+| TPC-H 12 || 985.68 | 1003.29 | +2%˄ || 1.01 | 1.00 | -2%˄ | (run time too short) |
+| TPC-H 13 || 6392.76 | 5436.38 | -15% || 0.16 | 0.18 | +18% | 0.0000 |
+| TPC-H 14 || 506.33 | 505.03 | -0%˄ || 1.97 | 1.98 | +0%˄ | (run time too short) |
+| TPC-H 15 || 181.22 | 177.08 | -2%˄ || 5.52 | 5.65 | +2%˄ | (run time too short) |
+| TPC-H 16 || 521.41 | 519.72 | -0%˄ || 1.92 | 1.92 | +0%˄ | (run time too short) |
+| TPC-H 17 || 222.30 | 221.81 | -0%˄ || 4.50 | 4.51 | +0%˄ | (run time too short) |
+| TPC-H 18 || 1372.02 | 1516.44 | +11% || 0.73 | 0.66 | -10% | 0.0000 |
+| TPC-H 19 || 231.63 | 235.31 | +2%˄ || 4.32 | 4.25 | -2%˄ | (run time too short) |
+| TPC-H 20 || 502.44 | 564.95 | +12%˄ || 1.99 | 1.77 | -11%˄ | (run time too short) |
+| TPC-H 21 || 4440.00 | 4375.11 | -1% || 0.23 | 0.23 | +1% | 0.0259 |
+| TPC-H 22 || 457.49 | 460.62 | +1%˄ || 2.19 | 2.17 | -1%˄ | (run time too short) |
++----------++----------+----------+--------++----------+----------+--------+----------------------+
+| Sum || 35422.95 | 34757.70 | -2% || | | | |
+| Geomean || | | || | | -0% | |
++----------++----------+----------+--------++----------+----------+--------+----------------------+
+| Notes || ˄ Execution stopped due to max runs reached |
++----------++----------+----------+--------++----------+----------+--------+----------------------+
hyriseBenchmarkTPCH - single-threaded, SF 0.01
Sum of avg. item runtimes: -0% || Geometric mean of throughput changes: +1%
Configuration Overview - click to expand
+Configuration Overview----+---------------------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /home/Martin.Boissier/hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCH_43b228e1bc09ffbd5956577684cb99d0e060df1c_st_s01.json | /home/Martin.Boissier/hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCH_556e8941a1168263ed4aedb7bf6bb4aaf25e8e28_st_s01.json |
+--------------------------+---------------------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 43b228e1bc09ffbd5956577684cb99d0e060df1c-dirty | 556e8941a1168263ed4aedb7bf6bb4aaf25e8e28-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| clustering | None | None |
| compiler | clang 14.0.0 | clang 14.0.0 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2024-05-06 00:20:03 | 2024-05-06 04:16:06 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| scale_factor | 0.009999999776482582 | 0.009999999776482582 |
| time_unit | ns | ns |
| use_prepared_statements | False | False |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+--------------------------+---------------------------------------------------------------------------------------------------------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------+
++----------++----------+---------+--------++----------+----------+--------+----------------------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++----------++----------+---------+--------++----------+----------+--------+----------------------+
+| TPC-H 01 || 4.96 | 4.99 | +1%˄ || 201.50 | 200.48 | -1%˄ | (run time too short) |
+| TPC-H 02 || 4.19 | 3.94 | -6%˄ || 238.62 | 253.39 | +6%˄ | (run time too short) |
+| TPC-H 03 || 0.59 | 0.60 | +1%˄ || 1679.51 | 1668.77 | -1%˄ | (run time too short) |
+| TPC-H 04 || 0.36 | 0.37 | +2%˄ || 2745.89 | 2698.35 | -2%˄ | (run time too short) |
+| TPC-H 05 || 0.89 | 0.91 | +2%˄ || 1116.15 | 1095.50 | -2%˄ | (run time too short) |
+| TPC-H 06 || 0.20 | 0.22 | +11%˄ || 5070.20 | 4558.56 | -10%˄ | (run time too short) |
+| TPC-H 07 || 10.44 | 10.61 | +2%˄ || 95.73 | 94.28 | -2%˄ | (run time too short) |
+| TPC-H 08 || 14.36 | 14.79 | +3%˄ || 69.61 | 67.61 | -3%˄ | (run time too short) |
+| TPC-H 09 || 3.46 | 2.86 | -17%˄ || 288.76 | 349.04 | +21%˄ | (run time too short) |
+| TPC-H 10 || 0.72 | 0.65 | -9%˄ || 1393.38 | 1530.92 | +10%˄ | (run time too short) |
+| TPC-H 11 || 0.17 | 0.18 | +3%˄ || 5856.25 | 5670.67 | -3%˄ | (run time too short) |
+| TPC-H 12 || 0.64 | 0.68 | +6%˄ || 1558.08 | 1467.13 | -6%˄ | (run time too short) |
+| TPC-H 13 || 2.07 | 1.95 | -6%˄ || 482.78 | 512.20 | +6%˄ | (run time too short) |
+| TPC-H 14 || 0.29 | 0.29 | -1%˄ || 3415.33 | 3434.99 | +1%˄ | (run time too short) |
+| TPC-H 15 || 1.20 | 1.21 | +1%˄ || 829.91 | 824.75 | -1%˄ | (run time too short) |
+| TPC-H 16 || 2.29 | 2.32 | +1%˄ || 436.61 | 430.24 | -1%˄ | (run time too short) |
+| TPC-H 17 || 0.63 | 0.52 | -17%˄ || 1578.49 | 1901.56 | +20%˄ | (run time too short) |
+| TPC-H 18 || 1.05 | 0.98 | -6%˄ || 954.55 | 1017.84 | +7%˄ | (run time too short) |
+| TPC-H 19 || 5.97 | 6.12 | +2%˄ || 167.44 | 163.36 | -2%˄ | (run time too short) |
+| TPC-H 20 || 2.59 | 2.61 | +1%˄ || 386.31 | 382.25 | -1%˄ | (run time too short) |
+| TPC-H 21 || 0.95 | 0.99 | +4%˄ || 1049.73 | 1012.44 | -4%˄ | (run time too short) |
+| TPC-H 22 || 1.16 | 1.18 | +2%˄ || 862.77 | 845.83 | -2%˄ | (run time too short) |
++----------++----------+---------+--------++----------+----------+--------+----------------------+
+| Sum || 59.19 | 58.97 | -0% || | | | |
+| Geomean || | | || | | +1% | |
++----------++----------+---------+--------++----------+----------+--------+----------------------+
+| Notes || ˄ Execution stopped due to max runs reached |
++----------++----------+---------+--------++----------+----------+--------+----------------------+
hyriseBenchmarkTPCH - multi-threaded, ordered, 1 client, 24 cores, SF 10.0
Sum of avg. item runtimes: -5% || Geometric mean of throughput changes: +5%
Configuration Overview - click to expand
+Configuration Overview---------+-------------------------------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /home/Martin.Boissier/hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCH_43b228e1bc09ffbd5956577684cb99d0e060df1c_mt_ordered.json | /home/Martin.Boissier/hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCH_556e8941a1168263ed4aedb7bf6bb4aaf25e8e28_mt_ordered.json |
+-------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 43b228e1bc09ffbd5956577684cb99d0e060df1c-dirty | 556e8941a1168263ed4aedb7bf6bb4aaf25e8e28-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| clustering | None | None |
| compiler | clang 14.0.0 | clang 14.0.0 |
| cores | 24 | 24 |
| data_preparation_cores | 0 | 0 |
| date | 2024-05-06 00:20:31 | 2024-05-06 04:16:31 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| use_prepared_statements | False | False |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [24] | [24] |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------+
++----------++----------+----------+--------++----------+----------+--------+----------------------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++----------++----------+----------+--------++----------+----------+--------+----------------------+
+| TPC-H 01 || 4302.33 | 4317.41 | +0% || 0.23 | 0.23 | -0% | 0.4584 |
+| TPC-H 02 || 49.17 | 48.87 | -1%˄ || 20.31 | 20.43 | +1%˄ | (run time too short) |
+| TPC-H 03 || 523.93 | 488.46 | -7%˄ || 1.91 | 2.05 | +7%˄ | (run time too short) |
+| TPC-H 04 || 513.45 | 512.77 | -0%˄ || 1.95 | 1.95 | +0%˄ | (run time too short) |
+| TPC-H 05 || 421.44 | 429.66 | +2%˄ || 2.37 | 2.33 | -2%˄ | (run time too short) |
+| TPC-H 06 || 44.30 | 44.91 | +1%˄ || 22.55 | 22.24 | -1%˄ | (run time too short) |
+| TPC-H 07 || 214.86 | 218.52 | +2%˄ || 4.65 | 4.58 | -2%˄ | (run time too short) |
+| TPC-H 08 || 187.62 | 184.16 | -2%˄ || 5.33 | 5.43 | +2%˄ | (run time too short) |
+| TPC-H 09 || 1786.45 | 1739.59 | -3% || 0.56 | 0.57 | +3% | 0.0000 |
+| TPC-H 10 || 920.11 | 469.51 | -49%˄ || 1.09 | 2.13 | +96%˄ | (run time too short) |
+| TPC-H 11 || 45.26 | 43.89 | -3%˄ || 22.06 | 22.75 | +3%˄ | (run time too short) |
+| TPC-H 12 || 427.44 | 425.84 | -0%˄ || 2.34 | 2.35 | +0%˄ | (run time too short) |
+| TPC-H 13 || 2948.01 | 2879.53 | -2% || 0.34 | 0.35 | +2% | 0.0001 |
+| TPC-H 14 || 105.24 | 106.32 | +1%˄ || 9.50 | 9.40 | -1%˄ | (run time too short) |
+| TPC-H 15 || 122.75 | 114.11 | -7%˄ || 8.14 | 8.76 | +8%˄ | (run time too short) |
+| TPC-H 16 || 485.66 | 487.92 | +0%˄ || 2.06 | 2.05 | -0%˄ | (run time too short) |
+| TPC-H 17 || 67.32 | 66.06 | -2%˄ || 14.85 | 15.13 | +2%˄ | (run time too short) |
+| TPC-H 18 || 1758.63 | 1530.74 | -13% || 0.57 | 0.65 | +15% | 0.0000 |
+| TPC-H 19 || 89.07 | 84.20 | -5%˄ || 11.22 | 11.87 | +6%˄ | (run time too short) |
+| TPC-H 20 || 165.79 | 180.20 | +9%˄ || 6.03 | 5.55 | -8%˄ | (run time too short) |
+| TPC-H 21 || 859.94 | 866.74 | +1%˄ || 1.16 | 1.15 | -1%˄ | (run time too short) |
+| TPC-H 22 || 106.13 | 107.03 | +1%˄ || 9.42 | 9.34 | -1%˄ | (run time too short) |
++----------++----------+----------+--------++----------+----------+--------+----------------------+
+| Sum || 16144.90 | 15346.43 | -5% || | | | |
+| Geomean || | | || | | +5% | |
++----------++----------+----------+--------++----------+----------+--------+----------------------+
+| Notes || ˄ Execution stopped due to max runs reached |
++----------++----------+----------+--------++----------+----------+--------+----------------------+
hyriseBenchmarkTPCH - multi-threaded, shuffled, 24 clients, 24 cores, SF 10.0
Sum of avg. item runtimes: -2% || Geometric mean of throughput changes: +2%
Configuration Overview - click to expand
+Configuration Overview---------+-----------------------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /home/Martin.Boissier/hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCH_43b228e1bc09ffbd5956577684cb99d0e060df1c_mt.json | /home/Martin.Boissier/hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCH_556e8941a1168263ed4aedb7bf6bb4aaf25e8e28_mt.json |
+-------------------------------+-----------------------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 43b228e1bc09ffbd5956577684cb99d0e060df1c-dirty | 556e8941a1168263ed4aedb7bf6bb4aaf25e8e28-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 24 | 24 |
| clustering | None | None |
| compiler | clang 14.0.0 | clang 14.0.0 |
| cores | 24 | 24 |
| data_preparation_cores | 0 | 0 |
| date | 2024-05-06 00:31:41 | 2024-05-06 04:27:11 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| use_prepared_statements | False | False |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [24] | [24] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+-----------------------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------+
++----------++----------+----------+--------++----------+----------+--------+---------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++----------++----------+----------+--------++----------+----------+--------+---------+
+| TPC-H 01 || 5071.69 | 4972.19 | -2% || 0.55 | 0.56 | +2% | 0.2996 |
+| TPC-H 02 || 245.49 | 351.99 | +43% || 0.55 | 0.56 | +2% | 0.0440 |
+| TPC-H 03 || 1897.11 | 1929.10 | +2% || 0.55 | 0.56 | +2% | 0.7914 |
+| TPC-H 04 || 1898.35 | 1756.46 | -7% || 0.55 | 0.56 | +2% | 0.3271 |
+| TPC-H 05 || 2803.56 | 2786.14 | -1% || 0.55 | 0.56 | +2% | 0.9175 |
+| TPC-H 06 || 513.36 | 654.89 | +28% || 0.55 | 0.56 | +2% | 0.0819 |
+| TPC-H 07 || 2219.92 | 2375.05 | +7% || 0.55 | 0.56 | +1% | 0.3517 |
+| TPC-H 08 || 1710.91 | 1677.28 | -2% || 0.55 | 0.56 | +1% | 0.8159 |
+| TPC-H 09 || 4822.57 | 4428.50 | -8% || 0.55 | 0.56 | +2% | 0.0444 |
+| TPC-H 10 || 2716.84 | 2375.97 | -13% || 0.55 | 0.56 | +2% | 0.0291 |
+| TPC-H 11 || 278.33 | 312.53 | +12% || 0.55 | 0.56 | +2% | 0.5292 |
+| TPC-H 12 || 1943.08 | 1805.55 | -7% || 0.55 | 0.56 | +2% | 0.2532 |
+| TPC-H 13 || 4382.27 | 4575.91 | +4% || 0.55 | 0.56 | +2% | 0.0935 |
+| TPC-H 14 || 732.17 | 965.82 | +32% || 0.55 | 0.56 | +2% | 0.0124 |
+| TPC-H 15 || 488.89 | 478.96 | -2% || 0.55 | 0.56 | +2% | 0.8852 |
+| TPC-H 16 || 1392.07 | 1471.62 | +6% || 0.55 | 0.56 | +2% | 0.4517 |
+| TPC-H 17 || 659.66 | 502.46 | -24% || 0.55 | 0.56 | +2% | 0.0622 |
+| TPC-H 18 || 2427.36 | 2522.57 | +4% || 0.55 | 0.56 | +2% | 0.3200 |
+| TPC-H 19 || 817.23 | 882.65 | +8% || 0.55 | 0.56 | +2% | 0.5600 |
+| TPC-H 20 || 1355.11 | 1278.63 | -6% || 0.55 | 0.56 | +2% | 0.5141 |
+| TPC-H 21 || 4248.94 | 3837.79 | -10% || 0.55 | 0.56 | +2% | 0.0630 |
+| TPC-H 22 || 792.89 | 761.14 | -4% || 0.55 | 0.56 | +2% | 0.7405 |
++----------++----------+----------+--------++----------+----------+--------+---------+
+| Sum || 43417.82 | 42703.23 | -2% || | | | |
+| Geomean || | | || | | +2% | |
++----------++----------+----------+--------++----------+----------+--------+---------+
hyriseBenchmarkTPCDS - single-threaded
Sum of avg. item runtimes: +6% || Geometric mean of throughput changes: -1%
Configuration Overview - click to expand
+Configuration Overview---+------------------------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /home/Martin.Boissier/hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCDS_43b228e1bc09ffbd5956577684cb99d0e060df1c_st.json | /home/Martin.Boissier/hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCDS_556e8941a1168263ed4aedb7bf6bb4aaf25e8e28_st.json |
+-------------------------+------------------------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 43b228e1bc09ffbd5956577684cb99d0e060df1c-dirty | 556e8941a1168263ed4aedb7bf6bb4aaf25e8e28-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 14.0.0 | clang 14.0.0 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2024-05-06 00:53:19 | 2024-05-06 04:48:48 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| time_unit | ns | ns |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------+------------------------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------+
++---------++----------+----------+--------++----------+----------+--------+----------------------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++---------++----------+----------+--------++----------+----------+--------+----------------------+
+| 01 || 210.57 | 219.74 | +4%˄ || 4.75 | 4.55 | -4%˄ | (run time too short) |
+| 03 || 63.31 | 64.07 | +1%˄ || 15.79 | 15.61 | -1%˄ | (run time too short) |
+| 06 || 192.63 | 190.16 | -1%˄ || 5.19 | 5.26 | +1%˄ | (run time too short) |
+| 07 || 258.21 | 275.01 | +7%˄ || 3.87 | 3.64 | -6%˄ | (run time too short) |
+| 09 || 687.29 | 689.12 | +0%˄ || 1.45 | 1.45 | -0%˄ | (run time too short) |
+| 10 || 130.56 | 129.52 | -1%˄ || 7.66 | 7.72 | +1%˄ | (run time too short) |
+| 13 || 438.01 | 450.62 | +3%˄ || 2.28 | 2.22 | -3%˄ | (run time too short) |
+| 15 || 108.49 | 110.87 | +2%˄ || 9.22 | 9.02 | -2%˄ | (run time too short) |
+| 16 || 57.72 | 59.57 | +3%˄ || 17.32 | 16.79 | -3%˄ | (run time too short) |
+| 17 || 317.59 | 316.28 | -0%˄ || 3.15 | 3.16 | +0%˄ | (run time too short) |
+| 19 || 107.01 | 105.22 | -2%˄ || 9.34 | 9.50 | +2%˄ | (run time too short) |
+| 25 || 168.26 | 167.88 | -0%˄ || 5.94 | 5.96 | +0%˄ | (run time too short) |
+| 26 || 117.19 | 122.63 | +5%˄ || 8.53 | 8.15 | -4%˄ | (run time too short) |
+| 28 || 557.21 | 544.15 | -2%˄ || 1.79 | 1.84 | +2%˄ | (run time too short) |
+| 29 || 454.35 | 444.86 | -2%˄ || 2.20 | 2.25 | +2%˄ | (run time too short) |
+| 31 || 1290.17 | 1267.18 | -2% || 0.78 | 0.79 | +2% | 0.0000 |
+| 32 || 27.90 | 30.00 | +8%˄ || 35.83 | 33.33 | -7%˄ | (run time too short) |
+| 34 || 150.59 | 153.69 | +2%˄ || 6.64 | 6.51 | -2%˄ | (run time too short) |
+| 35 || 597.78 | 597.86 | +0%˄ || 1.67 | 1.67 | -0%˄ | (run time too short) |
+| 37 || 666.68 | 743.12 | +11%˄ || 1.50 | 1.35 | -10%˄ | (run time too short) |
+| 39a || 1535.29 | 1498.00 | -2% || 0.65 | 0.67 | +2% | 0.0000 |
+| 39b || 1524.29 | 1489.24 | -2% || 0.66 | 0.67 | +2% | 0.0000 |
+| 41 || 276.71 | 280.14 | +1%˄ || 3.61 | 3.57 | -1%˄ | (run time too short) |
+| 42 || 87.48 | 87.21 | -0%˄ || 11.43 | 11.47 | +0%˄ | (run time too short) |
+| 43 || 949.07 | 972.21 | +2%˄ || 1.05 | 1.03 | -2%˄ | (run time too short) |
+| 45 || 131.80 | 129.05 | -2%˄ || 7.59 | 7.75 | +2%˄ | (run time too short) |
+| 48 || 939.87 | 951.69 | +1%˄ || 1.06 | 1.05 | -1%˄ | (run time too short) |
+| 50 || 124.35 | 122.48 | -2%˄ || 8.04 | 8.16 | +2%˄ | (run time too short) |
+| 52 || 88.25 | 85.81 | -3%˄ || 11.33 | 11.65 | +3%˄ | (run time too short) |
+| 55 || 83.45 | 80.32 | -4%˄ || 11.98 | 12.45 | +4%˄ | (run time too short) |
+| 62 || 526.77 | 532.57 | +1%˄ || 1.90 | 1.88 | -1%˄ | (run time too short) |
+| 65 || 1634.39 | 1770.44 | +8% || 0.61 | 0.56 | -8% | 0.0000 |
+| 69 || 145.25 | 141.82 | -2%˄ || 6.88 | 7.05 | +2%˄ | (run time too short) |
+| 73 || 82.69 | 78.71 | -5%˄ || 12.09 | 12.70 | +5%˄ | (run time too short) |
+| 79 || 479.49 | 485.97 | +1%˄ || 2.09 | 2.06 | -1%˄ | (run time too short) |
+| 81 || 150.19 | 151.89 | +1%˄ || 6.66 | 6.58 | -1%˄ | (run time too short) |
+| 82 || 711.55 | 795.03 | +12%˄ || 1.41 | 1.26 | -10%˄ | (run time too short) |
+| 83 || 39.12 | 39.39 | +1%˄ || 25.56 | 25.38 | -1%˄ | (run time too short) |
+| 84 || 13.85 | 13.42 | -3%˄ || 72.20 | 74.52 | +3%˄ | (run time too short) |
+| 85 || 155.32 | 152.15 | -2%˄ || 6.44 | 6.57 | +2%˄ | (run time too short) |
+| 88 || 679.41 | 653.22 | -4%˄ || 1.47 | 1.53 | +4%˄ | (run time too short) |
+| 91 || 15.18 | 15.12 | -0%˄ || 65.85 | 66.12 | +0%˄ | (run time too short) |
+| 92 || 41.36 | 38.88 | -6%˄ || 24.18 | 25.72 | +6%˄ | (run time too short) |
+| 93 || 3677.86 | 3679.68 | +0% || 0.27 | 0.27 | -0% | 0.6890 |
+| 94 || 39.87 | 39.40 | -1%˄ || 25.08 | 25.38 | +1%˄ | (run time too short) |
+| 95 || 4378.12 | 4373.36 | -0% || 0.23 | 0.23 | +0% | 0.9433 |
+| 96 || 63.31 | 61.44 | -3%˄ || 15.80 | 16.27 | +3%˄ | (run time too short) |
+| 97 || 2412.40 | 3822.21 | +58% || 0.41 | 0.26 | -37% | 0.0000 |
+| 99 || 987.97 | 999.11 | +1%˄ || 1.01 | 1.00 | -1%˄ | (run time too short) |
++---------++----------+----------+--------++----------+----------+--------+----------------------+
+| Sum || 28576.20 | 30221.51 | +6% || | | | |
+| Geomean || | | || | | -1% | |
++---------++----------+----------+--------++----------+----------+--------+----------------------+
+| Notes || ˄ Execution stopped due to max runs reached |
++---------++----------+----------+--------++----------+----------+--------+----------------------+
hyriseBenchmarkTPCDS - multi-threaded, ordered, 1 client, 24 cores
Sum of avg. item runtimes: -5% || Geometric mean of throughput changes: +1%
Configuration Overview - click to expand
+Configuration Overview---------+--------------------------------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /home/Martin.Boissier/hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCDS_43b228e1bc09ffbd5956577684cb99d0e060df1c_mt_ordered.json | /home/Martin.Boissier/hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCDS_556e8941a1168263ed4aedb7bf6bb4aaf25e8e28_mt_ordered.json |
+-------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 43b228e1bc09ffbd5956577684cb99d0e060df1c-dirty | 556e8941a1168263ed4aedb7bf6bb4aaf25e8e28-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 14.0.0 | clang 14.0.0 |
| cores | 24 | 24 |
| data_preparation_cores | 0 | 0 |
| date | 2024-05-06 01:13:42 | 2024-05-06 05:07:33 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [24] | [24] |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------+
++---------++----------+----------+--------++----------+----------+--------+----------------------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++---------++----------+----------+--------++----------+----------+--------+----------------------+
+| 01 || 189.75 | 185.91 | -2%˄ || 5.27 | 5.37 | +2%˄ | (run time too short) |
+| 03 || 24.67 | 23.93 | -3%˄ || 40.49 | 41.73 | +3%˄ | (run time too short) |
+| 06 || 130.56 | 129.68 | -1%˄ || 7.66 | 7.71 | +1%˄ | (run time too short) |
+| 07 || 152.06 | 143.70 | -5%˄ || 6.57 | 6.95 | +6%˄ | (run time too short) |
+| 09 || 94.55 | 89.42 | -5%˄ || 10.57 | 11.18 | +6%˄ | (run time too short) |
+| 10 || 27.79 | 27.80 | +0%˄ || 35.94 | 35.93 | -0%˄ | (run time too short) |
+| 13 || 189.70 | 193.25 | +2%˄ || 5.27 | 5.17 | -2%˄ | (run time too short) |
+| 15 || 50.78 | 51.26 | +1%˄ || 19.68 | 19.49 | -1%˄ | (run time too short) |
+| 16 || 23.34 | 23.32 | -0%˄ || 42.79 | 42.83 | +0%˄ | (run time too short) |
+| 17 || 102.97 | 102.25 | -1%˄ || 9.71 | 9.78 | +1%˄ | (run time too short) |
+| 19 || 52.29 | 51.75 | -1%˄ || 19.11 | 19.31 | +1%˄ | (run time too short) |
+| 25 || 78.18 | 77.34 | -1%˄ || 12.79 | 12.92 | +1%˄ | (run time too short) |
+| 26 || 85.17 | 80.07 | -6%˄ || 11.73 | 12.47 | +6%˄ | (run time too short) |
+| 28 || 110.06 | 112.43 | +2%˄ || 9.08 | 8.89 | -2%˄ | (run time too short) |
+| 29 || 283.10 | 281.74 | -0%˄ || 3.53 | 3.55 | +0%˄ | (run time too short) |
+| 31 || 387.14 | 374.62 | -3%˄ || 2.58 | 2.67 | +3%˄ | (run time too short) |
+| 32 || 20.43 | 20.06 | -2%˄ || 48.88 | 49.74 | +2%˄ | (run time too short) |
+| 34 || 67.92 | 66.03 | -3%˄ || 14.71 | 15.14 | +3%˄ | (run time too short) |
+| 35 || 322.78 | 313.98 | -3%˄ || 3.10 | 3.18 | +3%˄ | (run time too short) |
+| 37 || 140.50 | 148.03 | +5%˄ || 7.12 | 6.75 | -5%˄ | (run time too short) |
+| 39a || 634.20 | 636.09 | +0%˄ || 1.58 | 1.57 | -0%˄ | (run time too short) |
+| 39b || 624.25 | 570.30 | -9%˄ || 1.60 | 1.75 | +9%˄ | (run time too short) |
+| 41 || 316.54 | 322.80 | +2%˄ || 3.16 | 3.10 | -2%˄ | (run time too short) |
+| 42 || 35.30 | 35.28 | -0%˄ || 28.30 | 28.32 | +0%˄ | (run time too short) |
+| 43 || 360.32 | 366.31 | +2%˄ || 2.77 | 2.73 | -2%˄ | (run time too short) |
+| 45 || 42.05 | 41.95 | -0%˄ || 23.76 | 23.82 | +0%˄ | (run time too short) |
+| 48 || 314.20 | 313.27 | -0%˄ || 3.18 | 3.19 | +0%˄ | (run time too short) |
+| 50 || 79.38 | 78.12 | -2%˄ || 12.59 | 12.79 | +2%˄ | (run time too short) |
+| 52 || 37.52 | 36.92 | -2%˄ || 26.63 | 27.06 | +2%˄ | (run time too short) |
+| 55 || 32.68 | 32.52 | -0%˄ || 30.57 | 30.72 | +0%˄ | (run time too short) |
+| 62 || 295.66 | 289.72 | -2%˄ || 3.38 | 3.45 | +2%˄ | (run time too short) |
+| 65 || 1657.13 | 1387.02 | -16% || 0.60 | 0.72 | +19% | 0.0000 |
+| 69 || 52.01 | 51.73 | -1%˄ || 19.21 | 19.32 | +1%˄ | (run time too short) |
+| 73 || 39.60 | 37.98 | -4%˄ || 25.24 | 26.31 | +4%˄ | (run time too short) |
+| 79 || 406.99 | 410.74 | +1%˄ || 2.46 | 2.43 | -1%˄ | (run time too short) |
+| 81 || 155.05 | 141.02 | -9%˄ || 6.44 | 7.08 | +10%˄ | (run time too short) |
+| 82 || 158.72 | 166.33 | +5%˄ || 6.30 | 6.01 | -5%˄ | (run time too short) |
+| 83 || 32.83 | 30.95 | -6%˄ || 30.41 | 32.25 | +6%˄ | (run time too short) |
+| 84 || 6.66 | 7.00 | +5%˄ || 149.79 | 142.29 | -5%˄ | (run time too short) |
+| 85 || 44.01 | 45.21 | +3%˄ || 22.70 | 22.10 | -3%˄ | (run time too short) |
+| 88 || 79.66 | 79.03 | -1%˄ || 12.55 | 12.65 | +1%˄ | (run time too short) |
+| 91 || 9.81 | 10.40 | +6%˄ || 101.65 | 95.93 | -6%˄ | (run time too short) |
+| 92 || 33.62 | 33.67 | +0%˄ || 29.70 | 29.66 | -0%˄ | (run time too short) |
+| 93 || 598.29 | 593.35 | -1%˄ || 1.67 | 1.69 | +1%˄ | (run time too short) |
+| 94 || 21.50 | 22.63 | +5%˄ || 46.45 | 44.14 | -5%˄ | (run time too short) |
+| 95 || 537.35 | 539.51 | +0%˄ || 1.86 | 1.85 | -0%˄ | (run time too short) |
+| 96 || 30.91 | 29.58 | -4%˄ || 32.32 | 33.77 | +4%˄ | (run time too short) |
+| 97 || 1363.64 | 1214.66 | -11%˄ || 0.73 | 0.82 | +12%˄ | 0.0000 |
+| 99 || 500.08 | 500.98 | +0%˄ || 2.00 | 2.00 | -0%˄ | (run time too short) |
++---------++----------+----------+--------++----------+----------+--------+----------------------+
+| Sum || 11033.72 | 10521.64 | -5% || | | | |
+| Geomean || | | || | | +1% | |
++---------++----------+----------+--------++----------+----------+--------+----------------------+
+| Notes || ˄ Execution stopped due to max runs reached |
++---------++----------+----------+--------++----------+----------+--------+----------------------+
hyriseBenchmarkTPCDS - multi-threaded, shuffled, 24 clients, 24 cores
Sum of avg. item runtimes: +4% || Geometric mean of throughput changes: -4%
Configuration Overview - click to expand
+Configuration Overview---------+------------------------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /home/Martin.Boissier/hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCDS_43b228e1bc09ffbd5956577684cb99d0e060df1c_mt.json | /home/Martin.Boissier/hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCDS_556e8941a1168263ed4aedb7bf6bb4aaf25e8e28_mt.json |
+-------------------------------+------------------------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 43b228e1bc09ffbd5956577684cb99d0e060df1c-dirty | 556e8941a1168263ed4aedb7bf6bb4aaf25e8e28-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 24 | 24 |
| compiler | clang 14.0.0 | clang 14.0.0 |
| cores | 24 | 24 |
| data_preparation_cores | 0 | 0 |
| date | 2024-05-06 01:23:57 | 2024-05-06 05:17:42 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [24] | [24] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+------------------------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------+
++---------++----------+----------+--------++----------+----------+--------+---------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++---------++----------+----------+--------++----------+----------+--------+---------+
+| 01 || 400.51 | 514.50 | +28% || 0.64 | 0.61 | -4% | 0.0021 |
+| 03 || 222.35 | 186.42 | -16% || 0.64 | 0.61 | -4% | 0.1786 |
+| 06 || 537.88 | 586.76 | +9% || 0.64 | 0.61 | -4% | 0.2294 |
+| 07 || 629.81 | 642.40 | +2% || 0.64 | 0.61 | -4% | 0.7917 |
+| 09 || 571.13 | 550.67 | -4% || 0.64 | 0.61 | -4% | 0.6761 |
+| 10 || 466.63 | 450.20 | -4% || 0.64 | 0.61 | -4% | 0.7287 |
+| 13 || 1065.11 | 1115.89 | +5% || 0.64 | 0.61 | -4% | 0.4017 |
+| 15 || 284.01 | 334.71 | +18% || 0.64 | 0.61 | -4% | 0.1448 |
+| 16 || 309.87 | 289.44 | -7% || 0.64 | 0.61 | -4% | 0.5819 |
+| 17 || 776.81 | 863.42 | +11% || 0.64 | 0.61 | -4% | 0.1154 |
+| 19 || 405.51 | 430.83 | +6% || 0.64 | 0.61 | -4% | 0.5071 |
+| 25 || 677.39 | 637.42 | -6% || 0.64 | 0.61 | -4% | 0.4589 |
+| 26 || 324.68 | 341.95 | +5% || 0.64 | 0.61 | -4% | 0.6046 |
+| 28 || 939.12 | 863.98 | -8% || 0.64 | 0.61 | -4% | 0.2824 |
+| 29 || 968.89 | 940.71 | -3% || 0.64 | 0.61 | -4% | 0.6065 |
+| 31 || 1611.30 | 1674.90 | +4% || 0.64 | 0.61 | -4% | 0.4316 |
+| 32 || 104.49 | 116.91 | +12% || 0.64 | 0.61 | -4% | 0.4996 |
+| 34 || 539.69 | 517.39 | -4% || 0.64 | 0.61 | -4% | 0.6315 |
+| 35 || 1295.48 | 1249.96 | -4% || 0.64 | 0.61 | -4% | 0.4927 |
+| 37 || 640.25 | 688.60 | +8% || 0.64 | 0.61 | -4% | 0.2762 |
+| 39a || 1596.40 | 1696.79 | +6% || 0.64 | 0.61 | -4% | 0.1150 |
+| 39b || 1482.41 | 1658.02 | +12% || 0.64 | 0.61 | -4% | 0.0040 |
+| 41 || 1336.34 | 1567.85 | +17% || 0.64 | 0.61 | -4% | 0.0032 |
+| 42 || 327.15 | 365.03 | +12% || 0.64 | 0.61 | -4% | 0.3115 |
+| 43 || 1072.22 | 1138.25 | +6% || 0.64 | 0.61 | -4% | 0.1943 |
+| 45 || 552.69 | 545.73 | -1% || 0.64 | 0.61 | -4% | 0.8948 |
+| 48 || 1465.06 | 1379.94 | -6% || 0.64 | 0.61 | -4% | 0.1977 |
+| 50 || 624.85 | 721.46 | +15% || 0.64 | 0.61 | -4% | 0.0640 |
+| 52 || 330.64 | 359.28 | +9% || 0.64 | 0.61 | -4% | 0.4548 |
+| 55 || 299.29 | 292.40 | -2% || 0.64 | 0.61 | -4% | 0.8325 |
+| 62 || 727.48 | 768.25 | +6% || 0.64 | 0.61 | -4% | 0.3686 |
+| 65 || 2547.86 | 2597.83 | +2% || 0.64 | 0.61 | -4% | 0.2910 |
+| 69 || 689.32 | 716.97 | +4% || 0.64 | 0.61 | -4% | 0.6426 |
+| 73 || 346.48 | 351.68 | +2% || 0.64 | 0.61 | -4% | 0.8931 |
+| 79 || 987.48 | 1041.72 | +5% || 0.64 | 0.61 | -4% | 0.2833 |
+| 81 || 341.35 | 376.24 | +10% || 0.64 | 0.61 | -4% | 0.2342 |
+| 82 || 680.54 | 775.27 | +14% || 0.64 | 0.61 | -4% | 0.0550 |
+| 83 || 214.14 | 196.94 | -8% || 0.64 | 0.61 | -4% | 0.6083 |
+| 84 || 88.94 | 76.75 | -14% || 0.64 | 0.61 | -4% | 0.4941 |
+| 85 || 520.93 | 516.87 | -1% || 0.64 | 0.61 | -4% | 0.9321 |
+| 88 || 1472.83 | 1626.97 | +10% || 0.64 | 0.61 | -4% | 0.0851 |
+| 91 || 117.06 | 165.18 | +41% || 0.64 | 0.61 | -4% | 0.0763 |
+| 92 || 192.66 | 203.85 | +6% || 0.64 | 0.61 | -4% | 0.7036 |
+| 93 || 1416.85 | 1497.68 | +6% || 0.64 | 0.61 | -4% | 0.1885 |
+| 94 || 281.07 | 269.61 | -4% || 0.64 | 0.61 | -4% | 0.7435 |
+| 95 || 1371.67 | 1391.38 | +1% || 0.64 | 0.61 | -4% | 0.7293 |
+| 96 || 256.43 | 250.14 | -2% || 0.64 | 0.61 | -4% | 0.8062 |
+| 97 || 2420.90 | 2605.33 | +8% || 0.64 | 0.61 | -4% | 0.0062 |
+| 99 || 957.35 | 974.47 | +2% || 0.64 | 0.61 | -4% | 0.6924 |
++---------++----------+----------+--------++----------+----------+--------+---------+
+| Sum || 37489.27 | 39124.97 | +4% || | | | |
+| Geomean || | | || | | -4% | |
++---------++----------+----------+--------++----------+----------+--------+---------+
hyriseBenchmarkTPCC - single-threaded
Sum of avg. item runtimes: -4% || Geometric mean of throughput changes: +3%
Configuration Overview - click to expand
+Configuration Overview---+-----------------------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /home/Martin.Boissier/hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCC_43b228e1bc09ffbd5956577684cb99d0e060df1c_st.json | /home/Martin.Boissier/hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCC_556e8941a1168263ed4aedb7bf6bb4aaf25e8e28_st.json |
+-------------------------+-----------------------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 43b228e1bc09ffbd5956577684cb99d0e060df1c-dirty | 556e8941a1168263ed4aedb7bf6bb4aaf25e8e28-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 14.0.0 | clang 14.0.0 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2024-05-06 01:44:19 | 2024-05-06 05:38:00 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10 | 10 |
| time_unit | ns | ns |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------+-----------------------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------+
++--------------++----------+---------+--------++----------+----------+--------+----------------------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++--------------++----------+---------+--------++----------+----------+--------+----------------------+
+| Delivery || 58.18 | 56.75 | -2% || 1.45 | 1.83 | +26% | (run time too short) |
+| New-Order || 42.04 | 39.86 | -5% || 18.26 | 18.97 | +4% | 0.0000 |
+| Order-Status || 1.92 | 1.87 | -3% || 2.05 | 1.72 | -16% | 0.0083 |
+| Payment || 7.54 | 7.32 | -3% || 18.31 | 17.77 | -3% | 0.0000 |
+| Stock-Level || 3.25 | 3.15 | -3% || 1.60 | 1.75 | +9% | (run time too short) |
++--------------++----------+---------+--------++----------+----------+--------+----------------------+
+| Sum || 112.92 | 108.96 | -4% || | | | |
+| Geomean || | | || | | +3% | |
++--------------++----------+---------+--------++----------+----------+--------+----------------------+
hyriseBenchmarkTPCC - multi-threaded, shuffled, 24 clients, 10 warehouses, 24 cores (high contention)
Sum of avg. item runtimes: -1% || Geometric mean of throughput changes: +2%
Configuration Overview - click to expand
+Configuration Overview---------+--------------------------------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /home/Martin.Boissier/hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCC_43b228e1bc09ffbd5956577684cb99d0e060df1c_mt_highcont.json | /home/Martin.Boissier/hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCC_556e8941a1168263ed4aedb7bf6bb4aaf25e8e28_mt_highcont.json |
+-------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 43b228e1bc09ffbd5956577684cb99d0e060df1c-dirty | 556e8941a1168263ed4aedb7bf6bb4aaf25e8e28-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 24 | 24 |
| compiler | clang 14.0.0 | clang 14.0.0 |
| cores | 24 | 24 |
| data_preparation_cores | 0 | 0 |
| date | 2024-05-06 01:51:57 | 2024-05-06 05:39:05 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 600000000000 | 600000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10 | 10 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [24] | [24] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------+
++--------------++----------+---------+--------++----------+----------+--------+---------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++--------------++----------+---------+--------++----------+----------+--------+---------+
+| Delivery || 113.89 | 113.78 | -0% || 22.15 | 22.23 | +0% | 0.8330 |
+| unsucc.: || 1.92 | 1.43 | -26% || 6.95 | 6.95 | -0% | |
+| New-Order || 69.64 | 68.52 | -2% || 257.26 | 259.82 | +1% | 0.0000 |
+| unsucc.: || 4.87 | 5.35 | +10% || 68.24 | 70.23 | +3% | |
+| Order-Status || 5.77 | 5.63 | -3% || 29.00 | 29.62 | +2% | 0.2434 |
+| Payment || 13.08 | 13.00 | -1% || 189.83 | 193.68 | +2% | 0.0920 |
+| unsucc.: || 2.38 | 2.42 | +2% || 120.89 | 123.92 | +3% | |
+| Stock-Level || 8.91 | 9.25 | +4% || 28.81 | 29.59 | +3% | 0.0694 |
++--------------++----------+---------+--------++----------+----------+--------+---------+
+| Sum || 211.29 | 210.18 | -1% || | | | |
+| Geomean || | | || | | +2% | |
++--------------++----------+---------+--------++----------+----------+--------+---------+
hyriseBenchmarkTPCC - multi-threaded, shuffled, 10 clients, 10 warehouses, 24 cores (low contention)
Sum of avg. item runtimes: -1% || Geometric mean of throughput changes: +1%
Configuration Overview - click to expand
+Configuration Overview---------+-------------------------------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /home/Martin.Boissier/hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCC_43b228e1bc09ffbd5956577684cb99d0e060df1c_mt_lowcont.json | /home/Martin.Boissier/hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkTPCC_556e8941a1168263ed4aedb7bf6bb4aaf25e8e28_mt_lowcont.json |
+-------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 43b228e1bc09ffbd5956577684cb99d0e060df1c-dirty | 556e8941a1168263ed4aedb7bf6bb4aaf25e8e28-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 10 | 10 |
| compiler | clang 14.0.0 | clang 14.0.0 |
| cores | 24 | 24 |
| data_preparation_cores | 0 | 0 |
| date | 2024-05-06 02:02:05 | 2024-05-06 05:49:13 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 600000000000 | 600000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10 | 10 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [24] | [24] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------+
++--------------++----------+---------+--------++----------+----------+--------+---------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++--------------++----------+---------+--------++----------+----------+--------+---------+
+| Delivery || 90.64 | 90.12 | -1% || 10.65 | 10.63 | -0% | 0.0004 |
+| unsucc.: || 0.62 | 0.58 | -6% || 0.99 | 0.95 | -4% | |
+| New-Order || 63.61 | 62.36 | -2% || 118.23 | 120.65 | +2% | 0.0000 |
+| unsucc.: || 4.26 | 4.13 | -3% || 11.86 | 11.89 | +0% | |
+| Order-Status || 3.90 | 3.92 | +1% || 11.67 | 11.91 | +2% | 0.3115 |
+| Payment || 12.90 | 12.76 | -1% || 101.78 | 103.05 | +1% | 0.0000 |
+| unsucc.: || 1.44 | 1.46 | +1% || 22.58 | 23.62 | +5% | |
+| Stock-Level || 5.53 | 5.52 | -0% || 11.57 | 11.73 | +1% | 0.5242 |
++--------------++----------+---------+--------++----------+----------+--------+---------+
+| Sum || 176.58 | 174.67 | -1% || | | | |
+| Geomean || | | || | | +1% | |
++--------------++----------+---------+--------++----------+----------+--------+---------+
hyriseBenchmarkJoinOrder - single-threaded
Sum of avg. item runtimes: -0% || Geometric mean of throughput changes: +0%
Configuration Overview - click to expand
+Configuration Overview---+----------------------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /home/Martin.Boissier/hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkJoinOrder_43b228e1bc09ffbd5956577684cb99d0e060df1c_st.json | /home/Martin.Boissier/hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkJoinOrder_556e8941a1168263ed4aedb7bf6bb4aaf25e8e28_st.json |
+-------------------------+----------------------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 43b228e1bc09ffbd5956577684cb99d0e060df1c-dirty | 556e8941a1168263ed4aedb7bf6bb4aaf25e8e28-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 14.0.0 | clang 14.0.0 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2024-05-06 02:15:41 | 2024-05-06 06:03:23 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| time_unit | ns | ns |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------+----------------------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------+
++---------++----------+----------+--------++----------+----------+--------+----------------------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++---------++----------+----------+--------++----------+----------+--------+----------------------+
+| 10a || 153.18 | 149.71 | -2%˄ || 6.53 | 6.68 | +2%˄ | (run time too short) |
+| 10b || 100.78 | 99.20 | -2%˄ || 9.92 | 10.08 | +2%˄ | (run time too short) |
+| 10c || 358.78 | 356.28 | -1%˄ || 2.79 | 2.81 | +1%˄ | (run time too short) |
+| 11a || 105.65 | 106.75 | +1%˄ || 9.47 | 9.37 | -1%˄ | (run time too short) |
+| 11b || 100.57 | 101.49 | +1%˄ || 9.94 | 9.85 | -1%˄ | (run time too short) |
+| 11c || 20.78 | 20.69 | -0%˄ || 48.11 | 48.33 | +0%˄ | (run time too short) |
+| 11d || 23.26 | 23.23 | -0%˄ || 42.99 | 43.05 | +0%˄ | (run time too short) |
+| 12a || 31.78 | 31.79 | +0%˄ || 31.46 | 31.45 | -0%˄ | (run time too short) |
+| 12b || 26.65 | 26.75 | +0%˄ || 37.52 | 37.38 | -0%˄ | (run time too short) |
+| 12c || 73.25 | 73.01 | -0%˄ || 13.65 | 13.70 | +0%˄ | (run time too short) |
+| 13a || 179.36 | 178.59 | -0%˄ || 5.58 | 5.60 | +0%˄ | (run time too short) |
+| 13b || 231.43 | 230.80 | -0%˄ || 4.32 | 4.33 | +0%˄ | (run time too short) |
+| 13c || 186.82 | 186.52 | -0%˄ || 5.35 | 5.36 | +0%˄ | (run time too short) |
+| 13d || 505.81 | 507.19 | +0%˄ || 1.98 | 1.97 | -0%˄ | (run time too short) |
+| 14a || 102.84 | 101.78 | -1%˄ || 9.72 | 9.82 | +1%˄ | (run time too short) |
+| 14b || 108.19 | 108.24 | +0%˄ || 9.24 | 9.24 | -0%˄ | (run time too short) |
+| 14c || 211.97 | 210.44 | -1%˄ || 4.72 | 4.75 | +1%˄ | (run time too short) |
+| 15a || 77.78 | 77.41 | -0%˄ || 12.86 | 12.92 | +0%˄ | (run time too short) |
+| 15b || 81.92 | 81.44 | -1%˄ || 12.21 | 12.28 | +1%˄ | (run time too short) |
+| 15c || 51.20 | 50.62 | -1%˄ || 19.53 | 19.75 | +1%˄ | (run time too short) |
+| 15d || 48.61 | 47.97 | -1%˄ || 20.57 | 20.84 | +1%˄ | (run time too short) |
+| 16a || 1324.91 | 1307.18 | -1% || 0.75 | 0.77 | +1% | 0.0000 |
+| 16b || 2538.38 | 2500.35 | -1% || 0.39 | 0.40 | +2% | 0.0005 |
+| 16c || 1482.52 | 1491.73 | +1% || 0.67 | 0.67 | -1% | 0.0109 |
+| 16d || 1445.24 | 1447.34 | +0% || 0.69 | 0.69 | -0% | 0.5113 |
+| 17a || 466.51 | 464.95 | -0%˄ || 2.14 | 2.15 | +0%˄ | (run time too short) |
+| 17b || 373.68 | 372.11 | -0%˄ || 2.68 | 2.69 | +0%˄ | (run time too short) |
+| 17c || 355.19 | 352.92 | -1%˄ || 2.82 | 2.83 | +1%˄ | (run time too short) |
+| 17d || 438.72 | 438.04 | -0%˄ || 2.28 | 2.28 | +0%˄ | (run time too short) |
+| 17e || 1557.38 | 1567.76 | +1% || 0.64 | 0.64 | -1% | 0.0000 |
+| 17f || 931.32 | 929.71 | -0%˄ || 1.07 | 1.08 | +0%˄ | (run time too short) |
+| 18a || 143.00 | 143.70 | +0%˄ || 6.99 | 6.96 | -0%˄ | (run time too short) |
+| 18b || 111.10 | 110.43 | -1%˄ || 9.00 | 9.05 | +1%˄ | (run time too short) |
+| 18c || 201.95 | 202.18 | +0%˄ || 4.95 | 4.95 | -0%˄ | (run time too short) |
+| 19a || 224.07 | 223.46 | -0%˄ || 4.46 | 4.47 | +0%˄ | (run time too short) |
+| 19b || 199.99 | 201.02 | +1%˄ || 5.00 | 4.97 | -1%˄ | (run time too short) |
+| 19c || 266.07 | 264.68 | -1%˄ || 3.76 | 3.78 | +1%˄ | (run time too short) |
+| 19d || 700.80 | 690.07 | -2%˄ || 1.43 | 1.45 | +2%˄ | (run time too short) |
+| 1a || 9.61 | 9.66 | +0%˄ || 104.01 | 103.50 | -0%˄ | (run time too short) |
+| 1b || 16.14 | 15.88 | -2%˄ || 61.95 | 62.95 | +2%˄ | (run time too short) |
+| 1c || 22.73 | 22.18 | -2%˄ || 43.99 | 45.08 | +2%˄ | (run time too short) |
+| 1d || 8.98 | 9.00 | +0%˄ || 111.36 | 111.08 | -0%˄ | (run time too short) |
+| 20a || 573.70 | 569.78 | -1%˄ || 1.74 | 1.76 | +1%˄ | (run time too short) |
+| 20b || 634.05 | 630.13 | -1%˄ || 1.58 | 1.59 | +1%˄ | (run time too short) |
+| 20c || 426.72 | 424.20 | -1%˄ || 2.34 | 2.36 | +1%˄ | (run time too short) |
+| 21a || 117.86 | 117.69 | -0%˄ || 8.48 | 8.50 | +0%˄ | (run time too short) |
+| 21b || 110.14 | 110.33 | +0%˄ || 9.08 | 9.06 | -0%˄ | (run time too short) |
+| 21c || 114.40 | 114.27 | -0%˄ || 8.74 | 8.75 | +0%˄ | (run time too short) |
+| 22a || 186.97 | 185.46 | -1%˄ || 5.35 | 5.39 | +1%˄ | (run time too short) |
+| 22b || 169.90 | 168.25 | -1%˄ || 5.89 | 5.94 | +1%˄ | (run time too short) |
+| 22c || 247.49 | 246.09 | -1%˄ || 4.04 | 4.06 | +1%˄ | (run time too short) |
+| 22d || 353.42 | 352.64 | -0%˄ || 2.83 | 2.84 | +0%˄ | (run time too short) |
+| 23a || 54.65 | 53.99 | -1%˄ || 18.30 | 18.52 | +1%˄ | (run time too short) |
+| 23b || 62.20 | 61.07 | -2%˄ || 16.08 | 16.37 | +2%˄ | (run time too short) |
+| 23c || 58.18 | 57.50 | -1%˄ || 17.19 | 17.39 | +1%˄ | (run time too short) |
+| 24a || 211.73 | 210.66 | -1%˄ || 4.72 | 4.75 | +1%˄ | (run time too short) |
+| 24b || 201.06 | 200.79 | -0%˄ || 4.97 | 4.98 | +0%˄ | (run time too short) |
+| 25a || 106.78 | 106.41 | -0%˄ || 9.37 | 9.40 | +0%˄ | (run time too short) |
+| 25b || 66.11 | 65.16 | -1%˄ || 15.13 | 15.35 | +1%˄ | (run time too short) |
+| 25c || 241.58 | 241.57 | -0%˄ || 4.14 | 4.14 | +0%˄ | (run time too short) |
+| 26a || 172.98 | 172.16 | -0%˄ || 5.78 | 5.81 | +0%˄ | (run time too short) |
+| 26b || 143.01 | 141.51 | -1%˄ || 6.99 | 7.07 | +1%˄ | (run time too short) |
+| 26c || 321.19 | 317.34 | -1%˄ || 3.11 | 3.15 | +1%˄ | (run time too short) |
+| 27a || 112.06 | 113.17 | +1%˄ || 8.92 | 8.84 | -1%˄ | (run time too short) |
+| 27b || 100.17 | 100.90 | +1%˄ || 9.98 | 9.91 | -1%˄ | (run time too short) |
+| 27c || 113.78 | 114.28 | +0%˄ || 8.79 | 8.75 | -0%˄ | (run time too short) |
+| 28a || 204.76 | 205.41 | +0%˄ || 4.88 | 4.87 | -0%˄ | (run time too short) |
+| 28b || 82.95 | 82.59 | -0%˄ || 12.05 | 12.11 | +0%˄ | (run time too short) |
+| 28c || 185.06 | 184.60 | -0%˄ || 5.40 | 5.42 | +0%˄ | (run time too short) |
+| 29a || 174.75 | 173.40 | -1%˄ || 5.72 | 5.77 | +1%˄ | (run time too short) |
+| 29b || 933.73 | 1001.21 | +7%˄ || 1.07 | 1.00 | -7%˄ | (run time too short) |
+| 29c || 213.94 | 213.71 | -0%˄ || 4.67 | 4.68 | +0%˄ | (run time too short) |
+| 2a || 29.74 | 29.87 | +0%˄ || 33.62 | 33.47 | -0%˄ | (run time too short) |
+| 2b || 27.24 | 27.37 | +0%˄ || 36.70 | 36.53 | -0%˄ | (run time too short) |
+| 2c || 22.82 | 22.86 | +0%˄ || 43.81 | 43.74 | -0%˄ | (run time too short) |
+| 2d || 58.74 | 58.58 | -0%˄ || 17.02 | 17.07 | +0%˄ | (run time too short) |
+| 30a || 92.56 | 92.46 | -0%˄ || 10.80 | 10.81 | +0%˄ | (run time too short) |
+| 30b || 96.55 | 95.81 | -1%˄ || 10.36 | 10.44 | +1%˄ | (run time too short) |
+| 30c || 159.95 | 159.96 | +0%˄ || 6.25 | 6.25 | -0%˄ | (run time too short) |
+| 31a || 80.80 | 80.46 | -0%˄ || 12.38 | 12.43 | +0%˄ | (run time too short) |
+| 31b || 87.34 | 86.46 | -1%˄ || 11.45 | 11.57 | +1%˄ | (run time too short) |
+| 31c || 90.92 | 89.86 | -1%˄ || 11.00 | 11.13 | +1%˄ | (run time too short) |
+| 32a || 15.23 | 15.35 | +1%˄ || 65.63 | 65.14 | -1%˄ | (run time too short) |
+| 32b || 36.43 | 36.27 | -0%˄ || 27.45 | 27.57 | +0%˄ | (run time too short) |
+| 33a || 35.54 | 35.37 | -0%˄ || 28.14 | 28.27 | +0%˄ | (run time too short) |
+| 33b || 21.71 | 21.81 | +0%˄ || 46.04 | 45.85 | -0%˄ | (run time too short) |
+| 33c || 45.55 | 45.46 | -0%˄ || 21.95 | 22.00 | +0%˄ | (run time too short) |
+| 3a || 71.49 | 71.31 | -0%˄ || 13.99 | 14.02 | +0%˄ | (run time too short) |
+| 3b || 19.76 | 19.13 | -3%˄ || 50.61 | 52.25 | +3%˄ | (run time too short) |
+| 3c || 220.34 | 218.79 | -1%˄ || 4.54 | 4.57 | +1%˄ | (run time too short) |
+| 4a || 149.93 | 148.64 | -1%˄ || 6.67 | 6.73 | +1%˄ | (run time too short) |
+| 4b || 18.65 | 17.79 | -5%˄ || 53.61 | 56.20 | +5%˄ | (run time too short) |
+| 4c || 188.62 | 187.81 | -0%˄ || 5.30 | 5.32 | +0%˄ | (run time too short) |
+| 5a || 65.27 | 64.42 | -1%˄ || 15.32 | 15.52 | +1%˄ | (run time too short) |
+| 5b || 65.07 | 64.05 | -2%˄ || 15.37 | 15.61 | +2%˄ | (run time too short) |
+| 5c || 101.29 | 101.55 | +0%˄ || 9.87 | 9.85 | -0%˄ | (run time too short) |
+| 6a || 180.54 | 179.37 | -1%˄ || 5.54 | 5.57 | +1%˄ | (run time too short) |
+| 6b || 194.01 | 192.27 | -1%˄ || 5.15 | 5.20 | +1%˄ | (run time too short) |
+| 6c || 171.24 | 170.68 | -0%˄ || 5.84 | 5.86 | +0%˄ | (run time too short) |
+| 6d || 386.70 | 384.62 | -1%˄ || 2.59 | 2.60 | +1%˄ | (run time too short) |
+| 6e || 176.69 | 175.69 | -1%˄ || 5.66 | 5.69 | +1%˄ | (run time too short) |
+| 6f || 708.35 | 708.80 | +0%˄ || 1.41 | 1.41 | -0%˄ | (run time too short) |
+| 7a || 87.54 | 87.89 | +0%˄ || 11.42 | 11.38 | -0%˄ | (run time too short) |
+| 7b || 80.82 | 81.38 | +1%˄ || 12.37 | 12.29 | -1%˄ | (run time too short) |
+| 7c || 546.81 | 548.22 | +0%˄ || 1.83 | 1.82 | -0%˄ | (run time too short) |
+| 8a || 198.20 | 196.89 | -1%˄ || 5.05 | 5.08 | +1%˄ | (run time too short) |
+| 8b || 192.88 | 192.65 | -0%˄ || 5.18 | 5.19 | +0%˄ | (run time too short) |
+| 8c || 1774.67 | 1766.63 | -0% || 0.56 | 0.57 | +0% | 0.0153 |
+| 8d || 291.46 | 291.30 | -0%˄ || 3.43 | 3.43 | +0%˄ | (run time too short) |
+| 9a || 262.07 | 262.16 | +0%˄ || 3.82 | 3.81 | -0%˄ | (run time too short) |
+| 9b || 187.08 | 188.25 | +1%˄ || 5.35 | 5.31 | -1%˄ | (run time too short) |
+| 9c || 285.42 | 283.24 | -1%˄ || 3.50 | 3.53 | +1%˄ | (run time too short) |
+| 9d || 454.64 | 455.32 | +0%˄ || 2.20 | 2.20 | -0%˄ | (run time too short) |
++---------++----------+----------+--------++----------+----------+--------+----------------------+
+| Sum || 30274.87 | 30227.32 | -0% || | | | |
+| Geomean || | | || | | +0% | |
++---------++----------+----------+--------++----------+----------+--------+----------------------+
+| Notes || ˄ Execution stopped due to max runs reached |
++---------++----------+----------+--------++----------+----------+--------+----------------------+
hyriseBenchmarkJoinOrder - multi-threaded, ordered, 1 client, 24 cores
Sum of avg. item runtimes: -0% || Geometric mean of throughput changes: +0%
Configuration Overview - click to expand
+Configuration Overview---------+------------------------------------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /home/Martin.Boissier/hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkJoinOrder_43b228e1bc09ffbd5956577684cb99d0e060df1c_mt_ordered.json | /home/Martin.Boissier/hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkJoinOrder_556e8941a1168263ed4aedb7bf6bb4aaf25e8e28_mt_ordered.json |
+-------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 43b228e1bc09ffbd5956577684cb99d0e060df1c-dirty | 556e8941a1168263ed4aedb7bf6bb4aaf25e8e28-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 14.0.0 | clang 14.0.0 |
| cores | 24 | 24 |
| data_preparation_cores | 0 | 0 |
| date | 2024-05-06 02:44:57 | 2024-05-06 06:35:53 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [24] | [24] |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------------------------------------+
++---------++----------+----------+--------++----------+----------+--------+----------------------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++---------++----------+----------+--------++----------+----------+--------+----------------------+
+| 10a || 32.32 | 30.53 | -6%˄ || 30.91 | 32.72 | +6%˄ | (run time too short) |
+| 10b || 17.91 | 17.70 | -1%˄ || 55.74 | 56.39 | +1%˄ | (run time too short) |
+| 10c || 87.73 | 86.38 | -2%˄ || 11.39 | 11.57 | +2%˄ | (run time too short) |
+| 11a || 18.88 | 18.83 | -0%˄ || 52.87 | 53.02 | +0%˄ | (run time too short) |
+| 11b || 16.90 | 16.65 | -1%˄ || 59.08 | 59.96 | +1%˄ | (run time too short) |
+| 11c || 14.20 | 14.43 | +2%˄ || 70.27 | 69.15 | -2%˄ | (run time too short) |
+| 11d || 18.34 | 17.98 | -2%˄ || 54.43 | 55.51 | +2%˄ | (run time too short) |
+| 12a || 16.17 | 15.97 | -1%˄ || 61.74 | 62.51 | +1%˄ | (run time too short) |
+| 12b || 8.96 | 8.75 | -2%˄ || 111.31 | 113.87 | +2%˄ | (run time too short) |
+| 12c || 39.84 | 39.83 | -0%˄ || 25.08 | 25.08 | +0%˄ | (run time too short) |
+| 13a || 113.18 | 113.77 | +1%˄ || 8.83 | 8.78 | -1%˄ | (run time too short) |
+| 13b || 61.86 | 59.07 | -5%˄ || 16.16 | 16.92 | +5%˄ | (run time too short) |
+| 13c || 51.08 | 52.51 | +3%˄ || 19.56 | 19.03 | -3%˄ | (run time too short) |
+| 13d || 327.78 | 329.35 | +0%˄ || 3.05 | 3.04 | -0%˄ | (run time too short) |
+| 14a || 43.68 | 43.88 | +0%˄ || 22.88 | 22.77 | -0%˄ | (run time too short) |
+| 14b || 52.71 | 53.08 | +1%˄ || 18.96 | 18.82 | -1%˄ | (run time too short) |
+| 14c || 111.94 | 111.19 | -1%˄ || 8.93 | 8.99 | +1%˄ | (run time too short) |
+| 15a || 23.79 | 24.28 | +2%˄ || 41.98 | 41.14 | -2%˄ | (run time too short) |
+| 15b || 20.29 | 20.60 | +2%˄ || 49.22 | 48.47 | -2%˄ | (run time too short) |
+| 15c || 17.97 | 17.84 | -1%˄ || 55.57 | 55.96 | +1%˄ | (run time too short) |
+| 15d || 22.97 | 22.15 | -4%˄ || 43.48 | 45.08 | +4%˄ | (run time too short) |
+| 16a || 567.91 | 563.51 | -1%˄ || 1.76 | 1.77 | +1%˄ | (run time too short) |
+| 16b || 1637.42 | 1629.23 | -1% || 0.61 | 0.61 | +1% | 0.1664 |
+| 16c || 694.48 | 691.54 | -0%˄ || 1.44 | 1.45 | +0%˄ | (run time too short) |
+| 16d || 667.28 | 667.06 | -0%˄ || 1.50 | 1.50 | +0%˄ | (run time too short) |
+| 17a || 153.17 | 154.52 | +1%˄ || 6.53 | 6.47 | -1%˄ | (run time too short) |
+| 17b || 124.14 | 121.03 | -3%˄ || 8.05 | 8.26 | +3%˄ | (run time too short) |
+| 17c || 99.43 | 102.06 | +3%˄ || 10.05 | 9.79 | -3%˄ | (run time too short) |
+| 17d || 93.84 | 95.24 | +1%˄ || 10.65 | 10.50 | -1%˄ | (run time too short) |
+| 17e || 651.28 | 651.30 | +0%˄ || 1.54 | 1.54 | -0%˄ | (run time too short) |
+| 17f || 284.94 | 280.52 | -2%˄ || 3.51 | 3.56 | +2%˄ | (run time too short) |
+| 18a || 39.76 | 39.91 | +0%˄ || 25.13 | 25.03 | -0%˄ | (run time too short) |
+| 18b || 38.33 | 38.72 | +1%˄ || 26.06 | 25.80 | -1%˄ | (run time too short) |
+| 18c || 75.26 | 74.92 | -0%˄ || 13.28 | 13.34 | +0%˄ | (run time too short) |
+| 19a || 75.85 | 76.95 | +1%˄ || 13.18 | 12.99 | -1%˄ | (run time too short) |
+| 19b || 50.42 | 50.33 | -0%˄ || 19.82 | 19.85 | +0%˄ | (run time too short) |
+| 19c || 88.91 | 89.42 | +1%˄ || 11.24 | 11.18 | -1%˄ | (run time too short) |
+| 19d || 477.56 | 472.63 | -1%˄ || 2.09 | 2.12 | +1%˄ | (run time too short) |
+| 1a || 4.65 | 4.59 | -1%˄ || 214.14 | 216.65 | +1%˄ | (run time too short) |
+| 1b || 3.19 | 3.15 | -1%˄ || 311.17 | 315.30 | +1%˄ | (run time too short) |
+| 1c || 3.45 | 3.41 | -1%˄ || 287.51 | 290.77 | +1%˄ | (run time too short) |
+| 1d || 3.64 | 3.68 | +1%˄ || 272.74 | 269.88 | -1%˄ | (run time too short) |
+| 20a || 64.46 | 64.14 | -0%˄ || 15.51 | 15.58 | +0%˄ | (run time too short) |
+| 20b || 54.38 | 52.94 | -3%˄ || 18.38 | 18.88 | +3%˄ | (run time too short) |
+| 20c || 61.75 | 61.10 | -1%˄ || 16.18 | 16.36 | +1%˄ | (run time too short) |
+| 21a || 22.77 | 22.41 | -2%˄ || 43.85 | 44.57 | +2%˄ | (run time too short) |
+| 21b || 19.42 | 19.81 | +2%˄ || 51.42 | 50.40 | -2%˄ | (run time too short) |
+| 21c || 23.66 | 23.78 | +1%˄ || 42.21 | 41.99 | -1%˄ | (run time too short) |
+| 22a || 55.48 | 54.92 | -1%˄ || 18.01 | 18.19 | +1%˄ | (run time too short) |
+| 22b || 41.69 | 41.02 | -2%˄ || 23.96 | 24.35 | +2%˄ | (run time too short) |
+| 22c || 96.58 | 98.60 | +2%˄ || 10.35 | 10.14 | -2%˄ | (run time too short) |
+| 22d || 160.77 | 165.84 | +3%˄ || 6.22 | 6.03 | -3%˄ | (run time too short) |
+| 23a || 12.58 | 12.59 | +0%˄ || 79.30 | 79.23 | -0%˄ | (run time too short) |
+| 23b || 20.93 | 20.49 | -2%˄ || 47.70 | 48.73 | +2%˄ | (run time too short) |
+| 23c || 14.38 | 14.44 | +0%˄ || 69.41 | 69.09 | -0%˄ | (run time too short) |
+| 24a || 46.20 | 46.65 | +1%˄ || 21.63 | 21.42 | -1%˄ | (run time too short) |
+| 24b || 43.29 | 42.89 | -1%˄ || 23.08 | 23.29 | +1%˄ | (run time too short) |
+| 25a || 43.91 | 44.53 | +1%˄ || 22.75 | 22.44 | -1%˄ | (run time too short) |
+| 25b || 24.24 | 23.77 | -2%˄ || 41.19 | 42.01 | +2%˄ | (run time too short) |
+| 25c || 135.99 | 135.04 | -1%˄ || 7.35 | 7.40 | +1%˄ | (run time too short) |
+| 26a || 64.72 | 64.30 | -1%˄ || 15.44 | 15.54 | +1%˄ | (run time too short) |
+| 26b || 46.19 | 46.03 | -0%˄ || 21.63 | 21.71 | +0%˄ | (run time too short) |
+| 26c || 105.71 | 104.16 | -1%˄ || 9.46 | 9.60 | +1%˄ | (run time too short) |
+| 27a || 19.70 | 19.93 | +1%˄ || 50.68 | 50.10 | -1%˄ | (run time too short) |
+| 27b || 19.49 | 19.56 | +0%˄ || 51.23 | 51.04 | -0%˄ | (run time too short) |
+| 27c || 22.97 | 23.26 | +1%˄ || 43.47 | 42.93 | -1%˄ | (run time too short) |
+| 28a || 93.91 | 94.21 | +0%˄ || 10.64 | 10.61 | -0%˄ | (run time too short) |
+| 28b || 22.51 | 22.73 | +1%˄ || 44.37 | 43.93 | -1%˄ | (run time too short) |
+| 28c || 83.46 | 84.09 | +1%˄ || 11.98 | 11.89 | -1%˄ | (run time too short) |
+| 29a || 39.44 | 39.64 | +1%˄ || 25.33 | 25.20 | -1%˄ | (run time too short) |
+| 29b || 134.87 | 148.42 | +10%˄ || 7.41 | 6.74 | -9%˄ | (run time too short) |
+| 29c || 49.59 | 50.17 | +1%˄ || 20.15 | 19.91 | -1%˄ | (run time too short) |
+| 2a || 17.60 | 17.63 | +0%˄ || 56.73 | 56.63 | -0%˄ | (run time too short) |
+| 2b || 14.93 | 15.32 | +3%˄ || 66.88 | 65.19 | -3%˄ | (run time too short) |
+| 2c || 10.66 | 10.70 | +0%˄ || 93.61 | 93.25 | -0%˄ | (run time too short) |
+| 2d || 43.22 | 42.86 | -1%˄ || 23.12 | 23.31 | +1%˄ | (run time too short) |
+| 30a || 36.90 | 36.81 | -0%˄ || 27.07 | 27.14 | +0%˄ | (run time too short) |
+| 30b || 28.88 | 28.78 | -0%˄ || 34.58 | 34.70 | +0%˄ | (run time too short) |
+| 30c || 85.99 | 86.11 | +0%˄ || 11.62 | 11.61 | -0%˄ | (run time too short) |
+| 31a || 28.39 | 28.23 | -1%˄ || 35.18 | 35.38 | +1%˄ | (run time too short) |
+| 31b || 25.32 | 25.04 | -1%˄ || 39.45 | 39.88 | +1%˄ | (run time too short) |
+| 31c || 31.59 | 31.51 | -0%˄ || 31.61 | 31.69 | +0%˄ | (run time too short) |
+| 32a || 4.67 | 4.65 | -0%˄ || 213.01 | 214.10 | +1%˄ | (run time too short) |
+| 32b || 23.76 | 23.90 | +1%˄ || 42.04 | 41.79 | -1%˄ | (run time too short) |
+| 33a || 8.56 | 8.50 | -1%˄ || 116.47 | 117.15 | +1%˄ | (run time too short) |
+| 33b || 6.36 | 6.34 | -0%˄ || 156.44 | 156.97 | +0%˄ | (run time too short) |
+| 33c || 13.57 | 13.69 | +1%˄ || 73.53 | 72.91 | -1%˄ | (run time too short) |
+| 3a || 31.46 | 30.55 | -3%˄ || 31.75 | 32.70 | +3%˄ | (run time too short) |
+| 3b || 4.73 | 4.77 | +1%˄ || 210.41 | 208.73 | -1%˄ | (run time too short) |
+| 3c || 55.54 | 53.39 | -4%˄ || 17.99 | 18.71 | +4%˄ | (run time too short) |
+| 4a || 45.82 | 46.90 | +2%˄ || 21.81 | 21.30 | -2%˄ | (run time too short) |
+| 4b || 3.78 | 3.86 | +2%˄ || 263.15 | 257.42 | -2%˄ | (run time too short) |
+| 4c || 60.14 | 58.31 | -3%˄ || 16.62 | 17.14 | +3%˄ | (run time too short) |
+| 5a || 19.94 | 19.87 | -0%˄ || 50.06 | 50.24 | +0%˄ | (run time too short) |
+| 5b || 15.77 | 15.80 | +0%˄ || 63.30 | 63.16 | -0%˄ | (run time too short) |
+| 5c || 37.35 | 35.57 | -5%˄ || 26.74 | 28.09 | +5%˄ | (run time too short) |
+| 6a || 20.67 | 20.58 | -0%˄ || 48.30 | 48.51 | +0%˄ | (run time too short) |
+| 6b || 37.32 | 36.58 | -2%˄ || 26.77 | 27.31 | +2%˄ | (run time too short) |
+| 6c || 18.33 | 18.42 | +0%˄ || 54.44 | 54.19 | -0%˄ | (run time too short) |
+| 6d || 100.47 | 100.42 | -0%˄ || 9.95 | 9.95 | +0%˄ | (run time too short) |
+| 6e || 20.20 | 20.42 | +1%˄ || 49.42 | 48.89 | -1%˄ | (run time too short) |
+| 6f || 425.86 | 425.04 | -0%˄ || 2.35 | 2.35 | +0%˄ | (run time too short) |
+| 7a || 19.73 | 20.00 | +1%˄ || 50.59 | 49.91 | -1%˄ | (run time too short) |
+| 7b || 19.94 | 20.14 | +1%˄ || 50.06 | 49.56 | -1%˄ | (run time too short) |
+| 7c || 207.41 | 207.63 | +0%˄ || 4.82 | 4.82 | -0%˄ | (run time too short) |
+| 8a || 29.65 | 30.25 | +2%˄ || 33.68 | 33.02 | -2%˄ | (run time too short) |
+| 8b || 28.59 | 29.45 | +3%˄ || 34.92 | 33.91 | -3%˄ | (run time too short) |
+| 8c || 1050.05 | 1046.03 | -0%˄ || 0.95 | 0.96 | +0%˄ | (run time too short) |
+| 8d || 187.44 | 188.20 | +0%˄ || 5.33 | 5.31 | -0%˄ | (run time too short) |
+| 9a || 106.37 | 106.34 | -0%˄ || 9.40 | 9.40 | +0%˄ | (run time too short) |
+| 9b || 60.69 | 62.37 | +3%˄ || 16.47 | 16.02 | -3%˄ | (run time too short) |
+| 9c || 106.31 | 103.49 | -3%˄ || 9.40 | 9.66 | +3%˄ | (run time too short) |
+| 9d || 323.63 | 322.94 | -0%˄ || 3.09 | 3.10 | +0%˄ | (run time too short) |
++---------++----------+----------+--------++----------+----------+--------+----------------------+
+| Sum || 12016.07 | 11997.32 | -0% || | | | |
+| Geomean || | | || | | +0% | |
++---------++----------+----------+--------++----------+----------+--------+----------------------+
+| Notes || ˄ Execution stopped due to max runs reached |
++---------++----------+----------+--------++----------+----------+--------+----------------------+
hyriseBenchmarkJoinOrder - multi-threaded, shuffled, 24 clients, 24 cores
Sum of avg. item runtimes: -0% || Geometric mean of throughput changes: +0%
Configuration Overview - click to expand
+Configuration Overview---------+----------------------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /home/Martin.Boissier/hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkJoinOrder_43b228e1bc09ffbd5956577684cb99d0e060df1c_mt.json | /home/Martin.Boissier/hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkJoinOrder_556e8941a1168263ed4aedb7bf6bb4aaf25e8e28_mt.json |
+-------------------------------+----------------------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 43b228e1bc09ffbd5956577684cb99d0e060df1c-dirty | 556e8941a1168263ed4aedb7bf6bb4aaf25e8e28-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 24 | 24 |
| compiler | clang 14.0.0 | clang 14.0.0 |
| cores | 24 | 24 |
| data_preparation_cores | 0 | 0 |
| date | 2024-05-06 03:01:12 | 2024-05-06 06:51:54 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [24] | [24] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+----------------------------------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------------------------------+
++---------++----------+----------+--------++----------+----------+--------+---------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++---------++----------+----------+--------++----------+----------+--------+---------+
+| 10a || 175.19 | 185.27 | +6% || 0.59 | 0.59 | +0% | 0.6079 |
+| 10b || 131.84 | 156.59 | +19% || 0.59 | 0.59 | +0% | 0.3017 |
+| 10c || 410.65 | 440.36 | +7% || 0.59 | 0.59 | +0% | 0.3598 |
+| 11a || 89.77 | 95.35 | +6% || 0.59 | 0.59 | +0% | 0.6706 |
+| 11b || 88.04 | 105.69 | +20% || 0.59 | 0.59 | -0% | 0.2610 |
+| 11c || 79.13 | 72.40 | -9% || 0.59 | 0.59 | +0% | 0.5949 |
+| 11d || 74.27 | 60.07 | -19% || 0.59 | 0.59 | +0% | 0.1331 |
+| 12a || 111.07 | 139.31 | +25% || 0.59 | 0.59 | +0% | 0.1477 |
+| 12b || 91.24 | 58.50 | -36% || 0.59 | 0.59 | +0% | 0.0186 |
+| 12c || 258.96 | 290.96 | +12% || 0.59 | 0.59 | +0% | 0.2475 |
+| 13a || 373.61 | 362.99 | -3% || 0.59 | 0.59 | +0% | 0.6872 |
+| 13b || 270.06 | 274.61 | +2% || 0.59 | 0.59 | +0% | 0.8488 |
+| 13c || 234.02 | 235.75 | +1% || 0.59 | 0.59 | +0% | 0.9368 |
+| 13d || 649.80 | 708.00 | +9% || 0.59 | 0.59 | +0% | 0.0433 |
+| 14a || 331.37 | 285.26 | -14% || 0.59 | 0.59 | -0% | 0.1225 |
+| 14b || 296.72 | 301.05 | +1% || 0.59 | 0.59 | +0% | 0.8600 |
+| 14c || 405.32 | 388.74 | -4% || 0.59 | 0.59 | +0% | 0.6063 |
+| 15a || 107.92 | 113.12 | +5% || 0.59 | 0.59 | +0% | 0.7358 |
+| 15b || 113.19 | 92.81 | -18% || 0.59 | 0.59 | +0% | 0.1764 |
+| 15c || 136.30 | 96.11 | -29% || 0.59 | 0.59 | +0% | 0.0104 |
+| 15d || 123.65 | 106.75 | -14% || 0.59 | 0.59 | +0% | 0.2250 |
+| 16a || 1276.54 | 1303.37 | +2% || 0.59 | 0.59 | +0% | 0.5625 |
+| 16b || 2441.36 | 2452.57 | +0% || 0.59 | 0.59 | +0% | 0.8229 |
+| 16c || 1484.30 | 1459.69 | -2% || 0.59 | 0.59 | +0% | 0.5978 |
+| 16d || 1413.57 | 1440.06 | +2% || 0.59 | 0.59 | +0% | 0.5526 |
+| 17a || 685.87 | 682.09 | -1% || 0.59 | 0.59 | +0% | 0.9227 |
+| 17b || 534.75 | 534.68 | -0% || 0.59 | 0.59 | +0% | 0.9985 |
+| 17c || 484.13 | 496.51 | +3% || 0.59 | 0.59 | +0% | 0.7063 |
+| 17d || 488.46 | 501.39 | +3% || 0.59 | 0.59 | +0% | 0.7218 |
+| 17e || 1401.65 | 1374.36 | -2% || 0.59 | 0.59 | +0% | 0.5641 |
+| 17f || 943.80 | 938.97 | -1% || 0.59 | 0.59 | +0% | 0.9118 |
+| 18a || 212.39 | 232.45 | +9% || 0.59 | 0.59 | +0% | 0.3916 |
+| 18b || 325.80 | 333.23 | +2% || 0.59 | 0.59 | +0% | 0.8213 |
+| 18c || 582.94 | 514.82 | -12% || 0.59 | 0.59 | +0% | 0.1098 |
+| 19a || 514.44 | 454.09 | -12% || 0.59 | 0.59 | +0% | 0.1140 |
+| 19b || 313.98 | 325.73 | +4% || 0.59 | 0.59 | +0% | 0.6969 |
+| 19c || 537.40 | 468.48 | -13% || 0.59 | 0.59 | +0% | 0.0534 |
+| 19d || 1156.27 | 1156.24 | -0% || 0.59 | 0.59 | +0% | 0.9995 |
+| 1a || 32.80 | 35.17 | +7% || 0.59 | 0.59 | -0% | 0.6961 |
+| 1b || 34.70 | 45.50 | +31% || 0.59 | 0.59 | +0% | 0.2975 |
+| 1c || 50.16 | 52.45 | +5% || 0.59 | 0.59 | +0% | 0.8709 |
+| 1d || 31.45 | 25.10 | -20% || 0.59 | 0.59 | +0% | 0.2583 |
+| 20a || 333.92 | 391.60 | +17% || 0.59 | 0.59 | +0% | 0.0544 |
+| 20b || 330.64 | 311.62 | -6% || 0.59 | 0.59 | +0% | 0.4925 |
+| 20c || 294.00 | 320.24 | +9% || 0.59 | 0.59 | +0% | 0.3385 |
+| 21a || 138.43 | 135.25 | -2% || 0.59 | 0.59 | +0% | 0.8586 |
+| 21b || 117.56 | 108.20 | -8% || 0.59 | 0.59 | +0% | 0.5883 |
+| 21c || 147.12 | 168.91 | +15% || 0.59 | 0.59 | +0% | 0.3550 |
+| 22a || 382.87 | 346.83 | -9% || 0.59 | 0.59 | +0% | 0.2584 |
+| 22b || 342.92 | 297.97 | -13% || 0.59 | 0.59 | +0% | 0.1713 |
+| 22c || 490.15 | 427.87 | -13% || 0.59 | 0.59 | +0% | 0.0619 |
+| 22d || 588.96 | 623.05 | +6% || 0.59 | 0.59 | +0% | 0.3488 |
+| 23a || 126.70 | 135.86 | +7% || 0.59 | 0.59 | +0% | 0.6554 |
+| 23b || 97.98 | 88.08 | -10% || 0.59 | 0.59 | +0% | 0.4333 |
+| 23c || 141.34 | 138.71 | -2% || 0.59 | 0.59 | +0% | 0.9013 |
+| 24a || 294.01 | 321.85 | +9% || 0.59 | 0.59 | +0% | 0.3313 |
+| 24b || 235.59 | 216.79 | -8% || 0.59 | 0.59 | +0% | 0.3941 |
+| 25a || 345.16 | 345.56 | +0% || 0.59 | 0.59 | +0% | 0.9902 |
+| 25b || 166.22 | 151.79 | -9% || 0.59 | 0.59 | +0% | 0.4915 |
+| 25c || 674.27 | 662.69 | -2% || 0.59 | 0.59 | +0% | 0.7757 |
+| 26a || 297.24 | 314.75 | +6% || 0.59 | 0.59 | +0% | 0.4568 |
+| 26b || 177.47 | 234.65 | +32% || 0.59 | 0.59 | +0% | 0.0066 |
+| 26c || 470.73 | 486.49 | +3% || 0.59 | 0.59 | +0% | 0.6264 |
+| 27a || 141.56 | 124.56 | -12% || 0.59 | 0.59 | +0% | 0.3275 |
+| 27b || 159.44 | 131.64 | -17% || 0.59 | 0.59 | +0% | 0.1833 |
+| 27c || 185.92 | 173.31 | -7% || 0.59 | 0.59 | -0% | 0.6722 |
+| 28a || 463.49 | 536.83 | +16% || 0.59 | 0.59 | +0% | 0.0671 |
+| 28b || 185.73 | 216.11 | +16% || 0.59 | 0.59 | +0% | 0.2318 |
+| 28c || 446.59 | 422.26 | -5% || 0.59 | 0.59 | +0% | 0.4032 |
+| 29a || 227.49 | 223.91 | -2% || 0.59 | 0.59 | +0% | 0.8793 |
+| 29b || 328.12 | 359.20 | +9% || 0.59 | 0.59 | +0% | 0.2589 |
+| 29c || 314.21 | 322.74 | +3% || 0.59 | 0.59 | +0% | 0.7948 |
+| 2a || 114.75 | 116.45 | +1% || 0.59 | 0.59 | +0% | 0.9118 |
+| 2b || 110.10 | 110.15 | +0% || 0.59 | 0.59 | +0% | 0.9976 |
+| 2c || 80.55 | 89.47 | +11% || 0.59 | 0.59 | +0% | 0.5308 |
+| 2d || 173.19 | 206.62 | +19% || 0.59 | 0.59 | +0% | 0.0944 |
+| 30a || 248.14 | 275.51 | +11% || 0.59 | 0.59 | +0% | 0.2849 |
+| 30b || 237.50 | 235.48 | -1% || 0.59 | 0.59 | +0% | 0.9319 |
+| 30c || 526.64 | 514.69 | -2% || 0.59 | 0.59 | +0% | 0.7591 |
+| 31a || 188.30 | 215.81 | +15% || 0.59 | 0.59 | +0% | 0.2432 |
+| 31b || 214.36 | 180.89 | -16% || 0.59 | 0.59 | +0% | 0.1832 |
+| 31c || 236.21 | 200.80 | -15% || 0.59 | 0.59 | +0% | 0.0973 |
+| 32a || 48.42 | 49.67 | +3% || 0.59 | 0.59 | +0% | 0.9274 |
+| 32b || 136.94 | 133.14 | -3% || 0.59 | 0.59 | +0% | 0.8093 |
+| 33a || 101.18 | 87.48 | -14% || 0.59 | 0.59 | +0% | 0.3513 |
+| 33b || 78.55 | 75.80 | -4% || 0.59 | 0.59 | -0% | 0.8755 |
+| 33c || 108.84 | 127.56 | +17% || 0.59 | 0.59 | +0% | 0.2868 |
+| 3a || 237.13 | 210.85 | -11% || 0.59 | 0.59 | +0% | 0.3010 |
+| 3b || 84.98 | 70.71 | -17% || 0.59 | 0.59 | +0% | 0.4040 |
+| 3c || 309.68 | 360.38 | +16% || 0.59 | 0.59 | -0% | 0.0898 |
+| 4a || 230.84 | 230.00 | -0% || 0.59 | 0.59 | -0% | 0.9730 |
+| 4b || 61.09 | 63.56 | +4% || 0.59 | 0.59 | +0% | 0.8775 |
+| 4c || 240.29 | 234.30 | -2% || 0.59 | 0.59 | +0% | 0.7804 |
+| 5a || 199.22 | 175.23 | -12% || 0.59 | 0.59 | -0% | 0.3438 |
+| 5b || 158.68 | 132.53 | -16% || 0.59 | 0.59 | +0% | 0.2548 |
+| 5c || 253.99 | 244.75 | -4% || 0.59 | 0.59 | +0% | 0.7186 |
+| 6a || 135.61 | 111.92 | -17% || 0.59 | 0.59 | +0% | 0.1030 |
+| 6b || 142.55 | 154.54 | +8% || 0.59 | 0.59 | +0% | 0.5015 |
+| 6c || 116.80 | 127.03 | +9% || 0.59 | 0.59 | +0% | 0.5968 |
+| 6d || 442.03 | 391.46 | -11% || 0.59 | 0.59 | +0% | 0.0750 |
+| 6e || 148.74 | 152.63 | +3% || 0.59 | 0.59 | +0% | 0.8470 |
+| 6f || 920.28 | 942.80 | +2% || 0.59 | 0.59 | +0% | 0.5104 |
+| 7a || 124.02 | 120.48 | -3% || 0.59 | 0.59 | +0% | 0.8144 |
+| 7b || 146.89 | 132.76 | -10% || 0.59 | 0.59 | +0% | 0.4917 |
+| 7c || 870.01 | 884.20 | +2% || 0.59 | 0.59 | +0% | 0.7236 |
+| 8a || 174.88 | 208.61 | +19% || 0.59 | 0.59 | +0% | 0.1612 |
+| 8b || 147.54 | 159.62 | +8% || 0.59 | 0.59 | +0% | 0.5147 |
+| 8c || 1747.17 | 1746.30 | -0% || 0.59 | 0.59 | -0% | 0.9844 |
+| 8d || 541.48 | 522.91 | -3% || 0.59 | 0.59 | +0% | 0.5586 |
+| 9a || 526.48 | 484.49 | -8% || 0.59 | 0.59 | +0% | 0.2232 |
+| 9b || 411.78 | 389.14 | -5% || 0.59 | 0.59 | +0% | 0.5535 |
+| 9c || 503.12 | 583.45 | +16% || 0.59 | 0.59 | +0% | 0.0541 |
+| 9d || 892.12 | 902.48 | +1% || 0.59 | 0.59 | +0% | 0.8183 |
++---------++----------+----------+--------++----------+----------+--------+---------+
+| Sum || 40515.77 | 40492.63 | -0% || | | | |
+| Geomean || | | || | | +0% | |
++---------++----------+----------+--------++----------+----------+--------+---------+
hyriseBenchmarkStarSchema - single-threaded
Sum of avg. item runtimes: -1% || Geometric mean of throughput changes: +1%
Configuration Overview - click to expand
+Configuration Overview---+-----------------------------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /home/Martin.Boissier/hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkStarSchema_43b228e1bc09ffbd5956577684cb99d0e060df1c_st.json | /home/Martin.Boissier/hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkStarSchema_556e8941a1168263ed4aedb7bf6bb4aaf25e8e28_st.json |
+-------------------------+-----------------------------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 43b228e1bc09ffbd5956577684cb99d0e060df1c-dirty | 556e8941a1168263ed4aedb7bf6bb4aaf25e8e28-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 14.0.0 | clang 14.0.0 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2024-05-06 03:22:18 | 2024-05-06 07:13:08 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------+-----------------------------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------+
++---------++----------+---------+--------++----------+----------+--------+----------------------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++---------++----------+---------+--------++----------+----------+--------+----------------------+
+| 1.1 || 406.20 | 399.13 | -2%˄ || 2.46 | 2.51 | +2%˄ | (run time too short) |
+| 1.2 || 219.23 | 216.61 | -1%˄ || 4.56 | 4.62 | +1%˄ | (run time too short) |
+| 1.3 || 213.29 | 210.59 | -1%˄ || 4.69 | 4.75 | +1%˄ | (run time too short) |
+| 2.1 || 530.19 | 529.59 | -0%˄ || 1.89 | 1.89 | +0%˄ | (run time too short) |
+| 2.2 || 291.27 | 292.32 | +0%˄ || 3.43 | 3.42 | -0%˄ | (run time too short) |
+| 2.3 || 175.69 | 177.39 | +1%˄ || 5.69 | 5.64 | -1%˄ | (run time too short) |
+| 3.1 || 2631.02 | 2573.58 | -2% || 0.38 | 0.39 | +2% | 0.0215 |
+| 3.2 || 291.73 | 288.24 | -1%˄ || 3.43 | 3.47 | +1%˄ | (run time too short) |
+| 3.3 || 125.55 | 122.88 | -2%˄ || 7.96 | 8.14 | +2%˄ | (run time too short) |
+| 3.4 || 115.84 | 113.07 | -2%˄ || 8.63 | 8.84 | +2%˄ | (run time too short) |
+| 4.1 || 2494.00 | 2517.91 | +1% || 0.40 | 0.40 | -1% | 0.1706 |
+| 4.2 || 813.27 | 812.13 | -0%˄ || 1.23 | 1.23 | +0%˄ | (run time too short) |
+| 4.3 || 233.42 | 229.54 | -2%˄ || 4.28 | 4.36 | +2%˄ | (run time too short) |
++---------++----------+---------+--------++----------+----------+--------+----------------------+
+| Sum || 8540.69 | 8482.98 | -1% || | | | |
+| Geomean || | | || | | +1% | |
++---------++----------+---------+--------++----------+----------+--------+----------------------+
+| Notes || ˄ Execution stopped due to max runs reached |
++---------++----------+---------+--------++----------+----------+--------+----------------------+
hyriseBenchmarkStarSchema - multi-threaded, ordered, 1 client, 24 cores
Sum of avg. item runtimes: -0% || Geometric mean of throughput changes: +0%
Configuration Overview - click to expand
+Configuration Overview---------+-------------------------------------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /home/Martin.Boissier/hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkStarSchema_43b228e1bc09ffbd5956577684cb99d0e060df1c_mt_ordered.json | /home/Martin.Boissier/hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkStarSchema_556e8941a1168263ed4aedb7bf6bb4aaf25e8e28_mt_ordered.json |
+-------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 43b228e1bc09ffbd5956577684cb99d0e060df1c-dirty | 556e8941a1168263ed4aedb7bf6bb4aaf25e8e28-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 14.0.0 | clang 14.0.0 |
| cores | 24 | 24 |
| data_preparation_cores | 0 | 0 |
| date | 2024-05-06 03:31:20 | 2024-05-06 07:18:35 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 50 | 50 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [24] | [24] |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------------------------------------------+
++---------++----------+---------+--------++----------+----------+--------+----------------------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++---------++----------+---------+--------++----------+----------+--------+----------------------+
+| 1.1 || 90.08 | 89.22 | -1%˄ || 11.10 | 11.20 | +1%˄ | (run time too short) |
+| 1.2 || 60.74 | 59.62 | -2%˄ || 16.45 | 16.76 | +2%˄ | (run time too short) |
+| 1.3 || 57.76 | 57.14 | -1%˄ || 17.30 | 17.49 | +1%˄ | (run time too short) |
+| 2.1 || 258.24 | 256.81 | -1%˄ || 3.87 | 3.89 | +1%˄ | (run time too short) |
+| 2.2 || 124.07 | 122.61 | -1%˄ || 8.06 | 8.15 | +1%˄ | (run time too short) |
+| 2.3 || 44.92 | 44.86 | -0%˄ || 22.24 | 22.27 | +0%˄ | (run time too short) |
+| 3.1 || 688.43 | 690.11 | +0%˄ || 1.45 | 1.45 | -0%˄ | (run time too short) |
+| 3.2 || 119.52 | 120.00 | +0%˄ || 8.36 | 8.33 | -0%˄ | (run time too short) |
+| 3.3 || 56.00 | 56.19 | +0%˄ || 17.85 | 17.79 | -0%˄ | (run time too short) |
+| 3.4 || 52.82 | 52.89 | +0%˄ || 18.92 | 18.89 | -0%˄ | (run time too short) |
+| 4.1 || 588.42 | 591.86 | +1%˄ || 1.70 | 1.69 | -1%˄ | (run time too short) |
+| 4.2 || 250.30 | 250.61 | +0%˄ || 3.99 | 3.99 | -0%˄ | (run time too short) |
+| 4.3 || 74.98 | 73.90 | -1%˄ || 13.33 | 13.52 | +1%˄ | (run time too short) |
++---------++----------+---------+--------++----------+----------+--------+----------------------+
+| Sum || 2466.27 | 2465.82 | -0% || | | | |
+| Geomean || | | || | | +0% | |
++---------++----------+---------+--------++----------+----------+--------+----------------------+
+| Notes || ˄ Execution stopped due to max runs reached |
++---------++----------+---------+--------++----------+----------+--------+----------------------+
hyriseBenchmarkStarSchema - multi-threaded, shuffled, 24 clients, 24 cores
Sum of avg. item runtimes: -0% || Geometric mean of throughput changes: +0%
Configuration Overview - click to expand
+Configuration Overview---------+-----------------------------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------+
| Parameter | /home/Martin.Boissier/hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkStarSchema_43b228e1bc09ffbd5956577684cb99d0e060df1c_mt.json | /home/Martin.Boissier/hyrise/rel_clang/benchmark_all_results/hyriseBenchmarkStarSchema_556e8941a1168263ed4aedb7bf6bb4aaf25e8e28_mt.json |
+-------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | 43b228e1bc09ffbd5956577684cb99d0e060df1c-dirty | 556e8941a1168263ed4aedb7bf6bb4aaf25e8e28-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 24 | 24 |
| compiler | clang 14.0.0 | clang 14.0.0 |
| cores | 24 | 24 |
| data_preparation_cores | 0 | 0 |
| date | 2024-05-06 03:34:00 | 2024-05-06 07:21:15 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [24] | [24] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------+
++---------++----------+----------+--------++----------+----------+--------+---------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++---------++----------+----------+--------++----------+----------+--------+---------+
+| 1.1 || 538.02 | 534.00 | -1% || 2.26 | 2.27 | +0% | 0.8331 |
+| 1.2 || 323.26 | 301.76 | -7% || 2.26 | 2.27 | +0% | 0.1385 |
+| 1.3 || 297.94 | 292.81 | -2% || 2.26 | 2.27 | +0% | 0.7233 |
+| 2.1 || 1286.07 | 1259.15 | -2% || 2.26 | 2.27 | +0% | 0.3735 |
+| 2.2 || 702.26 | 713.43 | +2% || 2.26 | 2.26 | -0% | 0.6079 |
+| 2.3 || 260.30 | 259.16 | -0% || 2.26 | 2.27 | +0% | 0.9281 |
+| 3.1 || 1968.63 | 1970.19 | +0% || 2.26 | 2.26 | +0% | 0.9586 |
+| 3.2 || 671.18 | 680.46 | +1% || 2.26 | 2.27 | +0% | 0.6573 |
+| 3.3 || 328.61 | 332.86 | +1% || 2.26 | 2.27 | +0% | 0.7901 |
+| 3.4 || 324.59 | 322.05 | -1% || 2.26 | 2.27 | +0% | 0.8759 |
+| 4.1 || 1874.08 | 1843.00 | -2% || 2.26 | 2.26 | +0% | 0.3196 |
+| 4.2 || 1539.44 | 1549.73 | +1% || 2.26 | 2.26 | +0% | 0.7506 |
+| 4.3 || 473.52 | 512.90 | +8% || 2.26 | 2.27 | +0% | 0.0335 |
++---------++----------+----------+--------++----------+----------+--------+---------+
+| Sum || 10587.90 | 10571.52 | -0% || | | | |
+| Geomean || | | || | | +0% | |
++---------++----------+----------+--------++----------+----------+--------+---------+