hyrise
hyrise copied to clipboard
Published
20 hours ago •
hyrise
hyrise
Update CI image and supported compilers
We have several branches we would like to merge that are dependent on newer GCC versions (we still support GCC 9).
This PR updates the CI image (Ubuntu 23.10) and with that many small changes:
- GCC 11 the oldest supported GCC version
- llvm 15 is the oldest supported version (supported in a sense that we test it in the CI; llvm 13 continues to work just fine but it can be a mess when a newer libstdc++ is installed via GCC 13)
- clang-tidy:
- got a big bump from llvm 11 to llvm 17
- new rules that check for correct includes and other things (further, we re-enable two rules that have been previously blocked by llvm bugs)
- removed wrapper that caused tidy to run really slow (files have been tidied multiple times)
- clang-format:
- groups and sorts includes automatically (using matching regexes in
.clang-format) - similar to previous changes to prohibit single line functions, we also don't allow single-line lambdas
- groups and sorts includes automatically (using matching regexes in
- cpplint: removed some excluded rules (e.g., concerning single-line lambdas) and added explanations to exceptions
- b-tree index has been removed as it caused multiple problems with GCC, the repository is no longer maintained, and we want to get rid of chunk-based indexes anyways.
Things to discuss:
- [ ] clang-format changes for includes and single-line lambdas
- [ ] usage of
std::hashoverboost::hash_value(shouldn't be used directly anyways; seesrc/lib/logical_query_plan/export_node.cpp) - [ ] std::endl removal due to clang-tidy rule
Most changes do not need to be reviewed changes were done mostly automated. Thus viewing a few random samples should be sufficient. However, I wan't to ask for review of at least the following files:
- [ ] all scripts (format, lint, Jenkinsfile, etcl.)
- [ ]
console.cpp - [ ]
expression_evaluator.cpp - [ ]
window_expression.cpp
@Bouncner note that llvm-cov report 17 adds branch coverage. Thus, I changed the coverage script to still grep line coverage. The remaining coverage diff seems to be caused by the newer llvm-cov not counting blank lines and comments anymore.
@Bouncner note that
llvm-cov report17 adds branch coverage. Thus, I changed the coverage script to still grep line coverage. The remaining coverage diff seems to be caused by the newerllvm-covnot counting blank lines and comments anymore.
Wat?
Wat
Noticed a >5% decrease in this PR and looked into the coverage report to find an explanation.
Console output w/ llvm-cov 17:
So in the last column is branch coverage. We use to grep the overall value for the last column for the coverage percentage. Using the added flags, the output looks like this:
Line coverage is in the last column again —> we grep the correct metric again. However, I looked into the coverage report to explain the remaining ~1% decrease. master (11): https://hyrise-ci.epic-hpi.de/job/Hyrise/job/hyrise/job/master/lastStableBuild/Llvm-cov_5fReport/ PR (17): https://hyrise-ci.epic-hpi.de/job/hyrise/job/hyrise/job/PR-2611/16/Llvm-cov_5fReport/
Note that the total line counts and covered line counts are smaller w/ 17. When looking into the detailed file reports, it seems that llvm-cov counted blank lines and comments before and changed the behavior to consider only code lines now (which seems perfectly fine imo).
I'll continue working on the problem when the boost hash map has landed (in case it turns out to be advantageous).
batch 2: console. Anything special you wanted to show me here that I overlooked?
Nothing in particular. Just one of the files with many changes.
Nothing surprising performance-wise.
System
cx25 - click to expand
| property | value |
|---|---|
| Hostname | cx25 |
| CPU | AMD EPYC 7742 64-Core Processor |
| Memory | 408GB |
| numactl | nodebind: 0 |
| numactl | membind: 0 1 |
Commit Info and Build Time
| commit | date | message | build time |
|---|---|---|---|
| f5bdcb3c4 | 13.02.2024 14:38 | Improve Predicate Placement and Avoid Semi-Join Reductions (#2590) | real 351.65 user 3108.53 sys 188.24 |
| ebe0fabff | 22.02.2024 11:35 | review | real 351.84 user 3147.83 sys 191.88 |
hyriseBenchmarkTPCH - single-threaded, SF 10.0
Sum of avg. item runtimes: +1% || Geometric mean of throughput changes: -2%
Configuration Overview - click to expand
+Configuration Overview----+------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCH_f5bdcb3c47233e058ef9792c861ed1794fca2d18_st.json | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCH_ebe0fabff633577230a1182668faaf03adaf4b7c_st.json |
+--------------------------+------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------+
| GIT-HASH | f5bdcb3c47233e058ef9792c861ed1794fca2d18-dirty | ebe0fabff633577230a1182668faaf03adaf4b7c-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| clustering | None | None |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2024-02-23 00:30:46 | 2024-02-23 04:21:36 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 100 | 100 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| use_prepared_statements | False | False |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+--------------------------+------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------+
++----------++----------+----------+--------++----------+----------+--------+---------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++----------++----------+----------+--------++----------+----------+--------+---------+
+| TPC-H 01 || 6260.82 | 6176.03 | -1% || 0.16 | 0.16 | +1% | 0.0290 |
+| TPC-H 02 || 46.25 | 47.98 | +4%˄ || 21.62 | 20.84 | -4%˄ | 0.0000 |
+| TPC-H 03 || 1605.49 | 1586.14 | -1% || 0.62 | 0.63 | +1% | 0.0517 |
+| TPC-H 04 || 1559.74 | 1578.56 | +1% || 0.64 | 0.63 | -1% | 0.0228 |
+| TPC-H 05 || 2404.31 | 2416.67 | +1% || 0.42 | 0.41 | -1% | 0.3731 |
+| TPC-H 06 || 187.74 | 207.00 | +10%˄ || 5.33 | 4.83 | -9%˄ | 0.0000 |
+| TPC-H 07 || 810.45 | 850.08 | +5% || 1.23 | 1.18 | -5% | 0.0000 |
+| TPC-H 08 || 572.77 | 578.83 | +1%˄ || 1.75 | 1.73 | -1%˄ | 0.0000 |
+| TPC-H 09 || 5982.68 | 6003.46 | +0% || 0.17 | 0.17 | -0% | 0.1748 |
+| TPC-H 10 || 1822.03 | 1855.93 | +2% || 0.55 | 0.54 | -2% | 0.0031 |
+| TPC-H 11 || 52.95 | 53.73 | +1%˄ || 18.88 | 18.61 | -1%˄ | 0.0000 |
+| TPC-H 12 || 1029.20 | 1044.30 | +1% || 0.97 | 0.96 | -1% | 0.0000 |
+| TPC-H 13 || 5644.28 | 5737.62 | +2% || 0.18 | 0.17 | -2% | 0.0036 |
+| TPC-H 14 || 527.92 | 529.68 | +0%˄ || 1.89 | 1.89 | -0%˄ | 0.1945 |
+| TPC-H 15 || 189.90 | 199.70 | +5%˄ || 5.27 | 5.01 | -5%˄ | 0.0000 |
+| TPC-H 16 || 567.21 | 583.99 | +3%˄ || 1.76 | 1.71 | -3%˄ | 0.0000 |
+| TPC-H 17 || 222.67 | 227.69 | +2%˄ || 4.49 | 4.39 | -2%˄ | 0.0000 |
+| TPC-H 18 || 1540.23 | 1546.65 | +0% || 0.65 | 0.65 | -0% | 0.6849 |
+| TPC-H 19 || 263.30 | 267.29 | +2%˄ || 3.80 | 3.74 | -1%˄ | 0.0019 |
+| TPC-H 20 || 521.50 | 533.58 | +2%˄ || 1.92 | 1.87 | -2%˄ | 0.4968 |
+| TPC-H 21 || 4436.67 | 4434.32 | -0% || 0.23 | 0.23 | +0% | 0.9093 |
+| TPC-H 22 || 497.43 | 502.17 | +1%˄ || 2.01 | 1.99 | -1%˄ | 0.0000 |
++----------++----------+----------+--------++----------+----------+--------+---------+
+| Sum || 36745.57 | 36961.42 | +1% || | | | |
+| Geomean || | | || | | -2% | |
++----------++----------+----------+--------++----------+----------+--------+---------+
+| Notes || ˄ Execution stopped due to max runs reached |
++----------++----------+----------+--------++----------+----------+--------+---------+
hyriseBenchmarkTPCH - single-threaded, SF 0.01
Sum of avg. item runtimes: +1% || Geometric mean of throughput changes: -1%
Configuration Overview - click to expand
+Configuration Overview----+----------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCH_f5bdcb3c47233e058ef9792c861ed1794fca2d18_st_s01.json | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCH_ebe0fabff633577230a1182668faaf03adaf4b7c_st_s01.json |
+--------------------------+----------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------+
| GIT-HASH | f5bdcb3c47233e058ef9792c861ed1794fca2d18-dirty | ebe0fabff633577230a1182668faaf03adaf4b7c-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| clustering | None | None |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2024-02-23 00:50:26 | 2024-02-23 04:41:19 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 100 | 100 |
| scale_factor | 0.009999999776482582 | 0.009999999776482582 |
| time_unit | ns | ns |
| use_prepared_statements | False | False |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+--------------------------+----------------------------------------------------------------------------------------------------------------+----------------------------------------------------------------------------------------------------------------+
++----------++----------+---------+--------++----------+----------+--------+---------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++----------++----------+---------+--------++----------+----------+--------+---------+
+| TPC-H 01 || 5.80 | 5.78 | -0%˄ || 172.46 | 172.89 | +0%˄ | 0.3850 |
+| TPC-H 02 || 4.53 | 4.41 | -3%˄ || 220.67 | 226.73 | +3%˄ | 0.6153 |
+| TPC-H 03 || 0.71 | 0.72 | +1%˄ || 1402.75 | 1382.78 | -1%˄ | 0.0113 |
+| TPC-H 04 || 0.42 | 0.43 | +1%˄ || 2356.14 | 2338.99 | -1%˄ | 0.1749 |
+| TPC-H 05 || 1.06 | 1.05 | -1%˄ || 942.39 | 952.13 | +1%˄ | 0.5754 |
+| TPC-H 06 || 0.22 | 0.24 | +9%˄ || 4434.26 | 4083.80 | -8%˄ | 0.0000 |
+| TPC-H 07 || 11.47 | 11.41 | -0%˄ || 87.19 | 87.63 | +1%˄ | 0.9346 |
+| TPC-H 08 || 15.43 | 15.78 | +2%˄ || 64.79 | 63.36 | -2%˄ | 0.4546 |
+| TPC-H 09 || 3.80 | 4.22 | +11%˄ || 262.91 | 237.15 | -10%˄ | 0.4766 |
+| TPC-H 10 || 0.82 | 0.81 | -1%˄ || 1221.06 | 1229.69 | +1%˄ | 0.2390 |
+| TPC-H 11 || 0.21 | 0.20 | -1%˄ || 4844.42 | 4898.15 | +1%˄ | 0.2617 |
+| TPC-H 12 || 0.69 | 0.73 | +5%˄ || 1444.60 | 1372.10 | -5%˄ | 0.0201 |
+| TPC-H 13 || 2.21 | 2.22 | +0%˄ || 452.24 | 451.11 | -0%˄ | 0.4422 |
+| TPC-H 14 || 0.33 | 0.34 | +3%˄ || 2994.96 | 2921.11 | -2%˄ | 0.0121 |
+| TPC-H 15 || 1.35 | 1.37 | +1%˄ || 736.72 | 726.09 | -1%˄ | 0.0000 |
+| TPC-H 16 || 2.58 | 2.57 | -1%˄ || 386.97 | 388.91 | +1%˄ | 0.0960 |
+| TPC-H 17 || 0.72 | 0.65 | -10%˄ || 1393.02 | 1539.87 | +11%˄ | 0.4379 |
+| TPC-H 18 || 1.17 | 1.18 | +1%˄ || 853.83 | 847.51 | -1%˄ | 0.0022 |
+| TPC-H 19 || 6.70 | 6.68 | -0%˄ || 149.31 | 149.64 | +0%˄ | 0.0709 |
+| TPC-H 20 || 2.98 | 3.01 | +1%˄ || 335.62 | 332.26 | -1%˄ | 0.5920 |
+| TPC-H 21 || 1.12 | 1.09 | -3%˄ || 890.39 | 913.95 | +3%˄ | 0.5055 |
+| TPC-H 22 || 1.31 | 1.31 | -0%˄ || 762.21 | 762.60 | +0%˄ | 0.8262 |
++----------++----------+---------+--------++----------+----------+--------+---------+
+| Sum || 65.64 | 66.20 | +1% || | | | |
+| Geomean || | | || | | -1% | |
++----------++----------+---------+--------++----------+----------+--------+---------+
+| Notes || ˄ Execution stopped due to max runs reached |
++----------++----------+---------+--------++----------+----------+--------+---------+
hyriseBenchmarkTPCH - multi-threaded, ordered, 1 client, 64 cores, SF 10.0
Sum of avg. item runtimes: +0% || Geometric mean of throughput changes: -0%
Configuration Overview - click to expand
+Configuration Overview---------+--------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCH_f5bdcb3c47233e058ef9792c861ed1794fca2d18_mt_ordered.json | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCH_ebe0fabff633577230a1182668faaf03adaf4b7c_mt_ordered.json |
+-------------------------------+--------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | f5bdcb3c47233e058ef9792c861ed1794fca2d18-dirty | ebe0fabff633577230a1182668faaf03adaf4b7c-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| clustering | None | None |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2024-02-23 00:50:55 | 2024-02-23 04:41:48 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| use_prepared_statements | False | False |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+--------------------------------------------------------------------------------------------------------------------+--------------------------------------------------------------------------------------------------------------------+
++----------++----------+----------+--------++----------+----------+--------+----------------------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++----------++----------+----------+--------++----------+----------+--------+----------------------+
+| TPC-H 01 || 4897.76 | 4983.87 | +2% || 0.20 | 0.20 | +0% | (run time too short) |
+| TPC-H 02 || 30.70 | 30.56 | -0% || 27.80 | 27.78 | -0% | 0.5641 |
+| TPC-H 03 || 483.79 | 481.40 | -0% || 2.03 | 2.05 | +1% | 0.4606 |
+| TPC-H 04 || 463.02 | 461.77 | -0% || 2.13 | 2.13 | +0% | 0.7872 |
+| TPC-H 05 || 386.63 | 386.30 | -0% || 2.55 | 2.55 | -0% | 0.8911 |
+| TPC-H 06 || 36.49 | 38.27 | +5% || 24.50 | 23.63 | -4% | 0.0000 |
+| TPC-H 07 || 194.50 | 198.00 | +2% || 5.00 | 4.92 | -2% | 0.0006 |
+| TPC-H 08 || 166.30 | 166.74 | +0% || 5.82 | 5.82 | +0% | 0.4328 |
+| TPC-H 09 || 1771.00 | 1763.51 | -0% || 0.55 | 0.55 | +0% | (run time too short) |
+| TPC-H 10 || 879.08 | 859.85 | -2% || 1.12 | 1.15 | +3% | (run time too short) |
+| TPC-H 11 || 37.17 | 37.58 | +1% || 23.57 | 23.43 | -1% | 0.0042 |
+| TPC-H 12 || 393.79 | 397.12 | +1% || 2.50 | 2.48 | -1% | 0.0033 |
+| TPC-H 13 || 2839.95 | 2851.98 | +0% || 0.35 | 0.35 | -0% | 0.0501 |
+| TPC-H 14 || 94.47 | 94.66 | +0% || 10.00 | 9.97 | -0% | 0.4431 |
+| TPC-H 15 || 121.71 | 122.14 | +0% || 7.85 | 7.82 | -0% | 0.0924 |
+| TPC-H 16 || 461.30 | 457.88 | -1% || 2.13 | 2.15 | +1% | 0.0873 |
+| TPC-H 17 || 57.00 | 57.22 | +0% || 16.30 | 16.21 | -1% | 0.2543 |
+| TPC-H 18 || 1852.68 | 1849.29 | -0% || 0.53 | 0.53 | -0% | 0.8833 |
+| TPC-H 19 || 71.05 | 71.12 | +0% || 13.12 | 13.10 | -0% | 0.8862 |
+| TPC-H 20 || 151.20 | 156.59 | +4% || 6.38 | 6.18 | -3% | 0.0005 |
+| TPC-H 21 || 779.61 | 780.53 | +0% || 1.27 | 1.27 | -0% | 0.8775 |
+| TPC-H 22 || 93.69 | 94.08 | +0% || 10.00 | 9.98 | -0% | 0.0773 |
++----------++----------+----------+--------++----------+----------+--------+----------------------+
+| Sum || 16262.90 | 16340.45 | +0% || | | | |
+| Geomean || | | || | | -0% | |
++----------++----------+----------+--------++----------+----------+--------+----------------------+
hyriseBenchmarkTPCH - multi-threaded, shuffled, 64 clients, 64 cores, SF 10.0
Sum of avg. item runtimes: +1% || Geometric mean of throughput changes: -0%
Configuration Overview - click to expand
+Configuration Overview---------+------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCH_f5bdcb3c47233e058ef9792c861ed1794fca2d18_mt.json | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCH_ebe0fabff633577230a1182668faaf03adaf4b7c_mt.json |
+-------------------------------+------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------+
| GIT-HASH | f5bdcb3c47233e058ef9792c861ed1794fca2d18-dirty | ebe0fabff633577230a1182668faaf03adaf4b7c-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 64 | 64 |
| clustering | None | None |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2024-02-23 01:14:36 | 2024-02-23 05:05:29 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| use_prepared_statements | False | False |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------+
++----------++----------+----------+--------++----------+----------+--------+---------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++----------++----------+----------+--------++----------+----------+--------+---------+
+| TPC-H 01 || 6642.82 | 6449.70 | -3% || 1.01 | 1.01 | -0% | 0.0324 |
+| TPC-H 02 || 489.18 | 442.51 | -10% || 1.01 | 1.01 | -0% | 0.4283 |
+| TPC-H 03 || 3065.76 | 2908.72 | -5% || 1.01 | 1.01 | -1% | 0.3191 |
+| TPC-H 04 || 2578.92 | 2673.07 | +4% || 1.01 | 1.01 | -0% | 0.5770 |
+| TPC-H 05 || 4034.03 | 4248.75 | +5% || 1.01 | 1.01 | -1% | 0.2677 |
+| TPC-H 06 || 772.51 | 885.31 | +15% || 1.01 | 1.01 | -0% | 0.2052 |
+| TPC-H 07 || 3339.13 | 3545.47 | +6% || 1.01 | 1.01 | -1% | 0.2834 |
+| TPC-H 08 || 2583.34 | 2346.54 | -9% || 1.01 | 1.01 | -1% | 0.1304 |
+| TPC-H 09 || 6586.54 | 6791.55 | +3% || 1.01 | 1.01 | -0% | 0.3327 |
+| TPC-H 10 || 4205.86 | 4336.81 | +3% || 1.01 | 1.01 | -0% | 0.4427 |
+| TPC-H 11 || 579.00 | 491.57 | -15% || 1.01 | 1.01 | -0% | 0.2468 |
+| TPC-H 12 || 3100.68 | 2768.30 | -11% || 1.01 | 1.01 | -1% | 0.0414 |
+| TPC-H 13 || 5970.99 | 6014.25 | +1% || 1.01 | 1.00 | -1% | 0.7348 |
+| TPC-H 14 || 1313.55 | 1216.48 | -7% || 1.01 | 1.01 | -0% | 0.4089 |
+| TPC-H 15 || 725.94 | 677.41 | -7% || 1.01 | 1.01 | -1% | 0.4372 |
+| TPC-H 16 || 2447.21 | 2453.28 | +0% || 1.01 | 1.01 | -0% | 0.9617 |
+| TPC-H 17 || 692.67 | 998.64 | +44% || 1.01 | 1.01 | -1% | 0.0010 |
+| TPC-H 18 || 3651.49 | 3849.11 | +5% || 1.01 | 1.01 | -0% | 0.0301 |
+| TPC-H 19 || 1276.84 | 1310.78 | +3% || 1.01 | 1.01 | -0% | 0.7762 |
+| TPC-H 20 || 1843.11 | 1874.57 | +2% || 1.01 | 1.01 | -1% | 0.7938 |
+| TPC-H 21 || 5554.00 | 5489.57 | -1% || 1.01 | 1.01 | -0% | 0.7600 |
+| TPC-H 22 || 1109.06 | 1197.08 | +8% || 1.01 | 1.01 | -0% | 0.3976 |
++----------++----------+----------+--------++----------+----------+--------+---------+
+| Sum || 62562.63 | 62969.47 | +1% || | | | |
+| Geomean || | | || | | -0% | |
++----------++----------+----------+--------++----------+----------+--------+---------+
hyriseBenchmarkTPCDS - single-threaded
Sum of avg. item runtimes: -0% || Geometric mean of throughput changes: +1%
Configuration Overview - click to expand
+Configuration Overview---+-------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCDS_f5bdcb3c47233e058ef9792c861ed1794fca2d18_st.json | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCDS_ebe0fabff633577230a1182668faaf03adaf4b7c_st.json |
+-------------------------+-------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------+
| GIT-HASH | f5bdcb3c47233e058ef9792c861ed1794fca2d18-dirty | ebe0fabff633577230a1182668faaf03adaf4b7c-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2024-02-23 01:36:19 | 2024-02-23 05:27:10 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 100 | 100 |
| time_unit | ns | ns |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------+-------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------+
++---------++----------+----------+--------++----------+----------+--------+---------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++---------++----------+----------+--------++----------+----------+--------+---------+
+| 01 || 220.17 | 219.25 | -0%˄ || 4.54 | 4.56 | +0%˄ | 0.0462 |
+| 03 || 68.64 | 68.93 | +0%˄ || 14.57 | 14.51 | -0%˄ | 0.2014 |
+| 06 || 210.40 | 208.81 | -1%˄ || 4.75 | 4.79 | +1%˄ | 0.0000 |
+| 07 || 305.66 | 295.56 | -3%˄ || 3.27 | 3.38 | +3%˄ | 0.0000 |
+| 09 || 774.31 | 724.67 | -6% || 1.29 | 1.38 | +7% | 0.0000 |
+| 10 || 141.18 | 140.10 | -1%˄ || 7.08 | 7.14 | +1%˄ | 0.0226 |
+| 13 || 502.96 | 490.44 | -2%˄ || 1.99 | 2.04 | +3%˄ | 0.0000 |
+| 15 || 126.54 | 124.68 | -1%˄ || 7.90 | 8.02 | +1%˄ | 0.0000 |
+| 16 || 67.74 | 65.98 | -3%˄ || 14.76 | 15.16 | +3%˄ | 0.0000 |
+| 17 || 340.61 | 335.72 | -1%˄ || 2.94 | 2.98 | +1%˄ | 0.0000 |
+| 19 || 116.50 | 115.23 | -1%˄ || 8.58 | 8.68 | +1%˄ | 0.0000 |
+| 25 || 184.67 | 181.94 | -1%˄ || 5.42 | 5.50 | +1%˄ | 0.0000 |
+| 26 || 138.35 | 131.16 | -5%˄ || 7.23 | 7.62 | +5%˄ | 0.0000 |
+| 28 || 587.00 | 567.50 | -3%˄ || 1.70 | 1.76 | +3%˄ | 0.0000 |
+| 29 || 495.03 | 495.29 | +0%˄ || 2.02 | 2.02 | -0%˄ | 0.7570 |
+| 31 || 1396.66 | 1389.47 | -1% || 0.72 | 0.72 | +1% | 0.0005 |
+| 32 || 32.95 | 32.38 | -2%˄ || 30.34 | 30.88 | +2%˄ | 0.0000 |
+| 34 || 170.52 | 166.06 | -3%˄ || 5.86 | 6.02 | +3%˄ | 0.0000 |
+| 35 || 659.04 | 652.93 | -1% || 1.52 | 1.53 | +1% | 0.0000 |
+| 37 || 764.32 | 818.29 | +7% || 1.31 | 1.22 | -7% | 0.0000 |
+| 39a || 1670.89 | 1670.15 | -0% || 0.60 | 0.60 | +0% | 0.8346 |
+| 39b || 1653.78 | 1655.60 | +0% || 0.60 | 0.60 | -0% | 0.5751 |
+| 41 || 312.88 | 309.16 | -1%˄ || 3.20 | 3.23 | +1%˄ | 0.0000 |
+| 42 || 94.34 | 94.14 | -0%˄ || 10.60 | 10.62 | +0%˄ | 0.2938 |
+| 43 || 1043.25 | 1023.05 | -2% || 0.96 | 0.98 | +2% | 0.0000 |
+| 45 || 137.38 | 136.68 | -1%˄ || 7.28 | 7.32 | +1%˄ | 0.0000 |
+| 48 || 1052.34 | 1042.52 | -1% || 0.95 | 0.96 | +1% | 0.0012 |
+| 50 || 130.99 | 132.76 | +1%˄ || 7.63 | 7.53 | -1%˄ | 0.0000 |
+| 52 || 94.24 | 95.71 | +2%˄ || 10.61 | 10.45 | -2%˄ | 0.0000 |
+| 55 || 89.05 | 89.91 | +1%˄ || 11.23 | 11.12 | -1%˄ | 0.0000 |
+| 62 || 612.47 | 618.21 | +1% || 1.63 | 1.62 | -1% | 0.0000 |
+| 65 || 1641.23 | 1633.80 | -0% || 0.61 | 0.61 | +0% | 0.0471 |
+| 69 || 156.48 | 156.21 | -0%˄ || 6.39 | 6.40 | +0%˄ | 0.1086 |
+| 73 || 89.19 | 88.20 | -1%˄ || 11.21 | 11.34 | +1%˄ | 0.0000 |
+| 79 || 530.26 | 519.42 | -2%˄ || 1.89 | 1.93 | +2%˄ | 0.0000 |
+| 81 || 165.02 | 163.29 | -1%˄ || 6.06 | 6.12 | +1%˄ | 0.0000 |
+| 82 || 811.15 | 865.46 | +7% || 1.23 | 1.16 | -6% | 0.0000 |
+| 83 || 43.32 | 42.62 | -2%˄ || 23.08 | 23.46 | +2%˄ | 0.0766 |
+| 85 || 169.50 | 167.57 | -1%˄ || 5.90 | 5.97 | +1%˄ | 0.0000 |
+| 88 || 725.41 | 714.95 | -1% || 1.38 | 1.40 | +1% | 0.0000 |
+| 91 || 16.89 | 17.15 | +2%˄ || 59.21 | 58.29 | -2%˄ | 0.0000 |
+| 92 || 42.76 | 42.54 | -1%˄ || 23.38 | 23.51 | +1%˄ | 0.0007 |
+| 93 || 3815.88 | 3777.39 | -1% || 0.26 | 0.26 | +1% | 0.0000 |
+| 94 || 43.38 | 42.57 | -2%˄ || 23.05 | 23.49 | +2%˄ | 0.0010 |
+| 95 || 4550.06 | 4543.69 | -0% || 0.22 | 0.22 | +0% | 0.8588 |
+| 96 || 67.84 | 67.25 | -1%˄ || 14.74 | 14.87 | +1%˄ | 0.4202 |
+| 97 || 2554.24 | 2587.76 | +1% || 0.39 | 0.39 | -1% | 0.0014 |
+| 99 || 1147.68 | 1145.90 | -0% || 0.87 | 0.87 | +0% | 0.1726 |
++---------++----------+----------+--------++----------+----------+--------+---------+
+| Sum || 30765.14 | 30668.04 | -0% || | | | |
+| Geomean || | | || | | +1% | |
++---------++----------+----------+--------++----------+----------+--------+---------+
+| Notes || ˄ Execution stopped due to max runs reached |
++---------++----------+----------+--------++----------+----------+--------+---------+
hyriseBenchmarkTPCDS - multi-threaded, shuffled, 64 clients, 64 cores
Sum of avg. item runtimes: +0% || Geometric mean of throughput changes: -0%
Configuration Overview - click to expand
+Configuration Overview---------+-------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCDS_f5bdcb3c47233e058ef9792c861ed1794fca2d18_mt.json | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCDS_ebe0fabff633577230a1182668faaf03adaf4b7c_mt.json |
+-------------------------------+-------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------+
| GIT-HASH | f5bdcb3c47233e058ef9792c861ed1794fca2d18-dirty | ebe0fabff633577230a1182668faaf03adaf4b7c-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 64 | 64 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2024-02-23 02:03:48 | 2024-02-23 05:54:29 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+-------------------------------------------------------------------------------------------------------------+-------------------------------------------------------------------------------------------------------------+
++---------++----------+----------+--------++----------+----------+--------+---------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++---------++----------+----------+--------++----------+----------+--------+---------+
+| 01 || 656.38 | 638.28 | -3% || 1.00 | 1.00 | -0% | 0.6858 |
+| 03 || 309.16 | 284.93 | -8% || 1.01 | 1.00 | -0% | 0.5170 |
+| 06 || 887.43 | 1000.51 | +13% || 1.01 | 1.00 | -0% | 0.0883 |
+| 07 || 1024.73 | 978.97 | -4% || 1.01 | 1.00 | -0% | 0.5605 |
+| 09 || 942.58 | 959.94 | +2% || 1.01 | 1.00 | -0% | 0.8268 |
+| 10 || 815.35 | 778.64 | -5% || 1.00 | 1.00 | -0% | 0.5883 |
+| 13 || 1668.70 | 1792.96 | +7% || 1.00 | 1.00 | -0% | 0.1545 |
+| 15 || 566.11 | 502.94 | -11% || 1.01 | 1.00 | -0% | 0.1642 |
+| 16 || 507.67 | 528.56 | +4% || 1.00 | 1.00 | -0% | 0.7110 |
+| 17 || 1375.20 | 1263.57 | -8% || 1.01 | 1.00 | -1% | 0.1772 |
+| 19 || 681.06 | 637.91 | -6% || 1.00 | 1.00 | -0% | 0.4482 |
+| 25 || 1075.90 | 1111.06 | +3% || 1.01 | 1.00 | -0% | 0.6718 |
+| 26 || 530.42 | 493.84 | -7% || 1.01 | 1.00 | -0% | 0.3960 |
+| 28 || 1709.97 | 1685.30 | -1% || 1.00 | 1.00 | -0% | 0.8225 |
+| 29 || 1689.82 | 1732.36 | +3% || 1.00 | 1.00 | -0% | 0.6549 |
+| 31 || 2864.90 | 2686.97 | -6% || 1.00 | 1.00 | -0% | 0.1348 |
+| 32 || 205.51 | 221.44 | +8% || 1.01 | 1.00 | -0% | 0.6301 |
+| 34 || 751.93 | 696.14 | -7% || 1.01 | 1.00 | -0% | 0.3399 |
+| 35 || 2235.06 | 2147.44 | -4% || 1.00 | 1.00 | -1% | 0.3801 |
+| 37 || 839.99 | 876.48 | +4% || 1.01 | 1.00 | -1% | 0.5084 |
+| 39a || 2639.01 | 2689.82 | +2% || 1.00 | 1.00 | -0% | 0.5878 |
+| 39b || 2715.37 | 2706.72 | -0% || 1.00 | 1.00 | -0% | 0.9265 |
+| 41 || 3666.76 | 3738.47 | +2% || 1.00 | 1.00 | -1% | 0.5787 |
+| 42 || 470.25 | 555.02 | +18% || 1.01 | 1.00 | -0% | 0.1156 |
+| 43 || 1476.50 | 1463.64 | -1% || 1.00 | 1.00 | -0% | 0.8591 |
+| 45 || 719.82 | 810.64 | +13% || 1.01 | 1.00 | -0% | 0.2188 |
+| 48 || 2448.90 | 2496.47 | +2% || 1.00 | 1.00 | -0% | 0.6596 |
+| 50 || 1042.94 | 1064.68 | +2% || 1.00 | 1.00 | -0% | 0.7794 |
+| 52 || 444.81 | 433.52 | -3% || 1.01 | 1.00 | -0% | 0.7847 |
+| 55 || 413.83 | 436.39 | +5% || 1.01 | 1.00 | -0% | 0.5576 |
+| 62 || 1065.28 | 1023.11 | -4% || 1.00 | 1.00 | -0% | 0.4751 |
+| 65 || 4485.19 | 4453.41 | -1% || 1.00 | 1.00 | -0% | 0.6296 |
+| 69 || 979.40 | 1010.69 | +3% || 1.01 | 1.00 | -0% | 0.6661 |
+| 73 || 530.65 | 545.41 | +3% || 1.01 | 1.00 | -0% | 0.7876 |
+| 79 || 1517.95 | 1572.72 | +4% || 1.00 | 1.00 | -0% | 0.4572 |
+| 81 || 575.27 | 711.88 | +24% || 1.01 | 1.00 | -0% | 0.0088 |
+| 82 || 901.07 | 1122.87 | +25% || 1.01 | 1.00 | -1% | 0.0003 |
+| 83 || 380.77 | 342.50 | -10% || 1.01 | 1.00 | -0% | 0.4121 |
+| 85 || 912.99 | 985.24 | +8% || 1.01 | 1.00 | -0% | 0.3749 |
+| 88 || 2814.83 | 2796.09 | -1% || 1.00 | 1.00 | -0% | 0.8856 |
+| 91 || 203.98 | 218.97 | +7% || 1.01 | 1.00 | -1% | 0.6839 |
+| 92 || 300.77 | 272.15 | -10% || 1.01 | 1.00 | -0% | 0.4355 |
+| 93 || 2214.95 | 2169.03 | -2% || 1.00 | 1.00 | -0% | 0.5810 |
+| 94 || 478.41 | 433.75 | -9% || 1.00 | 1.00 | -0% | 0.3613 |
+| 95 || 2237.74 | 2257.78 | +1% || 1.00 | 1.00 | -0% | 0.8314 |
+| 96 || 408.45 | 373.28 | -9% || 1.01 | 1.00 | -0% | 0.3625 |
+| 97 || 4291.22 | 4306.61 | +0% || 1.00 | 1.00 | -0% | 0.8797 |
+| 99 || 1527.76 | 1456.63 | -5% || 1.00 | 1.00 | -1% | 0.3275 |
++---------++----------+----------+--------++----------+----------+--------+---------+
+| Sum || 63202.73 | 63465.74 | +0% || | | | |
+| Geomean || | | || | | -0% | |
++---------++----------+----------+--------++----------+----------+--------+---------+
hyriseBenchmarkTPCC - single-threaded
Sum of avg. item runtimes: -0% || Geometric mean of throughput changes: +1%
Configuration Overview - click to expand
+Configuration Overview---+------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCC_f5bdcb3c47233e058ef9792c861ed1794fca2d18_st.json | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCC_ebe0fabff633577230a1182668faaf03adaf4b7c_st.json |
+-------------------------+------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------+
| GIT-HASH | f5bdcb3c47233e058ef9792c861ed1794fca2d18-dirty | ebe0fabff633577230a1182668faaf03adaf4b7c-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2024-02-23 02:24:14 | 2024-02-23 06:14:54 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10 | 10 |
| time_unit | ns | ns |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------+------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------+
++--------------++----------+---------+--------++----------+----------+--------+----------------------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++--------------++----------+---------+--------++----------+----------+--------+----------------------+
+| Delivery || 63.06 | 62.69 | -1% || 1.57 | 1.55 | -1% | (run time too short) |
+| New-Order || 43.23 | 43.38 | +0% || 17.48 | 17.46 | -0% | 0.8071 |
+| Order-Status || 2.08 | 2.05 | -1% || 1.53 | 1.57 | +2% | (run time too short) |
+| Payment || 8.14 | 8.14 | -0% || 16.71 | 16.70 | -0% | 0.9669 |
+| Stock-Level || 3.44 | 3.44 | -0% || 1.53 | 1.57 | +2% | (run time too short) |
++--------------++----------+---------+--------++----------+----------+--------+----------------------+
+| Sum || 119.96 | 119.69 | -0% || | | | |
+| Geomean || | | || | | +1% | |
++--------------++----------+---------+--------++----------+----------+--------+----------------------+
hyriseBenchmarkTPCC - multi-threaded, shuffled, 64 clients, 64 cores
Sum of avg. item runtimes: +0% || Geometric mean of throughput changes: +0%
Configuration Overview - click to expand
+Configuration Overview---------+------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCC_f5bdcb3c47233e058ef9792c861ed1794fca2d18_mt.json | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkTPCC_ebe0fabff633577230a1182668faaf03adaf4b7c_mt.json |
+-------------------------------+------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------+
| GIT-HASH | f5bdcb3c47233e058ef9792c861ed1794fca2d18-dirty | ebe0fabff633577230a1182668faaf03adaf4b7c-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 64 | 64 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2024-02-23 02:25:21 | 2024-02-23 06:16:00 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10 | 10 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------+
++--------------++----------+---------+--------++----------+----------+--------+---------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++--------------++----------+---------+--------++----------+----------+--------+---------+
+| Delivery || 215.64 | 215.81 | +0% || 25.62 | 25.54 | -0% | 0.8028 |
+| unsucc.: || 3.72 | 3.66 | -2% || 27.74 | 28.06 | +1% | |
+| New-Order || 129.48 | 129.17 | -0% || 320.03 | 320.14 | +0% | 0.0393 |
+| unsucc.: || 8.67 | 8.80 | +1% || 280.24 | 282.88 | +1% | |
+| Order-Status || 9.00 | 9.00 | +0% || 53.36 | 53.60 | +0% | 0.9958 |
+| Payment || 21.58 | 21.50 | -0% || 174.14 | 174.72 | +0% | 0.1129 |
+| unsucc.: || 5.48 | 5.43 | -1% || 399.48 | 401.53 | +1% | |
+| Stock-Level || 15.10 | 15.37 | +2% || 53.36 | 53.60 | +0% | 0.1566 |
++--------------++----------+---------+--------++----------+----------+--------+---------+
+| Sum || 390.80 | 390.86 | +0% || | | | |
+| Geomean || | | || | | +0% | |
++--------------++----------+---------+--------++----------+----------+--------+---------+
hyriseBenchmarkJoinOrder - single-threaded
Sum of avg. item runtimes: +0% || Geometric mean of throughput changes: -0%
Configuration Overview - click to expand
+Configuration Overview---+-----------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkJoinOrder_f5bdcb3c47233e058ef9792c861ed1794fca2d18_st.json | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkJoinOrder_ebe0fabff633577230a1182668faaf03adaf4b7c_st.json |
+-------------------------+-----------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------+
| GIT-HASH | f5bdcb3c47233e058ef9792c861ed1794fca2d18-dirty | ebe0fabff633577230a1182668faaf03adaf4b7c-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2024-02-23 02:45:36 | 2024-02-23 06:36:15 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 100 | 100 |
| time_unit | ns | ns |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------+-----------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------+
++---------++----------+----------+--------++----------+----------+--------+---------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++---------++----------+----------+--------++----------+----------+--------+---------+
+| 10a || 110.21 | 116.17 | +5%˄ || 9.07 | 8.61 | -5%˄ | 0.0000 |
+| 10b || 70.58 | 73.37 | +4%˄ || 14.17 | 13.63 | -4%˄ | 0.0000 |
+| 10c || 350.34 | 351.00 | +0%˄ || 2.85 | 2.85 | -0%˄ | 0.2474 |
+| 11a || 106.13 | 103.79 | -2%˄ || 9.42 | 9.63 | +2%˄ | 0.0000 |
+| 11b || 99.86 | 98.18 | -2%˄ || 10.01 | 10.18 | +2%˄ | 0.0000 |
+| 11c || 22.10 | 22.00 | -0%˄ || 45.25 | 45.44 | +0%˄ | 0.0008 |
+| 11d || 24.87 | 24.83 | -0%˄ || 40.21 | 40.27 | +0%˄ | 0.2889 |
+| 12a || 34.35 | 33.78 | -2%˄ || 29.11 | 29.58 | +2%˄ | 0.0000 |
+| 12b || 28.18 | 28.30 | +0%˄ || 35.48 | 35.33 | -0%˄ | 0.0003 |
+| 12c || 78.62 | 77.96 | -1%˄ || 12.72 | 12.83 | +1%˄ | 0.0000 |
+| 13a || 196.34 | 195.22 | -1%˄ || 5.09 | 5.12 | +1%˄ | 0.0000 |
+| 13b || 246.24 | 246.01 | -0%˄ || 4.06 | 4.06 | +0%˄ | 0.0011 |
+| 13c || 200.33 | 200.21 | -0%˄ || 4.99 | 4.99 | +0%˄ | 0.0756 |
+| 13d || 554.83 | 551.14 | -1%˄ || 1.80 | 1.81 | +1%˄ | 0.0000 |
+| 14a || 108.53 | 109.71 | +1%˄ || 9.21 | 9.11 | -1%˄ | 0.0000 |
+| 14b || 117.06 | 118.13 | +1%˄ || 8.54 | 8.46 | -1%˄ | 0.0000 |
+| 14c || 227.35 | 228.74 | +1%˄ || 4.40 | 4.37 | -1%˄ | 0.0000 |
+| 15a || 55.06 | 56.41 | +2%˄ || 18.16 | 17.73 | -2%˄ | 0.0000 |
+| 15b || 60.31 | 60.76 | +1%˄ || 16.58 | 16.46 | -1%˄ | 0.0000 |
+| 15c || 44.82 | 45.60 | +2%˄ || 22.31 | 21.93 | -2%˄ | 0.0000 |
+| 15d || 42.50 | 43.30 | +2%˄ || 23.53 | 23.09 | -2%˄ | 0.0000 |
+| 16a || 1387.99 | 1389.16 | +0% || 0.72 | 0.72 | -0% | 0.6942 |
+| 16b || 2644.47 | 2647.92 | +0% || 0.38 | 0.38 | -0% | 0.4942 |
+| 16c || 1571.32 | 1574.67 | +0% || 0.64 | 0.64 | -0% | 0.1167 |
+| 16d || 1532.75 | 1534.76 | +0% || 0.65 | 0.65 | -0% | 0.4086 |
+| 17a || 488.63 | 487.72 | -0%˄ || 2.05 | 2.05 | +0%˄ | 0.0009 |
+| 17b || 389.92 | 392.13 | +1%˄ || 2.56 | 2.55 | -1%˄ | 0.0000 |
+| 17c || 369.02 | 372.26 | +1%˄ || 2.71 | 2.69 | -1%˄ | 0.0000 |
+| 17d || 439.86 | 445.81 | +1%˄ || 2.27 | 2.24 | -1%˄ | 0.0000 |
+| 17e || 1656.37 | 1656.15 | -0% || 0.60 | 0.60 | +0% | 0.9226 |
+| 17f || 957.88 | 959.00 | +0% || 1.04 | 1.04 | -0% | 0.0148 |
+| 18a || 142.19 | 144.32 | +1%˄ || 7.03 | 6.93 | -1%˄ | 0.0000 |
+| 18b || 118.41 | 117.77 | -1%˄ || 8.44 | 8.49 | +1%˄ | 0.0000 |
+| 18c || 212.74 | 212.71 | -0%˄ || 4.70 | 4.70 | +0%˄ | 0.7764 |
+| 19a || 225.76 | 226.95 | +1%˄ || 4.43 | 4.41 | -1%˄ | 0.0000 |
+| 19b || 187.20 | 187.18 | -0%˄ || 5.34 | 5.34 | +0%˄ | 0.7552 |
+| 19c || 270.32 | 270.04 | -0%˄ || 3.70 | 3.70 | +0%˄ | 0.0311 |
+| 19d || 753.70 | 747.84 | -1% || 1.33 | 1.34 | +1% | 0.0000 |
+| 1a || 10.32 | 10.22 | -1%˄ || 96.85 | 97.77 | +1%˄ | 0.0005 |
+| 1b || 18.37 | 17.22 | -6%˄ || 54.42 | 58.05 | +7%˄ | 0.0000 |
+| 1c || 16.63 | 18.08 | +9%˄ || 60.11 | 55.30 | -8%˄ | 0.0000 |
+| 1d || 9.61 | 9.61 | +0%˄ || 104.05 | 104.01 | -0%˄ | 0.8897 |
+| 20a || 541.28 | 547.18 | +1%˄ || 1.85 | 1.83 | -1%˄ | 0.0000 |
+| 20b || 578.96 | 585.65 | +1%˄ || 1.73 | 1.71 | -1%˄ | 0.0000 |
+| 20c || 384.08 | 388.88 | +1%˄ || 2.60 | 2.57 | -1%˄ | 0.0000 |
+| 21a || 118.37 | 116.21 | -2%˄ || 8.45 | 8.61 | +2%˄ | 0.0000 |
+| 21b || 110.41 | 109.43 | -1%˄ || 9.06 | 9.14 | +1%˄ | 0.0000 |
+| 21c || 113.48 | 112.67 | -1%˄ || 8.81 | 8.88 | +1%˄ | 0.0000 |
+| 22a || 183.22 | 184.95 | +1%˄ || 5.46 | 5.41 | -1%˄ | 0.0000 |
+| 22b || 164.68 | 166.67 | +1%˄ || 6.07 | 6.00 | -1%˄ | 0.0000 |
+| 22c || 248.87 | 251.59 | +1%˄ || 4.02 | 3.97 | -1%˄ | 0.0000 |
+| 22d || 380.35 | 383.43 | +1%˄ || 2.63 | 2.61 | -1%˄ | 0.0000 |
+| 23a || 48.56 | 49.48 | +2%˄ || 20.59 | 20.21 | -2%˄ | 0.0000 |
+| 23b || 55.68 | 56.58 | +2%˄ || 17.96 | 17.67 | -2%˄ | 0.0000 |
+| 23c || 52.17 | 53.19 | +2%˄ || 19.17 | 18.80 | -2%˄ | 0.0000 |
+| 24a || 212.75 | 213.47 | +0%˄ || 4.70 | 4.68 | -0%˄ | 0.0000 |
+| 24b || 201.17 | 201.67 | +0%˄ || 4.97 | 4.96 | -0%˄ | 0.0000 |
+| 25a || 110.10 | 110.09 | -0%˄ || 9.08 | 9.08 | +0%˄ | 0.9547 |
+| 25b || 67.62 | 67.53 | -0%˄ || 14.79 | 14.81 | +0%˄ | 0.2105 |
+| 25c || 254.94 | 254.04 | -0%˄ || 3.92 | 3.94 | +0%˄ | 0.0000 |
+| 26a || 178.13 | 178.22 | +0%˄ || 5.61 | 5.61 | -0%˄ | 0.4976 |
+| 26b || 148.64 | 149.50 | +1%˄ || 6.73 | 6.69 | -1%˄ | 0.0000 |
+| 26c || 324.47 | 326.04 | +0%˄ || 3.08 | 3.07 | -0%˄ | 0.0000 |
+| 27a || 113.07 | 112.06 | -1%˄ || 8.84 | 8.92 | +1%˄ | 0.0000 |
+| 27b || 99.47 | 98.83 | -1%˄ || 10.05 | 10.12 | +1%˄ | 0.0000 |
+| 27c || 113.43 | 112.63 | -1%˄ || 8.82 | 8.88 | +1%˄ | 0.0000 |
+| 28a || 207.51 | 207.22 | -0%˄ || 4.82 | 4.83 | +0%˄ | 0.0034 |
+| 28b || 75.77 | 76.99 | +2%˄ || 13.20 | 12.99 | -2%˄ | 0.0000 |
+| 28c || 184.74 | 186.05 | +1%˄ || 5.41 | 5.37 | -1%˄ | 0.0000 |
+| 29a || 174.33 | 174.29 | -0%˄ || 5.74 | 5.74 | +0%˄ | 0.7020 |
+| 29b || 765.96 | 787.73 | +3% || 1.31 | 1.27 | -3% | 0.0000 |
+| 29c || 218.20 | 217.13 | -0%˄ || 4.58 | 4.61 | +0%˄ | 0.0000 |
+| 2a || 31.48 | 31.53 | +0%˄ || 31.76 | 31.71 | -0%˄ | 0.1671 |
+| 2b || 28.88 | 28.96 | +0%˄ || 34.62 | 34.53 | -0%˄ | 0.0062 |
+| 2c || 24.19 | 24.24 | +0%˄ || 41.34 | 41.25 | -0%˄ | 0.0964 |
+| 2d || 61.06 | 61.15 | +0%˄ || 16.37 | 16.35 | -0%˄ | 0.0217 |
+| 30a || 94.65 | 94.72 | +0%˄ || 10.57 | 10.56 | -0%˄ | 0.5490 |
+| 30b || 99.09 | 98.01 | -1%˄ || 10.09 | 10.20 | +1%˄ | 0.0003 |
+| 30c || 168.57 | 168.06 | -0%˄ || 5.93 | 5.95 | +0%˄ | 0.0000 |
+| 31a || 82.46 | 82.30 | -0%˄ || 12.13 | 12.15 | +0%˄ | 0.0723 |
+| 31b || 81.01 | 80.84 | -0%˄ || 12.34 | 12.37 | +0%˄ | 0.0322 |
+| 31c || 92.66 | 92.30 | -0%˄ || 10.79 | 10.83 | +0%˄ | 0.0001 |
+| 32a || 16.06 | 15.93 | -1%˄ || 62.24 | 62.78 | +1%˄ | 0.0000 |
+| 32b || 38.49 | 38.72 | +1%˄ || 25.98 | 25.82 | -1%˄ | 0.0000 |
+| 33a || 39.20 | 39.09 | -0%˄ || 25.51 | 25.58 | +0%˄ | 0.0254 |
+| 33b || 23.06 | 24.11 | +5%˄ || 43.36 | 41.47 | -4%˄ | 0.0000 |
+| 33c || 50.20 | 49.97 | -0%˄ || 19.92 | 20.01 | +0%˄ | 0.0000 |
+| 3a || 73.81 | 75.26 | +2%˄ || 13.55 | 13.29 | -2%˄ | 0.0000 |
+| 3b || 18.93 | 20.07 | +6%˄ || 52.81 | 49.81 | -6%˄ | 0.0000 |
+| 3c || 232.57 | 234.59 | +1%˄ || 4.30 | 4.26 | -1%˄ | 0.0000 |
+| 4a || 160.16 | 161.40 | +1%˄ || 6.24 | 6.20 | -1%˄ | 0.0000 |
+| 4b || 17.82 | 18.91 | +6%˄ || 56.09 | 52.87 | -6%˄ | 0.0000 |
+| 4c || 201.05 | 203.97 | +1%˄ || 4.97 | 4.90 | -1%˄ | 0.0000 |
+| 5a || 53.17 | 55.37 | +4%˄ || 18.81 | 18.06 | -4%˄ | 0.0000 |
+| 5b || 56.69 | 58.13 | +3%˄ || 17.64 | 17.20 | -2%˄ | 0.0000 |
+| 5c || 98.67 | 99.43 | +1%˄ || 10.13 | 10.06 | -1%˄ | 0.0000 |
+| 6a || 161.99 | 164.36 | +1%˄ || 6.17 | 6.08 | -1%˄ | 0.0000 |
+| 6b || 174.04 | 175.41 | +1%˄ || 5.75 | 5.70 | -1%˄ | 0.0000 |
+| 6c || 151.99 | 153.41 | +1%˄ || 6.58 | 6.52 | -1%˄ | 0.0000 |
+| 6d || 379.22 | 381.39 | +1%˄ || 2.64 | 2.62 | -1%˄ | 0.0000 |
+| 6e || 158.31 | 159.22 | +1%˄ || 6.32 | 6.28 | -1%˄ | 0.0000 |
+| 6f || 738.73 | 736.81 | -0% || 1.35 | 1.36 | +0% | 0.0000 |
+| 7a || 90.50 | 89.50 | -1%˄ || 11.05 | 11.17 | +1%˄ | 0.0000 |
+| 7b || 82.73 | 82.67 | -0%˄ || 12.09 | 12.10 | +0%˄ | 0.7117 |
+| 7c || 594.06 | 590.97 | -1%˄ || 1.68 | 1.69 | +1%˄ | 0.0008 |
+| 8a || 183.39 | 183.99 | +0%˄ || 5.45 | 5.44 | -0%˄ | 0.0000 |
+| 8b || 180.53 | 180.06 | -0%˄ || 5.54 | 5.55 | +0%˄ | 0.0000 |
+| 8c || 1911.89 | 1895.36 | -1% || 0.52 | 0.53 | +1% | 0.0000 |
+| 8d || 317.60 | 315.56 | -1%˄ || 3.15 | 3.17 | +1%˄ | 0.0000 |
+| 9a || 263.94 | 265.40 | +1%˄ || 3.79 | 3.77 | -1%˄ | 0.0000 |
+| 9b || 172.96 | 172.97 | +0%˄ || 5.78 | 5.78 | -0%˄ | 0.9544 |
+| 9c || 289.29 | 290.86 | +1%˄ || 3.46 | 3.44 | -1%˄ | 0.0000 |
+| 9d || 483.52 | 482.10 | -0%˄ || 2.07 | 2.07 | +0%˄ | 0.0000 |
++---------++----------+----------+--------++----------+----------+--------+---------+
+| Sum || 30791.12 | 30862.60 | +0% || | | | |
+| Geomean || | | || | | -0% | |
++---------++----------+----------+--------++----------+----------+--------+---------+
+| Notes || ˄ Execution stopped due to max runs reached |
++---------++----------+----------+--------++----------+----------+--------+---------+
hyriseBenchmarkJoinOrder - multi-threaded, shuffled, 64 clients, 64 cores
Sum of avg. item runtimes: -0% || Geometric mean of throughput changes: +0%
Configuration Overview - click to expand
+Configuration Overview---------+-----------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkJoinOrder_f5bdcb3c47233e058ef9792c861ed1794fca2d18_mt.json | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkJoinOrder_ebe0fabff633577230a1182668faaf03adaf4b7c_mt.json |
+-------------------------------+-----------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------+
| GIT-HASH | f5bdcb3c47233e058ef9792c861ed1794fca2d18-dirty | ebe0fabff633577230a1182668faaf03adaf4b7c-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 64 | 64 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2024-02-23 03:26:25 | 2024-02-23 07:17:10 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+-----------------------------------------------------------------------------------------------------------------+-----------------------------------------------------------------------------------------------------------------+
++---------++----------+----------+--------++----------+----------+--------+---------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++---------++----------+----------+--------++----------+----------+--------+---------+
+| 10a || 207.82 | 235.35 | +13% || 1.12 | 1.12 | +0% | 0.2126 |
+| 10b || 163.80 | 163.17 | -0% || 1.12 | 1.12 | +0% | 0.9759 |
+| 10c || 613.03 | 594.24 | -3% || 1.12 | 1.12 | +0% | 0.5965 |
+| 11a || 121.17 | 132.42 | +9% || 1.12 | 1.12 | +0% | 0.5211 |
+| 11b || 126.41 | 115.93 | -8% || 1.12 | 1.12 | +0% | 0.5249 |
+| 11c || 111.25 | 111.72 | +0% || 1.12 | 1.12 | +0% | 0.9754 |
+| 11d || 123.34 | 104.30 | -15% || 1.12 | 1.12 | +0% | 0.1948 |
+| 12a || 164.98 | 191.31 | +16% || 1.12 | 1.12 | +0% | 0.2088 |
+| 12b || 105.35 | 91.26 | -13% || 1.12 | 1.12 | -0% | 0.4066 |
+| 12c || 389.54 | 372.35 | -4% || 1.12 | 1.12 | +0% | 0.5158 |
+| 13a || 544.00 | 517.42 | -5% || 1.12 | 1.12 | -0% | 0.4316 |
+| 13b || 350.99 | 376.19 | +7% || 1.12 | 1.12 | +0% | 0.3490 |
+| 13c || 339.07 | 375.54 | +11% || 1.12 | 1.12 | -0% | 0.1843 |
+| 13d || 983.66 | 962.30 | -2% || 1.12 | 1.12 | -0% | 0.5410 |
+| 14a || 440.78 | 486.79 | +10% || 1.12 | 1.12 | +0% | 0.1848 |
+| 14b || 465.42 | 441.75 | -5% || 1.12 | 1.12 | +0% | 0.4422 |
+| 14c || 605.14 | 638.33 | +5% || 1.12 | 1.12 | +0% | 0.3444 |
+| 15a || 131.24 | 142.24 | +8% || 1.12 | 1.12 | -0% | 0.5265 |
+| 15b || 122.97 | 153.86 | +25% || 1.12 | 1.12 | +0% | 0.1176 |
+| 15c || 157.34 | 140.43 | -11% || 1.12 | 1.12 | -0% | 0.3833 |
+| 15d || 164.01 | 174.38 | +6% || 1.12 | 1.12 | +0% | 0.5591 |
+| 16a || 1685.87 | 1647.97 | -2% || 1.12 | 1.12 | -0% | 0.4116 |
+| 16b || 3259.17 | 3207.36 | -2% || 1.12 | 1.12 | +0% | 0.3247 |
+| 16c || 1959.50 | 1955.98 | -0% || 1.12 | 1.12 | +0% | 0.9440 |
+| 16d || 1897.23 | 1934.56 | +2% || 1.12 | 1.12 | -0% | 0.4669 |
+| 17a || 955.57 | 943.09 | -1% || 1.12 | 1.12 | -0% | 0.7844 |
+| 17b || 735.26 | 701.77 | -5% || 1.12 | 1.12 | +0% | 0.4167 |
+| 17c || 627.94 | 657.52 | +5% || 1.12 | 1.12 | +0% | 0.3833 |
+| 17d || 658.78 | 650.60 | -1% || 1.12 | 1.12 | +0% | 0.8325 |
+| 17e || 1851.75 | 1787.60 | -3% || 1.12 | 1.12 | +0% | 0.2040 |
+| 17f || 1252.03 | 1230.30 | -2% || 1.12 | 1.12 | -0% | 0.6526 |
+| 18a || 308.52 | 291.24 | -6% || 1.12 | 1.12 | +0% | 0.4917 |
+| 18b || 428.81 | 447.82 | +4% || 1.12 | 1.12 | +0% | 0.5710 |
+| 18c || 736.20 | 725.59 | -1% || 1.12 | 1.12 | +0% | 0.8133 |
+| 19a || 625.33 | 733.72 | +17% || 1.12 | 1.12 | +0% | 0.0192 |
+| 19b || 473.31 | 430.66 | -9% || 1.12 | 1.12 | -0% | 0.2214 |
+| 19c || 781.23 | 715.07 | -8% || 1.12 | 1.12 | +0% | 0.1286 |
+| 19d || 1554.65 | 1526.81 | -2% || 1.12 | 1.12 | -0% | 0.5868 |
+| 1a || 43.70 | 43.32 | -1% || 1.12 | 1.12 | +0% | 0.9613 |
+| 1b || 55.47 | 55.38 | -0% || 1.12 | 1.12 | +0% | 0.9929 |
+| 1c || 66.05 | 55.78 | -16% || 1.12 | 1.12 | +0% | 0.3617 |
+| 1d || 36.18 | 33.18 | -8% || 1.12 | 1.12 | +0% | 0.6699 |
+| 20a || 530.44 | 510.24 | -4% || 1.12 | 1.12 | +0% | 0.5696 |
+| 20b || 446.54 | 419.31 | -6% || 1.12 | 1.12 | +0% | 0.4051 |
+| 20c || 443.81 | 386.79 | -13% || 1.12 | 1.12 | +0% | 0.0564 |
+| 21a || 199.84 | 231.85 | +16% || 1.12 | 1.12 | +0% | 0.2101 |
+| 21b || 158.92 | 161.01 | +1% || 1.12 | 1.12 | +0% | 0.9103 |
+| 21c || 205.70 | 184.73 | -10% || 1.12 | 1.12 | +0% | 0.3161 |
+| 22a || 517.33 | 565.41 | +9% || 1.12 | 1.12 | -0% | 0.1642 |
+| 22b || 496.90 | 502.61 | +1% || 1.12 | 1.12 | +0% | 0.8869 |
+| 22c || 789.08 | 784.91 | -1% || 1.12 | 1.12 | +0% | 0.9317 |
+| 22d || 1010.01 | 1032.21 | +2% || 1.12 | 1.12 | +0% | 0.6271 |
+| 23a || 185.52 | 214.13 | +15% || 1.12 | 1.12 | +0% | 0.2979 |
+| 23b || 140.98 | 143.69 | +2% || 1.12 | 1.12 | +0% | 0.8625 |
+| 23c || 186.30 | 186.66 | +0% || 1.12 | 1.12 | +0% | 0.9873 |
+| 24a || 441.81 | 471.09 | +7% || 1.12 | 1.12 | +0% | 0.4114 |
+| 24b || 362.06 | 317.52 | -12% || 1.12 | 1.12 | -0% | 0.1585 |
+| 25a || 464.45 | 461.64 | -1% || 1.12 | 1.12 | +0% | 0.9336 |
+| 25b || 238.81 | 246.47 | +3% || 1.12 | 1.12 | +0% | 0.7587 |
+| 25c || 997.97 | 993.67 | -0% || 1.12 | 1.12 | -0% | 0.9274 |
+| 26a || 431.87 | 430.23 | -0% || 1.12 | 1.12 | +0% | 0.9529 |
+| 26b || 277.08 | 271.29 | -2% || 1.12 | 1.12 | +0% | 0.7952 |
+| 26c || 652.26 | 684.48 | +5% || 1.12 | 1.12 | +0% | 0.3682 |
+| 27a || 217.21 | 219.20 | +1% || 1.12 | 1.12 | -0% | 0.9427 |
+| 27b || 207.84 | 174.03 | -16% || 1.12 | 1.12 | -0% | 0.1648 |
+| 27c || 232.78 | 245.93 | +6% || 1.12 | 1.12 | +0% | 0.6315 |
+| 28a || 713.03 | 743.14 | +4% || 1.12 | 1.12 | +0% | 0.4670 |
+| 28b || 305.67 | 272.36 | -11% || 1.12 | 1.12 | +0% | 0.2440 |
+| 28c || 706.24 | 744.67 | +5% || 1.12 | 1.12 | +0% | 0.3644 |
+| 29a || 301.31 | 302.77 | +0% || 1.12 | 1.12 | +0% | 0.9585 |
+| 29b || 410.55 | 397.24 | -3% || 1.12 | 1.12 | -0% | 0.6488 |
+| 29c || 420.35 | 471.48 | +12% || 1.12 | 1.12 | +0% | 0.1700 |
+| 2a || 145.03 | 154.52 | +7% || 1.12 | 1.12 | -0% | 0.5761 |
+| 2b || 171.54 | 154.28 | -10% || 1.12 | 1.12 | +0% | 0.4311 |
+| 2c || 124.49 | 115.66 | -7% || 1.12 | 1.12 | +0% | 0.5874 |
+| 2d || 250.77 | 263.21 | +5% || 1.12 | 1.12 | +0% | 0.5692 |
+| 30a || 425.29 | 397.33 | -7% || 1.12 | 1.12 | +0% | 0.4233 |
+| 30b || 421.78 | 418.97 | -1% || 1.12 | 1.12 | +0% | 0.9430 |
+| 30c || 758.00 | 809.97 | +7% || 1.12 | 1.12 | +0% | 0.2748 |
+| 31a || 308.25 | 307.52 | -0% || 1.12 | 1.12 | -0% | 0.9791 |
+| 31b || 265.32 | 285.44 | +8% || 1.12 | 1.12 | +0% | 0.4747 |
+| 31c || 374.39 | 422.02 | +13% || 1.12 | 1.12 | +0% | 0.1811 |
+| 32a || 57.61 | 47.03 | -18% || 1.12 | 1.12 | +0% | 0.1984 |
+| 32b || 174.87 | 164.46 | -6% || 1.12 | 1.12 | +0% | 0.4411 |
+| 33a || 144.78 | 153.17 | +6% || 1.12 | 1.12 | -0% | 0.6806 |
+| 33b || 103.76 | 103.66 | -0% || 1.12 | 1.12 | +0% | 0.9960 |
+| 33c || 174.22 | 176.19 | +1% || 1.12 | 1.12 | +0% | 0.9232 |
+| 3a || 318.84 | 298.94 | -6% || 1.12 | 1.12 | -0% | 0.4930 |
+| 3b || 102.76 | 83.51 | -19% || 1.12 | 1.12 | -0% | 0.2570 |
+| 3c || 461.20 | 486.67 | +6% || 1.12 | 1.12 | +0% | 0.4620 |
+| 4a || 318.07 | 310.76 | -2% || 1.12 | 1.12 | +0% | 0.8060 |
+| 4b || 72.08 | 81.53 | +13% || 1.12 | 1.12 | +0% | 0.5346 |
+| 4c || 323.22 | 334.28 | +3% || 1.12 | 1.12 | +0% | 0.6533 |
+| 5a || 259.55 | 252.08 | -3% || 1.12 | 1.12 | +0% | 0.7660 |
+| 5b || 151.57 | 181.25 | +20% || 1.12 | 1.12 | +0% | 0.1085 |
+| 5c || 357.32 | 362.57 | +1% || 1.12 | 1.12 | +0% | 0.8562 |
+| 6a || 164.93 | 172.96 | +5% || 1.12 | 1.12 | -0% | 0.6897 |
+| 6b || 239.50 | 211.56 | -12% || 1.12 | 1.12 | +0% | 0.2176 |
+| 6c || 135.45 | 119.88 | -11% || 1.12 | 1.12 | +0% | 0.2576 |
+| 6d || 617.10 | 587.67 | -5% || 1.12 | 1.12 | +0% | 0.4201 |
+| 6e || 169.88 | 179.96 | +6% || 1.12 | 1.12 | +0% | 0.6566 |
+| 6f || 1278.05 | 1265.43 | -1% || 1.12 | 1.12 | -0% | 0.7630 |
+| 7a || 183.69 | 182.66 | -1% || 1.12 | 1.12 | +0% | 0.9625 |
+| 7b || 177.33 | 196.66 | +11% || 1.12 | 1.12 | +0% | 0.3960 |
+| 7c || 1168.22 | 1173.23 | +0% || 1.12 | 1.12 | +0% | 0.9178 |
+| 8a || 266.48 | 234.33 | -12% || 1.12 | 1.12 | +0% | 0.2389 |
+| 8b || 186.10 | 192.68 | +4% || 1.12 | 1.12 | +0% | 0.7416 |
+| 8c || 2448.70 | 2430.82 | -1% || 1.12 | 1.12 | +0% | 0.7314 |
+| 8d || 708.32 | 717.76 | +1% || 1.12 | 1.12 | -0% | 0.7850 |
+| 9a || 744.77 | 716.88 | -4% || 1.12 | 1.12 | +0% | 0.4987 |
+| 9b || 481.52 | 545.05 | +13% || 1.12 | 1.12 | +0% | 0.0708 |
+| 9c || 787.10 | 750.89 | -5% || 1.12 | 1.12 | +0% | 0.4006 |
+| 9d || 1217.86 | 1229.57 | +1% || 1.12 | 1.12 | +0% | 0.8060 |
++---------++----------+----------+--------++----------+----------+--------+---------+
+| Sum || 56356.22 | 56340.36 | -0% || | | | |
+| Geomean || | | || | | +0% | |
++---------++----------+----------+--------++----------+----------+--------+---------+
hyriseBenchmarkStarSchema - single-threaded
Sum of avg. item runtimes: -2% || Geometric mean of throughput changes: +3%
Configuration Overview - click to expand
+Configuration Overview---+------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkStarSchema_f5bdcb3c47233e058ef9792c861ed1794fca2d18_st.json | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkStarSchema_ebe0fabff633577230a1182668faaf03adaf4b7c_st.json |
+-------------------------+------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | f5bdcb3c47233e058ef9792c861ed1794fca2d18-dirty | ebe0fabff633577230a1182668faaf03adaf4b7c-dirty |
| benchmark_mode | Ordered | Ordered |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 1 | 1 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 0 | 0 |
| data_preparation_cores | 0 | 0 |
| date | 2024-02-23 03:46:51 | 2024-02-23 07:37:35 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 60000000000 | 60000000000 |
| max_runs | 100 | 100 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| using_scheduler | False | False |
| verify | False | False |
| warmup_duration | 1000000000 | 1000000000 |
+-------------------------+------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------+
++---------++----------+---------+--------++----------+----------+--------+---------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++---------++----------+---------+--------++----------+----------+--------+---------+
+| 1.1 || 451.17 | 419.53 | -7%˄ || 2.22 | 2.38 | +8%˄ | 0.0000 |
+| 1.2 || 252.76 | 229.26 | -9%˄ || 3.96 | 4.36 | +10%˄ | 0.0000 |
+| 1.3 || 244.13 | 223.13 | -9%˄ || 4.10 | 4.48 | +9%˄ | 0.0000 |
+| 2.1 || 555.55 | 554.10 | -0%˄ || 1.80 | 1.80 | +0%˄ | 0.0833 |
+| 2.2 || 299.69 | 298.96 | -0%˄ || 3.34 | 3.34 | +0%˄ | 0.0027 |
+| 2.3 || 183.52 | 184.47 | +1%˄ || 5.45 | 5.42 | -1%˄ | 0.0000 |
+| 3.1 || 2837.52 | 2839.43 | +0% || 0.35 | 0.35 | -0% | 0.8984 |
+| 3.2 || 301.29 | 301.00 | -0%˄ || 3.32 | 3.32 | +0%˄ | 0.6396 |
+| 3.3 || 128.92 | 129.15 | +0%˄ || 7.76 | 7.74 | -0%˄ | 0.4068 |
+| 3.4 || 119.59 | 118.98 | -1%˄ || 8.36 | 8.40 | +1%˄ | 0.0610 |
+| 4.1 || 2756.74 | 2638.14 | -4% || 0.36 | 0.38 | +4% | 0.0000 |
+| 4.2 || 880.46 | 880.77 | +0% || 1.14 | 1.14 | -0% | 0.9067 |
+| 4.3 || 250.25 | 245.88 | -2%˄ || 4.00 | 4.07 | +2%˄ | 0.0000 |
++---------++----------+---------+--------++----------+----------+--------+---------+
+| Sum || 9261.58 | 9062.79 | -2% || | | | |
+| Geomean || | | || | | +3% | |
++---------++----------+---------+--------++----------+----------+--------+---------+
+| Notes || ˄ Execution stopped due to max runs reached |
++---------++----------+---------+--------++----------+----------+--------+---------+
hyriseBenchmarkStarSchema - multi-threaded, shuffled, 64 clients, 64 cores
Sum of avg. item runtimes: -1% || Geometric mean of throughput changes: +1%
Configuration Overview - click to expand
+Configuration Overview---------+------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------+
| Parameter | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkStarSchema_f5bdcb3c47233e058ef9792c861ed1794fca2d18_mt.json | /hyrise/rel_amd/benchmark_all_results/hyriseBenchmarkStarSchema_ebe0fabff633577230a1182668faaf03adaf4b7c_mt.json |
+-------------------------------+------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------+
| GIT-HASH | f5bdcb3c47233e058ef9792c861ed1794fca2d18-dirty | ebe0fabff633577230a1182668faaf03adaf4b7c-dirty |
| benchmark_mode | Shuffled | Shuffled |
| build_type | release | release |
| chunk_indexes | False | False |
| chunk_size | 65535 | 65535 |
| clients | 64 | 64 |
| compiler | clang 17.0.2 | clang 17.0.2 |
| cores | 64 | 64 |
| data_preparation_cores | 0 | 0 |
| date | 2024-02-23 03:55:12 | 2024-02-23 07:45:48 |
| encoding | {'default': {'encoding': 'Dictionary'}} | {'default': {'encoding': 'Dictionary'}} |
| max_duration | 1200000000000 | 1200000000000 |
| max_runs | -1 | -1 |
| scale_factor | 10.0 | 10.0 |
| time_unit | ns | ns |
| using_scheduler | True | True |
| utilized_cores_per_numa_node | [64] | [64] |
| verify | False | False |
| warmup_duration | 0 | 0 |
+-------------------------------+------------------------------------------------------------------------------------------------------------------+------------------------------------------------------------------------------------------------------------------+
++---------++----------+----------+--------++----------+----------+--------+---------+
+| Item || Latency (ms/iter) | Change || Throughput (iter/s) | Change | p-value |
+| || old | new | || old | new | | |
++---------++----------+----------+--------++----------+----------+--------+---------+
+| 1.1 || 893.07 | 858.74 | -4% || 3.59 | 3.61 | +0% | 0.2178 |
+| 1.2 || 507.95 | 485.91 | -4% || 3.59 | 3.61 | +0% | 0.2299 |
+| 1.3 || 497.33 | 461.33 | -7% || 3.59 | 3.61 | +1% | 0.0872 |
+| 2.1 || 2231.60 | 2209.58 | -1% || 3.59 | 3.61 | +1% | 0.5966 |
+| 2.2 || 1238.64 | 1233.35 | -0% || 3.59 | 3.61 | +1% | 0.8657 |
+| 2.3 || 417.46 | 417.67 | +0% || 3.59 | 3.61 | +1% | 0.9907 |
+| 3.1 || 3177.04 | 3224.10 | +1% || 3.58 | 3.60 | +1% | 0.2755 |
+| 3.2 || 1131.05 | 1092.06 | -3% || 3.59 | 3.61 | +1% | 0.1753 |
+| 3.3 || 590.64 | 598.24 | +1% || 3.59 | 3.61 | +0% | 0.7517 |
+| 3.4 || 601.60 | 548.81 | -9% || 3.59 | 3.61 | +0% | 0.0197 |
+| 4.1 || 3035.10 | 3027.74 | -0% || 3.58 | 3.60 | +1% | 0.8612 |
+| 4.2 || 2580.49 | 2605.51 | +1% || 3.59 | 3.60 | +0% | 0.5940 |
+| 4.3 || 818.87 | 857.25 | +5% || 3.59 | 3.61 | +1% | 0.1572 |
++---------++----------+----------+--------++----------+----------+--------+---------+
+| Sum || 17720.85 | 17620.30 | -1% || | | | |
+| Geomean || | | || | | +1% | |
++---------++----------+----------+--------++----------+----------+--------+---------+