database-stream-processor
database-stream-processor copied to clipboard
Selenium test for WebUI
Benchmark results
Nexmark
- 1 out of 21 queries have regressed :exclamation:
- Compared results from dbe4663 (main) with a356006 (PR) No benchmark results found for current main revision, compared against dbe46638028c8dc4fbf95aab22bc94ff4fed9c24
| name | main~70 [kOp/s] | PR [kOp/s] | Tput change [%] | Assessment | Peak RSS diff |
|---|---|---|---|---|---|
| q0 | 5262.63 | 5212.89 | -1 | :heavy_check_mark: | 119.3 MB |
| q1 | 5429.6 | 5165.72 | -5 | :heavy_check_mark: | 79.8 MB |
| q2 | 5361.6 | 5334.28 | -1 | :heavy_check_mark: | 50.0 MB |
| q3 | 5321.94 | 5352.24 | 1 | :heavy_check_mark: | 48.2 MB |
| q4 | 4802.55 | 4766.7 | -1 | :heavy_check_mark: | -180.1 MB |
| q5 | 5378.33 | 5277.86 | -2 | :heavy_check_mark: | -180.1 MB |
| q6 | 4880.13 | 4366.42 | -11 | :small_red_triangle_down: | -111.4 MB |
| q7 | 2559.31 | 3638.93 | 42 | :evergreen_tree: | -4.8 GB |
| q8 | 5161.2 | 5049.11 | -2 | :heavy_check_mark: | -4.8 GB |
| q9 | 875.448 | 870.349 | -1 | :heavy_check_mark: | -270.3 MB |
| q12 | 4910.28 | 5005.27 | 2 | :heavy_check_mark: | -270.3 MB |
| q13 | 3645.17 | 3584.27 | -2 | :heavy_check_mark: | -270.3 MB |
| q14 | 5481.43 | 5461.3 | 0 | :heavy_check_mark: | -270.3 MB |
| q15 | 4895.11 | 5422.39 | 11 | :evergreen_tree: | -270.3 MB |
| q16 | 1045.16 | 1039.69 | -1 | :heavy_check_mark: | -270.3 MB |
| q17 | 3134.56 | 3282.9 | 5 | :heavy_check_mark: | -201.1 MB |
| q18 | 1440.13 | 1469.76 | 2 | :heavy_check_mark: | 942.1 kB |
| q19 | 1435.15 | 1377.41 | -4 | :heavy_check_mark: | 942.1 kB |
| q20 | 1500.83 | 1575.19 | 5 | :heavy_check_mark: | 942.1 kB |
| q21 | 5117.36 | 4927.48 | -4 | :heavy_check_mark: | 942.1 kB |
| q22 | 5356.59 | 5444.81 | 2 | :heavy_check_mark: | 942.1 kB |
Galen
- Compared results from dbe4663 (main) with a356006 (PR) No benchmark results found for current main revision, compared against dbe46638028c8dc4fbf95aab22bc94ff4fed9c24
| name | main~70 [s] | PR [s] | Runtime change [%] | Assessment |
|---|---|---|---|---|
| galen | 28.6952 | 28.9488 | 1 | :heavy_check_mark: |
LDBC
- 1 out of 4 queries have regressed :exclamation:
- Compared results from dbe4663 (main) with a356006 (PR) No benchmark results found for current main revision, compared against dbe46638028c8dc4fbf95aab22bc94ff4fed9c24
| algorithm | dataset | threads | main~70 [kEVPS] | PR [kEVPS] | Tput change [%] | Assessment | Peak RSS diff |
|---|---|---|---|---|---|---|---|
| bfs | graph500-22 | 1 | 1835.7 | 1764.56 | -4 | :heavy_check_mark: | 69.6 kB |
| bfs | datagen-8_4-fb | 6 | 8173.61 | 7502.95 | -8 | :small_red_triangle_down: | 31.7 MB |
| pagerank | graph500-22 | 1 | 681.655 | 690.726 | 1 | :heavy_check_mark: | 32.8 kB |
| pagerank | datagen-8_4-fb | 6 | 1994.79 | 2041.9 | 2 | :heavy_check_mark: | -320.5 MB |
Nexmark (with Persistence)
- Compared results from dbe4663 (main) with a356006 (PR) No benchmark results found for current main revision, compared against dbe46638028c8dc4fbf95aab22bc94ff4fed9c24
| name | main~70 [kOp/s] | PR [kOp/s] | Tput change [%] | PR DRAM [kOp/s] | DRAM diff [%] | Assessment |
|---|---|---|---|---|---|---|
| q0 | 2399.23 | 2384.59 | -1 | 2401.69 | -1 | :heavy_check_mark: |
| q1 | 1713.93 | 1641.45 | -4 | 1722.54 | -5 | :heavy_check_mark: |
| q2 | 2407.67 | 2327.45 | -3 | 2164.82 | 8 | :heavy_check_mark: |
| q3 | 2036.93 | 2008.32 | -1 | 2262.34 | -11 | :heavy_check_mark: |
| q4 | 360.256 | 359.343 | 0 | 1436.3 | -75 | :heavy_check_mark: |
| q5 | 2015.3 | 1990.09 | -1 | 2313.16 | -14 | :heavy_check_mark: |
| q6 | 332.421 | 337.382 | 1 | 1375.07 | -75 | :heavy_check_mark: |
| q7 | 639.584 | 663.936 | 4 | 1332.5 | -50 | :heavy_check_mark: |
| q8 | 2171.19 | 2192.41 | 1 | 2277.02 | -4 | :heavy_check_mark: |
| q9 | 79.0764 | 79.3372 | 0 | 390.792 | -80 | :heavy_check_mark: |
| q12 | 838.481 | 851.714 | 2 | 1833 | -54 | :heavy_check_mark: |
| q13 | 443.491 | 441.395 | 0 | 1004.26 | -56 | :heavy_check_mark: |
| q14 | 1697.52 | 1653.07 | -3 | 1717.06 | -4 | :heavy_check_mark: |
| q15 | 198.112 | 197.726 | 0 | 1231.74 | -84 | :heavy_check_mark: |
| q16 | 25.5771 | 25.8495 | 1 | 284.255 | -91 | :heavy_check_mark: |
| q17 | 81.4521 | 80.614 | -1 | 812.167 | -90 | :heavy_check_mark: |
| q18 | 124.763 | 124.37 | 0 | 807.769 | -85 | :heavy_check_mark: |
| q19 | 182.489 | 179.965 | -1 | 655.318 | -73 | :heavy_check_mark: |
| q20 | 505.761 | 497.938 | -2 | 966.35 | -48 | :heavy_check_mark: |
| q21 | 1489.8 | 1486.49 | 0 | 1504.32 | -1 | :heavy_check_mark: |
| q22 | 2102.89 | 2051.11 | -2 | 2109.1 | -3 | :heavy_check_mark: |