database-stream-processor icon indicating copy to clipboard operation
database-stream-processor copied to clipboard

Selenium test for WebUI

Open gz opened this issue 1 year ago • 1 comments

gz avatar May 05 '23 07:05 gz

Benchmark results

Nexmark

  • 1 out of 21 queries have regressed :exclamation:
  • Compared results from dbe4663 (main) with a356006 (PR) No benchmark results found for current main revision, compared against dbe46638028c8dc4fbf95aab22bc94ff4fed9c24
name main~70 [kOp/s] PR [kOp/s] Tput change [%] Assessment Peak RSS diff
q0 5262.63 5212.89 -1 :heavy_check_mark: 119.3 MB
q1 5429.6 5165.72 -5 :heavy_check_mark: 79.8 MB
q2 5361.6 5334.28 -1 :heavy_check_mark: 50.0 MB
q3 5321.94 5352.24 1 :heavy_check_mark: 48.2 MB
q4 4802.55 4766.7 -1 :heavy_check_mark: -180.1 MB
q5 5378.33 5277.86 -2 :heavy_check_mark: -180.1 MB
q6 4880.13 4366.42 -11 :small_red_triangle_down: -111.4 MB
q7 2559.31 3638.93 42 :evergreen_tree: -4.8 GB
q8 5161.2 5049.11 -2 :heavy_check_mark: -4.8 GB
q9 875.448 870.349 -1 :heavy_check_mark: -270.3 MB
q12 4910.28 5005.27 2 :heavy_check_mark: -270.3 MB
q13 3645.17 3584.27 -2 :heavy_check_mark: -270.3 MB
q14 5481.43 5461.3 0 :heavy_check_mark: -270.3 MB
q15 4895.11 5422.39 11 :evergreen_tree: -270.3 MB
q16 1045.16 1039.69 -1 :heavy_check_mark: -270.3 MB
q17 3134.56 3282.9 5 :heavy_check_mark: -201.1 MB
q18 1440.13 1469.76 2 :heavy_check_mark: 942.1 kB
q19 1435.15 1377.41 -4 :heavy_check_mark: 942.1 kB
q20 1500.83 1575.19 5 :heavy_check_mark: 942.1 kB
q21 5117.36 4927.48 -4 :heavy_check_mark: 942.1 kB
q22 5356.59 5444.81 2 :heavy_check_mark: 942.1 kB

Galen

  • Compared results from dbe4663 (main) with a356006 (PR) No benchmark results found for current main revision, compared against dbe46638028c8dc4fbf95aab22bc94ff4fed9c24
name main~70 [s] PR [s] Runtime change [%] Assessment
galen 28.6952 28.9488 1 :heavy_check_mark:

LDBC

  • 1 out of 4 queries have regressed :exclamation:
  • Compared results from dbe4663 (main) with a356006 (PR) No benchmark results found for current main revision, compared against dbe46638028c8dc4fbf95aab22bc94ff4fed9c24
algorithm dataset threads main~70 [kEVPS] PR [kEVPS] Tput change [%] Assessment Peak RSS diff
bfs graph500-22 1 1835.7 1764.56 -4 :heavy_check_mark: 69.6 kB
bfs datagen-8_4-fb 6 8173.61 7502.95 -8 :small_red_triangle_down: 31.7 MB
pagerank graph500-22 1 681.655 690.726 1 :heavy_check_mark: 32.8 kB
pagerank datagen-8_4-fb 6 1994.79 2041.9 2 :heavy_check_mark: -320.5 MB

Nexmark (with Persistence)

  • Compared results from dbe4663 (main) with a356006 (PR) No benchmark results found for current main revision, compared against dbe46638028c8dc4fbf95aab22bc94ff4fed9c24
name main~70 [kOp/s] PR [kOp/s] Tput change [%] PR DRAM [kOp/s] DRAM diff [%] Assessment
q0 2399.23 2384.59 -1 2401.69 -1 :heavy_check_mark:
q1 1713.93 1641.45 -4 1722.54 -5 :heavy_check_mark:
q2 2407.67 2327.45 -3 2164.82 8 :heavy_check_mark:
q3 2036.93 2008.32 -1 2262.34 -11 :heavy_check_mark:
q4 360.256 359.343 0 1436.3 -75 :heavy_check_mark:
q5 2015.3 1990.09 -1 2313.16 -14 :heavy_check_mark:
q6 332.421 337.382 1 1375.07 -75 :heavy_check_mark:
q7 639.584 663.936 4 1332.5 -50 :heavy_check_mark:
q8 2171.19 2192.41 1 2277.02 -4 :heavy_check_mark:
q9 79.0764 79.3372 0 390.792 -80 :heavy_check_mark:
q12 838.481 851.714 2 1833 -54 :heavy_check_mark:
q13 443.491 441.395 0 1004.26 -56 :heavy_check_mark:
q14 1697.52 1653.07 -3 1717.06 -4 :heavy_check_mark:
q15 198.112 197.726 0 1231.74 -84 :heavy_check_mark:
q16 25.5771 25.8495 1 284.255 -91 :heavy_check_mark:
q17 81.4521 80.614 -1 812.167 -90 :heavy_check_mark:
q18 124.763 124.37 0 807.769 -85 :heavy_check_mark:
q19 182.489 179.965 -1 655.318 -73 :heavy_check_mark:
q20 505.761 497.938 -2 966.35 -48 :heavy_check_mark:
q21 1489.8 1486.49 0 1504.32 -1 :heavy_check_mark:
q22 2102.89 2051.11 -2 2109.1 -3 :heavy_check_mark:

github-actions[bot] avatar May 05 '23 09:05 github-actions[bot]