CCF
CCF copied to clipboard
Published
20 hours ago •
microsoft
microsoft
End-to-end tests misc changes
- Move rarely-modified
launch_host_process_testto daily - Remove
recovery_test_curve_256altogether (was only run in daily) and test recovery with different curve from existing recovery test
move_host_launch_process_daily@51488 aka 20221018.32 vs main ewma over 20 builds from 51108 to 51484
Click to see table
main
| build_id | build_number | tpcc_virtual_cft^ | tpcc_virtual_cft_mem | tpcc_sgx_cft^ | tpcc_sgx_cft_mem | ls_virtual_cft^ | ls_virtual_cft_mem | ls_jwt_virtual_cft^ | ls_jwt_virtual_cft_mem | ls_sgx_cft^ | ls_sgx_cft_mem | ls_js_virtual_cft^ | ls_js_virtual_cft_mem | ls_jwt_sgx_cft^ | ls_jwt_sgx_cft_mem | ls_full_js_virtual_cft^ | ls_full_js_virtual_cft_mem | ls_js_sgx_cft^ | ls_js_sgx_cft_mem | ls_js_jwt_virtual_cft^ | ls_js_jwt_virtual_cft_mem | ls_full_js_sgx_cft^ | ls_full_js_sgx_cft_mem | hist_sgx_cft^ | ls_js_jwt_sgx_cft^ | ls_js_jwt_sgx_cft_mem | RB put (/s)^ | CHAMP put (/s)^ | RB get (/s)^ | CHAMP get (/s)^ |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 51108 | 20221011.2 | 11535.3 | 0 | 6323.44 | 8.32349e+07 | 39052.9 | 0 | 10195.2 | 0 | 19655.7 | 1.6126e+07 | 4591.11 | 0 | 5603.65 | 1.56017e+07 | 3519.27 | 0 | 2423.14 | 9.57242e+06 | 3402.86 | 0 | 2041.8 | 9.31027e+06 | 30358.8 | 1873.74 | 9.57242e+06 | 887882 | 1.37735e+06 | 9.15913e+06 | 3.58669e+07 |
| 51130 | 20221011.11 | 11002.5 | 0 | 6149.71 | 8.29727e+07 | 42292.9 | 0 | 10242.9 | 0 | 19508.1 | 1.6126e+07 | 4382.07 | 0 | 5317.16 | 1.53396e+07 | 3517.21 | 0 | 2429.71 | 9.57242e+06 | 3370.72 | 0 | 2032.13 | 9.57242e+06 | 25816 | 1872.97 | 9.04813e+06 | 907836 | 1.36351e+06 | 9.22934e+06 | 3.58663e+07 |
| 51135 | 20221011.13 | 11287.9 | 0 | 6958.2 | 8.29727e+07 | 42237.6 | 0 | 10684.8 | 0 | 19881 | 1.6126e+07 | 4410.79 | 0 | 5681.47 | 1.58639e+07 | 3463.51 | 0 | 2416.68 | 9.83456e+06 | 3344.84 | 0 | 2067.03 | 9.31027e+06 | 23655.5 | 1876.73 | 9.04813e+06 | 903550 | 1.40881e+06 | 9.25014e+06 | 3.58036e+07 |
| 51144 | 20221012.3 | 10963.2 | 0 | 6237.84 | 8.29727e+07 | 41097.8 | 0 | 10779.3 | 0 | 19582.1 | 1.63882e+07 | 4559.6 | 0 | 5550.91 | 1.53396e+07 | 3446.26 | 0 | 2428.68 | 9.57242e+06 | 3353.22 | 0 | 2027.51 | 9.31027e+06 | 23647.6 | 1885.21 | 9.57242e+06 | 894084 | 1.37782e+06 | 9.45954e+06 | 3.66369e+07 |
| 51154 | 20221012.8 | 10945.8 | 0 | 6310.17 | 8.29727e+07 | 43218.4 | 0 | 10674.1 | 0 | 19588.8 | 1.58639e+07 | 4400.72 | 0 | 5573.93 | 1.53396e+07 | 3490.57 | 0 | 2521.39 | 9.57242e+06 | 3225.78 | 0 | 2024.98 | 9.57242e+06 | 31361.3 | 1871.9 | 9.04813e+06 | 911594 | 1.3698e+06 | 9.16323e+06 | 3.54325e+07 |
| 51166 | 20221013.3 | 11012.9 | 0 | 6307.98 | 8.32349e+07 | 40320.4 | 0 | 10266.9 | 0 | 19594.2 | 1.71746e+07 | 4293.88 | 0 | 5599.85 | 1.53396e+07 | 3468.82 | 0 | 2420.73 | 9.57242e+06 | 3209.83 | 0 | 2029.2 | 1.08831e+07 | 21994 | 1871.34 | 9.31027e+06 | 889265 | 1.36769e+06 | 9.20851e+06 | 3.54325e+07 |
| 51192 | 20221013.15 | 11236.4 | 0 | 6302.95 | 8.24484e+07 | 41714.3 | 0 | 10479.4 | 0 | 19661.9 | 1.69124e+07 | 4385.86 | 0 | 5600.18 | 1.53396e+07 | 3563.95 | 0 | 2431.32 | 9.57242e+06 | 3339.92 | 0 | 2033.47 | 9.57242e+06 | 23541.9 | 1878.69 | 9.04813e+06 | 902875 | 1.38135e+06 | 9.27532e+06 | 3.58042e+07 |
| 51218 | 20221014.2 | 10047.5 | 0 | 6405.26 | 8.55942e+07 | 39098.4 | 0 | 10049.4 | 0 | 19215.6 | 1.74367e+07 | 4310.54 | 0 | 5690.56 | 1.53396e+07 | 3457.64 | 0 | 2424.67 | 9.83456e+06 | 3097.68 | 0 | 2036.1 | 9.31027e+06 | 22728.6 | 1879.17 | 9.04813e+06 | 892491 | 1.37838e+06 | 9.07399e+06 | 3.55556e+07 |
| 51225 | 20221014.5 | 10867.1 | 0 | 6372.16 | 8.32349e+07 | 39581.7 | 0 | 10231 | 0 | 20080.7 | 1.66503e+07 | 4666.19 | 0 | 5542.74 | 1.56017e+07 | 3424.22 | 0 | 2420.92 | 9.83456e+06 | 3231.91 | 0 | 2035.03 | 9.31027e+06 | 29800.6 | 1867.36 | 9.31027e+06 | 917146 | 1.37633e+06 | 9.13466e+06 | 3.53707e+07 |
| 51268 | 20221014.24 | 10451.7 | 0 | 6175.05 | 8.29727e+07 | 39975 | 0 | 10156.6 | 0 | 19398.9 | 1.69124e+07 | 4589.1 | 0 | 5576.74 | 1.53396e+07 | 3598.76 | 0 | 2422.77 | 9.57242e+06 | 3219.98 | 0 | 2057.44 | 9.57242e+06 | 26259.1 | 1870.29 | 9.04813e+06 | 900135 | 1.40408e+06 | 9.39445e+06 | 3.65714e+07 |
| 51312 | 20221014.44 | 10700 | 0 | 6144.6 | 8.32349e+07 | 40972.9 | 0 | 10237.2 | 0 | 19380 | 1.69124e+07 | 4689.8 | 0 | 5583.26 | 1.53396e+07 | 3562.02 | 0 | 2409.54 | 9.57242e+06 | 3414.58 | 0 | 2026.31 | 9.31027e+06 | 25408.5 | 1865.88 | 9.04813e+06 | 891980 | 1.37652e+06 | 9.26688e+06 | 3.44781e+07 |
| 51323 | 20221017.3 | 11697.2 | 0 | 6253.13 | 8.3497e+07 | 43984.1 | 0 | 10061.3 | 0 | 19369.6 | 1.6126e+07 | 4390.77 | 0 | 5600.96 | 1.56017e+07 | 3444.48 | 0 | 2434.56 | 9.57242e+06 | 3280.7 | 0 | 2039.86 | 9.31027e+06 | 23812.4 | 1907.97 | 9.04813e+06 | 891786 | 1.36989e+06 | 9.20028e+06 | 3.58042e+07 |
| 51356 | 20221017.18 | 10476.1 | 0 | 6294.69 | 8.29727e+07 | 42021.6 | 0 | 10516.1 | 0 | 19384.8 | 1.6126e+07 | 4260.13 | 0 | 5564.24 | 1.56017e+07 | 3424.86 | 0 | 2427.01 | 9.83456e+06 | 3349.05 | 0 | 2032.63 | 9.57242e+06 | 28408.8 | 1879.5 | 9.31027e+06 | 902005 | 1.36871e+06 | 9.25445e+06 | 3.58042e+07 |
| 51369 | 20221017.23 | 10815.5 | 0 | 6182.92 | 8.3497e+07 | 43886 | 0 | 10496.8 | 0 | 20141.6 | 1.63882e+07 | 4265.57 | 0 | 5526.98 | 1.50774e+07 | 3591.34 | 0 | 2428.79 | 9.57242e+06 | 3287.98 | 0 | 2033.49 | 1.35046e+07 | 31812.7 | 1869.38 | 9.04813e+06 | 892565 | 1.36669e+06 | 9.15508e+06 | 3.48887e+07 |
| 51401 | 20221017.36 | 11574 | 0 | 6401.49 | 8.32349e+07 | 42017.4 | 0 | 10681.1 | 0 | 19869.8 | 1.6126e+07 | 4325.12 | 0 | 5662.52 | 1.53396e+07 | 3465.53 | 0 | 2430.97 | 9.57242e+06 | 3295.72 | 0 | 2063.81 | 9.31027e+06 | 24574.1 | 1835.87 | 9.31027e+06 | 903431 | 1.36769e+06 | 9.25436e+06 | 3.55556e+07 |
| 51413 | 20221018.3 | 11013.5 | 0 | 6278.03 | 8.21863e+07 | 43526 | 0 | 10297.9 | 0 | 19757.1 | 1.6126e+07 | 4667.91 | 0 | 5570.73 | 1.56017e+07 | 3685.52 | 0 | 2430.11 | 1.00967e+07 | 3264.67 | 0 | 2027.11 | 9.31027e+06 | 31329.2 | 1869.16 | 9.04813e+06 | 902039 | 1.34692e+06 | 9.26693e+06 | 3.57411e+07 |
| 51429 | 20221018.9 | 11110.8 | 0 | 6224.69 | 8.29727e+07 | 40278 | 0 | 10337.7 | 0 | 19543 | 1.63882e+07 | 4266.39 | 0 | 5628.46 | 1.58639e+07 | 3578.13 | 0 | 2438.33 | 9.57242e+06 | 3221.39 | 0 | 2036.01 | 9.31027e+06 | 26283.5 | 1849.43 | 9.31027e+06 | 907997 | 1.36879e+06 | 9.21269e+06 | 3.49488e+07 |
| 51448 | 20221018.17 | 10970.3 | 0 | 6358.96 | 8.29727e+07 | 40387.1 | 0 | 10141 | 0 | 20736.7 | 1.6126e+07 | 4816.31 | 0 | 6546.68 | 1.58639e+07 | 3583.18 | 0 | 2491.75 | 9.83456e+06 | 3365.91 | 0 | 2114.99 | 9.57242e+06 | 27143.6 | 2043.52 | 9.04813e+06 | 896039 | 1.36332e+06 | 9.17555e+06 | 3.58042e+07 |
| 51462 | 20221018.22 | 11528.7 | 0 | 6364.65 | 8.21863e+07 | 40554.5 | 0 | 10737.9 | 0 | 20872.7 | 1.63882e+07 | 4313.46 | 0 | 6477.21 | 1.53396e+07 | 3591.18 | 0 | 2504.11 | 9.57242e+06 | 3248.26 | 0 | 2088.99 | 9.31027e+06 | 27237.4 | 2108.59 | 9.04813e+06 | 905588 | 1.38284e+06 | 9.26269e+06 | 3.58669e+07 |
| 51484 | 20221018.31 | 11594.7 | 0 | 6322.76 | 8.29727e+07 | 40594.8 | 0 | 10515.9 | 0 | 20910.3 | 1.6126e+07 | 4413.7 | 0 | 6470.15 | 1.58639e+07 | 3471.44 | 0 | 2541.74 | 1.00967e+07 | 3375.31 | 0 | 2082.94 | 9.57242e+06 | 28596.7 | 1993.75 | 9.31027e+06 | 886076 | 1.34268e+06 | 9.00216e+06 | 3.5128e+07 |
move_host_launch_process_daily
| build_id | build_number | tpcc_sgx_cft^ | tpcc_sgx_cft_mem | ls_sgx_cft^ | ls_sgx_cft_mem | ls_jwt_sgx_cft^ | ls_jwt_sgx_cft_mem | ls_js_sgx_cft^ | ls_js_sgx_cft_mem | tpcc_virtual_cft^ | tpcc_virtual_cft_mem | ls_full_js_sgx_cft^ | ls_full_js_sgx_cft_mem | ls_virtual_cft^ | ls_virtual_cft_mem | ls_jwt_virtual_cft^ | ls_jwt_virtual_cft_mem | ls_js_jwt_sgx_cft^ | ls_js_jwt_sgx_cft_mem | ls_js_virtual_cft^ | ls_js_virtual_cft_mem | ls_full_js_virtual_cft^ | ls_full_js_virtual_cft_mem | ls_js_jwt_virtual_cft^ | ls_js_jwt_virtual_cft_mem | hist_sgx_cft^ | RB put (/s)^ | CHAMP put (/s)^ | RB get (/s)^ | CHAMP get (/s)^ |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 51424 | 20221018.7 | 6301.76 | 8.29727e+07 | 19708.4 | 1.6126e+07 | 5551.47 | 1.58639e+07 | 2412.69 | 9.57242e+06 | 11083.2 | 0 | 2105.41 | 9.31027e+06 | 40151.1 | 0 | 10070.6 | 0 | 1830.25 | 9.31027e+06 | 4359.15 | 0 | 3407.22 | 0 | 3358.99 | 0 | 23023.7 | 901481 | 1.36943e+06 | 9.21684e+06 | 3.58036e+07 |
| 51433 | 20221018.10 | 6094.94 | 8.3497e+07 | 19559.4 | 1.6126e+07 | 5683.16 | 1.53396e+07 | 2425.4 | 9.83456e+06 | 10798.8 | 0 | 2028.11 | 9.31027e+06 | 40873.2 | 0 | 10094.7 | 0 | 1883.42 | 9.04813e+06 | 4408.07 | 0 | 3444.52 | 0 | 3262.64 | 0 | 25612.2 | 902197 | 1.39016e+06 | 9.49462e+06 | 3.66369e+07 |
| 51452 | 20221018.18 | 6193.38 | 8.27106e+07 | 20696 | 1.63882e+07 | 6387.07 | 1.56017e+07 | 2488 | 1.00967e+07 | 11069.7 | 0 | 2080.04 | 9.31027e+06 | 42305.6 | 0 | 10057.6 | 0 | 2001.79 | 9.04813e+06 | 4591.58 | 0 | 3429.48 | 0 | 3350.94 | 0 | 30115.8 | 887496 | 1.36542e+06 | 9.24601e+06 | 3.59298e+07 |
| 51458 | 20221018.20 | 6450.86 | 8.37592e+07 | 20967.4 | 1.63882e+07 | 6532.66 | 1.56017e+07 | 2615.32 | 9.83456e+06 | 10752.6 | 0 | 2093.31 | 9.31027e+06 | 40154.6 | 0 | 9974.2 | 0 | 2097.02 | 9.04813e+06 | 4330.22 | 0 | 3528.42 | 0 | 3372.39 | 0 | 29100.6 | 895883 | 1.38593e+06 | 9.39014e+06 | 3.65708e+07 |
| 51488 | 20221018.32 | 6386.02 | 8.3497e+07 | 20888.6 | 1.6126e+07 | 6453.89 | 1.53396e+07 | 2498.77 | 9.83456e+06 | 11451.8 | 0 | 2071.52 | 9.57242e+06 | 41765.6 | 0 | 10674 | 0 | 2001.67 | 9.04813e+06 | 4478.71 | 0 | 3589.39 | 0 | 3345.06 | 0 | 24165.3 | 865517 | 1.36751e+06 | 9.20445e+06 | 3.56788e+07 |
