CCF icon indicating copy to clipboard operation
CCF copied to clipboard

Redirection support, as alternative to request forwarding

Open eddyashton opened this issue 1 year ago • 1 comments

CCF now supports a mode where HTTP redirect responses are returned, rather than relying on internal forwarding. This can be used to ensure that write requests are executed on a primary, even if they are initially sent to a backup.

This behaviour is enabled by setting the redirections field in an rpc_interface within cchost's launch config. This can be configured to redirect either directly to a node (if each node has a distinct, accessible name), or to a static load balancer address, depending on the current deployment.

See docs (after this PR has merged) for description of redirection behaviour and configuration.

eddyashton avatar Mar 06 '24 11:03 eddyashton

add_redirection_strategies@83083 aka 20240325.11 vs main ewma over 20 builds from 82660 to 83028

Click to see table

main

build_id build_number pi_basic_mt_sgx_cft^ pi_basic_mt_sgx_cft_mem Commit latency factor tpcc_sgx_cft^ tpcc_sgx_cft_mem ls_sgx_cft^ ls_sgx_cft_mem pi_ls_sgx_cft^ pi_ls_sgx_cft_mem pi_basic_sgx_cft^ pi_basic_sgx_cft_mem pi_basic_js_sgx_cft^ pi_basic_js_sgx_cft_mem ls_jwt_sgx_cft^ ls_jwt_sgx_cft_mem tpcc_virtual_cft^ pi_ls_jwt_sgx_cft^ pi_ls_jwt_sgx_cft_mem ls_virtual_cft^ ls_js_sgx_cft^ ls_js_sgx_cft_mem pi_ls_virtual_cft^ pi_basic_virtual_cft^ ls_full_js_sgx_cft^ ls_full_js_sgx_cft_mem pi_basic_js_virtual_cft^ ls_jwt_virtual_cft^ ls_js_jwt_sgx_cft^ ls_js_jwt_sgx_cft_mem pi_ls_jwt_virtual_cft^ ls_js_virtual_cft^ ls_full_js_virtual_cft^ ls_js_jwt_virtual_cft^ hist_sgx_cft^ KV ser (/s)^ KV deser (/s)^ KV snap ser (/s)^ KV snap deser (/s)^ RB put (/s)^ CHAMP put (/s)^ RB get (/s)^ CHAMP get (/s)^ tlc_sim_traces tlc_sim_levelmean pi_basic_mt_virtual_cft^
82660 20240315.4 28028.6 2.30851e+07 0.79239 5655.25 8.59996e+07 14026.5 1.88908e+07 14117.6 1.05021e+07 15641.5 1.46964e+07 1368.7 1.25993e+07 6842.27 1.88908e+07 17278.6 6972.1 6.30784e+06 52740.4 5792.18 1.67936e+07 57193.2 62733.4 5483.28 1.67936e+07 4440.8 20988.5 3976.83 1.67936e+07 22202.5 20747.1 17454.8 11817.2 40414.1 1.04406e+06 1.17137e+06 8002.43 1400.4 800286 1.18393e+06 8.15319e+06 3.06816e+07 37881 370 79337.2
82675 20240315.8 27849.2 2.51822e+07 0.811411 5550.01 8.59996e+07 13859.8 1.88908e+07 13972.8 1.05021e+07 15436.6 1.46964e+07 1360.9 1.25993e+07 6846.44 1.88908e+07 17268.1 6892.1 6.30784e+06 52917.8 5757.2 1.67936e+07 55115.2 62057.3 5485.18 1.67936e+07 4467.7 20635 3976.84 1.67936e+07 21248.1 17434.3 17246.7 11703.8 45103.5 1.0661e+06 1.1325e+06 7645.03 1395.14 835351 1.1756e+06 8.1401e+06 3.06656e+07 29503 374 70052.1
82693 20240315.14 28016.3 2.51822e+07 0.813428 5633.92 8.59996e+07 13977 1.67936e+07 14070.7 1.05021e+07 15618.1 1.25993e+07 1369.8 1.25993e+07 6860.71 1.88908e+07 17072.9 7091.6 6.30784e+06 52921.3 5760.15 1.67936e+07 55314 60346.1 5477.92 1.67936e+07 4428.3 20651.6 3986.61 1.67936e+07 17502.7 17433.9 17251.2 11631.4 38435.7 1.00654e+06 1.14155e+06 8062.66 1405.03 842520 1.17709e+06 8.14249e+06 3.25265e+07 31401 376 91921.9
82711 20240315.19 27473.4 2.30851e+07 0.827234 5579.84 8.59996e+07 13936.8 1.67936e+07 14079 1.05021e+07 15445.4 1.46964e+07 1371.5 1.25993e+07 6864.43 1.88908e+07 17226.4 6921.8 6.30784e+06 52920 5786.72 1.67936e+07 55630.7 62135.6 5446.19 1.67936e+07 4460.1 20750.9 3995.28 1.67936e+07 21671.3 17455.4 17410.8 11590.7 46053.1 1.05419e+06 1.13097e+06 7959.78 1401.86 836557 1.17881e+06 8.14735e+06 3.33301e+07 30866 378 78701.2
82733 20240318.3 27923.1 2.51822e+07 0.793088 5595.36 8.59996e+07 14007.8 1.67936e+07 14120 1.05021e+07 15590.5 1.46964e+07 1375.3 1.25993e+07 6879.03 1.88908e+07 17295.9 7012.8 6.30784e+06 53432.6 5760.84 1.67936e+07 55698.8 61939.2 5448.96 1.67936e+07 4461.6 20831 3971.05 1.67936e+07 21767.5 17645.3 17454.5 11747.2 45965.6 988142 1.1655e+06 8411.83 1399.93 811496 1.18487e+06 8.15105e+06 3.07655e+07 31024 381 69387.2
82737 20240318.4 27855.7 2.30851e+07 0.838162 5614.11 8.59996e+07 13974.8 1.88908e+07 14025.9 1.05021e+07 15532.1 1.25993e+07 1369.4 1.25993e+07 7229.16 1.67936e+07 17108.6 6882.1 6.30784e+06 52882.5 5792.09 1.67936e+07 55297.8 61185.4 5445.12 1.67936e+07 4408.1 20714.4 3988.23 1.67936e+07 21251.3 17306 17150.3 11526.5 43448.6 1.01102e+06 1.13417e+06 8227.57 1400.71 826391 1.18204e+06 8.12995e+06 3.08267e+07 32286 383 66151.2
82757 20240318.11 27866.3 2.30851e+07 0.814693 5551.33 8.59996e+07 13972.9 1.88908e+07 14074.9 1.05021e+07 15512.2 1.25993e+07 1363.3 1.25993e+07 6813.84 1.88908e+07 17211.7 6923.5 6.30784e+06 52996.5 5738.68 1.67936e+07 55448.4 62108.6 5453.12 1.67936e+07 4458.6 20915.4 3988.85 1.67936e+07 21481.4 17391 17448.8 11560.6 42784.2 1.06598e+06 1.16428e+06 8761.61 1407.29 833024 1.17982e+06 8.1325e+06 3.18334e+07 30021 357 90465.6
82779 20240318.19 28083.2 2.30851e+07 0.808391 5527.75 8.59996e+07 13915.1 1.67936e+07 14015.2 1.05021e+07 15265.9 1.25993e+07 1348.1 1.25993e+07 6819.5 1.88908e+07 17109.9 6934.4 6.30784e+06 52992.4 5771.53 1.67936e+07 55188.2 61697.5 5438.4 1.67936e+07 4431.9 21246 3990.96 1.67936e+07 21519.7 17562.4 17243.6 11586.9 45272.7 1.02912e+06 1.17744e+06 7807.78 1397.64 837965 1.1708e+06 8.13602e+06 3.07517e+07 32536 373 83576.3
82788 20240318.22 27842 2.30851e+07 0.791602 5480.12 8.59996e+07 13872.5 1.88908e+07 13833.8 1.05021e+07 15367.6 1.46964e+07 1346.4 1.25993e+07 6866.93 1.88908e+07 17216.4 7042 6.30784e+06 52899.6 5767.17 1.67936e+07 54983.7 61392.7 5464.6 1.67936e+07 4446 20809.4 3976.85 1.67936e+07 21099.7 17490.9 17107.9 11706.2 42868.4 1.04167e+06 1.1558e+06 7956.66 1403.54 835007 1.17916e+06 8.14826e+06 3.08369e+07 32882 380 68458.7
82798 20240318.25 27980.6 2.30851e+07 0.816977 5577.76 8.59996e+07 13942.6 1.88908e+07 14002.4 1.05021e+07 15379.8 1.46964e+07 1370 1.25993e+07 6801.93 1.88908e+07 17215.3 6928.8 6.30784e+06 53023.5 5799.78 1.67936e+07 55469 62158.1 5480.57 1.67936e+07 4443.2 20725 3982.34 1.67936e+07 22098 17491.2 17205.9 11605.5 42771 1.05009e+06 1.14116e+06 7963.99 1404.73 827431 1.18304e+06 8.15472e+06 3.07581e+07 32280 384 97670.4
82808 20240318.28 27678.5 2.51822e+07 0.805582 5626.63 8.59996e+07 13970.8 1.88908e+07 14039 1.05021e+07 15521.4 1.46964e+07 1373.9 1.25993e+07 6868.02 1.88908e+07 17152.8 6931.4 6.30784e+06 53231.6 5803.98 1.67936e+07 55482.5 61663.6 5442.74 1.67936e+07 4405.7 20568.4 3990.95 1.67936e+07 21548.5 17531.8 17515.4 11563.2 45393.1 1.04646e+06 1.16809e+06 7919.02 1398.65 832135 1.17718e+06 8.09813e+06 3.14226e+07 31220 382 70163.6
82814 20240319.1 28079.1 2.30851e+07 0.835128 5601.4 8.59996e+07 13946.2 1.88908e+07 14017.3 1.05021e+07 15577.4 1.46964e+07 1359.8 1.25993e+07 6850.25 1.88908e+07 17277.2 7140.2 6.30784e+06 52833.5 5754.81 1.67936e+07 57165.7 62292 5447.98 1.67936e+07 4430.8 21262.1 3989.09 1.67936e+07 21811.2 17511.8 17293.3 11732.8 48561.4 1.03413e+06 1.14025e+06 7801.37 1405.27 830705 1.17741e+06 8.14402e+06 3.1109e+07 32462 369 70706.4
82835 20240319.8 28062.1 2.51822e+07 0.837813 5510.28 8.59996e+07 13804.3 1.88908e+07 13908.2 1.05021e+07 15320.3 1.46964e+07 1348.4 1.25993e+07 6848.14 1.88908e+07 17227.7 6889.5 6.30784e+06 53576 5778.13 1.67936e+07 56250.9 62196 5474.58 1.67936e+07 4431.4 20786.7 3957.99 1.67936e+07 21712.2 17538.6 17544 11613.7 44852.3 1.03907e+06 1.16741e+06 8028.68 1384.91 801178 1.18205e+06 8.1315e+06 3.11322e+07 31218 366 69590.2
82842 20240320.1 28088.6 2.30851e+07 0.795937 5578.48 8.59996e+07 13967.6 1.88908e+07 13984.1 1.05021e+07 15560.5 1.25993e+07 1370.3 1.05021e+07 6805.41 1.88908e+07 17161.1 7042.4 6.30784e+06 50737.4 5775.41 1.67936e+07 55481.9 61410.4 5467.65 1.67936e+07 4408.2 20721.6 3879.66 1.67936e+07 20939.8 17393.6 16990.9 11706.9 47065.1 1.05186e+06 1.16104e+06 8151.56 1404.1 839027 1.17528e+06 8.15056e+06 3.06587e+07 30174 382 82750.6
82864 20240320.9 27810.6 2.30851e+07 0.821651 5512.38 8.59996e+07 13879.7 1.88908e+07 14042 1.05021e+07 15479.2 1.46964e+07 1359.2 1.25993e+07 6849.78 1.67936e+07 17219.5 7018.8 6.30784e+06 53302.2 5765.35 1.67936e+07 55326.6 62207 5480.38 1.67936e+07 4407.7 17196.8 3990.49 1.67936e+07 21736.3 17512.2 17459.7 11693.7 41778.3 1.04701e+06 1.13109e+06 7937.05 1404.32 833112 1.18197e+06 8.15387e+06 3.07457e+07 31738 377 84734.7
82906 20240321.2 27754.2 2.30851e+07 0.801621 5533.71 8.59996e+07 13799.2 1.88908e+07 13962 1.05021e+07 15288.3 1.46964e+07 1355.5 1.25993e+07 6799.37 1.67936e+07 17172.3 6906.2 6.30784e+06 52970.8 5790.33 1.67936e+07 40672.6 60757.5 5465.42 1.67936e+07 4392.6 20462.7 3983.52 1.67936e+07 20745.2 17430.2 17175.9 11543 42157.6 1.05977e+06 1.17412e+06 7531.67 1400.02 836529 1.18229e+06 8.15368e+06 3.25902e+07 29270 386 87877.2
82925 20240321.7 27420.1 2.30851e+07 0.807056 5646.99 8.59996e+07 13895 1.88908e+07 14012.6 1.05021e+07 15451.8 1.46964e+07 1376.3 1.25993e+07 6896.06 1.88908e+07 17368.7 7094.7 6.30784e+06 53475.8 5751.92 1.67936e+07 56637 62746 5715.65 1.67936e+07 4439.9 21040.8 3995.22 1.67936e+07 21736.3 17694.8 17398 11628.1 45300.9 1.05086e+06 1.14718e+06 8069.03 1407.16 831410 1.17717e+06 8.13044e+06 3.0809e+07 32455 379 79485.1
82996 20240322.3 27423.4 2.30851e+07 0.803997 5569.26 8.59996e+07 13890.2 1.88908e+07 14049.6 1.05021e+07 15467.8 1.46964e+07 1372.1 1.25993e+07 6884.86 1.88908e+07 17355.5 7030.1 6.30784e+06 53050.4 5801.3 1.67936e+07 56308.8 62950.9 5456.3 1.67936e+07 4446 20891.9 3990.73 1.67936e+07 21857.9 17952 17419.6 11656.7 43140.2 1.04493e+06 1.11832e+06 8234.47 1400.61 835988 1.17669e+06 8.1458e+06 3.07868e+07 31479 377 79428.1
83004 20240322.5 27756.3 2.30851e+07 0.808055 5565.83 8.59996e+07 13932.7 1.88908e+07 13952 1.05021e+07 15426.3 1.46964e+07 1361.3 1.25993e+07 6830.62 1.88908e+07 17299.9 6879.1 6.30784e+06 52868.8 5801.54 1.67936e+07 55992.6 62180.5 5464.86 1.67936e+07 4432.5 20709.2 3984.08 1.67936e+07 21069 17629.6 17616.8 11600.9 42890.9 1.0618e+06 1.05664e+06 8153.94 1399.29 835816 1.1854e+06 8.16642e+06 3.10656e+07 30745 366 89907
83028 20240322.11 27692 2.30851e+07 0.786739 5528.39 8.59996e+07 13900.8 1.88908e+07 13977.4 1.05021e+07 15498.5 1.46964e+07 1363.7 1.25993e+07 6797.9 1.88908e+07 17295.9 6885.5 6.30784e+06 53368.8 5756.57 1.67936e+07 56110.7 62452.1 5440.95 1.67936e+07 4426.2 21072 3952.9 1.67936e+07 21721.7 17573.9 17149 11633.8 45247.5 1.01989e+06 1.16131e+06 7870.69 1403.37 826657 1.18227e+06 8.17001e+06 3.10609e+07 29497 374 67943.8

add_redirection_strategies

build_id build_number pi_basic_mt_sgx_cft^ pi_basic_mt_sgx_cft_mem Commit latency factor tpcc_sgx_cft^ tpcc_sgx_cft_mem ls_sgx_cft^ ls_sgx_cft_mem pi_basic_mt_virtual_cft^ pi_ls_sgx_cft^ pi_ls_sgx_cft_mem pi_basic_sgx_cft^ pi_basic_sgx_cft_mem pi_basic_js_sgx_cft^ pi_basic_js_sgx_cft_mem ls_jwt_sgx_cft^ ls_jwt_sgx_cft_mem pi_ls_jwt_sgx_cft^ pi_ls_jwt_sgx_cft_mem ls_js_sgx_cft^ ls_js_sgx_cft_mem ls_full_js_sgx_cft^ ls_full_js_sgx_cft_mem tpcc_virtual_cft^ ls_js_jwt_sgx_cft^ ls_js_jwt_sgx_cft_mem ls_virtual_cft^ pi_ls_virtual_cft^ pi_basic_virtual_cft^ pi_basic_js_virtual_cft^ ls_jwt_virtual_cft^ pi_ls_jwt_virtual_cft^ ls_js_virtual_cft^ hist_sgx_cft^ ls_full_js_virtual_cft^ KV ser (/s)^ KV deser (/s)^ KV snap ser (/s)^ KV snap deser (/s)^ RB put (/s)^ CHAMP put (/s)^ RB get (/s)^ CHAMP get (/s)^ ls_js_jwt_virtual_cft^ tlc_sim_traces tlc_sim_levelmean
82786 20240318.21 27666 2.51822e+07 0.805741 5618.58 8.59996e+07 13850.6 1.88908e+07 65544.1 13986.1 1.05021e+07 15422.1 1.46964e+07 1375 1.25993e+07 6829.23 1.88908e+07 6939.6 6.30784e+06 5800.19 1.67936e+07 5462.88 1.67936e+07 17388.6 3967 1.67936e+07 52810.3 55662.6 59663.8 4413 20633.7 21535.5 17712.4 44950.6 17211.8 1.03252e+06 1.15996e+06 8295.22 1404.05 838129 1.17659e+06 8.13515e+06 3.07364e+07 11598.4 31200 379
82869 20240320.10 27921.6 2.30851e+07 0.79831 5600.02 8.59996e+07 13923.2 1.88908e+07 82867.7 13938.7 1.05021e+07 15438.8 1.46964e+07 1370.8 1.25993e+07 7202.09 1.67936e+07 6875.8 6.30784e+06 5806.14 1.67936e+07 5467.1 1.67936e+07 17474.1 3988.79 1.67936e+07 52776.4 57105 61634.2 4462.6 21338.4 21721.7 17622.2 47563.3 17497.8 1.04789e+06 1.15754e+06 8035.34 1401.05 832430 1.17683e+06 8.10983e+06 3.06642e+07 11755.7 30738 377
83033 20240322.12 28097.6 2.30851e+07 0.77363 5528.03 8.59996e+07 13866.9 1.88908e+07 98703.7 13919.7 1.05021e+07 15472.4 1.46964e+07 1359.1 1.25993e+07 6851.1 1.88908e+07 6989.8 6.30784e+06 5797.7 1.67936e+07 5440.36 1.67936e+07 16920.7 3991.06 1.67936e+07 53020 56568.8 61462 4428 21105.8 21843.6 17597.8 43381.6 17180.6 1.07147e+06 1.11421e+06 7902.45 1399.93 824564 1.17646e+06 8.15485e+06 3.13711e+07 11860.9 32842 381
83083 20240325.11 27689.9 2.51822e+07 0.822621 5574.97 8.59996e+07 13851 1.88908e+07 98379.9 13901 1.05021e+07 15455.8 1.25993e+07 1361 1.25993e+07 6838.6 1.88908e+07 7037.2 6.30784e+06 5802.06 1.67936e+07 5477.62 1.67936e+07 17369 3980.46 1.67936e+07 53055 56500 61899 4440.3 20976.3 21082.4 17622.6 45225.9 17203.1 1.05031e+06 1.1685e+06 7975.9 1401.09 824794 1.18357e+06 8.14256e+06 3.07558e+07 11732 32293 382

images

ccf-bot avatar Mar 06 '24 18:03 ccf-bot