plutus icon indicating copy to clipboard operation
plutus copied to clipboard

[EXPERIMENT] [Builtins] 10x more builtins

Open effectfully opened this issue 1 year ago • 38 comments

This replicates the existing builtins so that there are 10x of them now. This is just to check whether it results in any evaluation slowdown.

effectfully avatar Sep 19 '24 00:09 effectfully

/benchmark validation

effectfully avatar Sep 19 '24 00:09 effectfully

/benchmark nofib

effectfully avatar Sep 19 '24 00:09 effectfully

/benchmark lists

effectfully avatar Sep 19 '24 00:09 effectfully

Click here to check the status of your benchmark.

github-actions[bot] avatar Sep 19 '24 00:09 github-actions[bot]

Comparing benchmark results of 'validation' on '4b372ecea' (base) and '9fbb994eb' (PR)

Results table
Script 4b372ec 9fbb994 Change
auction_1-1 251.1 μs 307.2 μs +22.3%
auction_1-2 893.9 μs 703.2 μs -21.3%
auction_1-3 886.5 μs 683.4 μs -22.9%
auction_1-4 321.7 μs 302.7 μs -5.9%
auction_2-1 251.4 μs 307.3 μs +22.2%
auction_2-2 893.5 μs 1.014 ms +13.5%
auction_2-3 1.168 ms 1.325 ms +13.4%
auction_2-4 887.1 μs 968.6 μs +9.2%
auction_2-5 322.1 μs 411.7 μs +27.8%
crowdfunding-success-1 293.7 μs 372.6 μs +26.9%
crowdfunding-success-2 292.8 μs 373.7 μs +27.6%
crowdfunding-success-3 294.0 μs 277.2 μs -5.7%
currency-1 344.5 μs 354.6 μs +2.9%
escrow-redeem_1-1 485.4 μs 582.6 μs +20.0%
escrow-redeem_1-2 485.8 μs 416.5 μs -14.3%
escrow-redeem_2-1 568.6 μs 471.7 μs -17.0%
escrow-redeem_2-2 568.3 μs 682.3 μs +20.1%
escrow-redeem_2-3 569.0 μs 677.9 μs +19.1%
escrow-refund-1 217.0 μs 273.4 μs +26.0%
future-increase-margin-1 345.8 μs 407.5 μs +17.8%
future-increase-margin-2 755.6 μs 881.8 μs +16.7%
future-increase-margin-3 755.0 μs 876.8 μs +16.1%
future-increase-margin-4 679.6 μs 785.9 μs +15.6%
future-increase-margin-5 1.141 ms 1.267 ms +11.0%
future-pay-out-1 345.6 μs 406.3 μs +17.6%
future-pay-out-2 754.6 μs 883.1 μs +17.0%
future-pay-out-3 751.7 μs 610.5 μs -18.8%
future-pay-out-4 1.136 ms 884.2 μs -22.2%
future-settle-early-1 345.7 μs 281.7 μs -18.5%
future-settle-early-2 515.7 μs 613.9 μs +19.0%
future-settle-early-3 529.1 μs 619.6 μs +17.1%
future-settle-early-4 599.6 μs 671.9 μs +12.1%
game-sm-success_1-1 486.4 μs 503.2 μs +3.5%
game-sm-success_1-2 278.5 μs 357.5 μs +28.4%
game-sm-success_1-3 897.6 μs 1.032 ms +15.0%
game-sm-success_1-4 315.9 μs 307.0 μs -2.8%
game-sm-success_2-1 410.1 μs 638.7 μs +55.7%
game-sm-success_2-2 194.6 μs 357.2 μs +83.6%
game-sm-success_2-3 638.0 μs 1.024 ms +60.5%
game-sm-success_2-4 275.1 μs 407.6 μs +48.2%
game-sm-success_2-5 631.2 μs 1.024 ms +62.2%
game-sm-success_2-6 291.1 μs 407.2 μs +39.9%
multisig-sm-1 557.6 μs 646.1 μs +15.9%
multisig-sm-2 377.9 μs 630.3 μs +66.8%
multisig-sm-3 509.5 μs 637.5 μs +25.1%
multisig-sm-4 551.7 μs 644.3 μs +16.8%
multisig-sm-5 783.0 μs 894.8 μs +14.3%
multisig-sm-6 555.5 μs 647.2 μs +16.5%
multisig-sm-7 542.4 μs 631.0 μs +16.3%
multisig-sm-8 547.7 μs 636.6 μs +16.2%
multisig-sm-9 553.9 μs 526.8 μs -4.9%
multisig-sm-10 782.6 μs 891.4 μs +13.9%
ping-pong-1 313.6 μs 368.0 μs +17.3%
ping-pong-2 319.8 μs 373.8 μs +16.9%
ping-pong_2-1 194.9 μs 237.9 μs +22.1%
prism-1 164.5 μs 210.8 μs +28.1%
prism-2 402.5 μs 479.3 μs +19.1%
prism-3 357.2 μs 432.6 μs +21.1%
pubkey-1 196.7 μs 181.0 μs -8.0%
stablecoin_1-1 1.002 ms 1.018 ms +1.6%
stablecoin_1-2 236.8 μs 244.9 μs +3.4%
stablecoin_1-3 1.017 ms 1.180 ms +16.0%
stablecoin_1-4 254.5 μs 319.2 μs +25.4%
stablecoin_1-5 1.863 ms 2.164 ms +16.2%
stablecoin_1-6 354.1 μs 457.6 μs +29.2%
stablecoin_2-1 1.266 ms 1.456 ms +15.0%
stablecoin_2-2 271.7 μs 351.3 μs +29.3%
stablecoin_2-3 1.451 ms 1.674 ms +15.4%
stablecoin_2-4 287.0 μs 369.3 μs +28.7%
token-account-1 264.6 μs 250.6 μs -5.3%
token-account-2 470.3 μs 395.4 μs -15.9%
uniswap-1 573.0 μs 464.2 μs -19.0%
uniswap-2 307.3 μs 263.0 μs -14.4%
uniswap-3 2.461 ms 1.966 ms -20.1%
uniswap-4 465.2 μs 417.7 μs -10.2%
uniswap-5 1.619 ms 1.324 ms -18.2%
uniswap-6 447.3 μs 400.4 μs -10.5%
vesting-1 485.7 μs 398.0 μs -18.1%
4b372ec 9fbb994 Change
TOTAL 45.88 ms 49.94 ms +8.9%

github-actions[bot] avatar Sep 19 '24 01:09 github-actions[bot]

Click here to check the status of your benchmark.

github-actions[bot] avatar Sep 19 '24 01:09 github-actions[bot]

That doesn't make any sense:

image

effectfully avatar Sep 19 '24 01:09 effectfully

/benchmark validation

effectfully avatar Sep 19 '24 01:09 effectfully

Comparing benchmark results of 'nofib' on '4b372ecea' (base) and '9fbb994eb' (PR)

Results table
Script 4b372ec 9fbb994 Change
clausify/formula1 4.003 ms -100.0%
clausify/formula2 5.809 ms -100.0%
clausify/formula3 15.92 ms -100.0%
clausify/formula4 36.51 ms -100.0%
clausify/formula5 76.93 ms -100.0%
knights/4x4 24.86 ms -100.0%
knights/6x6 65.24 ms -100.0%
knights/8x8 73.26 ms -100.0%
primetest/05digits 10.36 ms -100.0%
primetest/10digits 20.20 ms -100.0%
primetest/30digits 82.37 ms -100.0%
primetest/50digits 144.6 ms -100.0%
queens4x4/bt 7.506 ms -100.0%
queens4x4/bm 9.578 ms -100.0%
queens4x4/bjbt1 9.159 ms -100.0%
queens4x4/bjbt2 8.084 ms -100.0%
queens4x4/fc 13.67 ms -100.0%
queens5x5/bt 72.64 ms -100.0%
queens5x5/bm 110.6 ms -100.0%
queens5x5/bjbt1 119.8 ms -100.0%
queens5x5/bjbt2 91.60 ms -100.0%
queens5x5/fc 173.3 ms -100.0%
4b372ec 9fbb994 Change
TOTAL 1.176 s 0.000 ps -100.0%

github-actions[bot] avatar Sep 19 '24 01:09 github-actions[bot]

Click here to check the status of your benchmark.

github-actions[bot] avatar Sep 19 '24 01:09 github-actions[bot]

Comparing benchmark results of 'lists' on '4b372ecea' (base) and '9fbb994eb' (PR)

Results table
Script 4b372ec 9fbb994 Change
sort/ghcSort/50 229.0 μs -100.0%
sort/ghcSort/100 538.3 μs -100.0%
sort/ghcSort/150 932.8 μs -100.0%
sort/ghcSort/200 1.252 ms -100.0%
sort/ghcSort/250 1.628 ms -100.0%
sort/ghcSort/300 2.134 ms -100.0%
sort/insertionSort/50 780.2 μs -100.0%
sort/insertionSort/100 3.096 ms -100.0%
sort/insertionSort/150 7.008 ms -100.0%
sort/insertionSort/200 13.64 ms -100.0%
sort/insertionSort/250 19.61 ms -100.0%
sort/insertionSort/300 28.35 ms -100.0%
sort/mergeSort/50 674.5 μs -100.0%
sort/mergeSort/100 1.556 ms -100.0%
sort/mergeSort/150 2.502 ms -100.0%
sort/mergeSort/200 3.513 ms -100.0%
sort/mergeSort/250 4.602 ms -100.0%
sort/mergeSort/300 5.623 ms -100.0%
sort/quickSort/50 1.905 ms -100.0%
sort/quickSort/100 7.687 ms -100.0%
sort/quickSort/150 24.64 ms -100.0%
sort/quickSort/200 43.42 ms -100.0%
sort/quickSort/250 68.23 ms -100.0%
sort/quickSort/300 98.67 ms -100.0%
sum/compiled-from-Haskell/sum-right-builtin/100 129.3 μs -100.0%
sum/compiled-from-Haskell/sum-right-builtin/500 680.3 μs -100.0%
sum/compiled-from-Haskell/sum-right-builtin/1000 1.479 ms -100.0%
sum/compiled-from-Haskell/sum-right-builtin/2500 4.533 ms -100.0%
sum/compiled-from-Haskell/sum-right-builtin/5000 9.706 ms -100.0%
sum/compiled-from-Haskell/sum-right-Scott/100 87.70 μs -100.0%
sum/compiled-from-Haskell/sum-right-Scott/500 459.2 μs -100.0%
sum/compiled-from-Haskell/sum-right-Scott/1000 921.6 μs -100.0%
sum/compiled-from-Haskell/sum-right-Scott/2500 2.341 ms -100.0%
sum/compiled-from-Haskell/sum-right-Scott/5000 5.351 ms -100.0%
sum/compiled-from-Haskell/sum-right-data/100 243.7 μs -100.0%
sum/compiled-from-Haskell/sum-right-data/500 1.334 ms -100.0%
sum/compiled-from-Haskell/sum-right-data/1000 3.029 ms -100.0%
sum/compiled-from-Haskell/sum-right-data/2500 11.63 ms -100.0%
sum/compiled-from-Haskell/sum-right-data/5000 24.19 ms -100.0%
sum/compiled-from-Haskell/sum-left-builtin/100 126.2 μs -100.0%
sum/compiled-from-Haskell/sum-left-builtin/500 658.5 μs -100.0%
sum/compiled-from-Haskell/sum-left-builtin/1000 985.3 μs -100.0%
sum/compiled-from-Haskell/sum-left-builtin/2500 3.084 ms -100.0%
sum/compiled-from-Haskell/sum-left-builtin/5000 6.773 ms -100.0%
sum/compiled-from-Haskell/sum-left-Scott/100 59.30 μs -100.0%
sum/compiled-from-Haskell/sum-left-Scott/500 311.5 μs -100.0%
sum/compiled-from-Haskell/sum-left-Scott/1000 673.9 μs -100.0%
sum/compiled-from-Haskell/sum-left-Scott/2500 2.188 ms -100.0%
sum/compiled-from-Haskell/sum-left-Scott/5000 4.998 ms -100.0%
sum/compiled-from-Haskell/sum-left-data/100 245.0 μs -100.0%
sum/compiled-from-Haskell/sum-left-data/500 1.341 ms -100.0%
sum/compiled-from-Haskell/sum-left-data/1000 3.021 ms -100.0%
sum/compiled-from-Haskell/sum-left-data/2500 8.256 ms -100.0%
sum/compiled-from-Haskell/sum-left-data/5000 17.09 ms -100.0%
sum/hand-written-PLC/sum-right-builtin/100 89.29 μs -100.0%
sum/hand-written-PLC/sum-right-builtin/500 451.9 μs -100.0%
sum/hand-written-PLC/sum-right-builtin/1000 935.0 μs -100.0%
sum/hand-written-PLC/sum-right-builtin/2500 2.621 ms -100.0%
sum/hand-written-PLC/sum-right-builtin/5000 5.509 ms -100.0%
sum/hand-written-PLC/sum-right-Scott/100 49.67 μs -100.0%
sum/hand-written-PLC/sum-right-Scott/500 253.6 μs -100.0%
sum/hand-written-PLC/sum-right-Scott/1000 530.1 μs -100.0%
sum/hand-written-PLC/sum-right-Scott/2500 1.619 ms -100.0%
sum/hand-written-PLC/sum-right-Scott/5000 3.802 ms -100.0%
sum/hand-written-PLC/sum-left-builtin/100 94.13 μs -100.0%
sum/hand-written-PLC/sum-left-builtin/500 464.0 μs -100.0%
sum/hand-written-PLC/sum-left-builtin/1000 921.2 μs -100.0%
sum/hand-written-PLC/sum-left-builtin/2500 2.290 ms -100.0%
sum/hand-written-PLC/sum-left-builtin/5000 6.756 ms -100.0%
sum/hand-written-PLC/sum-left-Scott/100 80.85 μs -100.0%
sum/hand-written-PLC/sum-left-Scott/500 402.7 μs -100.0%
sum/hand-written-PLC/sum-left-Scott/1000 818.9 μs -100.0%
sum/hand-written-PLC/sum-left-Scott/2500 2.268 ms -100.0%
sum/hand-written-PLC/sum-left-Scott/5000 4.786 ms -100.0%
4b372ec 9fbb994 Change
TOTAL 492.9 ms 0.000 ps -100.0%

github-actions[bot] avatar Sep 19 '24 02:09 github-actions[bot]

/benchmark validation

effectfully avatar Sep 19 '24 03:09 effectfully

/benchmark validation

effectfully avatar Sep 19 '24 03:09 effectfully

/benchmark validation

effectfully avatar Sep 19 '24 03:09 effectfully

Click here to check the status of your benchmark.

github-actions[bot] avatar Sep 19 '24 04:09 github-actions[bot]

Comparing benchmark results of 'validation' on '4b372ecea' (base) and '9fbb994eb' (PR)

Results table
Script 4b372ec 9fbb994 Change
auction_1-1 251.3 μs 314.1 μs +25.0%
auction_1-2 895.0 μs 1.006 ms +12.4%
auction_1-3 885.9 μs 999.2 μs +12.8%
auction_1-4 320.4 μs 320.1 μs -0.1%
auction_2-1 251.2 μs 313.9 μs +25.0%
auction_2-2 894.3 μs 1.003 ms +12.2%
auction_2-3 1.169 ms 1.155 ms -1.2%
auction_2-4 886.2 μs 705.6 μs -20.4%
auction_2-5 320.3 μs 282.7 μs -11.7%
crowdfunding-success-1 293.5 μs 263.9 μs -10.1%
crowdfunding-success-2 293.5 μs 261.0 μs -11.1%
crowdfunding-success-3 210.4 μs 338.0 μs +60.6%
currency-1 241.9 μs 282.0 μs +16.6%
escrow-redeem_1-1 341.9 μs 404.8 μs +18.4%
escrow-redeem_1-2 341.4 μs 404.5 μs +18.5%
escrow-redeem_2-1 401.4 μs 470.3 μs +17.2%
escrow-redeem_2-2 402.0 μs 471.7 μs +17.3%
escrow-redeem_2-3 402.1 μs 471.0 μs +17.1%
escrow-refund-1 153.2 μs 188.0 μs +22.7%
future-increase-margin-1 243.4 μs 282.3 μs +16.0%
future-increase-margin-2 531.6 μs 614.1 μs +15.5%
future-increase-margin-3 531.3 μs 833.2 μs +56.8%
future-increase-margin-4 483.8 μs 777.2 μs +60.6%
future-increase-margin-5 802.8 μs 869.5 μs +8.3%
future-pay-out-1 243.4 μs 405.0 μs +66.4%
future-pay-out-2 532.1 μs 865.9 μs +62.7%
future-pay-out-3 533.1 μs 866.0 μs +62.4%
future-pay-out-4 804.5 μs 1.256 ms +56.1%
future-settle-early-1 243.5 μs 401.8 μs +65.0%
future-settle-early-2 532.0 μs 870.1 μs +63.6%
future-settle-early-3 532.6 μs 865.6 μs +62.5%
future-settle-early-4 733.1 μs 949.8 μs +29.6%
game-sm-success_1-1 543.4 μs 634.4 μs +16.7%
game-sm-success_1-2 278.0 μs 350.0 μs +25.9%
game-sm-success_1-3 896.4 μs 1.016 ms +13.3%
game-sm-success_1-4 315.4 μs 399.0 μs +26.5%
game-sm-success_2-1 491.4 μs 633.1 μs +28.8%
game-sm-success_2-2 276.9 μs 350.5 μs +26.6%
game-sm-success_2-3 628.8 μs 766.6 μs +21.9%
game-sm-success_2-4 222.5 μs 278.9 μs +25.3%
game-sm-success_2-5 632.2 μs 1.037 ms +64.0%
game-sm-success_2-6 223.1 μs 399.7 μs +79.2%
multisig-sm-1 393.4 μs 640.0 μs +62.7%
multisig-sm-2 381.7 μs 625.1 μs +63.8%
multisig-sm-3 387.2 μs 631.1 μs +63.0%
multisig-sm-4 425.8 μs 647.9 μs +52.2%
multisig-sm-5 781.5 μs 884.5 μs +13.2%
multisig-sm-6 553.5 μs 639.4 μs +15.5%
multisig-sm-7 543.2 μs 625.1 μs +15.1%
multisig-sm-8 546.9 μs 639.9 μs +17.0%
multisig-sm-9 553.9 μs 638.8 μs +15.3%
multisig-sm-10 782.8 μs 891.1 μs +13.8%
ping-pong-1 455.1 μs 529.8 μs +16.4%
ping-pong-2 454.8 μs 473.9 μs +4.2%
ping-pong_2-1 277.5 μs 335.5 μs +20.9%
prism-1 233.2 μs 296.5 μs +27.1%
prism-2 572.1 μs 675.2 μs +18.0%
prism-3 511.6 μs 415.4 μs -18.8%
pubkey-1 197.8 μs 194.0 μs -1.9%
stablecoin_1-1 1.263 ms 1.363 ms +7.9%
stablecoin_1-2 271.7 μs 344.2 μs +26.7%
stablecoin_1-3 1.450 ms 1.658 ms +14.3%
stablecoin_1-4 286.9 μs 363.9 μs +26.8%
stablecoin_1-5 1.867 ms 2.112 ms +13.1%
stablecoin_1-6 353.7 μs 449.7 μs +27.1%
stablecoin_2-1 1.264 ms 1.435 ms +13.5%
stablecoin_2-2 272.2 μs 344.7 μs +26.6%
stablecoin_2-3 1.448 ms 1.665 ms +15.0%
stablecoin_2-4 286.1 μs 364.8 μs +27.5%
token-account-1 264.7 μs 314.5 μs +18.8%
token-account-2 469.1 μs 383.6 μs -18.2%
uniswap-1 572.7 μs 452.2 μs -21.0%
uniswap-2 308.1 μs 257.9 μs -16.3%
uniswap-3 2.455 ms 1.920 ms -21.8%
uniswap-4 464.8 μs 584.6 μs +25.8%
uniswap-5 1.615 ms 1.682 ms +4.1%
uniswap-6 447.7 μs 389.8 μs -12.9%
vesting-1 483.9 μs 391.2 μs -19.2%
4b372ec 9fbb994 Change
TOTAL 44.11 ms 51.64 ms +17.1%

github-actions[bot] avatar Sep 19 '24 05:09 github-actions[bot]

Click here to check the status of your benchmark.

github-actions[bot] avatar Sep 19 '24 06:09 github-actions[bot]

Comparing benchmark results of 'validation' on '4b372ecea' (base) and '9fbb994eb' (PR)

Results table
Script 4b372ec 9fbb994 Change
auction_1-1 250.7 μs 217.5 μs -13.2%
auction_1-2 893.4 μs 1.003 ms +12.3%
auction_1-3 886.8 μs 997.5 μs +12.5%
auction_1-4 321.0 μs 404.9 μs +26.1%
auction_2-1 251.3 μs 313.9 μs +24.9%
auction_2-2 895.0 μs 1.000 ms +11.7%
auction_2-3 1.170 ms 1.304 ms +11.5%
auction_2-4 886.8 μs 999.8 μs +12.7%
auction_2-5 320.7 μs 404.9 μs +26.3%
crowdfunding-success-1 293.1 μs 263.2 μs -10.2%
crowdfunding-success-2 293.6 μs 368.4 μs +25.5%
crowdfunding-success-3 293.1 μs 258.0 μs -12.0%
currency-1 344.3 μs 281.4 μs -18.3%
escrow-redeem_1-1 486.4 μs 406.6 μs -16.4%
escrow-redeem_1-2 485.3 μs 584.4 μs +20.4%
escrow-redeem_2-1 567.3 μs 669.4 μs +18.0%
escrow-redeem_2-2 568.7 μs 667.1 μs +17.3%
escrow-redeem_2-3 568.0 μs 668.7 μs +17.7%
escrow-refund-1 215.8 μs 268.1 μs +24.2%
future-increase-margin-1 345.6 μs 279.8 μs -19.0%
future-increase-margin-2 754.4 μs 884.4 μs +17.2%
future-increase-margin-3 754.7 μs 868.6 μs +15.1%
future-increase-margin-4 474.4 μs 777.4 μs +63.9%
future-increase-margin-5 802.6 μs 1.076 ms +34.1%
future-pay-out-1 340.6 μs 298.1 μs -12.5%
future-pay-out-2 751.9 μs 612.4 μs -18.6%
future-pay-out-3 753.5 μs 610.4 μs -19.0%
future-pay-out-4 1.134 ms 882.6 μs -22.2%
future-settle-early-1 346.1 μs 281.8 μs -18.6%
future-settle-early-2 754.1 μs 613.5 μs -18.6%
future-settle-early-3 754.0 μs 610.6 μs -19.0%
future-settle-early-4 848.0 μs 669.3 μs -21.1%
game-sm-success_1-1 523.4 μs 503.9 μs -3.7%
game-sm-success_1-2 277.8 μs 351.0 μs +26.3%
game-sm-success_1-3 894.9 μs 1.015 ms +13.4%
game-sm-success_1-4 316.4 μs 400.0 μs +26.4%
game-sm-success_2-1 456.9 μs 633.6 μs +38.7%
game-sm-success_2-2 194.4 μs 351.4 μs +80.8%
game-sm-success_2-3 627.8 μs 1.017 ms +62.0%
game-sm-success_2-4 221.7 μs 401.4 μs +81.1%
game-sm-success_2-5 628.3 μs 1.013 ms +61.2%
game-sm-success_2-6 222.7 μs 388.3 μs +74.4%
multisig-sm-1 392.0 μs 459.0 μs +17.1%
multisig-sm-2 381.6 μs 600.5 μs +57.4%
multisig-sm-3 387.1 μs 630.8 μs +63.0%
multisig-sm-4 387.9 μs 636.2 μs +64.0%
multisig-sm-5 555.5 μs 893.2 μs +60.8%
multisig-sm-6 555.2 μs 638.4 μs +15.0%
multisig-sm-7 543.3 μs 625.3 μs +15.1%
multisig-sm-8 548.2 μs 628.2 μs +14.6%
multisig-sm-9 554.4 μs 635.8 μs +14.7%
multisig-sm-10 542.6 μs 884.7 μs +63.0%
ping-pong-1 321.2 μs 531.2 μs +65.4%
ping-pong-2 320.9 μs 530.3 μs +65.3%
ping-pong_2-1 278.0 μs 335.4 μs +20.6%
prism-1 234.1 μs 296.0 μs +26.4%
prism-2 572.2 μs 673.8 μs +17.8%
prism-3 512.6 μs 606.8 μs +18.4%
pubkey-1 198.5 μs 252.3 μs +27.1%
stablecoin_1-1 1.267 ms 1.423 ms +12.3%
stablecoin_1-2 271.4 μs 343.8 μs +26.7%
stablecoin_1-3 1.450 ms 1.660 ms +14.5%
stablecoin_1-4 286.8 μs 363.1 μs +26.6%
stablecoin_1-5 1.864 ms 1.787 ms -4.1%
stablecoin_1-6 354.3 μs 313.5 μs -11.5%
stablecoin_2-1 1.265 ms 1.444 ms +14.2%
stablecoin_2-2 271.6 μs 342.6 μs +26.1%
stablecoin_2-3 1.452 ms 1.191 ms -18.0%
stablecoin_2-4 286.4 μs 254.5 μs -11.1%
token-account-1 264.6 μs 219.6 μs -17.0%
token-account-2 471.4 μs 556.2 μs +18.0%
uniswap-1 572.5 μs 647.9 μs +13.2%
uniswap-2 307.5 μs 369.3 μs +20.1%
uniswap-3 2.452 ms 2.740 ms +11.7%
uniswap-4 465.2 μs 560.7 μs +20.5%
uniswap-5 1.613 ms 1.842 ms +14.2%
uniswap-6 447.2 μs 558.8 μs +25.0%
vesting-1 483.6 μs 559.2 μs +15.6%
4b372ec 9fbb994 Change
TOTAL 46.30 ms 52.65 ms +13.7%

github-actions[bot] avatar Sep 19 '24 07:09 github-actions[bot]

Click here to check the status of your benchmark.

github-actions[bot] avatar Sep 19 '24 07:09 github-actions[bot]

Comparing benchmark results of 'validation' on '4b372ecea' (base) and '9fbb994eb' (PR)

Results table
Script 4b372ec 9fbb994 Change
auction_1-1 176.7 μs 314.4 μs +77.9%
auction_1-2 630.5 μs 1.008 ms +59.9%
auction_1-3 626.7 μs 1.001 ms +59.7%
auction_1-4 226.4 μs 281.0 μs +24.1%
auction_2-1 177.1 μs 220.6 μs +24.6%
auction_2-2 628.5 μs 921.3 μs +46.6%
auction_2-3 1.172 ms 1.134 ms -3.2%
auction_2-4 884.4 μs 706.0 μs -20.2%
auction_2-5 320.6 μs 285.2 μs -11.0%
crowdfunding-success-1 204.9 μs 258.5 μs +26.2%
crowdfunding-success-2 207.0 μs 295.8 μs +42.9%
crowdfunding-success-3 207.0 μs 366.4 μs +77.0%
currency-1 243.5 μs 401.6 μs +64.9%
escrow-redeem_1-1 343.6 μs 576.3 μs +67.7%
escrow-redeem_1-2 342.2 μs 572.7 μs +67.4%
escrow-redeem_2-1 575.5 μs 668.7 μs +16.2%
escrow-redeem_2-2 398.6 μs 483.1 μs +21.2%
escrow-redeem_2-3 492.5 μs 471.0 μs -4.4%
escrow-refund-1 216.5 μs 189.2 μs -12.6%
future-increase-margin-1 243.3 μs 283.6 μs +16.6%
future-increase-margin-2 532.5 μs 614.3 μs +15.4%
future-increase-margin-3 529.9 μs 610.1 μs +15.1%
future-increase-margin-4 481.6 μs 547.2 μs +13.6%
future-increase-margin-5 802.5 μs 1.284 ms +60.0%
future-pay-out-1 243.2 μs 401.8 μs +65.2%
future-pay-out-2 530.5 μs 870.5 μs +64.1%
future-pay-out-3 530.9 μs 866.7 μs +63.3%
future-pay-out-4 802.4 μs 1.253 ms +56.2%
future-settle-early-1 244.0 μs 402.4 μs +64.9%
future-settle-early-2 530.3 μs 869.9 μs +64.0%
future-settle-early-3 531.1 μs 869.6 μs +63.7%
future-settle-early-4 601.9 μs 952.8 μs +58.3%
game-sm-success_1-1 384.1 μs 631.4 μs +64.4%
game-sm-success_1-2 224.7 μs 352.4 μs +56.8%
game-sm-success_1-3 894.8 μs 1.021 ms +14.1%
game-sm-success_1-4 316.0 μs 281.8 μs -10.8%
game-sm-success_2-1 543.8 μs 446.8 μs -17.8%
game-sm-success_2-2 277.0 μs 305.6 μs +10.3%
game-sm-success_2-3 893.9 μs 1.014 ms +13.4%
game-sm-success_2-4 221.0 μs 401.8 μs +81.8%
game-sm-success_2-5 909.9 μs 1.014 ms +11.4%
game-sm-success_2-6 313.2 μs 401.8 μs +28.3%
multisig-sm-1 556.4 μs 475.6 μs -14.5%
multisig-sm-2 542.8 μs 624.3 μs +15.0%
multisig-sm-3 549.1 μs 629.9 μs +14.7%
multisig-sm-4 552.7 μs 639.3 μs +15.7%
multisig-sm-5 784.2 μs 882.9 μs +12.6%
multisig-sm-6 554.8 μs 637.4 μs +14.9%
multisig-sm-7 543.8 μs 622.6 μs +14.5%
multisig-sm-8 547.7 μs 628.4 μs +14.7%
multisig-sm-9 554.6 μs 637.5 μs +14.9%
multisig-sm-10 783.5 μs 798.5 μs +1.9%
ping-pong-1 455.6 μs 374.2 μs -17.9%
ping-pong-2 455.1 μs 374.0 μs -17.8%
ping-pong_2-1 277.1 μs 236.5 μs -14.7%
prism-1 233.4 μs 208.6 μs -10.6%
prism-2 573.5 μs 476.5 μs -16.9%
prism-3 513.1 μs 426.2 μs -16.9%
pubkey-1 198.4 μs 178.1 μs -10.2%
stablecoin_1-1 1.267 ms 1.005 ms -20.7%
stablecoin_1-2 271.7 μs 244.2 μs -10.1%
stablecoin_1-3 1.455 ms 1.160 ms -20.3%
stablecoin_1-4 286.5 μs 257.1 μs -10.3%
stablecoin_1-5 1.867 ms 1.512 ms -19.0%
stablecoin_1-6 354.9 μs 316.5 μs -10.8%
stablecoin_2-1 883.3 μs 1.334 ms +51.0%
stablecoin_2-2 189.1 μs 244.7 μs +29.4%
stablecoin_2-3 1.454 ms 1.156 ms -20.5%
stablecoin_2-4 269.9 μs 257.0 μs -4.8%
token-account-1 264.2 μs 316.0 μs +19.6%
token-account-2 470.6 μs 557.2 μs +18.4%
uniswap-1 572.7 μs 450.7 μs -21.3%
uniswap-2 308.1 μs 260.7 μs -15.4%
uniswap-3 2.452 ms 2.264 ms -7.7%
uniswap-4 465.5 μs 587.0 μs +26.1%
uniswap-5 1.612 ms 1.847 ms +14.6%
uniswap-6 446.8 μs 397.1 μs -11.1%
vesting-1 483.5 μs 394.8 μs -18.3%
4b372ec 9fbb994 Change
TOTAL 43.71 ms 49.26 ms +12.7%

github-actions[bot] avatar Sep 19 '24 09:09 github-actions[bot]

Click here to check the status of your benchmark.

github-actions[bot] avatar Sep 19 '24 09:09 github-actions[bot]

Comparing benchmark results of 'validation' on '4b372ecea' (base) and '9fbb994eb' (PR)

Results table
Script 4b372ec 9fbb994 Change
auction_1-1 251.3 μs 312.8 μs +24.5%
auction_1-2 894.0 μs 1.000 ms +11.9%
auction_1-3 887.7 μs 998.8 μs +12.5%
auction_1-4 321.1 μs 403.7 μs +25.7%
auction_2-1 251.6 μs 312.3 μs +24.1%
auction_2-2 893.9 μs 999.1 μs +11.8%
auction_2-3 1.165 ms 1.312 ms +12.6%
auction_2-4 888.1 μs 1.002 ms +12.8%
auction_2-5 321.2 μs 405.3 μs +26.2%
crowdfunding-success-1 293.8 μs 264.8 μs -9.9%
crowdfunding-success-2 293.9 μs 342.3 μs +16.5%
crowdfunding-success-3 294.3 μs 257.5 μs -12.5%
currency-1 345.4 μs 283.8 μs -17.8%
escrow-redeem_1-1 487.8 μs 405.7 μs -16.8%
escrow-redeem_1-2 488.4 μs 405.9 μs -16.9%
escrow-redeem_2-1 568.5 μs 471.2 μs -17.1%
escrow-redeem_2-2 569.3 μs 674.9 μs +18.5%
escrow-redeem_2-3 569.4 μs 476.5 μs -16.3%
escrow-refund-1 152.5 μs 251.3 μs +64.8%
future-increase-margin-1 243.4 μs 399.5 μs +64.1%
future-increase-margin-2 727.0 μs 867.5 μs +19.3%
future-increase-margin-3 751.9 μs 864.8 μs +15.0%
future-increase-margin-4 681.4 μs 774.8 μs +13.7%
future-increase-margin-5 1.144 ms 1.269 ms +10.9%
future-pay-out-1 345.4 μs 401.6 μs +16.3%
future-pay-out-2 754.9 μs 869.6 μs +15.2%
future-pay-out-3 754.3 μs 865.8 μs +14.8%
future-pay-out-4 1.135 ms 1.262 ms +11.2%
future-settle-early-1 240.7 μs 400.7 μs +66.5%
future-settle-early-2 760.6 μs 865.8 μs +13.8%
future-settle-early-3 756.0 μs 871.8 μs +15.3%
future-settle-early-4 848.4 μs 946.3 μs +11.5%
game-sm-success_1-1 397.4 μs 631.2 μs +58.8%
game-sm-success_1-2 195.7 μs 349.6 μs +78.6%
game-sm-success_1-3 633.6 μs 1.010 ms +59.4%
game-sm-success_1-4 255.6 μs 397.6 μs +55.6%
game-sm-success_2-1 383.2 μs 630.7 μs +64.6%
game-sm-success_2-2 277.2 μs 348.4 μs +25.7%
game-sm-success_2-3 893.7 μs 921.1 μs +3.1%
game-sm-success_2-4 316.8 μs 399.2 μs +26.0%
game-sm-success_2-5 894.9 μs 693.7 μs -22.5%
game-sm-success_2-6 316.6 μs 279.4 μs -11.7%
multisig-sm-1 392.4 μs 629.4 μs +60.4%
multisig-sm-2 382.6 μs 437.8 μs +14.4%
multisig-sm-3 385.4 μs 442.9 μs +14.9%
multisig-sm-4 390.4 μs 447.8 μs +14.7%
multisig-sm-5 550.9 μs 619.7 μs +12.5%
multisig-sm-6 391.9 μs 450.7 μs +15.0%
multisig-sm-7 381.5 μs 568.7 μs +49.1%
multisig-sm-8 385.5 μs 637.1 μs +65.3%
multisig-sm-9 391.9 μs 640.1 μs +63.3%
multisig-sm-10 550.9 μs 877.1 μs +59.2%
ping-pong-1 320.9 μs 528.6 μs +64.7%
ping-pong-2 321.3 μs 528.0 μs +64.3%
ping-pong_2-1 195.7 μs 335.4 μs +71.4%
prism-1 165.1 μs 304.2 μs +84.3%
prism-2 404.8 μs 668.8 μs +65.2%
prism-3 360.8 μs 604.6 μs +67.6%
pubkey-1 139.5 μs 253.4 μs +81.6%
stablecoin_1-1 939.9 μs 1.418 ms +50.9%
stablecoin_1-2 272.1 μs 342.3 μs +25.8%
stablecoin_1-3 1.015 ms 1.656 ms +63.2%
stablecoin_1-4 202.6 μs 361.5 μs +78.4%
stablecoin_1-5 1.905 ms 2.137 ms +12.2%
stablecoin_1-6 272.4 μs 450.2 μs +65.3%
stablecoin_2-1 894.0 μs 1.416 ms +58.4%
stablecoin_2-2 191.8 μs 343.0 μs +78.8%
stablecoin_2-3 1.028 ms 1.132 ms +10.1%
stablecoin_2-4 202.3 μs 260.8 μs +28.9%
token-account-1 186.5 μs 281.8 μs +51.1%
token-account-2 471.7 μs 554.2 μs +17.5%
uniswap-1 572.7 μs 649.6 μs +13.4%
uniswap-2 307.5 μs 368.9 μs +20.0%
uniswap-3 2.454 ms 2.742 ms +11.7%
uniswap-4 465.8 μs 583.3 μs +25.2%
uniswap-5 1.540 ms 1.842 ms +19.6%
uniswap-6 452.3 μs 386.2 μs -14.6%
vesting-1 485.9 μs 391.6 μs -19.4%
4b372ec 9fbb994 Change
TOTAL 43.62 ms 53.19 ms +22.0%

github-actions[bot] avatar Sep 19 '24 10:09 github-actions[bot]

That doesn't make any sense:

Yup, the benchmarking machine is cooked as it turns out (confirmed elsewhere). Well, gotta wait for it to recover.

effectfully avatar Sep 21 '24 02:09 effectfully

/benchmark validation

effectfully avatar Sep 24 '24 16:09 effectfully

/benchmark nofib

effectfully avatar Sep 24 '24 16:09 effectfully

Click here to check the status of your benchmark.

github-actions[bot] avatar Sep 24 '24 16:09 github-actions[bot]

/benchmark lists

effectfully avatar Sep 24 '24 16:09 effectfully

Click here to check the status of your benchmark.

github-actions[bot] avatar Sep 24 '24 16:09 github-actions[bot]

Click here to check the status of your benchmark.

github-actions[bot] avatar Sep 24 '24 16:09 github-actions[bot]

/benchmark validation

effectfully avatar Sep 24 '24 18:09 effectfully