plutus icon indicating copy to clipboard operation
plutus copied to clipboard

[Builtins] Make unlifting lazy again

Open effectfully opened this issue 1 year ago • 42 comments

This is technically a regression performance-wise, but we may already be charging for it (depends on how budgeting calibration works), so let's see, maybe it's not detectable regardless.

effectfully avatar Sep 02 '24 17:09 effectfully

/benchmark validation

effectfully avatar Sep 02 '24 17:09 effectfully

/benchmark nofib

effectfully avatar Sep 02 '24 17:09 effectfully

/benchmark lists

effectfully avatar Sep 02 '24 17:09 effectfully

Make your bets, is this going to happen again:

image

effectfully avatar Sep 02 '24 17:09 effectfully

Click here to check the status of your benchmark.

github-actions[bot] avatar Sep 02 '24 20:09 github-actions[bot]

Comparing benchmark results of 'validation' on '4b8e137e1' (base) and 'd63521331' (PR)

Results table
Script 4b8e137 d635213 Change
auction_1-1 186.1 μs 181.2 μs -2.6%
auction_1-2 654.3 μs 652.6 μs -0.3%
auction_1-3 658.0 μs 645.8 μs -1.9%
auction_1-4 240.7 μs 234.6 μs -2.5%
auction_2-1 188.9 μs 181.1 μs -4.1%
auction_2-2 662.8 μs 649.8 μs -2.0%
auction_2-3 866.2 μs 851.6 μs -1.7%
auction_2-4 657.6 μs 641.8 μs -2.4%
auction_2-5 240.3 μs 233.9 μs -2.7%
crowdfunding-success-1 218.5 μs 211.9 μs -3.0%
crowdfunding-success-2 218.5 μs 212.2 μs -2.9%
crowdfunding-success-3 218.9 μs 212.1 μs -3.1%
currency-1 256.4 μs 251.0 μs -2.1%
escrow-redeem_1-1 361.7 μs 351.9 μs -2.7%
escrow-redeem_1-2 363.6 μs 352.1 μs -3.2%
escrow-redeem_2-1 423.8 μs 408.7 μs -3.6%
escrow-redeem_2-2 423.6 μs 410.5 μs -3.1%
escrow-redeem_2-3 423.9 μs 409.8 μs -3.3%
escrow-refund-1 161.2 μs 156.3 μs -3.0%
future-increase-margin-1 255.9 μs 250.3 μs -2.2%
future-increase-margin-2 557.8 μs 543.4 μs -2.6%
future-increase-margin-3 555.9 μs 545.9 μs -1.8%
future-increase-margin-4 502.1 μs 495.8 μs -1.3%
future-increase-margin-5 834.0 μs 823.0 μs -1.3%
future-pay-out-1 254.7 μs 249.8 μs -1.9%
future-pay-out-2 556.1 μs 544.8 μs -2.0%
future-pay-out-3 554.7 μs 546.8 μs -1.4%
future-pay-out-4 834.8 μs 808.8 μs -3.1%
future-settle-early-1 254.4 μs 245.1 μs -3.7%
future-settle-early-2 556.1 μs 533.3 μs -4.1%
future-settle-early-3 555.0 μs 536.1 μs -3.4%
future-settle-early-4 624.5 μs 605.8 μs -3.0%
game-sm-success_1-1 403.4 μs 381.0 μs -5.6%
game-sm-success_1-2 206.2 μs 198.9 μs -3.5%
game-sm-success_1-3 661.1 μs 630.3 μs -4.7%
game-sm-success_1-4 234.9 μs 226.8 μs -3.4%
game-sm-success_2-1 402.6 μs 382.7 μs -4.9%
game-sm-success_2-2 206.9 μs 199.7 μs -3.5%
game-sm-success_2-3 660.7 μs 631.2 μs -4.5%
game-sm-success_2-4 234.1 μs 227.8 μs -2.7%
game-sm-success_2-5 661.1 μs 631.6 μs -4.5%
game-sm-success_2-6 233.9 μs 225.7 μs -3.5%
multisig-sm-1 409.6 μs 391.5 μs -4.4%
multisig-sm-2 399.3 μs 384.7 μs -3.7%
multisig-sm-3 403.0 μs 386.4 μs -4.1%
multisig-sm-4 406.0 μs 393.0 μs -3.2%
multisig-sm-5 572.8 μs 564.3 μs -1.5%
multisig-sm-6 410.1 μs 396.9 μs -3.2%
multisig-sm-7 393.8 μs 391.2 μs -0.7%
multisig-sm-8 396.4 μs 395.0 μs -0.4%
multisig-sm-9 401.7 μs 396.3 μs -1.3%
multisig-sm-10 566.1 μs 562.3 μs -0.7%
ping-pong-1 331.1 μs 328.1 μs -0.9%
ping-pong-2 331.1 μs 328.2 μs -0.9%
ping-pong_2-1 203.4 μs 200.4 μs -1.5%
prism-1 171.5 μs 169.3 μs -1.3%
prism-2 418.4 μs 416.3 μs -0.5%
prism-3 374.1 μs 376.2 μs +0.6%
pubkey-1 146.2 μs 144.6 μs -1.1%
stablecoin_1-1 930.0 μs 918.6 μs -1.2%
stablecoin_1-2 203.4 μs 197.4 μs -2.9%
stablecoin_1-3 1.084 ms 1.056 ms -2.6%
stablecoin_1-4 214.6 μs 210.4 μs -2.0%
stablecoin_1-5 1.378 ms 1.359 ms -1.4%
stablecoin_1-6 267.1 μs 260.9 μs -2.3%
stablecoin_2-1 938.1 μs 914.9 μs -2.5%
stablecoin_2-2 203.2 μs 198.2 μs -2.5%
stablecoin_2-3 1.084 ms 1.059 ms -2.3%
stablecoin_2-4 216.1 μs 210.5 μs -2.6%
token-account-1 197.7 μs 192.8 μs -2.5%
token-account-2 345.6 μs 341.4 μs -1.2%
uniswap-1 421.1 μs 416.9 μs -1.0%
uniswap-2 226.6 μs 223.6 μs -1.3%
uniswap-3 1.779 ms 1.761 ms -1.0%
uniswap-4 343.6 μs 339.4 μs -1.2%
uniswap-5 1.175 ms 1.160 ms -1.3%
uniswap-6 331.7 μs 323.6 μs -2.4%
vesting-1 357.7 μs 352.8 μs -1.4%
TOTAL 36.26 ms 35.43 ms -2.3%

github-actions[bot] avatar Sep 02 '24 21:09 github-actions[bot]

Click here to check the status of your benchmark.

github-actions[bot] avatar Sep 02 '24 21:09 github-actions[bot]

-2.3% in total. I don't trust it, probably just a glitch, let's see the next one.

effectfully avatar Sep 02 '24 22:09 effectfully

Comparing benchmark results of 'nofib' on '4b8e137e1' (base) and 'd63521331' (PR)

Results table
Script 4b8e137 d635213 Change
clausify/formula1 3.129 ms 3.060 ms -2.2%
clausify/formula2 4.228 ms 4.087 ms -3.3%
clausify/formula3 11.59 ms 11.20 ms -3.4%
clausify/formula4 26.54 ms 26.13 ms -1.5%
clausify/formula5 56.19 ms 54.99 ms -2.1%
knights/4x4 17.96 ms 17.76 ms -1.1%
knights/6x6 47.43 ms 46.41 ms -2.2%
knights/8x8 83.40 ms 81.40 ms -2.4%
primetest/05digits 10.34 ms 10.47 ms +1.3%
primetest/10digits 20.19 ms 20.40 ms +1.0%
primetest/30digits 62.42 ms 62.47 ms +0.1%
primetest/50digits 102.5 ms 102.8 ms +0.3%
queens4x4/bt 5.497 ms 5.420 ms -1.4%
queens4x4/bm 6.960 ms 6.803 ms -2.3%
queens4x4/bjbt1 6.687 ms 6.566 ms -1.8%
queens4x4/bjbt2 6.247 ms 6.132 ms -1.8%
queens4x4/fc 14.12 ms 13.75 ms -2.6%
queens5x5/bt 74.47 ms 73.39 ms -1.5%
queens5x5/bm 77.84 ms 76.02 ms -2.3%
queens5x5/bjbt1 87.05 ms 85.52 ms -1.8%
queens5x5/bjbt2 84.47 ms 83.00 ms -1.7%
queens5x5/fc 178.8 ms 174.4 ms -2.5%
TOTAL 988.1 ms 972.2 ms -1.6%

github-actions[bot] avatar Sep 02 '24 22:09 github-actions[bot]

Click here to check the status of your benchmark.

github-actions[bot] avatar Sep 02 '24 22:09 github-actions[bot]

-1.6% in total and I still don't believe it. Also note how the primetest ones are (insignificant) regressions, those are the most sensitive to changes in the builtins code.

effectfully avatar Sep 02 '24 22:09 effectfully

Comparing benchmark results of 'lists' on '4b8e137e1' (base) and 'd63521331' (PR)

Results table
Script 4b8e137 d635213 Change
sort/ghcSort/50 237.8 μs 235.9 μs -0.8%
sort/ghcSort/100 555.6 μs 546.4 μs -1.7%
sort/ghcSort/150 964.5 μs 951.1 μs -1.4%
sort/ghcSort/200 1.293 ms 1.289 ms -0.3%
sort/ghcSort/250 1.673 ms 1.682 ms +0.5%
sort/ghcSort/300 2.202 ms 2.209 ms +0.3%
sort/insertionSort/50 806.6 μs 812.8 μs +0.8%
sort/insertionSort/100 3.228 ms 3.253 ms +0.8%
sort/insertionSort/150 7.243 ms 7.318 ms +1.0%
sort/insertionSort/200 12.98 ms 13.08 ms +0.8%
sort/insertionSort/250 20.26 ms 20.51 ms +1.2%
sort/insertionSort/300 29.74 ms 29.69 ms -0.2%
sort/mergeSort/50 704.1 μs 699.5 μs -0.7%
sort/mergeSort/100 1.624 ms 1.608 ms -1.0%
sort/mergeSort/150 2.613 ms 2.577 ms -1.4%
sort/mergeSort/200 3.671 ms 3.639 ms -0.9%
sort/mergeSort/250 4.825 ms 4.767 ms -1.2%
sort/mergeSort/300 5.875 ms 5.814 ms -1.0%
sort/quickSort/50 1.974 ms 1.961 ms -0.7%
sort/quickSort/100 7.981 ms 7.937 ms -0.6%
sort/quickSort/150 17.99 ms 17.81 ms -1.0%
sort/quickSort/200 31.84 ms 31.62 ms -0.7%
sort/quickSort/250 49.87 ms 49.61 ms -0.5%
sort/quickSort/300 72.05 ms 71.58 ms -0.7%
sum/compiled-from-Haskell/sum-right-builtin/100 97.11 μs 98.18 μs +1.1%
sum/compiled-from-Haskell/sum-right-builtin/500 508.0 μs 516.3 μs +1.6%
sum/compiled-from-Haskell/sum-right-builtin/1000 1.099 ms 1.112 ms +1.2%
sum/compiled-from-Haskell/sum-right-builtin/2500 3.353 ms 3.394 ms +1.2%
sum/compiled-from-Haskell/sum-right-builtin/5000 7.190 ms 7.252 ms +0.9%
sum/compiled-from-Haskell/sum-right-Scott/100 64.63 μs 63.99 μs -1.0%
sum/compiled-from-Haskell/sum-right-Scott/500 336.5 μs 335.1 μs -0.4%
sum/compiled-from-Haskell/sum-right-Scott/1000 725.2 μs 722.5 μs -0.4%
sum/compiled-from-Haskell/sum-right-Scott/2500 2.421 ms 2.405 ms -0.7%
sum/compiled-from-Haskell/sum-right-Scott/5000 5.446 ms 5.419 ms -0.5%
sum/compiled-from-Haskell/sum-right-data/100 258.2 μs 262.6 μs +1.7%
sum/compiled-from-Haskell/sum-right-data/500 1.412 ms 1.398 ms -1.0%
sum/compiled-from-Haskell/sum-right-data/1000 3.165 ms 3.098 ms -2.1%
sum/compiled-from-Haskell/sum-right-data/2500 8.561 ms 8.305 ms -3.0%
sum/compiled-from-Haskell/sum-right-data/5000 17.73 ms 17.24 ms -2.8%
sum/compiled-from-Haskell/sum-left-builtin/100 95.14 μs 94.16 μs -1.0%
sum/compiled-from-Haskell/sum-left-builtin/500 495.7 μs 494.0 μs -0.3%
sum/compiled-from-Haskell/sum-left-builtin/1000 1.062 ms 1.052 ms -0.9%
sum/compiled-from-Haskell/sum-left-builtin/2500 3.248 ms 3.195 ms -1.6%
sum/compiled-from-Haskell/sum-left-builtin/5000 7.057 ms 6.907 ms -2.1%
sum/compiled-from-Haskell/sum-left-Scott/100 62.69 μs 60.69 μs -3.2%
sum/compiled-from-Haskell/sum-left-Scott/500 327.7 μs 317.7 μs -3.1%
sum/compiled-from-Haskell/sum-left-Scott/1000 709.5 μs 685.0 μs -3.5%
sum/compiled-from-Haskell/sum-left-Scott/2500 2.287 ms 2.220 ms -2.9%
sum/compiled-from-Haskell/sum-left-Scott/5000 5.157 ms 5.017 ms -2.7%
sum/compiled-from-Haskell/sum-left-data/100 260.2 μs 255.4 μs -1.8%
sum/compiled-from-Haskell/sum-left-data/500 1.416 ms 1.388 ms -2.0%
sum/compiled-from-Haskell/sum-left-data/1000 3.190 ms 3.114 ms -2.4%
sum/compiled-from-Haskell/sum-left-data/2500 8.563 ms 8.363 ms -2.3%
sum/compiled-from-Haskell/sum-left-data/5000 17.67 ms 17.26 ms -2.3%
sum/hand-written-PLC/sum-right-builtin/100 92.73 μs 94.96 μs +2.4%
sum/hand-written-PLC/sum-right-builtin/500 469.5 μs 479.6 μs +2.2%
sum/hand-written-PLC/sum-right-builtin/1000 970.8 μs 993.8 μs +2.4%
sum/hand-written-PLC/sum-right-builtin/2500 2.707 ms 2.760 ms +2.0%
sum/hand-written-PLC/sum-right-builtin/5000 5.692 ms 5.753 ms +1.1%
sum/hand-written-PLC/sum-right-Scott/100 52.29 μs 51.83 μs -0.9%
sum/hand-written-PLC/sum-right-Scott/500 268.5 μs 264.8 μs -1.4%
sum/hand-written-PLC/sum-right-Scott/1000 561.7 μs 550.0 μs -2.1%
sum/hand-written-PLC/sum-right-Scott/2500 1.713 ms 1.687 ms -1.5%
sum/hand-written-PLC/sum-right-Scott/5000 3.996 ms 3.991 ms -0.1%
sum/hand-written-PLC/sum-left-builtin/100 96.18 μs 98.62 μs +2.5%
sum/hand-written-PLC/sum-left-builtin/500 476.8 μs 484.3 μs +1.6%
sum/hand-written-PLC/sum-left-builtin/1000 950.0 μs 961.4 μs +1.2%
sum/hand-written-PLC/sum-left-builtin/2500 2.360 ms 2.394 ms +1.4%
sum/hand-written-PLC/sum-left-builtin/5000 4.703 ms 4.769 ms +1.4%
sum/hand-written-PLC/sum-left-Scott/100 57.14 μs 56.77 μs -0.6%
sum/hand-written-PLC/sum-left-Scott/500 284.8 μs 280.9 μs -1.4%
sum/hand-written-PLC/sum-left-Scott/1000 580.4 μs 576.0 μs -0.8%
sum/hand-written-PLC/sum-left-Scott/2500 1.624 ms 1.609 ms -0.9%
sum/hand-written-PLC/sum-left-Scott/5000 3.552 ms 3.521 ms -0.9%
TOTAL 417.4 ms 414.6 ms -0.7%

github-actions[bot] avatar Sep 02 '24 23:09 github-actions[bot]

/benchmark lists

effectfully avatar Sep 03 '24 00:09 effectfully

/benchmark lists

effectfully avatar Sep 03 '24 00:09 effectfully

/benchmark lists

effectfully avatar Sep 03 '24 00:09 effectfully

Click here to check the status of your benchmark.

github-actions[bot] avatar Sep 03 '24 00:09 github-actions[bot]

Comparing benchmark results of 'lists' on '4b8e137e1' (base) and 'd63521331' (PR)

Results table
Script 4b8e137 d635213 Change
sort/ghcSort/50 239.3 μs 230.4 μs -3.7%
sort/ghcSort/100 558.4 μs 532.8 μs -4.6%
sort/ghcSort/150 972.2 μs 927.5 μs -4.6%
sort/ghcSort/200 1.300 ms 1.247 ms -4.1%
sort/ghcSort/250 1.684 ms 1.614 ms -4.2%
sort/ghcSort/300 2.216 ms 2.115 ms -4.6%
sort/insertionSort/50 813.8 μs 780.0 μs -4.2%
sort/insertionSort/100 3.245 ms 3.108 ms -4.2%
sort/insertionSort/150 7.313 ms 7.013 ms -4.1%
sort/insertionSort/200 13.04 ms 12.54 ms -3.8%
sort/insertionSort/250 20.50 ms 19.68 ms -4.0%
sort/insertionSort/300 29.78 ms 28.55 ms -4.1%
sort/mergeSort/50 704.5 μs 672.1 μs -4.6%
sort/mergeSort/100 1.624 ms 1.545 ms -4.9%
sort/mergeSort/150 2.618 ms 2.492 ms -4.8%
sort/mergeSort/200 3.669 ms 3.510 ms -4.3%
sort/mergeSort/250 4.820 ms 4.613 ms -4.3%
sort/mergeSort/300 5.861 ms 5.608 ms -4.3%
sort/quickSort/50 1.968 ms 1.903 ms -3.3%
sort/quickSort/100 7.964 ms 7.692 ms -3.4%
sort/quickSort/150 17.88 ms 17.35 ms -3.0%
sort/quickSort/200 31.78 ms 30.74 ms -3.3%
sort/quickSort/250 49.82 ms 48.24 ms -3.2%
sort/quickSort/300 71.86 ms 69.56 ms -3.2%
sum/compiled-from-Haskell/sum-right-builtin/100 97.05 μs 95.24 μs -1.9%
sum/compiled-from-Haskell/sum-right-builtin/500 508.2 μs 502.5 μs -1.1%
sum/compiled-from-Haskell/sum-right-builtin/1000 1.095 ms 1.083 ms -1.1%
sum/compiled-from-Haskell/sum-right-builtin/2500 3.341 ms 3.306 ms -1.0%
sum/compiled-from-Haskell/sum-right-builtin/5000 7.142 ms 7.069 ms -1.0%
sum/compiled-from-Haskell/sum-right-Scott/100 64.50 μs 62.39 μs -3.3%
sum/compiled-from-Haskell/sum-right-Scott/500 336.6 μs 325.9 μs -3.2%
sum/compiled-from-Haskell/sum-right-Scott/1000 720.7 μs 701.5 μs -2.7%
sum/compiled-from-Haskell/sum-right-Scott/2500 2.412 ms 2.340 ms -3.0%
sum/compiled-from-Haskell/sum-right-Scott/5000 5.415 ms 5.272 ms -2.6%
sum/compiled-from-Haskell/sum-right-data/100 258.0 μs 250.8 μs -2.8%
sum/compiled-from-Haskell/sum-right-data/500 1.409 ms 1.376 ms -2.3%
sum/compiled-from-Haskell/sum-right-data/1000 3.162 ms 3.094 ms -2.2%
sum/compiled-from-Haskell/sum-right-data/2500 8.538 ms 8.343 ms -2.3%
sum/compiled-from-Haskell/sum-right-data/5000 17.69 ms 17.33 ms -2.0%
sum/compiled-from-Haskell/sum-left-builtin/100 94.85 μs 93.81 μs -1.1%
sum/compiled-from-Haskell/sum-left-builtin/500 493.7 μs 491.3 μs -0.5%
sum/compiled-from-Haskell/sum-left-builtin/1000 1.058 ms 1.046 ms -1.1%
sum/compiled-from-Haskell/sum-left-builtin/2500 3.241 ms 3.184 ms -1.8%
sum/compiled-from-Haskell/sum-left-builtin/5000 7.056 ms 6.938 ms -1.7%
sum/compiled-from-Haskell/sum-left-Scott/100 62.44 μs 60.83 μs -2.6%
sum/compiled-from-Haskell/sum-left-Scott/500 327.4 μs 320.2 μs -2.2%
sum/compiled-from-Haskell/sum-left-Scott/1000 705.1 μs 690.4 μs -2.1%
sum/compiled-from-Haskell/sum-left-Scott/2500 2.279 ms 2.231 ms -2.1%
sum/compiled-from-Haskell/sum-left-Scott/5000 5.143 ms 5.039 ms -2.0%
sum/compiled-from-Haskell/sum-left-data/100 260.3 μs 255.7 μs -1.8%
sum/compiled-from-Haskell/sum-left-data/500 1.416 ms 1.391 ms -1.8%
sum/compiled-from-Haskell/sum-left-data/1000 3.177 ms 3.128 ms -1.5%
sum/compiled-from-Haskell/sum-left-data/2500 8.552 ms 8.412 ms -1.6%
sum/compiled-from-Haskell/sum-left-data/5000 17.65 ms 17.40 ms -1.4%
sum/hand-written-PLC/sum-right-builtin/100 92.30 μs 95.45 μs +3.4%
sum/hand-written-PLC/sum-right-builtin/500 468.3 μs 482.5 μs +3.0%
sum/hand-written-PLC/sum-right-builtin/1000 968.0 μs 996.6 μs +3.0%
sum/hand-written-PLC/sum-right-builtin/2500 2.698 ms 2.760 ms +2.3%
sum/hand-written-PLC/sum-right-builtin/5000 5.664 ms 5.794 ms +2.3%
sum/hand-written-PLC/sum-right-Scott/100 52.04 μs 52.78 μs +1.4%
sum/hand-written-PLC/sum-right-Scott/500 267.8 μs 266.4 μs -0.5%
sum/hand-written-PLC/sum-right-Scott/1000 560.7 μs 558.3 μs -0.4%
sum/hand-written-PLC/sum-right-Scott/2500 1.704 ms 1.711 ms +0.4%
sum/hand-written-PLC/sum-right-Scott/5000 3.992 ms 3.991 ms -0.0%
sum/hand-written-PLC/sum-left-builtin/100 96.73 μs 98.42 μs +1.7%
sum/hand-written-PLC/sum-left-builtin/500 475.8 μs 485.0 μs +1.9%
sum/hand-written-PLC/sum-left-builtin/1000 948.9 μs 964.6 μs +1.7%
sum/hand-written-PLC/sum-left-builtin/2500 2.368 ms 2.403 ms +1.5%
sum/hand-written-PLC/sum-left-builtin/5000 4.716 ms 4.808 ms +2.0%
sum/hand-written-PLC/sum-left-Scott/100 56.86 μs 56.91 μs +0.1%
sum/hand-written-PLC/sum-left-Scott/500 284.0 μs 283.2 μs -0.3%
sum/hand-written-PLC/sum-left-Scott/1000 580.1 μs 578.6 μs -0.3%
sum/hand-written-PLC/sum-left-Scott/2500 1.621 ms 1.630 ms +0.6%
sum/hand-written-PLC/sum-left-Scott/5000 3.550 ms 3.557 ms +0.2%
TOTAL 417.1 ms 405.7 ms -2.7%

github-actions[bot] avatar Sep 03 '24 00:09 github-actions[bot]

Click here to check the status of your benchmark.

github-actions[bot] avatar Sep 03 '24 00:09 github-actions[bot]

Comparing benchmark results of 'lists' on '4b8e137e1' (base) and 'd63521331' (PR)

Results table
Script 4b8e137 d635213 Change
sort/ghcSort/50 237.9 μs 243.6 μs +2.4%
sort/ghcSort/100 556.2 μs 568.2 μs +2.2%
sort/ghcSort/150 967.4 μs 984.4 μs +1.8%
sort/ghcSort/200 1.297 ms 1.343 ms +3.5%
sort/ghcSort/250 1.678 ms 1.735 ms +3.4%
sort/ghcSort/300 2.213 ms 2.278 ms +2.9%
sort/insertionSort/50 810.3 μs 846.6 μs +4.5%
sort/insertionSort/100 3.249 ms 3.367 ms +3.6%
sort/insertionSort/150 7.288 ms 7.590 ms +4.1%
sort/insertionSort/200 12.99 ms 13.55 ms +4.3%
sort/insertionSort/250 20.40 ms 21.78 ms +6.8%
sort/insertionSort/300 29.52 ms 30.79 ms +4.3%
sort/mergeSort/50 701.6 μs 722.4 μs +3.0%
sort/mergeSort/100 1.626 ms 1.662 ms +2.2%
sort/mergeSort/150 2.600 ms 2.670 ms +2.7%
sort/mergeSort/200 3.657 ms 3.757 ms +2.7%
sort/mergeSort/250 4.710 ms 4.921 ms +4.5%
sort/mergeSort/300 5.742 ms 5.995 ms +4.4%
sort/quickSort/50 1.924 ms 2.028 ms +5.4%
sort/quickSort/100 7.806 ms 8.185 ms +4.9%
sort/quickSort/150 17.55 ms 18.43 ms +5.0%
sort/quickSort/200 31.08 ms 32.65 ms +5.1%
sort/quickSort/250 48.85 ms 51.16 ms +4.7%
sort/quickSort/300 70.27 ms 73.70 ms +4.9%
sum/compiled-from-Haskell/sum-right-builtin/100 94.68 μs 104.0 μs +9.8%
sum/compiled-from-Haskell/sum-right-builtin/500 496.8 μs 544.3 μs +9.6%
sum/compiled-from-Haskell/sum-right-builtin/1000 1.075 ms 1.165 ms +8.4%
sum/compiled-from-Haskell/sum-right-builtin/2500 3.281 ms 3.544 ms +8.0%
sum/compiled-from-Haskell/sum-right-builtin/5000 7.009 ms 7.533 ms +7.5%
sum/compiled-from-Haskell/sum-right-Scott/100 63.02 μs 65.11 μs +3.3%
sum/compiled-from-Haskell/sum-right-Scott/500 331.1 μs 340.8 μs +2.9%
sum/compiled-from-Haskell/sum-right-Scott/1000 711.7 μs 732.3 μs +2.9%
sum/compiled-from-Haskell/sum-right-Scott/2500 2.385 ms 2.431 ms +1.9%
sum/compiled-from-Haskell/sum-right-Scott/5000 5.347 ms 5.476 ms +2.4%
sum/compiled-from-Haskell/sum-right-data/100 255.5 μs 273.9 μs +7.2%
sum/compiled-from-Haskell/sum-right-data/500 1.394 ms 1.468 ms +5.3%
sum/compiled-from-Haskell/sum-right-data/1000 3.130 ms 3.285 ms +5.0%
sum/compiled-from-Haskell/sum-right-data/2500 8.584 ms 8.835 ms +2.9%
sum/compiled-from-Haskell/sum-right-data/5000 17.73 ms 18.30 ms +3.2%
sum/compiled-from-Haskell/sum-left-builtin/100 94.88 μs 101.8 μs +7.3%
sum/compiled-from-Haskell/sum-left-builtin/500 494.3 μs 532.2 μs +7.7%
sum/compiled-from-Haskell/sum-left-builtin/1000 1.063 ms 1.133 ms +6.6%
sum/compiled-from-Haskell/sum-left-builtin/2500 3.252 ms 3.401 ms +4.6%
sum/compiled-from-Haskell/sum-left-builtin/5000 7.063 ms 7.363 ms +4.2%
sum/compiled-from-Haskell/sum-left-Scott/100 62.78 μs 64.86 μs +3.3%
sum/compiled-from-Haskell/sum-left-Scott/500 327.9 μs 339.2 μs +3.4%
sum/compiled-from-Haskell/sum-left-Scott/1000 708.7 μs 729.6 μs +2.9%
sum/compiled-from-Haskell/sum-left-Scott/2500 2.284 ms 2.338 ms +2.4%
sum/compiled-from-Haskell/sum-left-Scott/5000 5.146 ms 5.262 ms +2.3%
sum/compiled-from-Haskell/sum-left-data/100 260.5 μs 275.0 μs +5.6%
sum/compiled-from-Haskell/sum-left-data/500 1.416 ms 1.485 ms +4.9%
sum/compiled-from-Haskell/sum-left-data/1000 3.180 ms 3.302 ms +3.8%
sum/compiled-from-Haskell/sum-left-data/2500 8.573 ms 8.855 ms +3.3%
sum/compiled-from-Haskell/sum-left-data/5000 17.66 ms 18.23 ms +3.2%
sum/hand-written-PLC/sum-right-builtin/100 92.52 μs 102.1 μs +10.4%
sum/hand-written-PLC/sum-right-builtin/500 470.0 μs 516.1 μs +9.8%
sum/hand-written-PLC/sum-right-builtin/1000 970.5 μs 1.058 ms +9.0%
sum/hand-written-PLC/sum-right-builtin/2500 2.706 ms 2.944 ms +8.8%
sum/hand-written-PLC/sum-right-builtin/5000 5.680 ms 6.152 ms +8.3%
sum/hand-written-PLC/sum-right-Scott/100 52.19 μs 53.86 μs +3.2%
sum/hand-written-PLC/sum-right-Scott/500 268.4 μs 269.8 μs +0.5%
sum/hand-written-PLC/sum-right-Scott/1000 559.9 μs 570.1 μs +1.8%
sum/hand-written-PLC/sum-right-Scott/2500 1.712 ms 1.728 ms +0.9%
sum/hand-written-PLC/sum-right-Scott/5000 4.015 ms 4.029 ms +0.3%
sum/hand-written-PLC/sum-left-builtin/100 96.49 μs 106.3 μs +10.2%
sum/hand-written-PLC/sum-left-builtin/500 477.1 μs 523.8 μs +9.8%
sum/hand-written-PLC/sum-left-builtin/1000 951.6 μs 1.040 ms +9.3%
sum/hand-written-PLC/sum-left-builtin/2500 2.369 ms 2.587 ms +9.2%
sum/hand-written-PLC/sum-left-builtin/5000 4.709 ms 5.150 ms +9.4%
sum/hand-written-PLC/sum-left-Scott/100 56.94 μs 58.66 μs +3.0%
sum/hand-written-PLC/sum-left-Scott/500 286.7 μs 290.5 μs +1.3%
sum/hand-written-PLC/sum-left-Scott/1000 582.0 μs 591.0 μs +1.5%
sum/hand-written-PLC/sum-left-Scott/2500 1.600 ms 1.649 ms +3.1%
sum/hand-written-PLC/sum-left-Scott/5000 3.501 ms 3.597 ms +2.7%
TOTAL 412.4 ms 431.5 ms +4.6%

github-actions[bot] avatar Sep 03 '24 01:09 github-actions[bot]

Click here to check the status of your benchmark.

github-actions[bot] avatar Sep 03 '24 01:09 github-actions[bot]

Comparing benchmark results of 'lists' on '4b8e137e1' (base) and 'd63521331' (PR)

Results table
Script 4b8e137 d635213 Change
sort/ghcSort/50 238.0 μs 236.3 μs -0.7%
sort/ghcSort/100 561.5 μs 549.8 μs -2.1%
sort/ghcSort/150 978.8 μs 954.6 μs -2.5%
sort/ghcSort/200 1.311 ms 1.288 ms -1.8%
sort/ghcSort/250 1.691 ms 1.662 ms -1.7%
sort/ghcSort/300 2.233 ms 2.184 ms -2.2%
sort/insertionSort/50 818.8 μs 802.6 μs -2.0%
sort/insertionSort/100 3.261 ms 3.206 ms -1.7%
sort/insertionSort/150 7.417 ms 7.232 ms -2.5%
sort/insertionSort/200 13.09 ms 12.92 ms -1.3%
sort/insertionSort/250 20.61 ms 20.20 ms -2.0%
sort/insertionSort/300 29.80 ms 29.21 ms -2.0%
sort/mergeSort/50 704.3 μs 690.9 μs -1.9%
sort/mergeSort/100 1.621 ms 1.584 ms -2.3%
sort/mergeSort/150 2.623 ms 2.555 ms -2.6%
sort/mergeSort/200 3.680 ms 3.582 ms -2.7%
sort/mergeSort/250 4.827 ms 4.707 ms -2.5%
sort/mergeSort/300 5.877 ms 5.721 ms -2.7%
sort/quickSort/50 1.972 ms 1.938 ms -1.7%
sort/quickSort/100 7.977 ms 7.819 ms -2.0%
sort/quickSort/150 17.99 ms 17.65 ms -1.9%
sort/quickSort/200 31.91 ms 31.18 ms -2.3%
sort/quickSort/250 50.03 ms 48.90 ms -2.3%
sort/quickSort/300 71.81 ms 70.36 ms -2.0%
sum/compiled-from-Haskell/sum-right-builtin/100 96.93 μs 96.72 μs -0.2%
sum/compiled-from-Haskell/sum-right-builtin/500 507.0 μs 508.3 μs +0.3%
sum/compiled-from-Haskell/sum-right-builtin/1000 1.097 ms 1.110 ms +1.2%
sum/compiled-from-Haskell/sum-right-builtin/2500 3.348 ms 3.379 ms +0.9%
sum/compiled-from-Haskell/sum-right-builtin/5000 7.157 ms 7.227 ms +1.0%
sum/compiled-from-Haskell/sum-right-Scott/100 64.66 μs 64.26 μs -0.6%
sum/compiled-from-Haskell/sum-right-Scott/500 337.0 μs 335.1 μs -0.6%
sum/compiled-from-Haskell/sum-right-Scott/1000 711.5 μs 720.1 μs +1.2%
sum/compiled-from-Haskell/sum-right-Scott/2500 2.408 ms 2.399 ms -0.4%
sum/compiled-from-Haskell/sum-right-Scott/5000 5.450 ms 5.412 ms -0.7%
sum/compiled-from-Haskell/sum-right-data/100 258.3 μs 255.3 μs -1.2%
sum/compiled-from-Haskell/sum-right-data/500 1.411 ms 1.393 ms -1.3%
sum/compiled-from-Haskell/sum-right-data/1000 3.165 ms 3.129 ms -1.1%
sum/compiled-from-Haskell/sum-right-data/2500 8.559 ms 8.453 ms -1.2%
sum/compiled-from-Haskell/sum-right-data/5000 17.76 ms 17.51 ms -1.4%
sum/compiled-from-Haskell/sum-left-builtin/100 94.97 μs 94.83 μs -0.1%
sum/compiled-from-Haskell/sum-left-builtin/500 494.7 μs 497.0 μs +0.5%
sum/compiled-from-Haskell/sum-left-builtin/1000 1.059 ms 1.062 ms +0.3%
sum/compiled-from-Haskell/sum-left-builtin/2500 3.254 ms 3.227 ms -0.8%
sum/compiled-from-Haskell/sum-left-builtin/5000 7.078 ms 7.025 ms -0.7%
sum/compiled-from-Haskell/sum-left-Scott/100 62.84 μs 61.73 μs -1.8%
sum/compiled-from-Haskell/sum-left-Scott/500 327.4 μs 323.5 μs -1.2%
sum/compiled-from-Haskell/sum-left-Scott/1000 707.6 μs 698.2 μs -1.3%
sum/compiled-from-Haskell/sum-left-Scott/2500 2.283 ms 2.254 ms -1.3%
sum/compiled-from-Haskell/sum-left-Scott/5000 5.166 ms 5.091 ms -1.5%
sum/compiled-from-Haskell/sum-left-data/100 260.8 μs 258.5 μs -0.9%
sum/compiled-from-Haskell/sum-left-data/500 1.418 ms 1.408 ms -0.7%
sum/compiled-from-Haskell/sum-left-data/1000 3.187 ms 3.152 ms -1.1%
sum/compiled-from-Haskell/sum-left-data/2500 8.578 ms 8.456 ms -1.4%
sum/compiled-from-Haskell/sum-left-data/5000 17.67 ms 17.47 ms -1.1%
sum/hand-written-PLC/sum-right-builtin/100 92.73 μs 96.08 μs +3.6%
sum/hand-written-PLC/sum-right-builtin/500 469.5 μs 487.7 μs +3.9%
sum/hand-written-PLC/sum-right-builtin/1000 970.8 μs 998.6 μs +2.9%
sum/hand-written-PLC/sum-right-builtin/2500 2.721 ms 2.796 ms +2.8%
sum/hand-written-PLC/sum-right-builtin/5000 5.679 ms 5.868 ms +3.3%
sum/hand-written-PLC/sum-right-Scott/100 52.16 μs 53.34 μs +2.3%
sum/hand-written-PLC/sum-right-Scott/500 268.1 μs 268.4 μs +0.1%
sum/hand-written-PLC/sum-right-Scott/1000 561.6 μs 560.0 μs -0.3%
sum/hand-written-PLC/sum-right-Scott/2500 1.707 ms 1.723 ms +0.9%
sum/hand-written-PLC/sum-right-Scott/5000 4.009 ms 4.027 ms +0.4%
sum/hand-written-PLC/sum-left-builtin/100 96.92 μs 98.72 μs +1.9%
sum/hand-written-PLC/sum-left-builtin/500 479.2 μs 490.9 μs +2.4%
sum/hand-written-PLC/sum-left-builtin/1000 955.7 μs 972.8 μs +1.8%
sum/hand-written-PLC/sum-left-builtin/2500 2.371 ms 2.419 ms +2.0%
sum/hand-written-PLC/sum-left-builtin/5000 4.733 ms 4.821 ms +1.9%
sum/hand-written-PLC/sum-left-Scott/100 57.21 μs 58.14 μs +1.6%
sum/hand-written-PLC/sum-left-Scott/500 285.7 μs 283.6 μs -0.7%
sum/hand-written-PLC/sum-left-Scott/1000 583.2 μs 571.0 μs -2.1%
sum/hand-written-PLC/sum-left-Scott/2500 1.626 ms 1.597 ms -1.8%
sum/hand-written-PLC/sum-left-Scott/5000 3.556 ms 3.493 ms -1.8%
TOTAL 418.3 ms 411.9 ms -1.5%

github-actions[bot] avatar Sep 03 '24 02:09 github-actions[bot]

/benchmark validation

kwxm avatar Sep 11 '24 09:09 kwxm

/benchmark lists

kwxm avatar Sep 11 '24 10:09 kwxm

Click here to check the status of your benchmark.

github-actions[bot] avatar Sep 11 '24 11:09 github-actions[bot]

Click here to check the status of your benchmark.

github-actions[bot] avatar Sep 11 '24 11:09 github-actions[bot]

@kwxm needed rebasing on master, I've now done it.

effectfully avatar Sep 11 '24 16:09 effectfully

/benchmark validation

effectfully avatar Sep 11 '24 16:09 effectfully

/benchmark lists

effectfully avatar Sep 11 '24 16:09 effectfully

Click here to check the status of your benchmark.

github-actions[bot] avatar Sep 11 '24 18:09 github-actions[bot]

Comparing benchmark results of 'validation' on '1d2ad5ab88' (base) and '989b32c0e6' (PR)

Results table
Script 1d2ad5a 989b32c Change
auction_1-1 190.6 μs 187.5 μs -1.6%
auction_1-2 667.2 μs 664.2 μs -0.4%
auction_1-3 663.2 μs 657.7 μs -0.8%
auction_1-4 243.2 μs 239.5 μs -1.5%
auction_2-1 190.3 μs 185.2 μs -2.7%
auction_2-2 667.0 μs 661.4 μs -0.8%
auction_2-3 869.4 μs 866.6 μs -0.3%
auction_2-4 660.3 μs 657.9 μs -0.4%
auction_2-5 242.9 μs 246.7 μs +1.6%
crowdfunding-success-1 221.9 μs 217.4 μs -2.0%
crowdfunding-success-2 221.9 μs 217.7 μs -1.9%
crowdfunding-success-3 221.7 μs 214.7 μs -3.2%
currency-1 252.1 μs 252.4 μs +0.1%
escrow-redeem_1-1 357.3 μs 356.1 μs -0.3%
escrow-redeem_1-2 356.4 μs 353.7 μs -0.8%
escrow-redeem_2-1 417.9 μs 413.7 μs -1.0%
escrow-redeem_2-2 417.6 μs 412.9 μs -1.1%
escrow-redeem_2-3 418.0 μs 413.2 μs -1.1%
escrow-refund-1 160.8 μs 157.0 μs -2.4%
future-increase-margin-1 252.5 μs 252.4 μs -0.0%
future-increase-margin-2 549.3 μs 553.6 μs +0.8%
future-increase-margin-3 549.7 μs 553.4 μs +0.7%
future-increase-margin-4 501.5 μs 501.2 μs -0.1%
future-increase-margin-5 823.4 μs 836.3 μs +1.6%
future-pay-out-1 254.3 μs 255.9 μs +0.6%
future-pay-out-2 559.5 μs 559.5 μs 0.0%
future-pay-out-3 561.0 μs 559.3 μs -0.3%
future-pay-out-4 839.2 μs 841.7 μs +0.3%
future-settle-early-1 257.6 μs 256.2 μs -0.5%
future-settle-early-2 560.9 μs 559.5 μs -0.2%
future-settle-early-3 559.8 μs 559.4 μs -0.1%
future-settle-early-4 629.5 μs 628.1 μs -0.2%
game-sm-success_1-1 403.5 μs 398.0 μs -1.4%
game-sm-success_1-2 211.9 μs 207.8 μs -1.9%
game-sm-success_1-3 660.9 μs 662.5 μs +0.2%
game-sm-success_1-4 242.7 μs 235.9 μs -2.8%
game-sm-success_2-1 403.6 μs 399.3 μs -1.1%
game-sm-success_2-2 211.7 μs 203.4 μs -3.9%
game-sm-success_2-3 661.9 μs 647.2 μs -2.2%
game-sm-success_2-4 241.2 μs 231.7 μs -3.9%
game-sm-success_2-5 662.5 μs 647.0 μs -2.3%
game-sm-success_2-6 241.0 μs 230.1 μs -4.5%
multisig-sm-1 405.5 μs 398.8 μs -1.7%
multisig-sm-2 393.6 μs 391.9 μs -0.4%
multisig-sm-3 397.5 μs 391.9 μs -1.4%
multisig-sm-4 402.5 μs 398.6 μs -1.0%
multisig-sm-5 571.7 μs 563.7 μs -1.4%
multisig-sm-6 409.1 μs 397.6 μs -2.8%
multisig-sm-7 399.8 μs 393.2 μs -1.7%
multisig-sm-8 402.2 μs 396.5 μs -1.4%
multisig-sm-9 407.2 μs 396.6 μs -2.6%
multisig-sm-10 566.4 μs 565.5 μs -0.2%
ping-pong-1 332.0 μs 332.7 μs +0.2%
ping-pong-2 330.9 μs 331.3 μs +0.1%
ping-pong_2-1 204.0 μs 201.0 μs -1.5%
prism-1 174.4 μs 170.3 μs -2.4%
prism-2 420.5 μs 417.0 μs -0.8%
prism-3 372.5 μs 373.5 μs +0.3%
pubkey-1 148.0 μs 144.8 μs -2.2%
stablecoin_1-1 918.9 μs 912.9 μs -0.7%
stablecoin_1-2 202.3 μs 198.8 μs -1.7%
stablecoin_1-3 1.056 ms 1.060 ms +0.4%
stablecoin_1-4 215.2 μs 212.9 μs -1.1%
stablecoin_1-5 1.364 ms 1.363 ms -0.1%
stablecoin_1-6 268.4 μs 263.6 μs -1.8%
stablecoin_2-1 929.5 μs 929.0 μs -0.1%
stablecoin_2-2 205.4 μs 201.7 μs -1.8%
stablecoin_2-3 1.082 ms 1.070 ms -1.1%
stablecoin_2-4 219.9 μs 214.3 μs -2.5%
token-account-1 197.9 μs 195.3 μs -1.3%
token-account-2 353.7 μs 345.2 μs -2.4%
uniswap-1 426.3 μs 420.7 μs -1.3%
uniswap-2 230.0 μs 227.0 μs -1.3%
uniswap-3 1.807 ms 1.792 ms -0.8%
uniswap-4 351.0 μs 346.1 μs -1.4%
uniswap-5 1.200 ms 1.185 ms -1.2%
uniswap-6 339.7 μs 328.1 μs -3.4%
vesting-1 359.8 μs 358.9 μs -0.3%

| :------| :------: | :------: | :------: | | TOTAL | 36.34 ms | 36.04 ms | -0.8% |

github-actions[bot] avatar Sep 11 '24 19:09 github-actions[bot]