hydra icon indicating copy to clipboard operation
hydra copied to clipboard

Change Era from BabbageEra to ConwayEra

Open locallycompact opened this issue 1 year ago • 4 comments

Switch hydra from BabbageEra to ConwayEra. A Conway compatible hydra-node can be built using

nix build .#hydra-node

or a docker image with

nix build .#docker-hydra-node

  • [ ] CHANGELOG updated or not needed
  • [ ] Documentation updated or not needed
  • [ ] Haddocks updated or not needed
  • [ ] No new TODOs introduced or explained herafter

locallycompact avatar Mar 05 '24 18:03 locallycompact

@ch1bo Here is the withoutProtocolUpdates error. https://github.com/input-output-hk/hydra/actions/runs/8161289799/job/22309727685?pr=1338#step:5:2151

locallycompact avatar Mar 05 '24 19:03 locallycompact

@ch1bo Here is the withoutProtocolUpdates error. https://github.com/input-output-hk/hydra/actions/runs/8161289799/job/22309727685?pr=1338#step:5:2151

Protocol updates in the tx body seem to be bound only up to protocol version 8 (= babbage) as they (most likely) are done differently in conway (= protocol version 9)

image

Consequently, let's not clear that field (i.e. the updateTxBodyL) in the generator, but see whether the normal arbitrary transactions are fine within our tests. If not, we might need to tweak the generator to exclude any of the governance actions - the equivalents of protocol updates.

ch1bo avatar Mar 06 '24 18:03 ch1bo

Transaction costs

Sizes and execution budgets for Hydra protocol transactions. Note that unlisted parameters are currently using arbitrary values and results are not fully deterministic and comparable to previous runs.

Metadata
Generated at 2024-09-05 12:47:43.99006637 UTC
Max. memory units 14000000
Max. CPU units 10000000000
Max. tx size (kB) 16384

Script summary

Name Hash Size (Bytes)
νInitial 2fac819a1f4f14e29639d1414220d2a18b6abd6b8e444d88d0dda8ff 3799
νCommit 2043a9f1a685bcf491413a5f139ee42e335157c8c6bc8d9e4018669d 1743
νHead bd9fad235c871fb7f837c767593018a84be3083ff80f9dab5f1c55f9 10194
μHead c8038945816586c4d38926ee63bba67821eb863794220ebbd0bf79ee* 4607
  • The minting policy hash is only usable for comparison. As the script is parameterized, the actual script is unique per head.

Init transaction costs

Parties Tx size % max Mem % max CPU Min fee ₳
1 5195 5.88 2.33 0.44
2 5394 6.99 2.76 0.46
3 5597 8.46 3.34 0.49
5 5998 11.21 4.43 0.54
10 7003 18.11 7.16 0.66
56 16254 81.43 32.21 1.76

Commit transaction costs

This uses ada-only outputs for better comparability.

UTxO Tx size % max Mem % max CPU Min fee ₳
1 569 10.52 4.15 0.29
2 754 13.86 5.65 0.34
3 947 17.33 7.20 0.38
5 1319 24.65 10.44 0.48
10 2256 45.22 19.36 0.75
20 4124 95.99 40.76 1.40

CollectCom transaction costs

Parties UTxO (bytes) Tx size % max Mem % max CPU Min fee ₳
1 57 560 21.49 8.43 0.41
2 113 671 32.13 12.75 0.53
3 169 782 47.29 18.88 0.70
4 228 893 57.55 23.29 0.82
5 283 1004 75.51 30.71 1.03
6 340 1116 93.70 38.31 1.23

Cost of Decrement Transaction

Parties Tx size % max Mem % max CPU Min fee ₳
1 636 17.71 7.79 0.38
2 806 19.33 9.16 0.41
3 933 20.65 10.41 0.43
5 1365 27.26 14.37 0.53
10 2161 36.03 21.42 0.69
50 7930 97.77 74.58 1.83

Close transaction costs

Parties Tx size % max Mem % max CPU Min fee ₳
1 664 20.98 9.41 0.42
2 792 22.41 10.79 0.44
3 986 24.30 12.54 0.48
5 1213 26.86 15.03 0.53
10 2128 36.08 23.76 0.71
49 8076 98.84 83.48 1.91

Contest transaction costs

Parties Tx size % max Mem % max CPU Min fee ₳
1 690 27.10 11.65 0.48
2 853 29.32 13.50 0.52
3 951 30.75 14.71 0.55
5 1416 35.86 19.06 0.64
10 2013 43.99 26.07 0.78
39 6521 99.59 73.88 1.77

Abort transaction costs

There is some variation due to the random mixture of initial and already committed outputs.

Parties Tx size % max Mem % max CPU Min fee ₳
1 5105 17.43 7.59 0.57
2 5238 29.27 12.91 0.71
3 5461 44.01 19.55 0.89
4 5539 60.00 26.65 1.07
5 5579 71.40 31.59 1.20
6 5808 94.65 42.10 1.47

FanOut transaction costs

Involves spending head output and burning head tokens. Uses ada-only UTxO for better comparability.

Parties UTxO UTxO (bytes) Tx size % max Mem % max CPU Min fee ₳
5 0 0 5033 7.36 3.11 0.45
5 1 57 5068 8.88 3.99 0.47
5 5 284 5202 13.60 6.92 0.54
5 10 570 5373 19.06 10.39 0.62
5 20 1139 5713 30.58 17.60 0.78
5 30 1711 6057 41.70 24.63 0.93
5 40 2278 6393 53.03 31.76 1.09
5 50 2842 6728 64.37 38.89 1.25
5 81 4616 7789 99.92 61.18 1.74

End-to-end benchmark results

This page is intended to collect the latest end-to-end benchmark results produced by Hydra's continuous integration (CI) system from the latest master code.

Please note that these results are approximate as they are currently produced from limited cloud VMs and not controlled hardware. Rather than focusing on the absolute results, the emphasis should be on relative results, such as how the timings for a scenario evolve as the code changes.

Generated at 2024-09-05 12:50:01.549962691 UTC

Baseline Scenario

Number of nodes 1
Number of txs 3000
Avg. Confirmation Time (ms) 4.126726911
P99 7.703580429999997ms
P95 5.081546599999999ms
P50 3.9123945ms
Number of Invalid txs 0

Three local nodes

Number of nodes 3
Number of txs 9000
Avg. Confirmation Time (ms) 23.007426874
P99 113.3222350300001ms
P95 31.42892225ms
P50 20.537886ms
Number of Invalid txs 0

github-actions[bot] avatar Mar 13 '24 14:03 github-actions[bot]

Test Results

459 tests   - 5   454 :white_check_mark:  - 3   20m 29s :stopwatch: + 4m 5s 138 suites  - 1     5 :zzz:  - 2    5 files   ±0     0 :x: ±0 

Results for commit 25e7630a. ± Comparison against base commit 0062556b.

This pull request removes 23 and adds 18 tests. Note that renamed tests count towards both.
Hydra.API.ClientInput/JSON encoding of (ReasonablySized (ClientInput (Tx BabbageEra))) ‑ allows to encode values with aeson and read them back
Hydra.API.ClientInput/JSON encoding of (ReasonablySized (ClientInput (Tx BabbageEra))) ‑ produces the same JSON as is found in golden/ReasonablySized (ClientInput (Tx BabbageEra)).json
Hydra.API.HTTPServer/JSON encoding of (ReasonablySized (DraftCommitTxRequest (Tx BabbageEra))) ‑ allows to encode values with aeson and read them back
Hydra.API.HTTPServer/JSON encoding of (ReasonablySized (DraftCommitTxRequest (Tx BabbageEra))) ‑ produces the same JSON as is found in golden/ReasonablySized (DraftCommitTxRequest (Tx BabbageEra)).json
Hydra.API.HTTPServer/JSON encoding of (ReasonablySized (DraftCommitTxResponse (Tx BabbageEra))) ‑ allows to encode values with aeson and read them back
Hydra.API.HTTPServer/JSON encoding of (ReasonablySized (DraftCommitTxResponse (Tx BabbageEra))) ‑ produces the same JSON as is found in golden/ReasonablySized (DraftCommitTxResponse (Tx BabbageEra)).json
Hydra.API.HTTPServer/JSON encoding of (ReasonablySized (SubmitTxRequest (Tx BabbageEra))) ‑ allows to encode values with aeson and read them back
Hydra.API.HTTPServer/JSON encoding of (ReasonablySized (SubmitTxRequest (Tx BabbageEra))) ‑ produces the same JSON as is found in golden/ReasonablySized (SubmitTxRequest (Tx BabbageEra)).json
Hydra.API.ServerOutput/JSON encoding of (ReasonablySized (ServerOutput (Tx BabbageEra))) ‑ allows to encode values with aeson and read them back
Hydra.API.ServerOutput/JSON encoding of (ReasonablySized (ServerOutput (Tx BabbageEra))) ‑ produces the same JSON as is found in golden/ReasonablySized (ServerOutput (Tx BabbageEra)).json
…
Hydra.API.ClientInput/JSON encoding of (ReasonablySized (ClientInput (Tx ConwayEra))) ‑ allows to encode values with aeson and read them back
Hydra.API.ClientInput/JSON encoding of (ReasonablySized (ClientInput (Tx ConwayEra))) ‑ produces the same JSON as is found in golden/ReasonablySized (ClientInput (Tx ConwayEra)).json
Hydra.API.HTTPServer/JSON encoding of (ReasonablySized (DraftCommitTxRequest (Tx ConwayEra))) ‑ allows to encode values with aeson and read them back
Hydra.API.HTTPServer/JSON encoding of (ReasonablySized (DraftCommitTxRequest (Tx ConwayEra))) ‑ produces the same JSON as is found in golden/ReasonablySized (DraftCommitTxRequest (Tx ConwayEra)).json
Hydra.API.HTTPServer/JSON encoding of (ReasonablySized (DraftCommitTxResponse (Tx ConwayEra))) ‑ allows to encode values with aeson and read them back
Hydra.API.HTTPServer/JSON encoding of (ReasonablySized (DraftCommitTxResponse (Tx ConwayEra))) ‑ produces the same JSON as is found in golden/ReasonablySized (DraftCommitTxResponse (Tx ConwayEra)).json
Hydra.API.HTTPServer/JSON encoding of (ReasonablySized (SubmitTxRequest (Tx ConwayEra))) ‑ allows to encode values with aeson and read them back
Hydra.API.HTTPServer/JSON encoding of (ReasonablySized (SubmitTxRequest (Tx ConwayEra))) ‑ produces the same JSON as is found in golden/ReasonablySized (SubmitTxRequest (Tx ConwayEra)).json
Hydra.API.ServerOutput/JSON encoding of (ReasonablySized (ServerOutput (Tx ConwayEra))) ‑ allows to encode values with aeson and read them back
Hydra.API.ServerOutput/JSON encoding of (ReasonablySized (ServerOutput (Tx ConwayEra))) ‑ produces the same JSON as is found in golden/ReasonablySized (ServerOutput (Tx ConwayEra)).json
…

:recycle: This comment has been updated with latest results.

github-actions[bot] avatar Mar 14 '24 13:03 github-actions[bot]

Transaction costs

Sizes and execution budgets for Hydra protocol transactions. Note that unlisted parameters are currently using arbitrary values and results are not fully deterministic and comparable to previous runs.

Metadata
Generated at 2024-07-22 08:37:18.679558094 UTC
Max. memory units 14000000
Max. CPU units 10000000000
Max. tx size (kB) 16384

Script summary

Name Hash Size (Bytes)
νInitial e6685648e63ab510b49d2ce632c570d2ef53f44f3cbdf82ed553906c 4081
νCommit fce3b967fb72f4a3be8dfa30defe413258ff453e5d32d6752d83f9cf 2060
νHead 10a116037de398d6b0721152336d602f0ea653eb3dfe540d5da63fe4 9367
μHead 4f93fdfeda690e005d3f5a180208edd3f65ddd0892466ad7f4dd678b* 4236
  • The minting policy hash is only usable for comparison. As the script is parameterized, the actual script is unique per head.

Init transaction costs

Parties Tx size % max Mem % max CPU Min fee ₳
1 4825 5.75 2.27 0.43
2 5030 7.18 2.84 0.45
3 5231 8.55 3.38 0.47
5 5627 11.12 4.39 0.52
10 6634 18.24 7.22 0.64
58 16282 84.33 33.36 1.79

Commit transaction costs

This uses ada-only outputs for better comparability.

UTxO Tx size % max Mem % max CPU Min fee ₳
1 567 9.25 3.68 0.28
2 756 11.94 4.93 0.32
3 944 14.70 6.20 0.36
5 1323 20.44 8.83 0.44
10 2253 36.05 15.86 0.66
26 5258 98.14 42.75 1.48

CollectCom transaction costs

Parties UTxO (bytes) Tx size % max Mem % max CPU Min fee ₳
1 57 555 14.13 5.69 0.33
2 113 666 22.50 9.15 0.43
3 171 777 32.95 13.50 0.55
4 228 888 44.62 18.40 0.68
5 282 999 56.63 23.53 0.82
6 336 1111 72.48 30.21 1.00
7 394 1222 89.90 37.57 1.20

Close transaction costs

Parties Tx size % max Mem % max CPU Min fee ₳
1 602 8.04 4.51 0.27
2 756 8.74 5.59 0.29
3 830 9.02 6.29 0.31
5 1147 10.81 8.74 0.35
10 1979 15.21 14.96 0.47
50 8254 49.75 63.32 1.37

Contest transaction costs

Parties Tx size % max Mem % max CPU Min fee ₳
1 653 8.35 4.65 0.28
2 794 9.04 5.71 0.30
3 924 9.72 6.76 0.32
5 1340 12.62 10.07 0.38
10 1978 16.15 15.30 0.48
50 7651 46.16 59.83 1.29

Abort transaction costs

There is some variation due to the random mixture of initial and already committed outputs.

Parties Tx size % max Mem % max CPU Min fee ₳
1 4623 13.49 5.63 0.50
2 4870 28.04 12.39 0.68
3 5059 42.10 18.72 0.85
4 5148 57.35 25.48 1.02
5 5204 69.05 30.52 1.16
6 5366 95.03 42.21 1.46

FanOut transaction costs

Involves spending head output and burning head tokens. Uses ada-only UTxO for better comparability.

Parties UTxO UTxO (bytes) Tx size % max Mem % max CPU Min fee ₳
5 0 0 4661 7.63 3.20 0.44
5 1 57 4695 9.14 4.07 0.46
5 5 285 4832 13.81 6.96 0.52
5 10 567 4998 18.61 10.13 0.59
5 20 1138 5339 29.99 17.24 0.75
5 30 1710 5683 41.17 24.26 0.91
5 40 2278 6021 52.17 31.21 1.06
5 50 2849 6362 63.56 38.32 1.22
5 82 4667 7444 99.62 60.94 1.72

End-to-end benchmark results

This page is intended to collect the latest end-to-end benchmark results produced by Hydra's continuous integration (CI) system from the latest master code.

Please note that these results are approximate as they are currently produced from limited cloud VMs and not controlled hardware. Rather than focusing on the absolute results, the emphasis should be on relative results, such as how the timings for a scenario evolve as the code changes.

Generated at 2024-07-22 08:39:48.128471634 UTC

Baseline Scenario

Number of nodes 1
Number of txs 3000
Avg. Confirmation Time (ms) 4.157384863
P99 7.20362825999994ms
P95 5.249309099999996ms
P50 3.90223ms
Number of Invalid txs 0

Three local nodes

Number of nodes 3
Number of txs 9000
Avg. Confirmation Time (ms) 22.327715191
P99 112.65735542000004ms
P95 31.0648675ms
P50 19.867236ms
Number of Invalid txs 0

github-actions[bot] avatar Jul 22 '24 08:07 github-actions[bot]

Transaction costs

Sizes and execution budgets for Hydra protocol transactions. Note that unlisted parameters are currently using arbitrary values and results are not fully deterministic and comparable to previous runs.

Metadata
Generated at 2024-07-22 09:39:40.700446126 UTC
Max. memory units 14000000
Max. CPU units 10000000000
Max. tx size (kB) 16384

Script summary

Name Hash Size (Bytes)
νInitial e6685648e63ab510b49d2ce632c570d2ef53f44f3cbdf82ed553906c 4081
νCommit fce3b967fb72f4a3be8dfa30defe413258ff453e5d32d6752d83f9cf 2060
νHead 10a116037de398d6b0721152336d602f0ea653eb3dfe540d5da63fe4 9367
μHead 4f93fdfeda690e005d3f5a180208edd3f65ddd0892466ad7f4dd678b* 4236
  • The minting policy hash is only usable for comparison. As the script is parameterized, the actual script is unique per head.

Init transaction costs

Parties Tx size % max Mem % max CPU Min fee ₳
1 4826 5.69 2.25 0.42
2 5030 6.99 2.76 0.45
3 5226 8.56 3.39 0.47
5 5630 11.49 4.55 0.52
10 6632 18.11 7.16 0.64
58 16284 84.27 33.33 1.79

Commit transaction costs

This uses ada-only outputs for better comparability.

UTxO Tx size % max Mem % max CPU Min fee ₳
1 569 9.25 3.68 0.28
2 758 11.94 4.93 0.32
3 946 14.70 6.20 0.36
5 1315 20.44 8.83 0.44
10 2254 36.05 15.86 0.66
26 5255 98.14 42.75 1.48

CollectCom transaction costs

Parties UTxO (bytes) Tx size % max Mem % max CPU Min fee ₳
1 57 555 14.13 5.69 0.33
2 114 666 22.50 9.15 0.43
3 170 777 32.44 13.32 0.54
4 225 888 43.29 17.91 0.67
5 281 999 57.45 23.84 0.83
6 338 1111 72.12 30.09 1.00
7 396 1222 86.57 36.38 1.17

Close transaction costs

Parties Tx size % max Mem % max CPU Min fee ₳
1 609 8.08 4.53 0.28
2 694 8.36 5.25 0.29
3 867 9.40 6.61 0.31
5 1163 10.68 8.71 0.35
10 1847 14.74 14.39 0.45
50 4660 39.25 23.78 0.84

Contest transaction costs

Parties Tx size % max Mem % max CPU Min fee ₳
1 629 8.40 4.65 0.28
2 845 9.51 6.07 0.31
3 857 9.30 6.40 0.31
5 1316 12.44 9.92 0.38
10 2028 16.32 15.55 0.48
50 8480 54.07 65.96 1.44

Abort transaction costs

There is some variation due to the random mixture of initial and already committed outputs.

Parties Tx size % max Mem % max CPU Min fee ₳
1 4698 16.43 7.17 0.54
2 4804 23.87 10.35 0.63
3 5005 40.82 18.08 0.83
4 5124 53.61 23.69 0.98
5 5266 70.47 31.22 1.18
6 5359 93.87 41.61 1.44

FanOut transaction costs

Involves spending head output and burning head tokens. Uses ada-only UTxO for better comparability.

Parties UTxO UTxO (bytes) Tx size % max Mem % max CPU Min fee ₳
5 0 0 4662 7.63 3.20 0.44
5 1 57 4695 9.14 4.07 0.46
5 5 283 4829 13.30 6.75 0.52
5 10 570 5002 19.20 10.39 0.60
5 20 1137 5338 29.99 17.24 0.75
5 30 1705 5678 41.76 24.52 0.91
5 40 2279 6023 52.36 31.29 1.06
5 50 2844 6357 63.76 38.41 1.22
5 82 4670 7447 99.82 61.02 1.72

End-to-end benchmark results

This page is intended to collect the latest end-to-end benchmark results produced by Hydra's continuous integration (CI) system from the latest master code.

Please note that these results are approximate as they are currently produced from limited cloud VMs and not controlled hardware. Rather than focusing on the absolute results, the emphasis should be on relative results, such as how the timings for a scenario evolve as the code changes.

Generated at 2024-07-22 09:41:30.124151706 UTC

Baseline Scenario

Number of nodes 1
Number of txs 3000
Avg. Confirmation Time (ms) 4.395327218
P99 8.298198629999995ms
P95 5.7749046ms
P50 4.1818205ms
Number of Invalid txs 0

Three local nodes

Number of nodes 3
Number of txs 9000
Avg. Confirmation Time (ms) 22.237972718
P99 111.26133579000006ms
P95 30.448627399999992ms
P50 19.881816ms
Number of Invalid txs 0

github-actions[bot] avatar Jul 22 '24 09:07 github-actions[bot]