aptos-core icon indicating copy to clipboard operation
aptos-core copied to clipboard

[storage] turn on feature flag for remove_detailed_error_from_hash

Open areshand opened this issue 1 year ago • 49 comments

Description

for v1.12 testnet release

Type of Change

  • [x] New feature
  • [ ] Bug fix
  • [ ] Breaking change
  • [ ] Performance improvement
  • [ ] Refactoring
  • [ ] Dependency update
  • [ ] Documentation update
  • [ ] Tests

Which Components or Systems Does This Change Impact?

  • [x] Validator Node
  • [x] Full Node (API, Indexer, etc.)
  • [ ] Move/Aptos Virtual Machine
  • [ ] Aptos Framework
  • [ ] Aptos CLI/SDK
  • [ ] Developer Infrastructure
  • [ ] Other (specify)

How Has This Been Tested?

The internal error info was tested previously through unit tests

with devnet

Before the feature is on

transaction https://explorer.aptoslabs.com/txn/1319701?network=devnet Move abort in 0x1::from_bcs: EINVALID_UTF8(0x10001): UTF8 check failed in conversion from bytes to string [with detail error]

Run governance proposal to enable the feature https://explorer.aptoslabs.com/txn/1325739?network=devnet

We still have the error details as expected. Devnet is also running healthy https://explorer.aptoslabs.com/txn/1327821?network=devnet

Key Areas to Review

Checklist

  • [ ] I have read and followed the CONTRIBUTING doc
  • [ ] I have performed a self-review of my own code
  • [ ] I have commented my code, particularly in hard-to-understand areas
  • [ ] I identified and added all stakeholders and component owners affected by this change as reviewers
  • [ ] I tested both happy and unhappy path of the functionality
  • [ ] I have made corresponding changes to the documentation

areshand avatar May 03 '24 22:05 areshand

⏱️ 15h total CI duration on this PR
Job Cumulative Duration Recent Runs
forge-framework-upgrade-test / forge 3h 26m 🟩🟩
rust-targeted-unit-tests 1h 59m 🟥🟥🟥 (+2 more)
rust-move-tests 1h 25m 🟥🟥🟥 (+2 more)
rust-smoke-tests 1h 11m 🟩🟩
rust-lints 55m 🟩🟩🟩🟩 (+2 more)
rust-move-unit-coverage 53m 🟩🟩
windows-build 53m 🟩🟥
execution-performance / single-node-performance 46m 🟥🟥
run-tests-main-branch 42m 🟩🟩🟩🟩🟩 (+5 more)
forge-compat-test / forge 33m 🟩🟩
rust-images / rust-all 31m 🟩🟩
forge-e2e-test / forge 27m 🟩🟩
cli-e2e-tests / run-cli-tests 13m 🟩🟩
general-lints 13m 🟩🟩🟩🟩🟩 (+2 more)
rust-build-cached-packages 12m 🟩🟩
check-dynamic-deps 9m 🟩🟩🟩🟩🟩 (+2 more)
check 8m 🟩🟩
execution-performance / test-target-determinator 7m 🟩🟩
test-target-determinator 7m 🟩🟩
semgrep/ci 3m 🟩🟩🟩🟩🟩 (+2 more)
node-api-compatibility-tests / node-api-compatibility-tests 2m 🟩🟩
file_change_determinator 2m 🟩🟩🟩🟩🟩 (+4 more)
file_change_determinator 1m 🟩🟩🟩🟩🟩 (+2 more)
permission-check 30s 🟩🟩🟩🟩🟩 (+4 more)
permission-check 24s 🟩🟩🟩🟩🟩 (+4 more)
permission-check 24s 🟩🟩🟩🟩🟩 (+4 more)
permission-check 24s 🟩🟩🟩🟩🟩 (+4 more)
file_change_determinator 20s 🟩🟩
permission-check 5s 🟩🟩
determine-docker-build-metadata 4s 🟩🟩

🚨 2 jobs on the last run were significantly faster/slower than expected

Job Duration vs 7d avg Delta
rust-images / rust-all 19m 14m +36%
rust-lints 5m 9m -38%

settingsfeedbackdocs ⋅ learn more about trunk.io

trunk-io[bot] avatar May 03 '24 22:05 trunk-io[bot]

enable here for devnet genesis as well, please:

https://github.com/aptos-labs/aptos-core/blob/bbf569abd260d94bc30fe96da297d2aecb193644/types/src/on_chain_config/aptos_features.rs#L134-L137

msmouse avatar May 03 '24 22:05 msmouse

Codecov Report

Attention: Patch coverage is 6.06061% with 31 lines in your changes are missing coverage. Please review.

Project coverage is 57.6%. Comparing base (6cdd4c2) to head (bf5010f). Report is 5 commits behind head on main.

Files Patch % Lines
types/src/transaction/mod.rs 0.0% 23 Missing :warning:
types/src/proof/definition.rs 0.0% 8 Missing :warning:
Additional details and impacted files
@@            Coverage Diff            @@
##             main   #13197     +/-   ##
=========================================
- Coverage    57.6%    57.6%   -0.1%     
=========================================
  Files         834      834             
  Lines      198397   198430     +33     
=========================================
+ Hits       114318   114320      +2     
- Misses      84079    84110     +31     

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.

codecov[bot] avatar May 10 '24 17:05 codecov[bot]

Forge is running suite framework_upgrade on 01b24e7e3548382dd25440b39a0438a993387f12 ==> 3f70dece805a5d0db26c8f5073a13d39a2c90d6d

github-actions[bot] avatar May 10 '24 17:05 github-actions[bot]

Forge is running suite realistic_env_max_load on 3f70dece805a5d0db26c8f5073a13d39a2c90d6d

github-actions[bot] avatar May 10 '24 17:05 github-actions[bot]

Forge is running suite compat on 01b24e7e3548382dd25440b39a0438a993387f12 ==> 3f70dece805a5d0db26c8f5073a13d39a2c90d6d

github-actions[bot] avatar May 10 '24 17:05 github-actions[bot]

:white_check_mark: Forge suite realistic_env_max_load success on 3f70dece805a5d0db26c8f5073a13d39a2c90d6d

two traffics test: inner traffic : committed: 8151 txn/s, latency: 4808 ms, (p50: 4500 ms, p90: 5600 ms, p99: 10800 ms), latency samples: 3521660
two traffics test : committed: 100 txn/s, latency: 1841 ms, (p50: 1800 ms, p90: 2200 ms, p99: 2300 ms), latency samples: 1780
Latency breakdown for phase 0: ["QsBatchToPos: max: 0.201, avg: 0.201", "QsPosToProposal: max: 0.233, avg: 0.220", "ConsensusProposalToOrdered: max: 0.472, avg: 0.413", "ConsensusOrderedToCommit: max: 0.380, avg: 0.361", "ConsensusProposalToCommit: max: 0.787, avg: 0.774"]
Max round gap was 1 [limit 4] at version 1753121. Max no progress secs was 4.761114 [limit 15] at version 1753121.
Test Ok

github-actions[bot] avatar May 10 '24 18:05 github-actions[bot]

:white_check_mark: Forge suite compat success on 01b24e7e3548382dd25440b39a0438a993387f12 ==> 3f70dece805a5d0db26c8f5073a13d39a2c90d6d

Compatibility test results for 01b24e7e3548382dd25440b39a0438a993387f12 ==> 3f70dece805a5d0db26c8f5073a13d39a2c90d6d (PR)
1. Check liveness of validators at old version: 01b24e7e3548382dd25440b39a0438a993387f12
compatibility::simple-validator-upgrade::liveness-check : committed: 6481 txn/s, latency: 5105 ms, (p50: 5000 ms, p90: 8400 ms, p99: 9900 ms), latency samples: 226860
2. Upgrading first Validator to new version: 3f70dece805a5d0db26c8f5073a13d39a2c90d6d
compatibility::simple-validator-upgrade::single-validator-upgrade : committed: 1424 txn/s, latency: 19856 ms, (p50: 21800 ms, p90: 27100 ms, p99: 28600 ms), latency samples: 74080
3. Upgrading rest of first batch to new version: 3f70dece805a5d0db26c8f5073a13d39a2c90d6d
compatibility::simple-validator-upgrade::half-validator-upgrade : committed: 1582 txn/s, latency: 17621 ms, (p50: 19700 ms, p90: 22700 ms, p99: 23800 ms), latency samples: 83860
4. upgrading second batch to new version: 3f70dece805a5d0db26c8f5073a13d39a2c90d6d
compatibility::simple-validator-upgrade::rest-validator-upgrade : committed: 3543 txn/s, latency: 8909 ms, (p50: 9600 ms, p90: 12700 ms, p99: 13000 ms), latency samples: 145280
5. check swarm health
Compatibility test for 01b24e7e3548382dd25440b39a0438a993387f12 ==> 3f70dece805a5d0db26c8f5073a13d39a2c90d6d passed
Test Ok

github-actions[bot] avatar May 10 '24 18:05 github-actions[bot]

Forge is running suite realistic_env_max_load on 3756113e1a77719b93c767858e9b1c7207ebe406

github-actions[bot] avatar May 10 '24 19:05 github-actions[bot]

Forge is running suite framework_upgrade on 01b24e7e3548382dd25440b39a0438a993387f12 ==> 3756113e1a77719b93c767858e9b1c7207ebe406

github-actions[bot] avatar May 10 '24 19:05 github-actions[bot]

Forge is running suite compat on 01b24e7e3548382dd25440b39a0438a993387f12 ==> 3756113e1a77719b93c767858e9b1c7207ebe406

github-actions[bot] avatar May 10 '24 19:05 github-actions[bot]

:white_check_mark: Forge suite realistic_env_max_load success on 3756113e1a77719b93c767858e9b1c7207ebe406

two traffics test: inner traffic : committed: 7863.962558723379 txn/s, latency: 4982.012280335466 ms, (p50: 4800 ms, p90: 5700 ms, p99: 10500 ms), latency samples: 3400640
two traffics test : committed: 100.0251806937126 txn/s, latency: 1909.1366279069769 ms, (p50: 1900 ms, p90: 2200 ms, p99: 2700 ms), latency samples: 1720
Latency breakdown for phase 0: ["QsBatchToPos: max: 0.202, avg: 0.200", "QsPosToProposal: max: 0.246, avg: 0.233", "ConsensusProposalToOrdered: max: 0.439, avg: 0.418", "ConsensusOrderedToCommit: max: 0.376, avg: 0.365", "ConsensusProposalToCommit: max: 0.794, avg: 0.783"]
Max round gap was 1 [limit 4] at version 1752773. Max no progress secs was 4.370554 [limit 15] at version 1752773.
Test Ok

github-actions[bot] avatar May 10 '24 19:05 github-actions[bot]

:white_check_mark: Forge suite compat success on 01b24e7e3548382dd25440b39a0438a993387f12 ==> 3756113e1a77719b93c767858e9b1c7207ebe406

Compatibility test results for 01b24e7e3548382dd25440b39a0438a993387f12 ==> 3756113e1a77719b93c767858e9b1c7207ebe406 (PR)
1. Check liveness of validators at old version: 01b24e7e3548382dd25440b39a0438a993387f12
compatibility::simple-validator-upgrade::liveness-check : committed: 5118.1062390700745 txn/s, latency: 5774.976366826745 ms, (p50: 5000 ms, p90: 9500 ms, p99: 16000 ms), latency samples: 216560
2. Upgrading first Validator to new version: 3756113e1a77719b93c767858e9b1c7207ebe406
compatibility::simple-validator-upgrade::single-validator-upgrade : committed: 1614.2531987762522 txn/s, latency: 16940.446756329115 ms, (p50: 19600 ms, p90: 24000 ms, p99: 24900 ms), latency samples: 88480
3. Upgrading rest of first batch to new version: 3756113e1a77719b93c767858e9b1c7207ebe406
compatibility::simple-validator-upgrade::half-validator-upgrade : committed: 1502.514929533177 txn/s, latency: 16006.817987533394 ms, (p50: 19200 ms, p90: 22900 ms, p99: 23600 ms), latency samples: 89840
4. upgrading second batch to new version: 3756113e1a77719b93c767858e9b1c7207ebe406
compatibility::simple-validator-upgrade::rest-validator-upgrade : committed: 446.1499473505478 txn/s, submitted: 604.9695885969664 txn/s, expired: 158.8196412464186 txn/s, latency: 55784.69185396115 ms, (p50: 57100 ms, p90: 58600 ms, p99: 59000 ms), latency samples: 29499
5. check swarm health
Compatibility test for 01b24e7e3548382dd25440b39a0438a993387f12 ==> 3756113e1a77719b93c767858e9b1c7207ebe406 passed
Test Ok

github-actions[bot] avatar May 10 '24 19:05 github-actions[bot]

:white_check_mark: Forge suite framework_upgrade success on 01b24e7e3548382dd25440b39a0438a993387f12 ==> 3756113e1a77719b93c767858e9b1c7207ebe406

Compatibility test results for 01b24e7e3548382dd25440b39a0438a993387f12 ==> 3756113e1a77719b93c767858e9b1c7207ebe406 (PR)
Upgrade the nodes to version: 3756113e1a77719b93c767858e9b1c7207ebe406
framework_upgrade::framework-upgrade::full-framework-upgrade : committed: 1170.2468453669192 txn/s, submitted: 1172.938614993985 txn/s, failed submission: 2.691769627065944 txn/s, expired: 2.691769627065944 txn/s, latency: 2564.226528656316 ms, (p50: 2100 ms, p90: 4500 ms, p99: 7200 ms), latency samples: 104340
framework_upgrade::framework-upgrade::full-framework-upgrade : committed: 1239.6905978617942 txn/s, submitted: 1242.598044690624 txn/s, failed submission: 2.907446828829754 txn/s, expired: 2.907446828829754 txn/s, latency: 2591.6538066029225 ms, (p50: 2100 ms, p90: 4500 ms, p99: 5700 ms), latency samples: 110860
5. check swarm health
Compatibility test for 01b24e7e3548382dd25440b39a0438a993387f12 ==> 3756113e1a77719b93c767858e9b1c7207ebe406 passed
Upgrade the remaining nodes to version: 3756113e1a77719b93c767858e9b1c7207ebe406
framework_upgrade::framework-upgrade::full-framework-upgrade : committed: 1096.1574857657035 txn/s, submitted: 1098.3541941540116 txn/s, failed submission: 2.196708388308023 txn/s, expired: 2.196708388308023 txn/s, latency: 2702.7761022044087 ms, (p50: 2100 ms, p90: 4800 ms, p99: 6700 ms), latency samples: 99800
Test Ok

github-actions[bot] avatar May 10 '24 20:05 github-actions[bot]

Forge is running suite framework_upgrade on 01b24e7e3548382dd25440b39a0438a993387f12 ==> 6f75b9b2e7fce810e764079a7549977dea95d593

github-actions[bot] avatar May 11 '24 00:05 github-actions[bot]

Forge is running suite realistic_env_max_load on 6f75b9b2e7fce810e764079a7549977dea95d593

github-actions[bot] avatar May 11 '24 00:05 github-actions[bot]

Forge is running suite compat on 01b24e7e3548382dd25440b39a0438a993387f12 ==> 6f75b9b2e7fce810e764079a7549977dea95d593

github-actions[bot] avatar May 11 '24 00:05 github-actions[bot]

:white_check_mark: Forge suite realistic_env_max_load success on 6f75b9b2e7fce810e764079a7549977dea95d593

two traffics test: inner traffic : committed: 7353.569551912952 txn/s, latency: 5320.970813129664 ms, (p50: 5100 ms, p90: 6200 ms, p99: 11100 ms), latency samples: 3184240
two traffics test : committed: 99.89548529767143 txn/s, latency: 1960.8627777777779 ms, (p50: 1900 ms, p90: 2200 ms, p99: 4600 ms), latency samples: 1800
Latency breakdown for phase 0: ["QsBatchToPos: max: 0.204, avg: 0.201", "QsPosToProposal: max: 0.369, avg: 0.275", "ConsensusProposalToOrdered: max: 0.487, avg: 0.442", "ConsensusOrderedToCommit: max: 0.401, avg: 0.387", "ConsensusProposalToCommit: max: 0.867, avg: 0.829"]
Max round gap was 1 [limit 4] at version 1348616. Max no progress secs was 4.780177 [limit 15] at version 1348616.
Test Ok

github-actions[bot] avatar May 11 '24 00:05 github-actions[bot]

:white_check_mark: Forge suite compat success on 01b24e7e3548382dd25440b39a0438a993387f12 ==> 6f75b9b2e7fce810e764079a7549977dea95d593

Compatibility test results for 01b24e7e3548382dd25440b39a0438a993387f12 ==> 6f75b9b2e7fce810e764079a7549977dea95d593 (PR)
1. Check liveness of validators at old version: 01b24e7e3548382dd25440b39a0438a993387f12
compatibility::simple-validator-upgrade::liveness-check : committed: 6148.184318840567 txn/s, latency: 5005.955109024351 ms, (p50: 4800 ms, p90: 5400 ms, p99: 10300 ms), latency samples: 251320
2. Upgrading first Validator to new version: 6f75b9b2e7fce810e764079a7549977dea95d593
compatibility::simple-validator-upgrade::single-validator-upgrade : committed: 1674.3497556801105 txn/s, latency: 15860.98635970601 ms, (p50: 18300 ms, p90: 23100 ms, p99: 25000 ms), latency samples: 92520
3. Upgrading rest of first batch to new version: 6f75b9b2e7fce810e764079a7549977dea95d593
compatibility::simple-validator-upgrade::half-validator-upgrade : committed: 1667.3702602742937 txn/s, latency: 17078.067461077844 ms, (p50: 19900 ms, p90: 22900 ms, p99: 23700 ms), latency samples: 83500
4. upgrading second batch to new version: 6f75b9b2e7fce810e764079a7549977dea95d593
compatibility::simple-validator-upgrade::rest-validator-upgrade : committed: 3427.0662906612993 txn/s, latency: 9231.553277242503 ms, (p50: 9700 ms, p90: 12700 ms, p99: 13100 ms), latency samples: 147380
5. check swarm health
Compatibility test for 01b24e7e3548382dd25440b39a0438a993387f12 ==> 6f75b9b2e7fce810e764079a7549977dea95d593 passed
Test Ok

github-actions[bot] avatar May 11 '24 00:05 github-actions[bot]

:white_check_mark: Forge suite framework_upgrade success on 01b24e7e3548382dd25440b39a0438a993387f12 ==> 6f75b9b2e7fce810e764079a7549977dea95d593

Compatibility test results for 01b24e7e3548382dd25440b39a0438a993387f12 ==> 6f75b9b2e7fce810e764079a7549977dea95d593 (PR)
Upgrade the nodes to version: 6f75b9b2e7fce810e764079a7549977dea95d593
framework_upgrade::framework-upgrade::full-framework-upgrade : committed: 1182.5035795289864 txn/s, submitted: 1185.6449552620804 txn/s, failed submission: 3.1413757330940815 txn/s, expired: 3.1413757330940815 txn/s, latency: 2567.137125237192 ms, (p50: 2100 ms, p90: 4700 ms, p99: 6500 ms), latency samples: 105400
framework_upgrade::framework-upgrade::full-framework-upgrade : committed: 1215.3278576839623 txn/s, submitted: 1217.341471586605 txn/s, failed submission: 2.0136139026427946 txn/s, expired: 2.0136139026427946 txn/s, latency: 2551.5316273932253 ms, (p50: 2100 ms, p90: 4200 ms, p99: 7200 ms), latency samples: 108640
5. check swarm health
Compatibility test for 01b24e7e3548382dd25440b39a0438a993387f12 ==> 6f75b9b2e7fce810e764079a7549977dea95d593 passed
Upgrade the remaining nodes to version: 6f75b9b2e7fce810e764079a7549977dea95d593
framework_upgrade::framework-upgrade::full-framework-upgrade : committed: 1254.276079843485 txn/s, submitted: 1258.6708804035532 txn/s, failed submission: 4.394800560068273 txn/s, expired: 4.394800560068273 txn/s, latency: 2524.438936580238 ms, (p50: 2100 ms, p90: 4500 ms, p99: 6000 ms), latency samples: 114160
Test Ok

github-actions[bot] avatar May 11 '24 01:05 github-actions[bot]

Forge is running suite realistic_env_max_load on 2ee5dace82d220976ebf44814497933d68c40aba

github-actions[bot] avatar May 11 '24 03:05 github-actions[bot]

Forge is running suite framework_upgrade on 01b24e7e3548382dd25440b39a0438a993387f12 ==> 2ee5dace82d220976ebf44814497933d68c40aba

github-actions[bot] avatar May 11 '24 03:05 github-actions[bot]

Forge is running suite compat on 01b24e7e3548382dd25440b39a0438a993387f12 ==> 2ee5dace82d220976ebf44814497933d68c40aba

github-actions[bot] avatar May 11 '24 03:05 github-actions[bot]

:white_check_mark: Forge suite compat success on 01b24e7e3548382dd25440b39a0438a993387f12 ==> 2ee5dace82d220976ebf44814497933d68c40aba

Compatibility test results for 01b24e7e3548382dd25440b39a0438a993387f12 ==> 2ee5dace82d220976ebf44814497933d68c40aba (PR)
1. Check liveness of validators at old version: 01b24e7e3548382dd25440b39a0438a993387f12
compatibility::simple-validator-upgrade::liveness-check : committed: 6839.24623915166 txn/s, latency: 4840.20404662781 ms, (p50: 5000 ms, p90: 7400 ms, p99: 8700 ms), latency samples: 240200
2. Upgrading first Validator to new version: 2ee5dace82d220976ebf44814497933d68c40aba
compatibility::simple-validator-upgrade::single-validator-upgrade : committed: 1767.8923562034436 txn/s, latency: 16419.27508779631 ms, (p50: 18600 ms, p90: 23800 ms, p99: 24100 ms), latency samples: 91120
3. Upgrading rest of first batch to new version: 2ee5dace82d220976ebf44814497933d68c40aba
compatibility::simple-validator-upgrade::half-validator-upgrade : committed: 1619.6017562391244 txn/s, latency: 17204.55023046785 ms, (p50: 19300 ms, p90: 23100 ms, p99: 23700 ms), latency samples: 86780
4. upgrading second batch to new version: 2ee5dace82d220976ebf44814497933d68c40aba
compatibility::simple-validator-upgrade::rest-validator-upgrade : committed: 3030.844206941147 txn/s, latency: 10040.666260789149 ms, (p50: 9900 ms, p90: 12400 ms, p99: 12900 ms), latency samples: 129760
5. check swarm health
Compatibility test for 01b24e7e3548382dd25440b39a0438a993387f12 ==> 2ee5dace82d220976ebf44814497933d68c40aba passed
Test Ok

github-actions[bot] avatar May 11 '24 03:05 github-actions[bot]

:white_check_mark: Forge suite realistic_env_max_load success on 2ee5dace82d220976ebf44814497933d68c40aba

two traffics test: inner traffic : committed: 8623.265777439374 txn/s, latency: 4550.526464644836 ms, (p50: 4400 ms, p90: 5300 ms, p99: 9900 ms), latency samples: 3721380
two traffics test : committed: 99.88804320073478 txn/s, latency: 1838.3695652173913 ms, (p50: 1800 ms, p90: 2100 ms, p99: 2500 ms), latency samples: 1840
Latency breakdown for phase 0: ["QsBatchToPos: max: 0.205, avg: 0.202", "QsPosToProposal: max: 0.223, avg: 0.205", "ConsensusProposalToOrdered: max: 0.431, avg: 0.402", "ConsensusOrderedToCommit: max: 0.388, avg: 0.370", "ConsensusProposalToCommit: max: 0.786, avg: 0.772"]
Max round gap was 1 [limit 4] at version 1730689. Max no progress secs was 5.071468 [limit 15] at version 1730689.
Test Ok

github-actions[bot] avatar May 11 '24 03:05 github-actions[bot]

:white_check_mark: Forge suite framework_upgrade success on 01b24e7e3548382dd25440b39a0438a993387f12 ==> 2ee5dace82d220976ebf44814497933d68c40aba

Compatibility test results for 01b24e7e3548382dd25440b39a0438a993387f12 ==> 2ee5dace82d220976ebf44814497933d68c40aba (PR)
Upgrade the nodes to version: 2ee5dace82d220976ebf44814497933d68c40aba
framework_upgrade::framework-upgrade::full-framework-upgrade : committed: 1281.271104427355 txn/s, submitted: 1283.0624656359219 txn/s, failed submission: 1.791361208566732 txn/s, expired: 1.791361208566732 txn/s, latency: 2380.377874868927 ms, (p50: 2000 ms, p90: 4200 ms, p99: 6500 ms), latency samples: 114440
framework_upgrade::framework-upgrade::full-framework-upgrade : committed: 1221.4846108696684 txn/s, submitted: 1224.6051919923282 txn/s, failed submission: 3.1205811226597366 txn/s, expired: 3.1205811226597366 txn/s, latency: 2621.4369890510948 ms, (p50: 2100 ms, p90: 4500 ms, p99: 6900 ms), latency samples: 109600
5. check swarm health
Compatibility test for 01b24e7e3548382dd25440b39a0438a993387f12 ==> 2ee5dace82d220976ebf44814497933d68c40aba passed
Upgrade the remaining nodes to version: 2ee5dace82d220976ebf44814497933d68c40aba
framework_upgrade::framework-upgrade::full-framework-upgrade : committed: 1176.3378272048064 txn/s, submitted: 1178.3761484302286 txn/s, failed submission: 2.0383212254222673 txn/s, expired: 2.0383212254222673 txn/s, latency: 2596.7317289179823 ms, (p50: 2400 ms, p90: 4200 ms, p99: 7200 ms), latency samples: 103880
Test Ok

github-actions[bot] avatar May 11 '24 04:05 github-actions[bot]

Forge is running suite realistic_env_max_load on d7b981e32157288833946eed423d60f4f73b8aad

github-actions[bot] avatar May 11 '24 19:05 github-actions[bot]

Forge is running suite compat on 01b24e7e3548382dd25440b39a0438a993387f12 ==> d7b981e32157288833946eed423d60f4f73b8aad

github-actions[bot] avatar May 11 '24 19:05 github-actions[bot]

Forge is running suite framework_upgrade on 01b24e7e3548382dd25440b39a0438a993387f12 ==> d7b981e32157288833946eed423d60f4f73b8aad

github-actions[bot] avatar May 11 '24 19:05 github-actions[bot]

:white_check_mark: Forge suite compat success on 01b24e7e3548382dd25440b39a0438a993387f12 ==> d7b981e32157288833946eed423d60f4f73b8aad

Compatibility test results for 01b24e7e3548382dd25440b39a0438a993387f12 ==> d7b981e32157288833946eed423d60f4f73b8aad (PR)
1. Check liveness of validators at old version: 01b24e7e3548382dd25440b39a0438a993387f12
compatibility::simple-validator-upgrade::liveness-check : committed: 5333.965700022138 txn/s, latency: 5544.477768262396 ms, (p50: 4800 ms, p90: 9600 ms, p99: 11300 ms), latency samples: 233540
2. Upgrading first Validator to new version: d7b981e32157288833946eed423d60f4f73b8aad
compatibility::simple-validator-upgrade::single-validator-upgrade : committed: 1445.4352782687808 txn/s, latency: 16424.423150870844 ms, (p50: 19200 ms, p90: 23700 ms, p99: 31100 ms), latency samples: 88420
3. Upgrading rest of first batch to new version: d7b981e32157288833946eed423d60f4f73b8aad
compatibility::simple-validator-upgrade::half-validator-upgrade : committed: 1826.1884614139701 txn/s, latency: 15697.582202095155 ms, (p50: 18100 ms, p90: 22300 ms, p99: 22600 ms), latency samples: 91640
4. upgrading second batch to new version: d7b981e32157288833946eed423d60f4f73b8aad
compatibility::simple-validator-upgrade::rest-validator-upgrade : committed: 3303.191592564841 txn/s, latency: 9443.244367294885 ms, (p50: 9700 ms, p90: 12600 ms, p99: 12900 ms), latency samples: 141140
5. check swarm health
Compatibility test for 01b24e7e3548382dd25440b39a0438a993387f12 ==> d7b981e32157288833946eed423d60f4f73b8aad passed
Test Ok

github-actions[bot] avatar May 11 '24 19:05 github-actions[bot]