aptos-core
aptos-core copied to clipboard

Published 20 hours ago •

Reame
Issues

smoke test for fed keyless

Open zjma opened this issue 1 year ago • 2 comments

Description

Type of Change

[ ] New feature
[ ] Bug fix
[ ] Breaking change
[ ] Performance improvement
[ ] Refactoring
[ ] Dependency update
[ ] Documentation update
[ ] Tests

Which Components or Systems Does This Change Impact?

[ ] Validator Node
[ ] Full Node (API, Indexer, etc.)
[ ] Move/Aptos Virtual Machine
[ ] Aptos Framework
[ ] Aptos CLI/SDK
[ ] Developer Infrastructure
[ ] Other (specify)

How Has This Been Tested?

Key Areas to Review

Checklist

[ ] I have read and followed the CONTRIBUTING doc
[ ] I have performed a self-review of my own code
[ ] I have commented my code, particularly in hard-to-understand areas
[ ] I identified and added all stakeholders and component owners affected by this change as reviewers
[ ] I tested both happy and unhappy path of the functionality
[ ] I have made corresponding changes to the documentation

Aug 21 '24 06:08 zjma

⏱️ 29m total CI duration on this PR

Job	Cumulative Duration	Recent Runs
rust-move-unit-coverage	14m	🟩
rust-move-tests	9m	🟩
rust-cargo-deny	2m	🟩
general-lints	2m	🟩
check-dynamic-deps	2m	🟩
semgrep/ci	32s	🟩
file_change_determinator	12s	🟩
file_change_determinator	11s	🟩
permission-check	4s	🟩
permission-check	2s	🟩
permission-check	2s	🟩
permission-check	2s	🟩

_{settings ⋅ feedback ⋅ docs ⋅ learn more about trunk.io}

Aug 21 '24 06:08 trunk-io[bot]

Codecov Report

Attention: Patch coverage is 2.63158% with 37 lines in your changes missing coverage. Please review.

Project coverage is 59.4%. Comparing base (648d320) to head (10c5089). Report is 1 commits behind head on alin/federated-keyless-3a.

Files	Patch %	Lines
types/src/keyless/test_utils.rs	0.0%	26 Missing :warning:
types/src/transaction/mod.rs	0.0%	11 Missing :warning:

Additional details and impacted files

@@                     Coverage Diff                      @@
##           alin/federated-keyless-3a   #14359     +/-   ##
============================================================
- Coverage                       59.4%    59.4%   -0.1%     
============================================================
  Files                            838      838             
  Lines                         204392   204429     +37     
============================================================
  Hits                          121562   121562             
- Misses                         82830    82867     +37

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.

Aug 21 '24 06:08 codecov[bot]

Forge is running suite `realistic_env_max_load` on `6cb84fac959d85dfdf725c04ed5df3fde5b63038`

Sep 14 '24 00:09 github-actions[bot]

Forge is running suite `framework_upgrade` on `70806ff543496aa6de7807feff49e7e1370efd20` ==> `6cb84fac959d85dfdf725c04ed5df3fde5b63038`

Sep 14 '24 00:09 github-actions[bot]

Forge is running suite `compat` on `70806ff543496aa6de7807feff49e7e1370efd20` ==> `6cb84fac959d85dfdf725c04ed5df3fde5b63038`

Sep 14 '24 00:09 github-actions[bot]

:white_check_mark: Forge suite `realistic_env_max_load` success on `6cb84fac959d85dfdf725c04ed5df3fde5b63038`

two traffics test: inner traffic : committed: 14262.78 txn/s, latency: 2788.48 ms, (p50: 2700 ms, p70: 2700, p90: 3000 ms, p99: 3300 ms), latency samples: 5423020
two traffics test : committed: 99.97 txn/s, latency: 2335.78 ms, (p50: 2200 ms, p70: 2300, p90: 2400 ms, p99: 10700 ms), latency samples: 1700
Latency breakdown for phase 0: ["QsBatchToPos: max: 0.234, avg: 0.222", "QsPosToProposal: max: 0.513, avg: 0.473", "ConsensusProposalToOrdered: max: 0.313, avg: 0.294", "ConsensusOrderedToCommit: max: 0.409, avg: 0.396", "ConsensusProposalToCommit: max: 0.702, avg: 0.690"]
Max non-epoch-change gap was: 0 rounds at version 0 (avg 0.00) [limit 4], 0.89s no progress at version 2943141 (avg 0.20s) [limit 15].
Max epoch-change gap was: 0 rounds at version 0 (avg 0.00) [limit 4], 8.38s no progress at version 2943139 (avg 8.38s) [limit 15].
Test Ok

Sep 14 '24 00:09 github-actions[bot]

:white_check_mark: Forge suite `framework_upgrade` success on `70806ff543496aa6de7807feff49e7e1370efd20` ==> `6cb84fac959d85dfdf725c04ed5df3fde5b63038`

Compatibility test results for 70806ff543496aa6de7807feff49e7e1370efd20 ==> 6cb84fac959d85dfdf725c04ed5df3fde5b63038 (PR)
Upgrade the nodes to version: 6cb84fac959d85dfdf725c04ed5df3fde5b63038
framework_upgrade::framework-upgrade::full-framework-upgrade : committed: 1102.96 txn/s, submitted: 1104.72 txn/s, failed submission: 1.76 txn/s, expired: 1.76 txn/s, latency: 2892.60 ms, (p50: 2400 ms, p70: 3100, p90: 5700 ms, p99: 6800 ms), latency samples: 100160
framework_upgrade::framework-upgrade::full-framework-upgrade : committed: 1387.81 txn/s, submitted: 1390.50 txn/s, failed submission: 2.69 txn/s, expired: 2.69 txn/s, latency: 2464.39 ms, (p50: 2400 ms, p70: 2700, p90: 4200 ms, p99: 4800 ms), latency samples: 113400
5. check swarm health
Compatibility test for 70806ff543496aa6de7807feff49e7e1370efd20 ==> 6cb84fac959d85dfdf725c04ed5df3fde5b63038 passed
Upgrade the remaining nodes to version: 6cb84fac959d85dfdf725c04ed5df3fde5b63038
framework_upgrade::framework-upgrade::full-framework-upgrade : committed: 1293.44 txn/s, submitted: 1294.39 txn/s, failed submission: 0.94 txn/s, expired: 0.94 txn/s, latency: 2425.47 ms, (p50: 2400 ms, p70: 2600, p90: 3600 ms, p99: 5400 ms), latency samples: 109620
Test Ok

Sep 14 '24 00:09 github-actions[bot]

:white_check_mark: Forge suite `compat` success on `70806ff543496aa6de7807feff49e7e1370efd20` ==> `6cb84fac959d85dfdf725c04ed5df3fde5b63038`

Compatibility test results for 70806ff543496aa6de7807feff49e7e1370efd20 ==> 6cb84fac959d85dfdf725c04ed5df3fde5b63038 (PR)
1. Check liveness of validators at old version: 70806ff543496aa6de7807feff49e7e1370efd20
compatibility::simple-validator-upgrade::liveness-check : committed: 13620.06 txn/s, latency: 2354.04 ms, (p50: 1800 ms, p70: 1900, p90: 5300 ms, p99: 12100 ms), latency samples: 475760
2. Upgrading first Validator to new version: 6cb84fac959d85dfdf725c04ed5df3fde5b63038
compatibility::simple-validator-upgrade::single-validator-upgrading : committed: 7245.88 txn/s, latency: 3857.10 ms, (p50: 4200 ms, p70: 4200, p90: 5100 ms, p99: 5200 ms), latency samples: 145300
compatibility::simple-validator-upgrade::single-validator-upgrade : committed: 7754.32 txn/s, latency: 4085.15 ms, (p50: 4100 ms, p70: 4300, p90: 6400 ms, p99: 6700 ms), latency samples: 258040
3. Upgrading rest of first batch to new version: 6cb84fac959d85dfdf725c04ed5df3fde5b63038
compatibility::simple-validator-upgrade::half-validator-upgrading : committed: 6655.97 txn/s, latency: 4118.24 ms, (p50: 4600 ms, p70: 4800, p90: 5000 ms, p99: 5600 ms), latency samples: 133920
compatibility::simple-validator-upgrade::half-validator-upgrade : committed: 7198.63 txn/s, latency: 4482.12 ms, (p50: 4600 ms, p70: 4800, p90: 6400 ms, p99: 6700 ms), latency samples: 244540
4. upgrading second batch to new version: 6cb84fac959d85dfdf725c04ed5df3fde5b63038
compatibility::simple-validator-upgrade::rest-validator-upgrading : committed: 12167.21 txn/s, latency: 2273.39 ms, (p50: 2500 ms, p70: 2600, p90: 2700 ms, p99: 2800 ms), latency samples: 212020
compatibility::simple-validator-upgrade::rest-validator-upgrade : committed: 10467.49 txn/s, latency: 2996.00 ms, (p50: 2700 ms, p70: 2800, p90: 6000 ms, p99: 7700 ms), latency samples: 364220
5. check swarm health
Compatibility test for 70806ff543496aa6de7807feff49e7e1370efd20 ==> 6cb84fac959d85dfdf725c04ed5df3fde5b63038 passed
Test Ok

Sep 14 '24 00:09 github-actions[bot]