aptos-core
aptos-core copied to clipboard

Published 20 hours ago •

Reame
Issues

jwk updates

Open zjma opened this issue 1 year ago • 1 comments

trafficstars

Pull some shared JWK logic out into a crate and make it a dependency of pepper service and jwk-consensus.
Start fetching apple jwks in pepper service.

May 11 '24 02:05 zjma

⏱️ 56m total CI duration on this PR

Job	Cumulative Duration	Recent Runs
rust-targeted-unit-tests	29m	🟩
rust-move-tests	13m	🟩
rust-lints	6m	🟩
run-tests-main-branch	4m	🟩
general-lints	2m	🟩
check-dynamic-deps	1m	🟩
semgrep/ci	27s	🟩
file_change_determinator	12s	🟩
file_change_determinator	10s	🟩
permission-check	5s	🟩
permission-check	2s	🟩
permission-check	2s	🟩
permission-check	2s	🟩

🚨 1 job on the last run was significantly faster/slower than expected

Job	Duration	vs 7d avg	Delta
rust-targeted-unit-tests	29m	21m

_{settings ⋅ feedback ⋅ docs ⋅ learn more about trunk.io}

May 11 '24 02:05 trunk-io[bot]

Forge is running suite `framework_upgrade` on `3ffe0986b5fe4acb76544ae7ae85d73b91a6a411` ==> `df5202cf92337d1de77a78aa44492c5d3db8276f`

May 24 '24 18:05 github-actions[bot]

Forge is running suite `realistic_env_max_load` on `df5202cf92337d1de77a78aa44492c5d3db8276f`

May 24 '24 18:05 github-actions[bot]

Forge is running suite `compat` on `3ffe0986b5fe4acb76544ae7ae85d73b91a6a411` ==> `df5202cf92337d1de77a78aa44492c5d3db8276f`

May 24 '24 18:05 github-actions[bot]

:white_check_mark: Forge suite `compat` success on `3ffe0986b5fe4acb76544ae7ae85d73b91a6a411` ==> `df5202cf92337d1de77a78aa44492c5d3db8276f`

Compatibility test results for 3ffe0986b5fe4acb76544ae7ae85d73b91a6a411 ==> df5202cf92337d1de77a78aa44492c5d3db8276f (PR)
1. Check liveness of validators at old version: 3ffe0986b5fe4acb76544ae7ae85d73b91a6a411
compatibility::simple-validator-upgrade::liveness-check : committed: 6954.787004869771 txn/s, latency: 4749.0639303890985 ms, (p50: 4800 ms, p90: 7400 ms, p99: 8100 ms), latency samples: 243640
2. Upgrading first Validator to new version: df5202cf92337d1de77a78aa44492c5d3db8276f
compatibility::simple-validator-upgrade::single-validator-upgrade : committed: 1705.6390481246885 txn/s, latency: 16704.430230100963 ms, (p50: 19900 ms, p90: 21800 ms, p99: 22700 ms), latency samples: 85180
3. Upgrading rest of first batch to new version: df5202cf92337d1de77a78aa44492c5d3db8276f
compatibility::simple-validator-upgrade::half-validator-upgrade : committed: 1804.8041917279777 txn/s, latency: 15927.402075098815 ms, (p50: 17100 ms, p90: 21700 ms, p99: 22300 ms), latency samples: 91080
4. upgrading second batch to new version: df5202cf92337d1de77a78aa44492c5d3db8276f
compatibility::simple-validator-upgrade::rest-validator-upgrade : committed: 3580.8255807849837 txn/s, latency: 8700.317058335637 ms, (p50: 9500 ms, p90: 12600 ms, p99: 12800 ms), latency samples: 144680
5. check swarm health
Compatibility test for 3ffe0986b5fe4acb76544ae7ae85d73b91a6a411 ==> df5202cf92337d1de77a78aa44492c5d3db8276f passed
Test Ok

May 24 '24 18:05 github-actions[bot]

:white_check_mark: Forge suite `realistic_env_max_load` success on `df5202cf92337d1de77a78aa44492c5d3db8276f`

two traffics test: inner traffic : committed: 7723.166531810805 txn/s, latency: 5075.222954167613 ms, (p50: 5000 ms, p90: 5700 ms, p99: 10400 ms), latency samples: 3344360
two traffics test : committed: 99.88232895096307 txn/s, latency: 1852.5027777777777 ms, (p50: 1800 ms, p90: 2100 ms, p99: 4000 ms), latency samples: 1800
Latency breakdown for phase 0: ["QsBatchToPos: max: 0.204, avg: 0.201", "QsPosToProposal: max: 0.271, avg: 0.252", "ConsensusProposalToOrdered: max: 0.453, avg: 0.426", "ConsensusOrderedToCommit: max: 0.425, avg: 0.376", "ConsensusProposalToCommit: max: 0.867, avg: 0.802"]
Max round gap was 1 [limit 4] at version 1593626. Max no progress secs was 4.434167 [limit 15] at version 1593626.
Test Ok

May 24 '24 18:05 github-actions[bot]

:x: Forge suite `framework_upgrade` failure on `3ffe0986b5fe4acb76544ae7ae85d73b91a6a411` ==> `df5202cf92337d1de77a78aa44492c5d3db8276f`

Compatibility test results for 3ffe0986b5fe4acb76544ae7ae85d73b91a6a411 ==> df5202cf92337d1de77a78aa44492c5d3db8276f (PR)
Upgrade the nodes to version: df5202cf92337d1de77a78aa44492c5d3db8276f
framework_upgrade::framework-upgrade::full-framework-upgrade : committed: 1187.635368680466 txn/s, submitted: 1189.2381154668094 txn/s, failed submission: 1.6027467863434088 txn/s, expired: 1.6027467863434088 txn/s, latency: 2613.390302679776 ms, (p50: 2100 ms, p90: 4600 ms, p99: 7700 ms), latency samples: 103740
Test Failed: API error: Unknown error Transaction committed on chain, but failed execution: Move abort in 0x1::gas_schedule: EINVALID_GAS_FEATURE_VERSION(0x10002): 

Stack backtrace:
   0: anyhow::error::<impl core::convert::From<E> for anyhow::Error>::from
             at /usr/local/cargo/registry/src/index.crates.io-6f17d22bba15001f/anyhow-1.0.79/src/error.rs:565:25
   1: <core::result::Result<T,F> as core::ops::try_trait::FromResidual<core::result::Result<core::convert::Infallible,E>>>::from_residual
             at /rustc/82e1608dfa6e0b5569232559e3d385fea5a93112/library/core/src/result.rs:1963:27
   2: aptos_release_builder::validate::NetworkConfig::execute_proposal::{{closure}}
             at ./aptos-move/aptos-release-builder/src/validate.rs:364:9
   3: aptos_release_builder::validate::NetworkConfig::submit_and_execute_multi_step_proposal::{{closure}}
             at ./aptos-move/aptos-release-builder/src/validate.rs:124:64
   4: aptos_release_builder::validate::execute_release::{{closure}}
             at ./aptos-move/aptos-release-builder/src/validate.rs:432:22
   5: aptos_release_builder::validate::validate_config_and_generate_release::{{closure}}
             at ./aptos-move/aptos-release-builder/src/validate.rs:493:6
   6: aptos_release_builder::validate::validate_config::{{closure}}
             at ./aptos-move/aptos-release-builder/src/validate.rs:479:80
   7: tokio::runtime::park::CachedParkThread::block_on::{{closure}}
             at /usr/local/cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.35.1/src/runtime/park.rs:282:63
   8: tokio::runtime::coop::with_budget
             at /usr/local/cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.35.1/src/runtime/coop.rs:107:5
   9: tokio::runtime::coop::budget
             at /usr/local/cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.35.1/src/runtime/coop.rs:73:5
  10: tokio::runtime::park::CachedParkThread::block_on
             at /usr/local/cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.35.1/src/runtime/park.rs:282:31
  11: tokio::runtime::context::blocking::BlockingRegionGuard::block_on
             at /usr/local/cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.35.1/src/runtime/context/blocking.rs:66:9
  12: tokio::runtime::scheduler::multi_thread::MultiThread::block_on::{{closure}}
             at /usr/local/cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.35.1/src/runtime/scheduler/multi_thread/mod.rs:87:13
  13: tokio::runtime::context::runtime::enter_runtime
             at /usr/local/cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.35.1/src/runtime/context/runtime.rs:65:16
  14: tokio::runtime::scheduler::multi_thread::MultiThread::block_on
             at /usr/local/cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.35.1/src/runtime/scheduler/multi_thread/mod.rs:86:9
  15: tokio::runtime::runtime::Runtime::block_on
             at /usr/local/cargo/registry/src/index.crates.io-6f17d22bba15001f/tokio-1.35.1/src/runtime/runtime.rs:350:50
  16: <aptos_testcases::framework_upgrade::FrameworkUpgrade as aptos_forge::interface::network::NetworkTest>::run
             at ./testsuite/testcases/src/framework_upgrade.rs:112:9
  17: aptos_forge::runner::Forge<F>::run::{{closure}}
             at ./testsuite/forge/src/runner.rs:598:42
  18: aptos_forge::runner::run_test
             at ./testsuite/forge/src/runner.rs:666:11
  19: aptos_forge::runner::Forge<F>::run
             at ./testsuite/forge/src/runner.rs:598:30
  20: forge::run_forge
             at ./testsuite/forge-cli/src/main.rs:427:11
  21: forge::main
             at ./testsuite/forge-cli/src/main.rs:353:21
  22: core::ops::function::FnOnce::call_once
             at /rustc/82e1608dfa6e0b5569232559e3d385fea5a93112/library/core/src/ops/function.rs:250:5
  23: std::sys_common::backtrace::__rust_begin_short_backtrace
             at /rustc/82e1608dfa6e0b5569232559e3d385fea5a93112/library/std/src/sys_common/backtrace.rs:154:18
  24: std::rt::lang_start::{{closure}}
             at /rustc/82e1608dfa6e0b5569232559e3d385fea5a93112/library/std/src/rt.rs:167:18
  25: core::ops::function::impls::<impl core::ops::function::FnOnce<A> for &F>::call_once
             at /rustc/82e1608dfa6e0b5569232559e3d385fea5a93112/library/core/src/ops/function.rs:284:13
  26: std::panicking::try::do_call
             at /rustc/82e1608dfa6e0b5569232559e3d385fea5a93112/library/std/src/panicking.rs:552:40
  27: std::panicking::try
             at /rustc/82e1608dfa6e0b5569232559e3d385fea5a93112/library/std/src/panicking.rs:516:19
  28: std::panic::catch_unwind
             at /rustc/82e1608dfa6e0b5569232559e3d385fea5a93112/library/std/src/panic.rs:142:14
  29: std::rt::lang_start_internal::{{closure}}
             at /rustc/82e1608dfa6e0b5569232559e3d385fea5a93112/library/std/src/rt.rs:148:48
  30: std::panicking::try::do_call
             at /rustc/82e1608dfa6e0b5569232559e3d385fea5a93112/library/std/src/panicking.rs:552:40
  31: std::panicking::try
             at /rustc/82e1608dfa6e0b5569232559e3d385fea5a93112/library/std/src/panicking.rs:516:19
  32: std::panic::catch_unwind
             at /rustc/82e1608dfa6e0b5569232559e3d385fea5a93112/library/std/src/panic.rs:142:14
  33: std::rt::lang_start_internal
             at /rustc/82e1608dfa6e0b5569232559e3d385fea5a93112/library/std/src/rt.rs:148:20
  34: std::rt::lang_start
             at /rustc/82e1608dfa6e0b5569232559e3d385fea5a93112/library/std/src/rt.rs:166:17
  35: __libc_start_main
  36: _start
Trailing Log Lines:
             at /rustc/82e1608dfa6e0b5569232559e3d385fea5a93112/library/std/src/panicking.rs:516:19
  32: std::panic::catch_unwind
             at /rustc/82e1608dfa6e0b5569232559e3d385fea5a93112/library/std/src/panic.rs:142:14
  33: std::rt::lang_start_internal
             at /rustc/82e1608dfa6e0b5569232559e3d385fea5a93112/library/std/src/rt.rs:148:20
  34: std::rt::lang_start
             at /rustc/82e1608dfa6e0b5569232559e3d385fea5a93112/library/std/src/rt.rs:166:17
  35: __libc_start_main
  36: _start


Swarm logs can be found here: See fgi output for more information.
{"level":"INFO","source":{"package":"aptos_forge","file":"testsuite/forge/src/backend/k8s/cluster_helper.rs:292"},"thread_name":"main","hostname":"forge-framework-upgrade-pr-13253-1716574143-3ffe0986b5fe4acb765","timestamp":"2024-05-24T18:58:15.231893Z","message":"Deleting namespace forge-framework-upgrade-pr-13253: Some(NamespaceStatus { conditions: None, phase: Some(\"Terminating\") })"}
{"level":"INFO","source":{"package":"aptos_forge","file":"testsuite/forge/src/backend/k8s/cluster_helper.rs:400"},"thread_name":"main","hostname":"forge-framework-upgrade-pr-13253-1716574143-3ffe0986b5fe4acb765","timestamp":"2024-05-24T18:58:15.231921Z","message":"aptos-node resources for Forge removed in namespace: forge-framework-upgrade-pr-13253"}

failures:
    framework_upgrade::framework-upgrade

test result: FAILED. 0 passed; 1 failed; 0 filtered out

Failed to run tests:
Tests Failed
Error: Tests Failed

Stack backtrace:
   0: anyhow::error::<impl anyhow::Error>::msg
             at /usr/local/cargo/registry/src/index.crates.io-6f17d22bba15001f/anyhow-1.0.79/src/error.rs:83:36
   1: aptos_forge::runner::Forge<F>::run
             at ./testsuite/forge/src/runner.rs:618:13
   2: forge::run_forge
             at ./testsuite/forge-cli/src/main.rs:427:11
   3: forge::main
             at ./testsuite/forge-cli/src/main.rs:353:21
   4: core::ops::function::FnOnce::call_once
             at /rustc/82e1608dfa6e0b5569232559e3d385fea5a93112/library/core/src/ops/function.rs:250:5
   5: std::sys_common::backtrace::__rust_begin_short_backtrace
             at /rustc/82e1608dfa6e0b5569232559e3d385fea5a93112/library/std/src/sys_common/backtrace.rs:154:18
   6: std::rt::lang_start::{{closure}}
             at /rustc/82e1608dfa6e0b5569232559e3d385fea5a93112/library/std/src/rt.rs:167:18
   7: core::ops::function::impls::<impl core::ops::function::FnOnce<A> for &F>::call_once
             at /rustc/82e1608dfa6e0b5569232559e3d385fea5a93112/library/core/src/ops/function.rs:284:13
   8: std::panicking::try::do_call
             at /rustc/82e1608dfa6e0b5569232559e3d385fea5a93112/library/std/src/panicking.rs:552:40
   9: std::panicking::try
             at /rustc/82e1608dfa6e0b5569232559e3d385fea5a93112/library/std/src/panicking.rs:516:19
  10: std::panic::catch_unwind
             at /rustc/82e1608dfa6e0b5569232559e3d385fea5a93112/library/std/src/panic.rs:142:14
  11: std::rt::lang_start_internal::{{closure}}
             at /rustc/82e1608dfa6e0b5569232559e3d385fea5a93112/library/std/src/rt.rs:148:48
  12: std::panicking::try::do_call
             at /rustc/82e1608dfa6e0b5569232559e3d385fea5a93112/library/std/src/panicking.rs:552:40
  13: std::panicking::try
             at /rustc/82e1608dfa6e0b5569232559e3d385fea5a93112/library/std/src/panicking.rs:516:19
  14: std::panic::catch_unwind
             at /rustc/82e1608dfa6e0b5569232559e3d385fea5a93112/library/std/src/panic.rs:142:14
  15: std::rt::lang_start_internal
             at /rustc/82e1608dfa6e0b5569232559e3d385fea5a93112/library/std/src/rt.rs:148:20
  16: std::rt::lang_start
             at /rustc/82e1608dfa6e0b5569232559e3d385fea5a93112/library/std/src/rt.rs:166:17
  17: __libc_start_main
  18: _start
Debugging output:
NAME                                    READY   STATUS      RESTARTS   AGE
aptos-node-0-validator-0                1/1     Running     0          46m
aptos-node-1-validator-0                1/1     Running     0          45m
aptos-node-2-validator-0                1/1     Running     0          48m
aptos-node-3-validator-0                1/1     Running     0          48m
genesis-aptos-genesis-eforge137-4qg76   0/1     Completed   0          48m

May 24 '24 18:05 github-actions[bot]

Forge is running suite `compat` on `3ffe0986b5fe4acb76544ae7ae85d73b91a6a411` ==> `d1e7e4986104b11f0ceaf0d2383652ae435f917e`

May 24 '24 23:05 github-actions[bot]

Forge is running suite `realistic_env_max_load` on `d1e7e4986104b11f0ceaf0d2383652ae435f917e`

May 24 '24 23:05 github-actions[bot]

Forge is running suite `framework_upgrade` on `3ffe0986b5fe4acb76544ae7ae85d73b91a6a411` ==> `d1e7e4986104b11f0ceaf0d2383652ae435f917e`

May 24 '24 23:05 github-actions[bot]

:white_check_mark: Forge suite `compat` success on `3ffe0986b5fe4acb76544ae7ae85d73b91a6a411` ==> `d1e7e4986104b11f0ceaf0d2383652ae435f917e`

Compatibility test results for 3ffe0986b5fe4acb76544ae7ae85d73b91a6a411 ==> d1e7e4986104b11f0ceaf0d2383652ae435f917e (PR)
1. Check liveness of validators at old version: 3ffe0986b5fe4acb76544ae7ae85d73b91a6a411
compatibility::simple-validator-upgrade::liveness-check : committed: 6533.212623875931 txn/s, latency: 4769.381268906225 ms, (p50: 4800 ms, p90: 5300 ms, p99: 8100 ms), latency samples: 251240
2. Upgrading first Validator to new version: d1e7e4986104b11f0ceaf0d2383652ae435f917e
compatibility::simple-validator-upgrade::single-validator-upgrade : committed: 3354.1460620043345 txn/s, latency: 9225.45792422232 ms, (p50: 9300 ms, p90: 13800 ms, p99: 14200 ms), latency samples: 135660
3. Upgrading rest of first batch to new version: d1e7e4986104b11f0ceaf0d2383652ae435f917e
compatibility::simple-validator-upgrade::half-validator-upgrade : committed: 3295.8329410924975 txn/s, latency: 9357.991608191322 ms, (p50: 9300 ms, p90: 14200 ms, p99: 14500 ms), latency samples: 139660
4. upgrading second batch to new version: d1e7e4986104b11f0ceaf0d2383652ae435f917e
compatibility::simple-validator-upgrade::rest-validator-upgrade : committed: 4663.952104574224 txn/s, latency: 6945.844926778243 ms, (p50: 5100 ms, p90: 10800 ms, p99: 15900 ms), latency samples: 172080
5. check swarm health
Compatibility test for 3ffe0986b5fe4acb76544ae7ae85d73b91a6a411 ==> d1e7e4986104b11f0ceaf0d2383652ae435f917e passed
Test Ok

May 24 '24 23:05 github-actions[bot]

:white_check_mark: Forge suite `realistic_env_max_load` success on `d1e7e4986104b11f0ceaf0d2383652ae435f917e`

two traffics test: inner traffic : committed: 7864.849559196738 txn/s, latency: 4959.862404998068 ms, (p50: 4800 ms, p90: 6600 ms, p99: 9900 ms), latency samples: 3415720
two traffics test : committed: 99.93114130799236 txn/s, latency: 1832.9310344827586 ms, (p50: 1800 ms, p90: 2100 ms, p99: 3100 ms), latency samples: 1740
Latency breakdown for phase 0: ["QsBatchToPos: max: 0.213, avg: 0.203", "QsPosToProposal: max: 0.291, avg: 0.248", "ConsensusProposalToOrdered: max: 0.434, avg: 0.407", "ConsensusOrderedToCommit: max: 0.398, avg: 0.386", "ConsensusProposalToCommit: max: 0.804, avg: 0.793"]
Max round gap was 1 [limit 4] at version 1675474. Max no progress secs was 4.560237 [limit 15] at version 1675474.
Test Ok

May 24 '24 23:05 github-actions[bot]

:white_check_mark: Forge suite `framework_upgrade` success on `3ffe0986b5fe4acb76544ae7ae85d73b91a6a411` ==> `d1e7e4986104b11f0ceaf0d2383652ae435f917e`

Compatibility test results for 3ffe0986b5fe4acb76544ae7ae85d73b91a6a411 ==> d1e7e4986104b11f0ceaf0d2383652ae435f917e (PR)
Upgrade the nodes to version: d1e7e4986104b11f0ceaf0d2383652ae435f917e
framework_upgrade::framework-upgrade::full-framework-upgrade : committed: 1138.3379182606939 txn/s, submitted: 1141.8357878001927 txn/s, failed submission: 3.497869539498963 txn/s, expired: 3.497869539498963 txn/s, latency: 2594.9241693873632 ms, (p50: 2100 ms, p90: 4500 ms, p99: 8000 ms), latency samples: 104140
framework_upgrade::framework-upgrade::full-framework-upgrade : committed: 1189.823062278712 txn/s, submitted: 1193.1327230917268 txn/s, failed submission: 3.3096608130144984 txn/s, expired: 3.3096608130144984 txn/s, latency: 2723.9393900258297 ms, (p50: 2100 ms, p90: 5100 ms, p99: 10900 ms), latency samples: 100660
5. check swarm health
Compatibility test for 3ffe0986b5fe4acb76544ae7ae85d73b91a6a411 ==> d1e7e4986104b11f0ceaf0d2383652ae435f917e passed
Upgrade the remaining nodes to version: d1e7e4986104b11f0ceaf0d2383652ae435f917e
framework_upgrade::framework-upgrade::full-framework-upgrade : committed: 1177.0787853447785 txn/s, submitted: 1178.2553934868663 txn/s, failed submission: 1.1766081420879433 txn/s, expired: 1.1766081420879433 txn/s, latency: 2828.8782487005196 ms, (p50: 2100 ms, p90: 4800 ms, p99: 10000 ms), latency samples: 100040
Test Ok

May 24 '24 23:05 github-actions[bot]

Forge is running suite `compat` on `3ffe0986b5fe4acb76544ae7ae85d73b91a6a411` ==> `2c7f78ee535822bb8e5982480918254c8b9d6246`

May 25 '24 00:05 github-actions[bot]

Forge is running suite `framework_upgrade` on `3ffe0986b5fe4acb76544ae7ae85d73b91a6a411` ==> `2c7f78ee535822bb8e5982480918254c8b9d6246`

May 25 '24 00:05 github-actions[bot]

Forge is running suite `realistic_env_max_load` on `2c7f78ee535822bb8e5982480918254c8b9d6246`

May 25 '24 00:05 github-actions[bot]

:white_check_mark: Forge suite `compat` success on `3ffe0986b5fe4acb76544ae7ae85d73b91a6a411` ==> `2c7f78ee535822bb8e5982480918254c8b9d6246`

Compatibility test results for 3ffe0986b5fe4acb76544ae7ae85d73b91a6a411 ==> 2c7f78ee535822bb8e5982480918254c8b9d6246 (PR)
1. Check liveness of validators at old version: 3ffe0986b5fe4acb76544ae7ae85d73b91a6a411
compatibility::simple-validator-upgrade::liveness-check : committed: 6789.159100231531 txn/s, latency: 4846.687951515151 ms, (p50: 4800 ms, p90: 8100 ms, p99: 8700 ms), latency samples: 247500
2. Upgrading first Validator to new version: 2c7f78ee535822bb8e5982480918254c8b9d6246
compatibility::simple-validator-upgrade::single-validator-upgrade : committed: 3132.1708503740633 txn/s, latency: 9940.93188059241 ms, (p50: 9700 ms, p90: 13800 ms, p99: 14300 ms), latency samples: 129640
3. Upgrading rest of first batch to new version: 2c7f78ee535822bb8e5982480918254c8b9d6246
compatibility::simple-validator-upgrade::half-validator-upgrade : committed: 3343.266600582348 txn/s, latency: 9302.100697370333 ms, (p50: 9400 ms, p90: 14100 ms, p99: 14400 ms), latency samples: 137660
4. upgrading second batch to new version: 2c7f78ee535822bb8e5982480918254c8b9d6246
compatibility::simple-validator-upgrade::rest-validator-upgrade : committed: 4297.746338578865 txn/s, latency: 7449.21485743511 ms, (p50: 6600 ms, p90: 11700 ms, p99: 15200 ms), latency samples: 156420
5. check swarm health
Compatibility test for 3ffe0986b5fe4acb76544ae7ae85d73b91a6a411 ==> 2c7f78ee535822bb8e5982480918254c8b9d6246 passed
Test Ok

May 25 '24 00:05 github-actions[bot]

:white_check_mark: Forge suite `realistic_env_max_load` success on `2c7f78ee535822bb8e5982480918254c8b9d6246`

two traffics test: inner traffic : committed: 7702.410182388868 txn/s, latency: 5091.7466755215255 ms, (p50: 4800 ms, p90: 6900 ms, p99: 10500 ms), latency samples: 3327740
two traffics test : committed: 99.98931619478398 txn/s, latency: 1938.959090909091 ms, (p50: 1900 ms, p90: 2200 ms, p99: 5700 ms), latency samples: 1760
Latency breakdown for phase 0: ["QsBatchToPos: max: 0.232, avg: 0.209", "QsPosToProposal: max: 0.473, avg: 0.283", "ConsensusProposalToOrdered: max: 0.418, avg: 0.395", "ConsensusOrderedToCommit: max: 0.399, avg: 0.383", "ConsensusProposalToCommit: max: 0.787, avg: 0.778"]
Max round gap was 2 [limit 4] at version 318360. Max no progress secs was 4.740313 [limit 15] at version 1597226.
Test Ok

May 25 '24 00:05 github-actions[bot]

:white_check_mark: Forge suite `framework_upgrade` success on `3ffe0986b5fe4acb76544ae7ae85d73b91a6a411` ==> `2c7f78ee535822bb8e5982480918254c8b9d6246`

Compatibility test results for 3ffe0986b5fe4acb76544ae7ae85d73b91a6a411 ==> 2c7f78ee535822bb8e5982480918254c8b9d6246 (PR)
Upgrade the nodes to version: 2c7f78ee535822bb8e5982480918254c8b9d6246
framework_upgrade::framework-upgrade::full-framework-upgrade : committed: 1172.3670111852432 txn/s, submitted: 1173.713527660571 txn/s, failed submission: 1.3465164753276146 txn/s, expired: 1.3465164753276146 txn/s, latency: 2605.791098774885 ms, (p50: 2100 ms, p90: 4500 ms, p99: 7800 ms), latency samples: 104480
framework_upgrade::framework-upgrade::full-framework-upgrade : committed: 1201.7228287774806 txn/s, submitted: 1204.6973902348504 txn/s, failed submission: 2.974561457370001 txn/s, expired: 2.974561457370001 txn/s, latency: 2567.3517612338155 ms, (p50: 2100 ms, p90: 4500 ms, p99: 9000 ms), latency samples: 105040
5. check swarm health
Compatibility test for 3ffe0986b5fe4acb76544ae7ae85d73b91a6a411 ==> 2c7f78ee535822bb8e5982480918254c8b9d6246 passed
Upgrade the remaining nodes to version: 2c7f78ee535822bb8e5982480918254c8b9d6246
framework_upgrade::framework-upgrade::full-framework-upgrade : committed: 1153.2828117040337 txn/s, submitted: 1156.583563884068 txn/s, failed submission: 3.300752180034441 txn/s, expired: 3.300752180034441 txn/s, latency: 2686.839477199008 ms, (p50: 2100 ms, p90: 4500 ms, p99: 9900 ms), latency samples: 104820
Test Ok

May 25 '24 00:05 github-actions[bot]