:white_check_mark: Forge suite compat success on 843b204dce971d98449b82624f4f684c7a18b991 ==> 206736488a065f188a7a8b5b4502ebeb59959d66
Compatibility test results for 843b204dce971d98449b82624f4f684c7a18b991 ==> 206736488a065f188a7a8b5b4502ebeb59959d66 (PR)
1. Check liveness of validators at old version: 843b204dce971d98449b82624f4f684c7a18b991
compatibility::simple-validator-upgrade::liveness-check : 7402 TPS, 5167 ms latency, 8900 ms p99 latency,no expired txns
2. Upgrading first Validator to new version: 206736488a065f188a7a8b5b4502ebeb59959d66
compatibility::simple-validator-upgrade::single-validator-upgrade : 5220 TPS, 7815 ms latency, 10600 ms p99 latency,no expired txns
3. Upgrading rest of first batch to new version: 206736488a065f188a7a8b5b4502ebeb59959d66
compatibility::simple-validator-upgrade::half-validator-upgrade : 4323 TPS, 9332 ms latency, 13400 ms p99 latency,no expired txns
4. upgrading second batch to new version: 206736488a065f188a7a8b5b4502ebeb59959d66
compatibility::simple-validator-upgrade::rest-validator-upgrade : 6975 TPS, 5485 ms latency, 9800 ms p99 latency,no expired txns
5. check swarm health
Compatibility test for 843b204dce971d98449b82624f4f684c7a18b991 ==> 206736488a065f188a7a8b5b4502ebeb59959d66 passed
Test Ok
:white_check_mark: Forge suite land_blocking success on 206736488a065f188a7a8b5b4502ebeb59959d66
performance benchmark with full nodes : 6710 TPS, 5921 ms latency, 8700 ms p99 latency,(!) expired 740 out of 2866080 txns
Test Ok
:x: Forge suite land_blocking failure on bed7c59a82f3ff73d16ec6361568a13fcc11cbd8
Forge test runner terminated:
Trailing Log Lines:
at /aptos/crates/aptos/src/main.rs:20:5
31: core::ops::function::FnOnce::call_once
at /rustc/4b91a6ea7258a947e59c6522cd5898e7c0a6a88f/library/core/src/ops/function.rs:248:5
note: Some details are omitted, run with `RUST_BACKTRACE=full` for a verbose backtrace.
{"level":"INFO","source":{"package":"forge","file":"testsuite/forge/src/backend/k8s/cluster_helper.rs:81"},"thread_name":"main","hostname":"forge-e2e-pr-5050-1666057181-bed7c59a82f3ff73d16ec6361568a13fcc","timestamp":"2022-10-18T01:50:31.999200Z","message":"Genesis status: JobStatus { active: Some(1), completion_time: None, conditions: None, failed: Some(6), start_time: Some(Time(2022-10-18T01:40:40Z)), succeeded: None }"}
{"level":"INFO","source":{"package":"forge","file":"testsuite/forge/src/backend/k8s/cluster_helper.rs:280"},"thread_name":"main","hostname":"forge-e2e-pr-5050-1666057181-bed7c59a82f3ff73d16ec6361568a13fcc","timestamp":"2022-10-18T01:50:32.018480Z","message":"Deleting namespace forge-e2e-pr-5050: Some(NamespaceStatus { phase: Some(\"Terminating\") })"}
{"level":"INFO","source":{"package":"forge","file":"testsuite/forge/src/backend/k8s/cluster_helper.rs:388"},"thread_name":"main","hostname":"forge-e2e-pr-5050-1666057181-bed7c59a82f3ff73d16ec6361568a13fcc","timestamp":"2022-10-18T01:50:32.018503Z","message":"aptos-node resources for Forge removed in namespace: forge-e2e-pr-5050"}
Failed to run tests:
Genesis did not succeed
Error: Genesis did not succeed
Debugging output:
:x: Forge suite compat failure on 843b204dce971d98449b82624f4f684c7a18b991 ==> bed7c59a82f3ff73d16ec6361568a13fcc11cbd8
Forge test runner terminated:
Trailing Log Lines:
Error from server (BadRequest): container "genesis" in pod "genesis-aptos-genesis-eforge11-bn42g" is waiting to start: trying and failing to pull image
{"level":"INFO","source":{"package":"forge","file":"testsuite/forge/src/backend/k8s/cluster_helper.rs:81"},"thread_name":"main","hostname":"forge-compat-pr-5050-1666057187-843b204dce971d98449b82624f4f684","timestamp":"2022-10-18T01:50:34.946920Z","message":"Genesis status: JobStatus { active: Some(1), completion_time: None, conditions: None, failed: None, start_time: Some(Time(2022-10-18T01:40:47Z)), succeeded: None }"}
{"level":"INFO","source":{"package":"forge","file":"testsuite/forge/src/backend/k8s/cluster_helper.rs:63"},"thread_name":"main","hostname":"forge-compat-pr-5050-1666057187-843b204dce971d98449b82624f4f684","timestamp":"2022-10-18T01:50:44.958835Z","message":"Genesis status: JobStatus { active: Some(1), completion_time: None, conditions: None, failed: None, start_time: Some(Time(2022-10-18T01:40:47Z)), succeeded: None }"}
Error from server (BadRequest): container "genesis" in pod "genesis-aptos-genesis-eforge11-bn42g" is waiting to start: trying and failing to pull image
{"level":"INFO","source":{"package":"forge","file":"testsuite/forge/src/backend/k8s/cluster_helper.rs:81"},"thread_name":"main","hostname":"forge-compat-pr-5050-1666057187-843b204dce971d98449b82624f4f684","timestamp":"2022-10-18T01:50:45.070689Z","message":"Genesis status: JobStatus { active: Some(1), completion_time: None, conditions: None, failed: None, start_time: Some(Time(2022-10-18T01:40:47Z)), succeeded: None }"}
{"level":"INFO","source":{"package":"forge","file":"testsuite/forge/src/backend/k8s/cluster_helper.rs:280"},"thread_name":"main","hostname":"forge-compat-pr-5050-1666057187-843b204dce971d98449b82624f4f684","timestamp":"2022-10-18T01:50:45.100846Z","message":"Deleting namespace forge-compat-pr-5050: Some(NamespaceStatus { phase: Some(\"Terminating\") })"}
{"level":"INFO","source":{"package":"forge","file":"testsuite/forge/src/backend/k8s/cluster_helper.rs:388"},"thread_name":"main","hostname":"forge-compat-pr-5050-1666057187-843b204dce971d98449b82624f4f684","timestamp":"2022-10-18T01:50:45.100874Z","message":"aptos-node resources for Forge removed in namespace: forge-compat-pr-5050"}
Failed to run tests:
Genesis did not succeed
Error: Genesis did not succeed
Debugging output:
NAME READY STATUS RESTARTS AGE
genesis-aptos-genesis-eforge11-bn42g 0/1 Terminating 0 10m