aptos-core icon indicating copy to clipboard operation
aptos-core copied to clipboard

hacking-n-testing-b

Open zjma opened this issue 3 years ago • 8 comments

Description

Test Plan


This change is Reviewable

zjma avatar Oct 14 '22 19:10 zjma

Forge is running suite land_blocking on 206736488a065f188a7a8b5b4502ebeb59959d66

github-actions[bot] avatar Oct 14 '22 19:10 github-actions[bot]

Forge is running suite compat on 843b204dce971d98449b82624f4f684c7a18b991 ==> 206736488a065f188a7a8b5b4502ebeb59959d66

github-actions[bot] avatar Oct 14 '22 19:10 github-actions[bot]

:white_check_mark: Forge suite compat success on 843b204dce971d98449b82624f4f684c7a18b991 ==> 206736488a065f188a7a8b5b4502ebeb59959d66

Compatibility test results for 843b204dce971d98449b82624f4f684c7a18b991 ==> 206736488a065f188a7a8b5b4502ebeb59959d66 (PR)
1. Check liveness of validators at old version: 843b204dce971d98449b82624f4f684c7a18b991
compatibility::simple-validator-upgrade::liveness-check : 7402 TPS, 5167 ms latency, 8900 ms p99 latency,no expired txns
2. Upgrading first Validator to new version: 206736488a065f188a7a8b5b4502ebeb59959d66
compatibility::simple-validator-upgrade::single-validator-upgrade : 5220 TPS, 7815 ms latency, 10600 ms p99 latency,no expired txns
3. Upgrading rest of first batch to new version: 206736488a065f188a7a8b5b4502ebeb59959d66
compatibility::simple-validator-upgrade::half-validator-upgrade : 4323 TPS, 9332 ms latency, 13400 ms p99 latency,no expired txns
4. upgrading second batch to new version: 206736488a065f188a7a8b5b4502ebeb59959d66
compatibility::simple-validator-upgrade::rest-validator-upgrade : 6975 TPS, 5485 ms latency, 9800 ms p99 latency,no expired txns
5. check swarm health
Compatibility test for 843b204dce971d98449b82624f4f684c7a18b991 ==> 206736488a065f188a7a8b5b4502ebeb59959d66 passed
Test Ok

github-actions[bot] avatar Oct 14 '22 20:10 github-actions[bot]

:white_check_mark: Forge suite land_blocking success on 206736488a065f188a7a8b5b4502ebeb59959d66

performance benchmark with full nodes : 6710 TPS, 5921 ms latency, 8700 ms p99 latency,(!) expired 740 out of 2866080 txns
Test Ok

github-actions[bot] avatar Oct 14 '22 20:10 github-actions[bot]

Forge is running suite land_blocking on bed7c59a82f3ff73d16ec6361568a13fcc11cbd8

github-actions[bot] avatar Oct 18 '22 01:10 github-actions[bot]

Forge is running suite compat on 843b204dce971d98449b82624f4f684c7a18b991 ==> bed7c59a82f3ff73d16ec6361568a13fcc11cbd8

github-actions[bot] avatar Oct 18 '22 01:10 github-actions[bot]

:x: Forge suite land_blocking failure on bed7c59a82f3ff73d16ec6361568a13fcc11cbd8

Forge test runner terminated:
Trailing Log Lines:
             at /aptos/crates/aptos/src/main.rs:20:5
  31: core::ops::function::FnOnce::call_once
             at /rustc/4b91a6ea7258a947e59c6522cd5898e7c0a6a88f/library/core/src/ops/function.rs:248:5
note: Some details are omitted, run with `RUST_BACKTRACE=full` for a verbose backtrace.
{"level":"INFO","source":{"package":"forge","file":"testsuite/forge/src/backend/k8s/cluster_helper.rs:81"},"thread_name":"main","hostname":"forge-e2e-pr-5050-1666057181-bed7c59a82f3ff73d16ec6361568a13fcc","timestamp":"2022-10-18T01:50:31.999200Z","message":"Genesis status: JobStatus { active: Some(1), completion_time: None, conditions: None, failed: Some(6), start_time: Some(Time(2022-10-18T01:40:40Z)), succeeded: None }"}
{"level":"INFO","source":{"package":"forge","file":"testsuite/forge/src/backend/k8s/cluster_helper.rs:280"},"thread_name":"main","hostname":"forge-e2e-pr-5050-1666057181-bed7c59a82f3ff73d16ec6361568a13fcc","timestamp":"2022-10-18T01:50:32.018480Z","message":"Deleting namespace forge-e2e-pr-5050: Some(NamespaceStatus { phase: Some(\"Terminating\") })"}
{"level":"INFO","source":{"package":"forge","file":"testsuite/forge/src/backend/k8s/cluster_helper.rs:388"},"thread_name":"main","hostname":"forge-e2e-pr-5050-1666057181-bed7c59a82f3ff73d16ec6361568a13fcc","timestamp":"2022-10-18T01:50:32.018503Z","message":"aptos-node resources for Forge removed in namespace: forge-e2e-pr-5050"}
Failed to run tests:
Genesis did not succeed
Error: Genesis did not succeed
Debugging output:

github-actions[bot] avatar Oct 18 '22 01:10 github-actions[bot]

:x: Forge suite compat failure on 843b204dce971d98449b82624f4f684c7a18b991 ==> bed7c59a82f3ff73d16ec6361568a13fcc11cbd8

Forge test runner terminated:
Trailing Log Lines:
Error from server (BadRequest): container "genesis" in pod "genesis-aptos-genesis-eforge11-bn42g" is waiting to start: trying and failing to pull image
{"level":"INFO","source":{"package":"forge","file":"testsuite/forge/src/backend/k8s/cluster_helper.rs:81"},"thread_name":"main","hostname":"forge-compat-pr-5050-1666057187-843b204dce971d98449b82624f4f684","timestamp":"2022-10-18T01:50:34.946920Z","message":"Genesis status: JobStatus { active: Some(1), completion_time: None, conditions: None, failed: None, start_time: Some(Time(2022-10-18T01:40:47Z)), succeeded: None }"}
{"level":"INFO","source":{"package":"forge","file":"testsuite/forge/src/backend/k8s/cluster_helper.rs:63"},"thread_name":"main","hostname":"forge-compat-pr-5050-1666057187-843b204dce971d98449b82624f4f684","timestamp":"2022-10-18T01:50:44.958835Z","message":"Genesis status: JobStatus { active: Some(1), completion_time: None, conditions: None, failed: None, start_time: Some(Time(2022-10-18T01:40:47Z)), succeeded: None }"}
Error from server (BadRequest): container "genesis" in pod "genesis-aptos-genesis-eforge11-bn42g" is waiting to start: trying and failing to pull image
{"level":"INFO","source":{"package":"forge","file":"testsuite/forge/src/backend/k8s/cluster_helper.rs:81"},"thread_name":"main","hostname":"forge-compat-pr-5050-1666057187-843b204dce971d98449b82624f4f684","timestamp":"2022-10-18T01:50:45.070689Z","message":"Genesis status: JobStatus { active: Some(1), completion_time: None, conditions: None, failed: None, start_time: Some(Time(2022-10-18T01:40:47Z)), succeeded: None }"}
{"level":"INFO","source":{"package":"forge","file":"testsuite/forge/src/backend/k8s/cluster_helper.rs:280"},"thread_name":"main","hostname":"forge-compat-pr-5050-1666057187-843b204dce971d98449b82624f4f684","timestamp":"2022-10-18T01:50:45.100846Z","message":"Deleting namespace forge-compat-pr-5050: Some(NamespaceStatus { phase: Some(\"Terminating\") })"}
{"level":"INFO","source":{"package":"forge","file":"testsuite/forge/src/backend/k8s/cluster_helper.rs:388"},"thread_name":"main","hostname":"forge-compat-pr-5050-1666057187-843b204dce971d98449b82624f4f684","timestamp":"2022-10-18T01:50:45.100874Z","message":"aptos-node resources for Forge removed in namespace: forge-compat-pr-5050"}
Failed to run tests:
Genesis did not succeed
Error: Genesis did not succeed
Debugging output:
NAME                                   READY   STATUS        RESTARTS   AGE
genesis-aptos-genesis-eforge11-bn42g   0/1     Terminating   0          10m

github-actions[bot] avatar Oct 18 '22 01:10 github-actions[bot]