celestia-node icon indicating copy to clipboard operation
celestia-node copied to clipboard

Published 20 hours ago • verified publisher icon celestiaorg

[EPIC] e2e: Celestia network tests

Open liamsi opened this issue 3 years ago • 5 comments

Celestia network tests roadmap

Before incentivised testnet, we should have a set of test plans that contain such scenarios:

  • [x] PoC: testground is a viable option for further test automation to catch regressions on a e2e level
    • #638
  • [x] K8s Infra Setup:
    • https://github.com/celestiaorg/test-infra/issues/25
  • [x] appkit: Finish app-validator story
    • https://github.com/celestiaorg/test-infra/issues/24
  • [x] plan 1: Big blocks
    • https://github.com/celestiaorg/test-infra/issues/77
  • [ ] plan 2: Benchmarking Bridge/Full nodes serving shares to Light Nodes
    • https://github.com/celestiaorg/test-infra/issues/83
  • [ ] plan 3: Node download data by namespace
    • #602 (for plan 1/2)
  • [ ] plan 4: Peer discovery (peers (quickly) find/discover each other)
    • #649
  • [ ] plan 5: Block recovery
    • https://github.com/celestiaorg/test-infra/issues/21,
    • #600
  • [ ] plan 6: composition tests for sync scenarios
    • #647 Nice to have:
  • [ ] plan 7: working out custom malicious app nodes to test out befp

CI/CD

In order to put out the tests above into a regular run cadence/schedule we need to do the following:

  1. Polish/Harden out the set of tests that are used for experiments
  2. Split tests by amount of instances and which test-plans are executed in different stages
  3. Define the inbound requirements which triggers test runs (e.g. once a release candidate is released in either of the stack app/node/optimint)
  4. Implement a new github action for e2e/network runs
  5. Store a bucket of output logs
  6. Notification mechanism

liamsi avatar Mar 10 '21 17:03 liamsi

This will be resolved with Swamp.

Wondertan avatar Jan 13 '22 12:01 Wondertan

Ref: #315

adlerjohn avatar Jan 13 '22 13:01 adlerjohn

Swamp PR was merged now but at least some of this was rather about e2e tests with more realistic networking instead of integration tests and mocked networks. But feel free to close this in favour of more concrete and actionable issues.

liamsi avatar Jan 30 '22 23:01 liamsi

@Bidon15 1 bridge (4MB) and 1k light nodes das it

Bidon15 avatar Sep 28 '22 14:09 Bidon15

@Bidon15 1 bridge (4MB) and 1k light nodes das it

Updated the issue description to reflect this upcoming test-plan

Bidon15 avatar Oct 04 '22 10:10 Bidon15

Will be closed as https://github.com/celestiaorg/test-infra/issues/21 this is getting to the finishing line implementation wise

This one will be on it's own https://github.com/celestiaorg/celestia-node/issues/647

Bidon15 avatar Apr 21 '23 10:04 Bidon15

We will close this issue once we get manual work for BR ods 128

Bidon15 avatar Jun 12 '23 09:06 Bidon15