interchain-security
interchain-security copied to clipboard
EPIC: Refactor existing e2e testing framework
Problem
ICS e2e testing uses a long bash script to initialize the testing environment.
Although there is nothing wrong with using bash scripts they quickly become poorly maintained due to their imperative and verbose nature.
Besides that, in the current setup it is difficult to achieve the following:
- using arbitrary provider and consumer chains
- configuring multi-consumer setups
- getting comprehensive and understandable test output
- import the e2e testing framework into both provider and consumer chain repositories
- run in the CI
Closing criteria
At minimum the new test initialization should become declarative and allow easier running in the CI and allow arbitrary chain binaries to be used.
Related:
- https://github.com/cosmos/gaia/issues/2434
- https://github.com/cosmos/gaia/issues/2435
- https://github.com/cosmos/interchain-security/issues/875
### Tasks
- [ ] https://github.com/cosmos/interchain-security/issues/1132
- [ ] https://github.com/cosmos/interchain-security/issues/1167
- [ ] https://github.com/cosmos/interchain-security/issues/1178
- [ ] https://github.com/cosmos/interchain-security/issues/1133
- [ ] https://github.com/cosmos/interchain-security/issues/1134
- [ ] https://github.com/cosmos/interchain-security/issues/1135
- [ ] evaluate benefits of adding e2e tests of other libs into our CI [cosmos-sdk, ibc-go, other deps]
- [ ] https://github.com/cosmos/interchain-security/issues/1175
- [ ] https://github.com/cosmos/interchain-security/issues/1559
@MSalopek Is this EPIC still needed?