sharding-p2p-poc icon indicating copy to clipboard operation
sharding-p2p-poc copied to clipboard

Published 20 hours ago • verified publisher icon ethresearch

Design testing spec

Open mhchia opened this issue 6 years ago • 4 comments

What is wrong?

The testing spec is not clear for now.

How can it be fixed?

Design a formal testing spec

  • Network topology
    • Description for nodes(latency, connections, actor(role), …)
    • Spinning up nodes at beginning or gradually?
    • Deterministic simulations(can be reproduced)
    • Stochastic factors(e.g. nodes arriving time, random delay between actions, ...)
    • Survey if YANG helps
  • Failure conditions

mhchia avatar Jul 27 '18 06:07 mhchia

I think it would be good to design it to add some sort of stochastic element to the simulation. You could sample from an exponential distribution to generate the time until the next node joins or leaves. This is also nice bc you can modify the behavior of the sim by simply changing the params of the distribution.

jrhea avatar Jul 28 '18 03:07 jrhea

Agree. My thought was to start from the deterministic simulation, because it is easier to reproduce. We can also have stochastic factors specified in the spec.

mhchia avatar Jul 28 '18 09:07 mhchia

I have updated it in the issue, thanks a lot for pointing it out!

mhchia avatar Jul 28 '18 09:07 mhchia

Point to the testing plan: https://notes.ethereum.org/Q_kQKXZUQD29YCshej1qPQ

mhchia avatar Dec 14 '18 03:12 mhchia