[TESTING] Script for benchmarking builders locally
📝 Summary
Script created gives a opportunity to test performance of builder implementation and compare it to latest builder version. This gives an opportunity to ensure that builder works correctly and did not introduce any performance degradation.
Usage of a script is well described in Readme.md
High level usage:
- Run a script to build image
- Run a script to create a local infrastructure
- Wait for X blocks to be executed
- Analyze results in Grafana Dashboard
Here is a image of comparison of latest docker image vs latest docker image (Baseline to see if results are the same)
Next one is comparison of latest vs deneb branch built with command go run emulate_network.go build -t deneb - deneb seems to be a source for latest image so result should also be the same.
And the last one shows a difference between latest image and main branch (main seems to be outdated and tool clearly exposes a memory usage difference which on main is more than 2x higher, slower bid production on main branch and a bit different disk usage)
📚 References
Ethereum-package from Kurtosis which is used as a engine to run a devnet: https://github.com/kurtosis-tech/ethereum-package
- [X] I have seen and agree to
CONTRIBUTING.md
Some updated results as we've increased fuzzing rate since the description was added.
Latest vs latest:
Latest vs PR:
@avalonche fixed