Slow execution (in general)

[namiloh]

Earlier, nimbus-eth1 was one of the fastest evms, but in the last months, it has been by far the slowest. Here are some stats from a 90 hours of fuzzing

INFO [03-15|07:40:39.579] Executing                                tests=5,968,164 time=91h0m40.009s     test/s=18.2 "avg steps"=3098.1  global=5,968,164
INFO [03-15|07:40:39.579] Stats gethbatch-0                        execSpeed=121.2ms longest=40.549808945s    count=1,985,566
INFO [03-15|07:40:39.579] Stats nethbatch-0                        execSpeed=94.7ms  longest=42.301876462s    count=2,275,150
INFO [03-15|07:40:39.579] Stats besubatch-0                        execSpeed=148.2ms longest=38.015906585s    count=2,173,890
INFO [03-15|07:40:39.579] Stats erigonbatch-0                      execSpeed=181ms   longest=56.35799268s     count=1,624,566
INFO [03-15|07:40:39.579] Stats nimbus-0                           execSpeed=298ms   longest=21m44.533083944s count=600,659
INFO [03-15|07:40:39.579] Stats evmone-0                           execSpeed=126.8ms longest=1m2.163421388s   count=2,124,651
INFO [03-15|07:40:39.579] Stats revm-0                             execSpeed=232.3ms longest=1m32.551078339s  count=1,151,849

All other clients performed over 1M tests, nimbus-eth1 only 600K. The slowest of the other clients was nearly double as fast as nimbus-eth1.

I suspect that some regression has been introduced (possibly some kzg initialization?) which adds overhead on startup.