iroha icon indicating copy to clipboard operation
iroha copied to clipboard

Fix benchmarks

Open appetrosyan opened this issue 2 years ago • 5 comments

MWE

run

cargo bench

Expected

Works

Actual

Error messages in logs complaining about not being able to find alice@1@wonderland.

appetrosyan avatar May 18 '22 09:05 appetrosyan

Disambiguation. If this issue refers to WARN logs such as below on running cargo bench --bench tps-dev, then #2078 is responsible for it. This occurs when the interval_us_per_tx configuration is too short.

image image

Apart from that, I found another issue by accident. The tps-dev benchmark seems to have broken at some point since #1963. As of efa9a35692a949707ae0752119e4c4a1a08342a1, it fails with

thread 'main' panicked at 'The block is not yet in WSV. Need more sleep?', client/benches/tps/lib.rs:94:22

message, which would not be resolved by increasing the sleep (at least in 32 seconds, I've confirmed). This means the same number of blocks as the configuration are never applied to WSV. One possible cause is that the event counters are detecting more events than the actual number of blocks committed, and exiting prematurely

s8sato avatar Jun 02 '22 12:06 s8sato

The formatting "rose#wonderland@@wonderland" seems odd to me.

appetrosyan avatar Jun 02 '22 12:06 appetrosyan

I think so too. Created #2310

s8sato avatar Jun 02 '22 13:06 s8sato

I believe this is actually a consensus issue. It is probably the case that sumeragi currently can't handle high load due to some bug. This bug is however only triggered during the benchmark since it is the only time sumeragi is put under high tx load.

SamHSmith avatar Jul 28 '22 09:07 SamHSmith

Related #2078

appetrosyan avatar Jul 31 '22 21:07 appetrosyan

This issue no longer happens and so it can be closed.

SamHSmith avatar Oct 03 '22 14:10 SamHSmith