test-plans icon indicating copy to clipboard operation
test-plans copied to clipboard

perf: latency dashboard is misleading

Open marten-seemann opened this issue 2 years ago • 1 comments

The latency dashboard shows connection establishment latency + 1 round trip, and shows the ping latency in the same plot. ICMP Ping doesn't contain the additional 1 round trip, so it makes all other implementations look worse than they actually are.

Not ideal, but maybe a better way to visualize things is to plot measurement results in multiples of the round trip, and subtract the 1 round trip from our measurement results.

marten-seemann avatar Aug 25 '23 03:08 marten-seemann

I see your point.

I am hesitant to do any math beyond a simple boxplot on the data, as that would obfuscate details.

Instead I suggest to tackle the confusion with better documentation. We already have the line below. I think for each graph we should put the baseline (ping and iperf) into context.

show baseline - whether to display the baseline measurement, that is ping for latency and iperf for throughput:

mxinden avatar Aug 25 '23 09:08 mxinden