istio.io icon indicating copy to clipboard operation
istio.io copied to clipboard

istio.io performance numbers

Open linsun opened this issue 1 year ago • 6 comments

@danehans noticed the performance numbers seems odd between 1.21 and 1.22, for sidecars.

https://istio.io/latest/docs/ops/deployment/performance-and-scalability/#latency-for-istio-121 https://preliminary.istio.io/latest/docs/ops/deployment/performance-and-scalability/#latency-for-istio-122

We'd expect the sidecars numbers to be similar given tested on the same hardware. @Shuayb1 - iirc, when testing sidecars, you used ambient profile which has HBONE enabled, vs the default profile. Can you please confirm this? If so, could you rerun with default profile for sidecars?

linsun avatar Jun 17 '24 17:06 linsun

Yes, I used the ambient profile.

These are the graphs for the sidecars P90 istio-1 22-fortio-p90

p99 istio-1 22-fortio-p99

Below is also p90 graph from the ambient test with the default profile: newall

Shuayb1 avatar Jun 18 '24 10:06 Shuayb1

Thanks Shuayb! So the higher latency is caused by running sidecars with HBONE while with ambient profile. Could you generate the graph with the new numbers for sidecars (when using the default profile)? cc @craigbox

linsun avatar Jun 18 '24 14:06 linsun

What's the best number to use for describing "average" latency in general, for use on an overview page for example? p50? Can we have those numbers too please (maybe not in a graph; maybe I just need a pointer to the source data)

craigbox avatar Jun 18 '24 23:06 craigbox

What's the best number to use for describing "average" latency in general, for use on an overview page for example? p50? Can we have those numbers too please (maybe not in a graph; maybe I just need a pointer to the source data)

This is the data for the sidecar test using the default mode: sidecar.csv

and this is for the ambient test using the default mode: ambient.csv

Shuayb1 avatar Jun 19 '24 11:06 Shuayb1

How do you generate the graphs? Should we put p50 on the page too? @howardjohn may have an opinion

craigbox avatar Jul 01 '24 02:07 craigbox

It is as discussed in the Slack chat. Thanks.

Shuayb1 avatar Jul 03 '24 00:07 Shuayb1