API Server Latency buckets are skewed in large scale clusters

[vakalapa]

Describe the bug A clear and concise description of what the bug is.

On this large-scale cluster, all latencies are in the +inf category. Discussed increasing max bucket so that we have better information if latency is larger than 4.5ms (highest bucket currently).

Discussed making bucket width 1ms, starting at 0.5ms so that we don't get a lot of 0ms counts

cc @huntergregory @anubhabMajumdar

[rbtr]

@iamrajhans i see your linked PR, do you want this issue too?

[iamrajhans]

@rbtr yeah

[github-actions[bot]]

This issue is stale because it has been open for 7 days with no activity. Remove stale label or comment or this will be closed in 7 days