hyper icon indicating copy to clipboard operation
hyper copied to clipboard

Flaky benchmark for http2 with adaptive window

Open dswij opened this issue 1 year ago • 1 comments

The benchmark for the http2 adaptive window is inconsistent across runs. This will cause CI to be marked as a failure occasionally whenever there is a drop in benchmark results.

See for example https://github.com/hyperium/hyper/actions/runs/7786695842/job/21232101297.

dswij avatar Feb 16 '24 16:02 dswij

Yea, I think a problem with that benchmark is that it would most helpful when we can "control" the bandwidth. Currently, since it's a connection of localhost, it can blast all the bytes at full speed (fuller than real world), and then it's just based on the scheduler and other guests on the CI runner.

seanmonstar avatar Feb 16 '24 16:02 seanmonstar