chore: `[email protected]`
Codecov Report
:white_check_mark: All modified and coverable lines are covered by tests.
:white_check_mark: Project coverage is 93.40%. Comparing base (1fea5ea) to head (12ce246).
:warning: Report is 9 commits behind head on main.
Additional details and impacted files
@@ Coverage Diff @@
## main #3110 +/- ##
==========================================
- Coverage 93.41% 93.40% -0.02%
==========================================
Files 124 124
Lines 36178 36178
Branches 36178 36178
==========================================
- Hits 33796 33791 -5
- Misses 1536 1539 +3
- Partials 846 848 +2
| Components | Coverage Δ | |
|---|---|---|
| neqo-common | 97.32% <ø> (ø) |
|
| neqo-crypto | 83.25% <ø> (-0.48%) |
:arrow_down: |
| neqo-http3 | 93.34% <ø> (ø) |
|
| neqo-qpack | 94.18% <ø> (ø) |
|
| neqo-transport | 94.50% <ø> (+0.03%) |
:arrow_up: |
| neqo-udp | 78.94% <ø> (-0.48%) |
:arrow_down: |
| mtu | 85.76% <ø> (ø) |
Failed Interop Tests
QUIC Interop Runner, client vs. server, differences relative to d4d877ae225bf10b221a94ac15d024bb20356d9a.
neqo-latest as client
- neqo-latest vs. go-x-net: BP BA
- neqo-latest vs. haproxy: :warning:L1 BP BA
- neqo-latest vs. kwik: BP BA
- neqo-latest vs. lsquic: L1 C1
- neqo-latest vs. msquic: R :rocket:~~Z~~ A L1 C1 :warning:C2
- neqo-latest vs. mvfst: A L1 C1 :warning:BA
- neqo-latest vs. neqo: A
- neqo-latest vs. neqo-latest: A
- neqo-latest vs. nginx: BP BA
- neqo-latest vs. ngtcp2: :warning:R Z L1 C1 CM
- neqo-latest vs. picoquic: Z A :rocket:~~L1~~ C1
- neqo-latest vs. quic-go: A
- neqo-latest vs. quiche: BP BA
- neqo-latest vs. s2n-quic: BP BA CM
- neqo-latest vs. tquic: S BP BA
- neqo-latest vs. xquic: run cancelled after 20 min
neqo-latest as server
- aioquic vs. neqo-latest: CM
- go-x-net vs. neqo-latest: CM
- kwik vs. neqo-latest: BP BA CM
- msquic vs. neqo-latest: :rocket:~~U~~ :warning:BA CM
- mvfst vs. neqo-latest: Z A L1 C1 CM
- neqo vs. neqo-latest: A
- openssl vs. neqo-latest: LR M A CM
- quic-go vs. neqo-latest: CM
- quiche vs. neqo-latest: CM
- quinn vs. neqo-latest: V2 CM
- s2n-quic vs. neqo-latest: :rocket:~~L1~~ CM
- tquic vs. neqo-latest: CM
- xquic vs. neqo-latest: :warning:M CM
All results
Succeeded Interop Tests
QUIC Interop Runner, client vs. server
neqo-latest as client
- neqo-latest vs. aioquic: H DC LR C20 M S R Z 3 B U A L1 L2 C1 C2 6 V2 BP BA
- neqo-latest vs. go-x-net: H DC LR M B U A L2 C2 6
- neqo-latest vs. haproxy: H DC LR C20 M S R Z 3 B U A :warning:L1 L2 C1 C2 6 V2
- neqo-latest vs. kwik: H DC LR C20 M S R Z 3 B U A L1 L2 C1 C2 6 V2
- neqo-latest vs. linuxquic: H DC LR C20 M S R Z 3 B U E A L1 L2 C1 C2 6 V2 BP BA CM
- neqo-latest vs. lsquic: H DC LR C20 M S R Z 3 B U E A L2 C2 6 V2 BP BA CM
- neqo-latest vs. msquic: H DC LR C20 M S :rocket:~~Z~~ B U L2 :warning:C2 6 V2 BP BA
- neqo-latest vs. mvfst: H DC LR M R Z 3 B U L2 C2 6 BP :warning:BA
- neqo-latest vs. neqo: H DC LR C20 M S R Z 3 B U E L1 L2 C1 C2 6 V2 BP BA CM
- neqo-latest vs. neqo-latest: H DC LR C20 M S R Z 3 B U E L1 L2 C1 C2 6 V2 BP BA CM
- neqo-latest vs. nginx: H DC LR C20 M S R Z 3 B U A L1 L2 C1 C2 6
- neqo-latest vs. ngtcp2: H DC LR C20 M S :warning:R Z 3 B U E A :warning:L1 L2 :warning:C1 C2 6 V2 BP BA
- neqo-latest vs. picoquic: H DC LR C20 M S R 3 B U E :rocket:~~L1~~ L2 C2 6 V2 BP BA
- neqo-latest vs. quic-go: H DC LR C20 M S R Z 3 B U L1 L2 C1 C2 6 BP BA
- neqo-latest vs. quiche: H DC LR C20 M S R Z 3 B U A L1 L2 C1 C2 6
- neqo-latest vs. quinn: H DC LR C20 M S R Z 3 B U E A L1 L2 C1 C2 6 BP BA
- neqo-latest vs. s2n-quic: H DC LR C20 M S R 3 B U E A L1 L2 C1 C2 6
- neqo-latest vs. tquic: H DC LR C20 M R Z 3 B U A L1 L2 C1 C2 6
neqo-latest as server
- aioquic vs. neqo-latest: H DC LR C20 M S R Z 3 B U A L1 L2 C1 C2 6 V2 BP BA
- chrome vs. neqo-latest: 3
- go-x-net vs. neqo-latest: H DC LR M B U A L2 C2 6 BP BA
- kwik vs. neqo-latest: H DC LR C20 M S R Z 3 B U A L1 L2 C1 C2 6 V2
- linuxquic vs. neqo-latest: H DC LR C20 M S R Z 3 B U E A L1 L2 C1 C2 6 V2 BP BA CM
- lsquic vs. neqo-latest: H DC LR C20 M S R 3 B E A L1 L2 C1 C2 6 V2 BP BA CM
- msquic vs. neqo-latest: H DC LR C20 M S R Z B :rocket:~~U~~ A L1 L2 C1 C2 6 V2 BP :warning:BA
- mvfst vs. neqo-latest: H DC LR M 3 B L2 C2 6 BP BA
- neqo vs. neqo-latest: H DC LR C20 M S R Z 3 B U E L1 L2 C1 C2 6 V2 BP BA CM
- ngtcp2 vs. neqo-latest: H DC LR C20 M S R Z 3 B U E A L1 L2 C1 C2 6 V2 BP BA CM
- openssl vs. neqo-latest: H DC C20 S R 3 B L2 C2 6 BP BA
- picoquic vs. neqo-latest: H DC LR C20 M S R Z 3 B U E A L1 L2 C1 C2 6 V2 BP BA CM
- quic-go vs. neqo-latest: H DC LR C20 M S R Z 3 B U A L1 L2 C1 C2 6 BP BA
- quiche vs. neqo-latest: H DC LR M S R Z 3 B A L1 L2 C1 C2 6 BP BA
- quinn vs. neqo-latest: H DC LR C20 M S R Z 3 B U E A L1 L2 C1 C2 6 BP BA
- s2n-quic vs. neqo-latest: H DC LR M S R 3 B E A :rocket:~~L1~~ L2 C1 C2 6 BP BA
- tquic vs. neqo-latest: H DC LR M S R Z 3 B A L1 L2 C1 C2 6 BP BA
- xquic vs. neqo-latest: :rocket:~~H DC LR C20 S R Z 3 B U A L1 L2 C1 C2 6 BP BA~~
Unsupported Interop Tests
QUIC Interop Runner, client vs. server
neqo-latest as client
- neqo-latest vs. aioquic: E CM
- neqo-latest vs. go-x-net: C20 S R Z 3 E L1 C1 V2 CM
- neqo-latest vs. haproxy: E CM
- neqo-latest vs. kwik: E CM
- neqo-latest vs. msquic: 3 E CM
- neqo-latest vs. mvfst: C20 S E V2 CM
- neqo-latest vs. nginx: E V2 CM
- neqo-latest vs. picoquic: CM
- neqo-latest vs. quic-go: E V2 CM
- neqo-latest vs. quiche: E V2 CM
- neqo-latest vs. quinn: V2 CM
- neqo-latest vs. s2n-quic: Z V2
- neqo-latest vs. tquic: E V2 CM
neqo-latest as server
- aioquic vs. neqo-latest: E
- chrome vs. neqo-latest: H DC LR C20 M S R Z B U E A L1 L2 C1 C2 6 V2 BP BA CM
- go-x-net vs. neqo-latest: C20 S R Z 3 E L1 C1 V2
- kwik vs. neqo-latest: E
- lsquic vs. neqo-latest: Z U
- msquic vs. neqo-latest: 3 E
- mvfst vs. neqo-latest: C20 S R U E V2
- openssl vs. neqo-latest: Z U E L1 C1 V2
- quic-go vs. neqo-latest: E V2
- quiche vs. neqo-latest: C20 U E V2
- s2n-quic vs. neqo-latest: C20 Z U V2
- tquic vs. neqo-latest: C20 U E V2
- xquic vs. neqo-latest: E V2
Client/server transfer results
Performance differences relative to 6d56ec96fc97b488b0d67df1e72807386fdb23dd.
Transfer of 33554432 bytes over loopback, min. 100 runs. All unit-less numbers are in milliseconds.
| Client vs. server (params) | Mean ± σ | Min | Max | MiB/s ± σ | Δ main |
Δ main |
|---|---|---|---|---|---|---|
| google vs. google | 465.4 ± 4.7 | 456.1 | 475.9 | 68.8 ± 6.8 | ||
| google vs. neqo (cubic, paced) | 282.9 ± 4.9 | 273.1 | 302.6 | 113.1 ± 6.5 | :broken_heart: 1.7 | 0.6% |
| msquic vs. msquic | 180.2 ± 53.8 | 137.2 | 394.0 | 177.5 ± 0.6 | ||
| msquic vs. neqo (cubic, paced) | 199.2 ± 56.0 | 149.2 | 412.3 | 160.7 ± 0.6 | -9.6 | -4.6% |
| neqo vs. google (cubic, paced) | 769.3 ± 4.7 | 761.8 | 784.4 | 41.6 ± 6.8 | -0.6 | -0.1% |
| neqo vs. msquic (cubic, paced) | 158.0 ± 6.1 | 148.7 | 190.3 | 202.5 ± 5.2 | 0.6 | 0.4% |
| neqo vs. neqo (cubic) | 95.7 ± 6.0 | 86.7 | 112.4 | 334.5 ± 5.3 | :broken_heart: 1.5 | 1.6% |
| neqo vs. neqo (cubic, paced) | 96.7 ± 5.7 | 86.5 | 126.7 | 330.8 ± 5.6 | 0.7 | 0.7% |
| neqo vs. neqo (reno) | 93.0 ± 4.6 | 86.6 | 109.6 | 344.3 ± 7.0 | :green_heart: -1.9 | -2.0% |
| neqo vs. neqo (reno, paced) | 94.7 ± 5.7 | 84.3 | 113.2 | 337.9 ± 5.6 | 0.5 | 0.6% |
| neqo vs. quiche (cubic, paced) | 192.7 ± 4.6 | 186.0 | 204.7 | 166.0 ± 7.0 | -0.2 | -0.1% |
| neqo vs. s2n (cubic, paced) | 221.6 ± 4.5 | 214.4 | 232.2 | 144.4 ± 7.1 | :green_heart: -1.3 | -0.6% |
| quiche vs. neqo (cubic, paced) | 152.6 ± 4.9 | 141.9 | 164.7 | 209.7 ± 6.5 | -0.5 | -0.4% |
| quiche vs. quiche | 143.8 ± 4.7 | 135.7 | 154.1 | 222.5 ± 6.8 | ||
| s2n vs. neqo (cubic, paced) | 172.5 ± 5.3 | 164.5 | 183.7 | 185.5 ± 6.0 | -0.2 | -0.1% |
| s2n vs. s2n | 246.9 ± 23.8 | 233.2 | 344.7 | 129.6 ± 1.3 |
Download data for profiler.firefox.com or download performance comparison data.
Bencher Report
| Branch | chore-idna-adapter |
| Testbed | On-prem |
🚨 1 Alert
| Iteration | Benchmark | Measure Units | View | Benchmark Result (Result Δ%) | Upper Boundary (Limit %) |
|---|---|---|---|---|---|
| 0 | google vs. neqo (cubic, paced) | Latency milliseconds (ms) | 📈 plot 🚷 threshold 🚨 alert (🔔) | 282.87 ms(+1.73%)Baseline: 278.05 ms | 281.91 ms (100.34%) |
Click to view all benchmark results
| Benchmark | Latency | Benchmark Result milliseconds (ms) (Result Δ%) | Upper Boundary milliseconds (ms) (Limit %) |
|---|---|---|---|
| google vs. neqo (cubic, paced) | 📈 view plot 🚷 view threshold 🚨 view alert (🔔) | 282.87 ms(+1.73%)Baseline: 278.05 ms | 281.91 ms (100.34%) |
| Benchmark | Latency | Benchmark Result milliseconds (ms) (Result Δ%) | Upper Boundary milliseconds (ms) (Limit %) |
|---|---|---|---|
| msquic vs. neqo (cubic, paced) | 📈 view plot 🚷 view threshold | 199.16 ms(+0.83%)Baseline: 197.52 ms | 234.44 ms (84.95%) |
| Benchmark | Latency | Benchmark Result milliseconds (ms) (Result Δ%) | Upper Boundary milliseconds (ms) (Limit %) |
|---|---|---|---|
| neqo vs. google (cubic, paced) | 📈 view plot 🚷 view threshold | 769.35 ms(+1.44%)Baseline: 758.42 ms | 769.71 ms (99.95%) |
| Benchmark | Latency | Benchmark Result milliseconds (ms) (Result Δ%) | Upper Boundary milliseconds (ms) (Limit %) |
|---|---|---|---|
| neqo vs. msquic (cubic, paced) | 📈 view plot 🚷 view threshold | 158.00 ms(+0.10%)Baseline: 157.84 ms | 160.80 ms (98.26%) |
| Benchmark | Latency | Benchmark Result milliseconds (ms) (Result Δ%) | Upper Boundary milliseconds (ms) (Limit %) |
|---|---|---|---|
| neqo vs. neqo (cubic) | 📈 view plot 🚷 view threshold | 95.66 ms(+4.90%)Baseline: 91.19 ms | 96.30 ms (99.33%) |
| Benchmark | Latency | Benchmark Result milliseconds (ms) (Result Δ%) | Upper Boundary milliseconds (ms) (Limit %) |
|---|---|---|---|
| neqo vs. neqo (cubic, paced) | 📈 view plot 🚷 view threshold | 96.73 ms(+4.46%)Baseline: 92.60 ms | 97.74 ms (98.97%) |
| Benchmark | Latency | Benchmark Result milliseconds (ms) (Result Δ%) | Upper Boundary milliseconds (ms) (Limit %) |
|---|---|---|---|
| neqo vs. neqo (reno) | 📈 view plot 🚷 view threshold | 92.95 ms(+1.86%)Baseline: 91.25 ms | 96.35 ms (96.48%) |
| Benchmark | Latency | Benchmark Result milliseconds (ms) (Result Δ%) | Upper Boundary milliseconds (ms) (Limit %) |
|---|---|---|---|
| neqo vs. neqo (reno, paced) | 📈 view plot 🚷 view threshold | 94.70 ms(+2.39%)Baseline: 92.49 ms | 97.42 ms (97.22%) |
| Benchmark | Latency | Benchmark Result milliseconds (ms) (Result Δ%) | Upper Boundary milliseconds (ms) (Limit %) |
|---|---|---|---|
| neqo vs. quiche (cubic, paced) | 📈 view plot 🚷 view threshold | 192.74 ms(-0.49%)Baseline: 193.68 ms | 197.06 ms (97.81%) |
| Benchmark | Latency | Benchmark Result milliseconds (ms) (Result Δ%) | Upper Boundary milliseconds (ms) (Limit %) |
|---|---|---|---|
| neqo vs. s2n (cubic, paced) | 📈 view plot 🚷 view threshold | 221.62 ms(+0.24%)Baseline: 221.08 ms | 224.05 ms (98.91%) |
| Benchmark | Latency | Benchmark Result milliseconds (ms) (Result Δ%) | Upper Boundary milliseconds (ms) (Limit %) |
|---|---|---|---|
| quiche vs. neqo (cubic, paced) | 📈 view plot 🚷 view threshold | 152.60 ms(-0.27%)Baseline: 153.02 ms | 158.21 ms (96.46%) |
| Benchmark | Latency | Benchmark Result milliseconds (ms) (Result Δ%) | Upper Boundary milliseconds (ms) (Limit %) |
|---|---|---|---|
| s2n vs. neqo (cubic, paced) | 📈 view plot 🚷 view threshold | 172.53 ms(-0.86%)Baseline: 174.02 ms | 178.09 ms (96.88%) |
Benchmark results
Performance differences relative to 6d56ec96fc97b488b0d67df1e72807386fdb23dd.
1-conn/1-100mb-resp/mtu-1504 (aka. Download)/client: No change in performance detected.
time: [198.26 ms 198.70 ms 199.20 ms]
thrpt: [502.02 MiB/s 503.27 MiB/s 504.40 MiB/s]
change:
time: [−0.5666% −0.2490% +0.0624%] (p = 0.12 > 0.05)
thrpt: [−0.0623% +0.2496% +0.5698%]
Found 1 outliers among 100 measurements (1.00%)
1 (1.00%) high severe
1-conn/10_000-parallel-1b-resp/mtu-1504 (aka. RPS)/client: No change in performance detected.
time: [286.73 ms 288.45 ms 290.16 ms]
thrpt: [34.464 Kelem/s 34.669 Kelem/s 34.875 Kelem/s]
change:
time: [−0.3945% +0.4242% +1.2712%] (p = 0.33 > 0.05)
thrpt: [−1.2552% −0.4224% +0.3961%]
Found 2 outliers among 100 measurements (2.00%)
1 (1.00%) low mild
1 (1.00%) high mild
1-conn/1-1b-resp/mtu-1504 (aka. HPS)/client: No change in performance detected.
time: [38.554 ms 38.695 ms 38.853 ms]
thrpt: [25.738 B/s 25.843 B/s 25.938 B/s]
change:
time: [−0.0981% +0.3542% +0.8346%] (p = 0.16 > 0.05)
thrpt: [−0.8277% −0.3529% +0.0982%]
Found 5 outliers among 100 measurements (5.00%)
1 (1.00%) high mild
4 (4.00%) high severe
1-conn/1-100mb-req/mtu-1504 (aka. Upload)/client: :green_heart: Performance has improved.
time: [202.02 ms 202.41 ms 202.95 ms]
thrpt: [492.74 MiB/s 494.05 MiB/s 495.00 MiB/s]
change:
time: [−2.2754% −2.0079% −1.6908%] (p = 0.00 +2.0491% +2.3284%]
Found 2 outliers among 100 measurements (2.00%)
2 (2.00%) high severe
decode 4096 bytes, mask ff: Change within noise threshold.
time: [10.627 µs 10.686 µs 10.763 µs]
change: [−1.5109% −0.8882% −0.2210%] (p = 0.00 Found 14 outliers among 100 measurements (14.00%)
4 (4.00%) low mild
1 (1.00%) high mild
9 (9.00%) high severedecode 1048576 bytes, mask ff: No change in performance detected.
time: [3.0188 ms 3.0282 ms 3.0393 ms]
change: [−0.7383% −0.2486% +0.2532%] (p = 0.32 > 0.05)
Found 8 outliers among 100 measurements (8.00%)
8 (8.00%) high severe
decode 4096 bytes, mask 7f: No change in performance detected.
time: [19.372 µs 19.424 µs 19.482 µs]
change: [−0.2409% +0.4109% +1.1385%] (p = 0.29 > 0.05)
Found 19 outliers among 100 measurements (19.00%)
2 (2.00%) low mild
1 (1.00%) high mild
16 (16.00%) high severe
decode 1048576 bytes, mask 7f: No change in performance detected.
time: [5.0352 ms 5.0487 ms 5.0653 ms]
change: [−0.5213% −0.1110% +0.3107%] (p = 0.60 > 0.05)
Found 13 outliers among 100 measurements (13.00%)
1 (1.00%) high mild
12 (12.00%) high severe
decode 4096 bytes, mask 3f: No change in performance detected.
time: [5.5189 µs 5.5356 µs 5.5584 µs]
change: [−0.3866% +0.1298% +0.6491%] (p = 0.65 > 0.05)
Found 8 outliers among 100 measurements (8.00%)
4 (4.00%) high mild
4 (4.00%) high severe
decode 1048576 bytes, mask 3f: No change in performance detected.
time: [1.5850 ms 1.5905 ms 1.5974 ms]
change: [−0.7684% −0.1618% +0.4128%] (p = 0.59 > 0.05)
Found 5 outliers among 100 measurements (5.00%)
5 (5.00%) high severe
1-streams/each-1000-bytes/wallclock-time: No change in performance detected.
time: [582.78 µs 584.91 µs 587.35 µs]
change: [−0.6215% +0.1755% +0.9061%] (p = 0.68 > 0.05)
Found 9 outliers among 100 measurements (9.00%)
1 (1.00%) low mild
8 (8.00%) high severe
1-streams/each-1000-bytes/simulated-time
time: [118.93 ms 119.14 ms 119.35 ms]
thrpt: [8.1821 KiB/s 8.1967 KiB/s 8.2111 KiB/s]
change:
time: [−0.0664% +0.1851% +0.4407%] (p = 0.15 > 0.05)
thrpt: [−0.4388% −0.1848% +0.0664%]
No change in performance detected.
Found 1 outliers among 100 measurements (1.00%)
1 (1.00%) high mild
1000-streams/each-1-bytes/wallclock-time: :broken_heart: Performance has regressed.
time: [13.560 ms 13.584 ms 13.609 ms]
change: [+7.3122% +7.7434% +8.1654%] (p = 0.00 1000-streams/each-1-bytes/simulated-time: :broken_heart: Performance has regressed.
time: [15.031 s 15.045 s 15.060 s]
thrpt: [66.403 B/s 66.466 B/s 66.530 B/s]
change:
time: [+543.98% +545.12% +546.25%] (p = 0.00 −84.499% −84.471%]
1000-streams/each-1000-bytes/wallclock-time: :green_heart: Performance has improved.
time: [47.419 ms 47.594 ms 47.777 ms]
change: [−6.8004% −6.3796% −5.9997%] (p = 0.00 Found 1 outliers among 100 measurements (1.00%)
1 (1.00%) high mild
1000-streams/each-1000-bytes/simulated-time
time: [18.777 s 18.942 s 19.106 s]
thrpt: [51.112 KiB/s 51.556 KiB/s 52.008 KiB/s]
change:
time: [+14.367% +16.460% +18.561%] (p = 0.00 < 0.05)
thrpt: [−15.655% −14.134% −12.562%]
:broken_heart: Performance has regressed.coalesce_acked_from_zero 1+1 entries: No change in performance detected.
time: [89.166 ns 89.516 ns 89.864 ns]
change: [−0.7243% −0.2205% +0.3057%] (p = 0.40 > 0.05)
Found 12 outliers among 100 measurements (12.00%)
9 (9.00%) high mild
3 (3.00%) high severe
coalesce_acked_from_zero 3+1 entries: No change in performance detected.
time: [106.03 ns 106.89 ns 108.22 ns]
change: [−1.1724% −0.5084% +0.1893%] (p = 0.16 > 0.05)
Found 15 outliers among 100 measurements (15.00%)
2 (2.00%) low mild
3 (3.00%) high mild
10 (10.00%) high severe
coalesce_acked_from_zero 10+1 entries: No change in performance detected.
time: [105.40 ns 105.88 ns 106.41 ns]
change: [−0.7398% −0.3441% +0.0266%] (p = 0.08 > 0.05)
Found 13 outliers among 100 measurements (13.00%)
5 (5.00%) low severe
2 (2.00%) low mild
6 (6.00%) high severe
coalesce_acked_from_zero 1000+1 entries: No change in performance detected.
time: [91.431 ns 91.557 ns 91.697 ns]
change: [−0.2931% +0.4326% +1.0994%] (p = 0.23 > 0.05)
Found 13 outliers among 100 measurements (13.00%)
6 (6.00%) high mild
7 (7.00%) high severe
RxStreamOrderer::inbound_frame(): Change within noise threshold.
time: [109.52 ms 109.58 ms 109.66 ms]
change: [−0.5339% −0.2481% −0.0414%] (p = 0.04 Found 12 outliers among 100 measurements (12.00%)
7 (7.00%) low mild
3 (3.00%) high mild
2 (2.00%) high severesent::Packets::take_ranges: No change in performance detected.
time: [4.4962 µs 4.5978 µs 4.6908 µs]
change: [−8.4237% −3.3744% +1.0814%] (p = 0.19 > 0.05)
Found 1 outliers among 100 measurements (1.00%)
1 (1.00%) high mild
transfer/pacing-false/varying-seeds/wallclock-time/run: Change within noise threshold.
time: [24.719 ms 24.766 ms 24.821 ms]
change: [−1.9817% −1.6659% −1.3717%] (p = 0.00 Found 3 outliers among 100 measurements (3.00%)
2 (2.00%) high mild
1 (1.00%) high severetransfer/pacing-false/varying-seeds/simulated-time/run: No change in performance detected.
time: [25.135 s 25.167 s 25.198 s]
thrpt: [162.55 KiB/s 162.76 KiB/s 162.96 KiB/s]
change:
time: [−0.3585% −0.1694% +0.0121%] (p = 0.08 > 0.05)
thrpt: [−0.0121% +0.1697% +0.3598%]
transfer/pacing-true/varying-seeds/wallclock-time/run: Change within noise threshold.
time: [25.180 ms 25.259 ms 25.345 ms]
change: [−2.9904% −2.6082% −2.2034%] (p = 0.00 Found 1 outliers among 100 measurements (1.00%)
1 (1.00%) high severetransfer/pacing-true/varying-seeds/simulated-time/run: No change in performance detected.
time: [24.941 s 24.979 s 25.019 s]
thrpt: [163.71 KiB/s 163.98 KiB/s 164.23 KiB/s]
change:
time: [−0.2644% −0.0329% +0.1985%] (p = 0.78 > 0.05)
thrpt: [−0.1981% +0.0329% +0.2651%]
Found 3 outliers among 100 measurements (3.00%)
3 (3.00%) high mild
transfer/pacing-false/same-seed/wallclock-time/run: Change within noise threshold.
time: [24.655 ms 24.685 ms 24.723 ms]
change: [−2.4563% −2.2404% −2.0360%] (p = 0.00 Found 3 outliers among 100 measurements (3.00%)
2 (2.00%) high mild
1 (1.00%) high severetransfer/pacing-false/same-seed/simulated-time/run: :broken_heart: Performance has regressed.
time: [25.525 s 25.525 s 25.525 s]
thrpt: [160.47 KiB/s 160.47 KiB/s 160.47 KiB/s]
change:
time: [+1.1497% +1.1497% +1.1497%] (p = 0.00 −1.1367% −1.1367%]
transfer/pacing-true/same-seed/wallclock-time/run: Change within noise threshold.
time: [26.425 ms 26.454 ms 26.496 ms]
change: [+0.3618% +0.5632% +0.7497%] (p = 0.00 Found 2 outliers among 100 measurements (2.00%)
1 (1.00%) high mild
1 (1.00%) high severetransfer/pacing-true/same-seed/simulated-time/run: Change within noise threshold.
time: [25.252 s 25.252 s 25.252 s]
thrpt: [162.21 KiB/s 162.21 KiB/s 162.21 KiB/s]
change:
time: [−0.1937% −0.1937% −0.1937%] (p = 0.00 +0.1941% +0.1941%]
Download data for profiler.firefox.com or download performance comparison data.
Bencher Report
| Branch | chore-idna-adapter |
| Testbed | On-prem |
🚨 1 Alert
| Benchmark | Measure Units | View | Benchmark Result (Result Δ%) | Upper Boundary (Limit %) |
|---|---|---|---|---|
| 1000-streams/each-1-bytes/simulated-time | Latency seconds (s) | 📈 plot 🚷 threshold 🚨 alert (🔔) | 15.04 s(+0.33%)Baseline: 15.00 s | 15.03 s (100.11%) |
Click to view all benchmark results
| Benchmark | Latency | Benchmark Result nanoseconds (ns) (Result Δ%) | Upper Boundary nanoseconds (ns) (Limit %) |
|---|---|---|---|
| 1-conn/1-100mb-req/mtu-1504 (aka. Upload)/client | 📈 view plot 🚷 view threshold | 202,410,000.00 ns(-2.17%)Baseline: 206,909,836.07 ns | 216,927,209.84 ns (93.31%) |
| 1-conn/1-100mb-resp/mtu-1504 (aka. Download)/client | 📈 view plot 🚷 view threshold | 198,700,000.00 ns(-1.13%)Baseline: 200,961,737.70 ns | 211,754,875.84 ns (93.83%) |
| 1-conn/1-1b-resp/mtu-1504 (aka. HPS)/client | 📈 view plot 🚷 view threshold | 38,695,000.00 ns(+25.91%)Baseline: 30,732,068.85 ns | 40,875,363.62 ns (94.67%) |
| 1-conn/10_000-parallel-1b-resp/mtu-1504 (aka. RPS)/client | 📈 view plot 🚷 view threshold | 288,450,000.00 ns(-1.13%)Baseline: 291,756,262.30 ns | 304,354,411.18 ns (94.77%) |
| 1-streams/each-1000-bytes/simulated-time | 📈 view plot 🚷 view threshold | 119,140,000.00 ns(+0.43%)Baseline: 118,626,918.03 ns | 120,767,887.46 ns (98.65%) |
| 1-streams/each-1000-bytes/wallclock-time | 📈 view plot 🚷 view threshold | 584,910.00 ns(-1.43%)Baseline: 593,418.46 ns | 617,007.61 ns (94.80%) |
| 1000-streams/each-1-bytes/simulated-time | 📈 view plot 🚷 view threshold 🚨 view alert (🔔) | 15,045,000,000.00 ns(+0.33%)Baseline: 14,996,032,786.89 ns | 15,029,202,410.93 ns (100.11%) |
| 1000-streams/each-1-bytes/wallclock-time | 📈 view plot 🚷 view threshold | 13,584,000.00 ns(-2.87%)Baseline: 13,984,688.52 ns | 14,871,498.82 ns (91.34%) |
| 1000-streams/each-1000-bytes/simulated-time | 📈 view plot 🚷 view threshold | 18,942,000,000.00 ns(-0.12%)Baseline: 18,963,980,327.87 ns | 19,244,149,881.63 ns (98.43%) |
| 1000-streams/each-1000-bytes/wallclock-time | 📈 view plot 🚷 view threshold | 47,594,000.00 ns(-5.97%)Baseline: 50,618,406.56 ns | 57,426,013.99 ns (82.88%) |
| RxStreamOrderer::inbound_frame() | 📈 view plot 🚷 view threshold | 109,580,000.00 ns(-0.10%)Baseline: 109,684,852.46 ns | 111,652,559.72 ns (98.14%) |
| coalesce_acked_from_zero 1+1 entries | 📈 view plot 🚷 view threshold | 89.52 ns(+0.86%)Baseline: 88.75 ns | 89.80 ns (99.68%) |
| coalesce_acked_from_zero 10+1 entries | 📈 view plot 🚷 view threshold | 105.88 ns(-0.15%)Baseline: 106.04 ns | 107.15 ns (98.82%) |
| coalesce_acked_from_zero 1000+1 entries | 📈 view plot 🚷 view threshold | 91.56 ns(+1.65%)Baseline: 90.07 ns | 94.57 ns (96.82%) |
| coalesce_acked_from_zero 3+1 entries | 📈 view plot 🚷 view threshold | 106.89 ns(+0.31%)Baseline: 106.56 ns | 107.61 ns (99.34%) |
| decode 1048576 bytes, mask 3f | 📈 view plot 🚷 view threshold | 1,590,500.00 ns(-2.20%)Baseline: 1,626,357.05 ns | 1,788,323.38 ns (88.94%) |
| decode 1048576 bytes, mask 7f | 📈 view plot 🚷 view threshold | 5,048,700.00 ns(-0.33%)Baseline: 5,065,363.93 ns | 5,110,593.24 ns (98.79%) |
| decode 1048576 bytes, mask ff | 📈 view plot 🚷 view threshold | 3,028,200.00 ns(-0.03%)Baseline: 3,029,063.93 ns | 3,046,931.27 ns (99.39%) |
| decode 4096 bytes, mask 3f | 📈 view plot 🚷 view threshold | 5,535.60 ns(-25.42%)Baseline: 7,422.24 ns | 10,414.66 ns (53.15%) |
| decode 4096 bytes, mask 7f | 📈 view plot 🚷 view threshold | 19,424.00 ns(-1.97%)Baseline: 19,814.87 ns | 20,477.17 ns (94.86%) |
| decode 4096 bytes, mask ff | 📈 view plot 🚷 view threshold | 10,686.00 ns(-6.08%)Baseline: 11,377.50 ns | 12,559.35 ns (85.08%) |
| sent::Packets::take_ranges | 📈 view plot 🚷 view threshold | 4,597.80 ns(-2.81%)Baseline: 4,730.68 ns | 4,965.28 ns (92.60%) |
| transfer/pacing-false/same-seed/simulated-time/run | 📈 view plot 🚷 view threshold | 25,525,000,000.00 ns(+0.36%)Baseline: 25,434,422,442.24 ns | 26,073,382,879.69 ns (97.90%) |
| transfer/pacing-false/same-seed/wallclock-time/run | 📈 view plot 🚷 view threshold | 24,685,000.00 ns(-4.32%)Baseline: 25,799,924.09 ns | 27,067,190.44 ns (91.20%) |
| transfer/pacing-false/varying-seeds/simulated-time/run | 📈 view plot 🚷 view threshold | 25,167,000,000.00 ns(-0.02%)Baseline: 25,172,871,287.13 ns | 25,220,428,385.68 ns (99.79%) |
| transfer/pacing-false/varying-seeds/wallclock-time/run | 📈 view plot 🚷 view threshold | 24,766,000.00 ns(-4.21%)Baseline: 25,853,798.68 ns | 27,485,159.50 ns (90.11%) |
| transfer/pacing-true/same-seed/simulated-time/run | 📈 view plot 🚷 view threshold | 25,252,000,000.00 ns(-1.41%)Baseline: 25,613,821,782.18 ns | 25,824,915,988.32 ns (97.78%) |
| transfer/pacing-true/same-seed/wallclock-time/run | 📈 view plot 🚷 view threshold | 26,454,000.00 ns(-2.44%)Baseline: 27,115,617.16 ns | 28,657,945.44 ns (92.31%) |
| transfer/pacing-true/varying-seeds/simulated-time/run | 📈 view plot 🚷 view threshold | 24,979,000,000.00 ns(-0.06%)Baseline: 24,993,475,247.52 ns | 25,040,872,952.52 ns (99.75%) |
| transfer/pacing-true/varying-seeds/wallclock-time/run | 📈 view plot 🚷 view threshold | 25,259,000.00 ns(-4.15%)Baseline: 26,352,372.94 ns | 28,081,813.41 ns (89.95%) |
Needs MSRV >= 1.82.