libdatadog icon indicating copy to clipboard operation
libdatadog copied to clipboard

chore(ci): set benchmarking jobs to be interruptible outside main

Open igoragoli opened this issue 1 week ago • 1 comments
trafficstars

What does this PR do?

  • Sets benchmarking jobs to be interruptible outside main.

Motivation

#incident-45572 and APMSP-2369.

How to test the change?

A dummy commit, b67e3d0, interrupts benchmarking jobs from a previous pipeline:

image

igoragoli avatar Nov 18 '25 15:11 igoragoli

Codecov Report

:white_check_mark: All modified and coverable lines are covered by tests. :white_check_mark: Project coverage is 70.97%. Comparing base (3e9119a) to head (3d789de).

Additional details and impacted files
@@            Coverage Diff             @@
##             main    #1356      +/-   ##
==========================================
+ Coverage   70.95%   70.97%   +0.02%     
==========================================
  Files         390      390              
  Lines       62562    62562              
==========================================
+ Hits        44389    44403      +14     
+ Misses      18173    18159      -14     
Components Coverage Δ
libdd-crashtracker 57.73% <ø> (+0.08%) :arrow_up:
libdd-crashtracker-ffi 14.60% <ø> (ø)
libdd-alloc 98.73% <ø> (ø)
libdd-data-pipeline 86.02% <ø> (ø)
libdd-data-pipeline-ffi 77.74% <ø> (ø)
libdd-common 80.93% <ø> (ø)
libdd-common-ffi 73.90% <ø> (ø)
libdd-telemetry 59.98% <ø> (-0.04%) :arrow_down:
libdd-telemetry-ffi 21.24% <ø> (ø)
libdd-dogstatsd-client 83.75% <ø> (ø)
datadog-ipc 82.67% <ø> (+0.06%) :arrow_up:
libdd-profiling 79.65% <ø> (ø)
libdd-profiling-ffi 62.13% <ø> (ø)
datadog-sidecar 35.91% <ø> (ø)
datdog-sidecar-ffi 10.99% <ø> (ø)
spawn-worker 55.18% <ø> (ø)
libdd-tinybytes 92.44% <ø> (ø)
libdd-trace-normalization 98.24% <ø> (ø)
datadog-trace-obfuscation 94.17% <ø> (ø)
libdd-trace-protobuf 59.65% <ø> (ø)
libdd-trace-utils 90.07% <ø> (ø)
datadog-tracer-flare 63.49% <ø> (ø)
libdd-log 75.57% <ø> (ø)
:rocket: New features to boost your workflow:
  • :snowflake: Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

codecov-commenter avatar Nov 18 '25 16:11 codecov-commenter

/merge

igoragoli avatar Nov 19 '25 15:11 igoragoli

View all feedbacks in Devflow UI.

2025-11-19 15:03:50 UTC :information_source: Start processing command /merge


2025-11-19 15:03:56 UTC :information_source: MergeQueue: waiting for PR to be ready

This pull request is not mergeable according to GitHub. Common reasons include pending required checks, missing approvals, or merge conflicts — but it could also be blocked by other repository rules or settings. It will be added to the queue as soon as checks pass and/or get approvals. Note: if you pushed new commits since the last approval, you may need additional approval. You can remove it from the waiting list with /remove command.


2025-11-19 15:23:31 UTC :information_source: MergeQueue: merge request added to the queue

The expected merge time in main is approximately 35m (p90).


2025-11-19 15:43:02 UTC :information_source: MergeQueue: This merge request was merged

Benchmarks

Comparison

Benchmark execution time: 2025-11-19 15:24:42

Comparing candidate commit 3d789de5 in PR branch augusto.deoliveira/apmsp-2369.ensure-correct-interrupt-policy with baseline commit 3e9119ad in branch main.

Found 0 performance improvements and 0 performance regressions! Performance is the same for 55 metrics, 2 unstable metrics.

Candidate

Candidate benchmark details

Group 1

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 3d789de5 1763564597 augusto.deoliveira/apmsp-2369.ensure-correct-interrupt-policy
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
concentrator/add_spans_to_concentrator execution_time 10.656ms 10.698ms ± 0.015ms 10.697ms ± 0.009ms 10.705ms 10.723ms 10.744ms 10.770ms 0.68% 0.919 3.029 0.14% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
concentrator/add_spans_to_concentrator execution_time [10.695ms; 10.700ms] or [-0.020%; +0.020%] None None None

Group 2

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 3d789de5 1763564597 augusto.deoliveira/apmsp-2369.ensure-correct-interrupt-policy
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_trace/test_trace execution_time 244.130ns 252.648ns ± 12.011ns 247.227ns ± 2.500ns 253.141ns 287.999ns 289.469ns 290.759ns 17.61% 2.044 3.330 4.74% 0.849ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_trace/test_trace execution_time [250.983ns; 254.312ns] or [-0.659%; +0.659%] None None None

Group 3

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 3d789de5 1763564597 augusto.deoliveira/apmsp-2369.ensure-correct-interrupt-policy
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching serializing traces from their internal representation to msgpack execution_time 14.843ms 14.897ms ± 0.034ms 14.893ms ± 0.014ms 14.906ms 14.938ms 15.019ms 15.182ms 1.94% 3.775 25.584 0.23% 0.002ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching serializing traces from their internal representation to msgpack execution_time [14.892ms; 14.902ms] or [-0.032%; +0.032%] None None None

Group 4

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 3d789de5 1763564597 augusto.deoliveira/apmsp-2369.ensure-correct-interrupt-policy
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
two way interface execution_time 17.908µs 23.251µs ± 9.062µs 18.596µs ± 0.475µs 27.216µs 42.463µs 45.800µs 71.931µs 286.81% 2.025 4.672 38.88% 0.641µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
two way interface execution_time [21.995µs; 24.506µs] or [-5.401%; +5.401%] None None None

Group 5

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 3d789de5 1763564597 augusto.deoliveira/apmsp-2369.ensure-correct-interrupt-policy
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
single_flag_killswitch/rules-based execution_time 189.839ns 192.510ns ± 2.007ns 192.188ns ± 1.253ns 193.367ns 196.691ns 198.213ns 199.143ns 3.62% 1.111 0.751 1.04% 0.142ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
single_flag_killswitch/rules-based execution_time [192.232ns; 192.788ns] or [-0.144%; +0.144%] None None None

Group 6

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 3d789de5 1763564597 augusto.deoliveira/apmsp-2369.ensure-correct-interrupt-policy
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
write only interface execution_time 1.232µs 3.208µs ± 1.389µs 3.008µs ± 0.029µs 3.032µs 3.677µs 13.665µs 14.717µs 389.28% 7.337 55.127 43.18% 0.098µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
write only interface execution_time [3.015µs; 3.400µs] or [-5.999%; +5.999%] None None None

Group 7

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 3d789de5 1763564597 augusto.deoliveira/apmsp-2369.ensure-correct-interrupt-policy
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching deserializing traces from msgpack to their internal representation execution_time 63.478ms 63.962ms ± 2.269ms 63.660ms ± 0.060ms 63.723ms 63.974ms 76.566ms 85.867ms 34.88% 8.414 71.260 3.54% 0.160ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching deserializing traces from msgpack to their internal representation execution_time [63.648ms; 64.277ms] or [-0.492%; +0.492%] None None None

Group 8

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 3d789de5 1763564597 augusto.deoliveira/apmsp-2369.ensure-correct-interrupt-policy
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
credit_card/is_card_number/ execution_time 3.896µs 3.915µs ± 0.003µs 3.915µs ± 0.002µs 3.916µs 3.922µs 3.923µs 3.928µs 0.34% 0.052 5.070 0.09% 0.000µs 1 200
credit_card/is_card_number/ throughput 254581799.823op/s 255418065.592op/s ± 225526.481op/s 255452166.583op/s ± 102133.657op/s 255551698.130op/s 255679803.001op/s 255746252.840op/s 256685424.628op/s 0.48% -0.033 5.145 0.09% 15947.130op/s 1 200
credit_card/is_card_number/ 3782-8224-6310-005 execution_time 77.910µs 79.270µs ± 0.761µs 79.197µs ± 0.516µs 79.756µs 80.663µs 81.046µs 81.660µs 3.11% 0.437 -0.184 0.96% 0.054µs 1 200
credit_card/is_card_number/ 3782-8224-6310-005 throughput 12245894.054op/s 12616287.145op/s ± 120662.195op/s 12626809.887op/s ± 82445.611op/s 12699522.688op/s 12801935.488op/s 12831960.985op/s 12835402.567op/s 1.65% -0.390 -0.246 0.95% 8532.106op/s 1 200
credit_card/is_card_number/ 378282246310005 execution_time 71.519µs 72.018µs ± 0.438µs 71.892µs ± 0.148µs 72.115µs 73.000µs 73.827µs 74.110µs 3.09% 2.348 6.349 0.61% 0.031µs 1 200
credit_card/is_card_number/ 378282246310005 throughput 13493520.701op/s 13885840.520op/s ± 83345.456op/s 13909809.492op/s ± 28726.573op/s 13925801.276op/s 13970204.976op/s 13979179.689op/s 13982382.198op/s 0.52% -2.297 6.071 0.60% 5893.414op/s 1 200
credit_card/is_card_number/37828224631 execution_time 3.894µs 3.916µs ± 0.003µs 3.916µs ± 0.002µs 3.918µs 3.921µs 3.922µs 3.923µs 0.20% -1.496 11.923 0.08% 0.000µs 1 200
credit_card/is_card_number/37828224631 throughput 254888649.574op/s 255385629.597op/s ± 195197.836op/s 255395173.124op/s ± 120809.472op/s 255506183.250op/s 255608563.395op/s 255704292.927op/s 256791016.837op/s 0.55% 1.523 12.139 0.08% 13802.571op/s 1 200
credit_card/is_card_number/378282246310005 execution_time 68.233µs 68.406µs ± 0.396µs 68.322µs ± 0.031µs 68.351µs 68.696µs 70.688µs 71.173µs 4.17% 5.311 29.072 0.58% 0.028µs 1 200
credit_card/is_card_number/378282246310005 throughput 14050189.955op/s 14619100.076op/s ± 82070.212op/s 14636622.692op/s ± 6598.873op/s 14643468.888op/s 14649317.391op/s 14654324.581op/s 14655593.552op/s 0.13% -5.262 28.538 0.56% 5803.240op/s 1 200
credit_card/is_card_number/37828224631000521389798 execution_time 45.421µs 45.723µs ± 0.098µs 45.736µs ± 0.065µs 45.795µs 45.877µs 45.902µs 45.912µs 0.39% -0.345 -0.335 0.21% 0.007µs 1 200
credit_card/is_card_number/37828224631000521389798 throughput 21780594.425op/s 21871030.106op/s ± 47145.604op/s 21864472.433op/s ± 31227.252op/s 21905638.515op/s 21949018.238op/s 21982918.466op/s 22016345.377op/s 0.69% 0.355 -0.322 0.22% 3333.698op/s 1 200
credit_card/is_card_number/x371413321323331 execution_time 6.559µs 6.618µs ± 0.019µs 6.620µs ± 0.013µs 6.634µs 6.642µs 6.644µs 6.646µs 0.40% -0.906 0.554 0.28% 0.001µs 1 200
credit_card/is_card_number/x371413321323331 throughput 150456444.253op/s 151102868.676op/s ± 431830.054op/s 151051478.746op/s ± 304869.106op/s 151319158.296op/s 151940180.066op/s 152327429.573op/s 152470829.114op/s 0.94% 0.920 0.592 0.29% 30534.996op/s 1 200
credit_card/is_card_number_no_luhn/ execution_time 3.896µs 3.915µs ± 0.003µs 3.915µs ± 0.002µs 3.916µs 3.919µs 3.922µs 3.926µs 0.29% -1.056 12.790 0.07% 0.000µs 1 200
credit_card/is_card_number_no_luhn/ throughput 254682850.076op/s 255423963.681op/s ± 172532.767op/s 255427126.641op/s ± 101720.218op/s 255531960.660op/s 255625648.953op/s 255684366.089op/s 256646336.527op/s 0.48% 1.084 12.956 0.07% 12199.909op/s 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time 65.045µs 65.736µs ± 0.081µs 65.732µs ± 0.043µs 65.779µs 65.846µs 65.895µs 66.055µs 0.49% -2.696 26.055 0.12% 0.006µs 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput 15138806.530op/s 15212467.606op/s ± 18752.258op/s 15213357.646op/s ± 9940.061op/s 15221778.704op/s 15233252.763op/s 15242165.377op/s 15373871.452op/s 1.06% 2.773 26.775 0.12% 1325.985op/s 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time 53.356µs 53.426µs ± 0.037µs 53.417µs ± 0.017µs 53.441µs 53.504µs 53.535µs 53.551µs 0.25% 1.060 0.917 0.07% 0.003µs 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 throughput 18673802.443op/s 18717450.580op/s ± 12839.656op/s 18720492.198op/s ± 6069.717op/s 18725423.194op/s 18733937.393op/s 18736729.475op/s 18742032.767op/s 0.12% -1.057 0.908 0.07% 907.901op/s 1 200
credit_card/is_card_number_no_luhn/37828224631 execution_time 3.894µs 3.915µs ± 0.003µs 3.915µs ± 0.001µs 3.916µs 3.919µs 3.920µs 3.937µs 0.56% 0.348 24.628 0.08% 0.000µs 1 200
credit_card/is_card_number_no_luhn/37828224631 throughput 254027540.007op/s 255438631.136op/s ± 194259.846op/s 255452917.131op/s ± 92110.007op/s 255531835.262op/s 255632344.238op/s 255680697.565op/s 256819027.857op/s 0.53% -0.287 24.613 0.08% 13736.245op/s 1 200
credit_card/is_card_number_no_luhn/378282246310005 execution_time 50.159µs 50.221µs ± 0.034µs 50.215µs ± 0.023µs 50.243µs 50.288µs 50.311µs 50.322µs 0.21% 0.672 0.160 0.07% 0.002µs 1 200
credit_card/is_card_number_no_luhn/378282246310005 throughput 19871927.415op/s 19911976.384op/s ± 13398.345op/s 19914193.722op/s ± 8938.787op/s 19920999.789op/s 19930619.025op/s 19934978.082op/s 19936490.316op/s 0.11% -0.669 0.154 0.07% 947.406op/s 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time 45.441µs 45.704µs ± 0.096µs 45.710µs ± 0.075µs 45.773µs 45.862µs 45.896µs 45.918µs 0.46% -0.049 -0.616 0.21% 0.007µs 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput 21778038.628op/s 21880164.631op/s ± 46177.263op/s 21877173.380op/s ± 35719.097op/s 21914285.926op/s 21948747.000op/s 21974619.222op/s 22006438.541op/s 0.59% 0.058 -0.612 0.21% 3265.226op/s 1 200
credit_card/is_card_number_no_luhn/x371413321323331 execution_time 6.539µs 6.618µs ± 0.017µs 6.620µs ± 0.012µs 6.632µs 6.639µs 6.644µs 6.645µs 0.37% -1.063 1.798 0.26% 0.001µs 1 200
credit_card/is_card_number_no_luhn/x371413321323331 throughput 150495092.050op/s 151110775.308op/s ± 398922.122op/s 151047154.616op/s ± 277464.157op/s 151342674.983op/s 151872193.785op/s 152108629.433op/s 152932740.524op/s 1.25% 1.084 1.890 0.26% 28208.054op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
credit_card/is_card_number/ execution_time [3.915µs; 3.916µs] or [-0.012%; +0.012%] None None None
credit_card/is_card_number/ throughput [255386809.791op/s; 255449321.393op/s] or [-0.012%; +0.012%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 execution_time [79.164µs; 79.375µs] or [-0.133%; +0.133%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 throughput [12599564.525op/s; 12633009.765op/s] or [-0.133%; +0.133%] None None None
credit_card/is_card_number/ 378282246310005 execution_time [71.958µs; 72.079µs] or [-0.084%; +0.084%] None None None
credit_card/is_card_number/ 378282246310005 throughput [13874289.642op/s; 13897391.399op/s] or [-0.083%; +0.083%] None None None
credit_card/is_card_number/37828224631 execution_time [3.915µs; 3.916µs] or [-0.011%; +0.011%] None None None
credit_card/is_card_number/37828224631 throughput [255358577.054op/s; 255412682.140op/s] or [-0.011%; +0.011%] None None None
credit_card/is_card_number/378282246310005 execution_time [68.351µs; 68.461µs] or [-0.080%; +0.080%] None None None
credit_card/is_card_number/378282246310005 throughput [14607725.934op/s; 14630474.218op/s] or [-0.078%; +0.078%] None None None
credit_card/is_card_number/37828224631000521389798 execution_time [45.709µs; 45.736µs] or [-0.030%; +0.030%] None None None
credit_card/is_card_number/37828224631000521389798 throughput [21864496.179op/s; 21877564.033op/s] or [-0.030%; +0.030%] None None None
credit_card/is_card_number/x371413321323331 execution_time [6.615µs; 6.621µs] or [-0.040%; +0.040%] None None None
credit_card/is_card_number/x371413321323331 throughput [151043021.184op/s; 151162716.169op/s] or [-0.040%; +0.040%] None None None
credit_card/is_card_number_no_luhn/ execution_time [3.915µs; 3.915µs] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/ throughput [255400052.299op/s; 255447875.064op/s] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time [65.724µs; 65.747µs] or [-0.017%; +0.017%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput [15209868.723op/s; 15215066.489op/s] or [-0.017%; +0.017%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time [53.421µs; 53.431µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 throughput [18715671.127op/s; 18719230.032op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number_no_luhn/37828224631 execution_time [3.914µs; 3.915µs] or [-0.011%; +0.011%] None None None
credit_card/is_card_number_no_luhn/37828224631 throughput [255411708.589op/s; 255465553.682op/s] or [-0.011%; +0.011%] None None None
credit_card/is_card_number_no_luhn/378282246310005 execution_time [50.216µs; 50.226µs] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/378282246310005 throughput [19910119.503op/s; 19913833.266op/s] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time [45.690µs; 45.717µs] or [-0.029%; +0.029%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput [21873764.906op/s; 21886564.355op/s] or [-0.029%; +0.029%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 execution_time [6.615µs; 6.620µs] or [-0.036%; +0.036%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 throughput [151055488.538op/s; 151166062.077op/s] or [-0.037%; +0.037%] None None None

Group 9

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 3d789de5 1763564597 augusto.deoliveira/apmsp-2369.ensure-correct-interrupt-policy
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
tags/replace_trace_tags execution_time 2.343µs 2.412µs ± 0.017µs 2.411µs ± 0.007µs 2.422µs 2.440µs 2.443µs 2.445µs 1.42% -1.070 2.726 0.72% 0.001µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
tags/replace_trace_tags execution_time [2.410µs; 2.415µs] or [-0.100%; +0.100%] None None None

Group 10

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 3d789de5 1763564597 augusto.deoliveira/apmsp-2369.ensure-correct-interrupt-policy
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
receiver_entry_point/report/2597 execution_time 6.210ms 6.459ms ± 0.045ms 6.459ms ± 0.019ms 6.478ms 6.519ms 6.588ms 6.608ms 2.32% -0.915 7.577 0.70% 0.003ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
receiver_entry_point/report/2597 execution_time [6.453ms; 6.465ms] or [-0.097%; +0.097%] None None None

Group 11

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 3d789de5 1763564597 augusto.deoliveira/apmsp-2369.ensure-correct-interrupt-policy
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time 205.094µs 205.633µs ± 0.400µs 205.576µs ± 0.160µs 205.736µs 206.092µs 207.578µs 208.713µs 1.53% 4.119 25.415 0.19% 0.028µs 1 200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput 4791273.356op/s 4863039.207op/s ± 9390.187op/s 4864387.451op/s ± 3793.235op/s 4868171.399op/s 4871752.306op/s 4874409.811op/s 4875820.110op/s 0.24% -4.059 24.834 0.19% 663.986op/s 1 200
normalization/normalize_name/normalize_name/bad-name execution_time 18.201µs 18.295µs ± 0.082µs 18.265µs ± 0.031µs 18.319µs 18.478µs 18.540µs 18.678µs 2.27% 1.625 2.632 0.45% 0.006µs 1 200
normalization/normalize_name/normalize_name/bad-name throughput 53537718.447op/s 54662062.163op/s ± 244535.349op/s 54750679.668op/s ± 94335.923op/s 54819459.731op/s 54904849.791op/s 54935165.956op/s 54941604.923op/s 0.35% -1.599 2.497 0.45% 17291.260op/s 1 200
normalization/normalize_name/normalize_name/good execution_time 10.549µs 10.727µs ± 0.080µs 10.718µs ± 0.048µs 10.774µs 10.855µs 10.959µs 11.008µs 2.70% 0.525 0.591 0.74% 0.006µs 1 200
normalization/normalize_name/normalize_name/good throughput 90843590.222op/s 93227071.081op/s ± 693677.384op/s 93298962.383op/s ± 418660.878op/s 93654295.906op/s 94255219.898op/s 94634900.468op/s 94796469.808op/s 1.61% -0.474 0.501 0.74% 49050.398op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time [205.578µs; 205.689µs] or [-0.027%; +0.027%] None None None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput [4861737.817op/s; 4864340.596op/s] or [-0.027%; +0.027%] None None None
normalization/normalize_name/normalize_name/bad-name execution_time [18.283µs; 18.306µs] or [-0.062%; +0.062%] None None None
normalization/normalize_name/normalize_name/bad-name throughput [54628171.915op/s; 54695952.410op/s] or [-0.062%; +0.062%] None None None
normalization/normalize_name/normalize_name/good execution_time [10.716µs; 10.738µs] or [-0.104%; +0.104%] None None None
normalization/normalize_name/normalize_name/good throughput [93130934.068op/s; 93323208.095op/s] or [-0.103%; +0.103%] None None None

Group 12

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 3d789de5 1763564597 augusto.deoliveira/apmsp-2369.ensure-correct-interrupt-policy
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sdk_test_data/rules-based execution_time 145.533µs 147.628µs ± 1.805µs 147.430µs ± 0.630µs 148.074µs 149.158µs 154.310µs 165.978µs 12.58% 6.332 56.113 1.22% 0.128µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sdk_test_data/rules-based execution_time [147.378µs; 147.878µs] or [-0.169%; +0.169%] None None None

Group 13

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 3d789de5 1763564597 augusto.deoliveira/apmsp-2369.ensure-correct-interrupt-policy
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
ip_address/quantize_peer_ip_address_benchmark execution_time 5.063µs 5.136µs ± 0.042µs 5.138µs ± 0.040µs 5.165µs 5.200µs 5.202µs 5.204µs 1.27% 0.062 -1.238 0.81% 0.003µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
ip_address/quantize_peer_ip_address_benchmark execution_time [5.130µs; 5.142µs] or [-0.112%; +0.112%] None None None

Group 14

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 3d789de5 1763564597 augusto.deoliveira/apmsp-2369.ensure-correct-interrupt-policy
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
redis/obfuscate_redis_string execution_time 34.036µs 34.624µs ± 1.080µs 34.145µs ± 0.076µs 34.247µs 36.897µs 36.942µs 38.905µs 13.94% 1.791 1.556 3.11% 0.076µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
redis/obfuscate_redis_string execution_time [34.475µs; 34.774µs] or [-0.432%; +0.432%] None None None

Group 15

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 3d789de5 1763564597 augusto.deoliveira/apmsp-2369.ensure-correct-interrupt-policy
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time 533.802µs 534.546µs ± 0.371µs 534.479µs ± 0.187µs 534.690µs 535.367µs 535.672µs 535.912µs 0.27% 1.084 1.625 0.07% 0.026µs 1 200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput 1865977.177op/s 1870748.947op/s ± 1295.971op/s 1870979.561op/s ± 655.865op/s 1871507.523op/s 1872535.248op/s 1873212.135op/s 1873354.823op/s 0.13% -1.079 1.612 0.07% 91.639op/s 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time 380.239µs 381.163µs ± 0.410µs 381.106µs ± 0.228µs 381.366µs 381.905µs 382.240µs 383.094µs 0.52% 0.872 2.096 0.11% 0.029µs 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput 2610326.292op/s 2623552.569op/s ± 2817.891op/s 2623942.644op/s ± 1566.334op/s 2625248.090op/s 2627416.101op/s 2628903.480op/s 2629922.457op/s 0.23% -0.862 2.056 0.11% 199.255op/s 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time 194.646µs 195.027µs ± 0.306µs 195.009µs ± 0.106µs 195.119µs 195.259µs 195.361µs 198.757µs 1.92% 9.120 109.235 0.16% 0.022µs 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput 5031281.022op/s 5127500.164op/s ± 7921.261op/s 5127972.501op/s ± 2788.900op/s 5130738.789op/s 5134569.126op/s 5136598.316op/s 5137539.846op/s 0.19% -8.989 107.129 0.15% 560.118op/s 1 200
normalization/normalize_service/normalize_service/[empty string] execution_time 37.086µs 37.285µs ± 0.086µs 37.286µs ± 0.065µs 37.344µs 37.416µs 37.460µs 37.484µs 0.53% -0.041 -0.685 0.23% 0.006µs 1 200
normalization/normalize_service/normalize_service/[empty string] throughput 26678214.818op/s 26820406.814op/s ± 62009.516op/s 26819772.242op/s ± 46873.709op/s 26869083.554op/s 26918727.599op/s 26947681.452op/s 26964463.033op/s 0.54% 0.050 -0.683 0.23% 4384.735op/s 1 200
normalization/normalize_service/normalize_service/test_ASCII execution_time 44.994µs 45.137µs ± 0.052µs 45.136µs ± 0.035µs 45.170µs 45.214µs 45.284µs 45.306µs 0.38% 0.302 0.499 0.11% 0.004µs 1 200
normalization/normalize_service/normalize_service/test_ASCII throughput 22072110.995op/s 22155047.456op/s ± 25349.127op/s 22155258.869op/s ± 17109.107op/s 22172942.466op/s 22193719.295op/s 22211431.459op/s 22225274.914op/s 0.32% -0.293 0.489 0.11% 1792.454op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time [534.494µs; 534.597µs] or [-0.010%; +0.010%] None None None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput [1870569.338op/s; 1870928.556op/s] or [-0.010%; +0.010%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time [381.106µs; 381.220µs] or [-0.015%; +0.015%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput [2623162.036op/s; 2623943.101op/s] or [-0.015%; +0.015%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time [194.985µs; 195.070µs] or [-0.022%; +0.022%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput [5126402.353op/s; 5128597.974op/s] or [-0.021%; +0.021%] None None None
normalization/normalize_service/normalize_service/[empty string] execution_time [37.273µs; 37.297µs] or [-0.032%; +0.032%] None None None
normalization/normalize_service/normalize_service/[empty string] throughput [26811812.891op/s; 26829000.736op/s] or [-0.032%; +0.032%] None None None
normalization/normalize_service/normalize_service/test_ASCII execution_time [45.129µs; 45.144µs] or [-0.016%; +0.016%] None None None
normalization/normalize_service/normalize_service/test_ASCII throughput [22151534.311op/s; 22158560.601op/s] or [-0.016%; +0.016%] None None None

Group 16

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 3d789de5 1763564597 augusto.deoliveira/apmsp-2369.ensure-correct-interrupt-policy
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching string interning on wordpress profile execution_time 159.823µs 160.361µs ± 0.219µs 160.327µs ± 0.116µs 160.439µs 160.767µs 161.042µs 161.167µs 0.52% 1.067 1.822 0.14% 0.015µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching string interning on wordpress profile execution_time [160.330µs; 160.391µs] or [-0.019%; +0.019%] None None None

Group 17

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 3d789de5 1763564597 augusto.deoliveira/apmsp-2369.ensure-correct-interrupt-policy
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sql/obfuscate_sql_string execution_time 86.581µs 86.932µs ± 1.726µs 86.760µs ± 0.055µs 86.822µs 86.932µs 88.579µs 110.173µs 26.99% 12.587 164.197 1.98% 0.122µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sql/obfuscate_sql_string execution_time [86.693µs; 87.171µs] or [-0.275%; +0.275%] None None None

Baseline

Omitted due to size.

pr-commenter[bot] avatar Nov 19 '25 15:11 pr-commenter[bot]