libdatadog
libdatadog copied to clipboard
chore(ci): set benchmarking jobs to be interruptible outside main
What does this PR do?
- Sets benchmarking jobs to be interruptible outside
main.
Motivation
#incident-45572 and APMSP-2369.
How to test the change?
A dummy commit, b67e3d0, interrupts benchmarking jobs from a previous pipeline:
Codecov Report
:white_check_mark: All modified and coverable lines are covered by tests.
:white_check_mark: Project coverage is 70.97%. Comparing base (3e9119a) to head (3d789de).
Additional details and impacted files
@@ Coverage Diff @@
## main #1356 +/- ##
==========================================
+ Coverage 70.95% 70.97% +0.02%
==========================================
Files 390 390
Lines 62562 62562
==========================================
+ Hits 44389 44403 +14
+ Misses 18173 18159 -14
| Components | Coverage Δ | |
|---|---|---|
| libdd-crashtracker | 57.73% <ø> (+0.08%) |
:arrow_up: |
| libdd-crashtracker-ffi | 14.60% <ø> (ø) |
|
| libdd-alloc | 98.73% <ø> (ø) |
|
| libdd-data-pipeline | 86.02% <ø> (ø) |
|
| libdd-data-pipeline-ffi | 77.74% <ø> (ø) |
|
| libdd-common | 80.93% <ø> (ø) |
|
| libdd-common-ffi | 73.90% <ø> (ø) |
|
| libdd-telemetry | 59.98% <ø> (-0.04%) |
:arrow_down: |
| libdd-telemetry-ffi | 21.24% <ø> (ø) |
|
| libdd-dogstatsd-client | 83.75% <ø> (ø) |
|
| datadog-ipc | 82.67% <ø> (+0.06%) |
:arrow_up: |
| libdd-profiling | 79.65% <ø> (ø) |
|
| libdd-profiling-ffi | 62.13% <ø> (ø) |
|
| datadog-sidecar | 35.91% <ø> (ø) |
|
| datdog-sidecar-ffi | 10.99% <ø> (ø) |
|
| spawn-worker | 55.18% <ø> (ø) |
|
| libdd-tinybytes | 92.44% <ø> (ø) |
|
| libdd-trace-normalization | 98.24% <ø> (ø) |
|
| datadog-trace-obfuscation | 94.17% <ø> (ø) |
|
| libdd-trace-protobuf | 59.65% <ø> (ø) |
|
| libdd-trace-utils | 90.07% <ø> (ø) |
|
| datadog-tracer-flare | 63.49% <ø> (ø) |
|
| libdd-log | 75.57% <ø> (ø) |
:rocket: New features to boost your workflow:
- :snowflake: Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
/merge
View all feedbacks in Devflow UI.
2025-11-19 15:03:50 UTC :information_source: Start processing command /merge
2025-11-19 15:03:56 UTC :information_source: MergeQueue: waiting for PR to be ready
This pull request is not mergeable according to GitHub. Common reasons include pending required checks, missing approvals, or merge conflicts — but it could also be blocked by other repository rules or settings.
It will be added to the queue as soon as checks pass and/or get approvals.
Note: if you pushed new commits since the last approval, you may need additional approval.
You can remove it from the waiting list with /remove command.
2025-11-19 15:23:31 UTC :information_source: MergeQueue: merge request added to the queue
The expected merge time in main is approximately 35m (p90).
2025-11-19 15:43:02 UTC :information_source: MergeQueue: This merge request was merged
Benchmarks
Comparison
Benchmark execution time: 2025-11-19 15:24:42
Comparing candidate commit 3d789de5 in PR branch augusto.deoliveira/apmsp-2369.ensure-correct-interrupt-policy with baseline commit 3e9119ad in branch main.
Found 0 performance improvements and 0 performance regressions! Performance is the same for 55 metrics, 2 unstable metrics.
Candidate
Candidate benchmark details
Group 1
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 3d789de5 | 1763564597 | augusto.deoliveira/apmsp-2369.ensure-correct-interrupt-policy |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| concentrator/add_spans_to_concentrator | execution_time | 10.656ms | 10.698ms ± 0.015ms | 10.697ms ± 0.009ms | 10.705ms | 10.723ms | 10.744ms | 10.770ms | 0.68% | 0.919 | 3.029 | 0.14% | 0.001ms | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| concentrator/add_spans_to_concentrator | execution_time | [10.695ms; 10.700ms] or [-0.020%; +0.020%] | None | None | None |
Group 2
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 3d789de5 | 1763564597 | augusto.deoliveira/apmsp-2369.ensure-correct-interrupt-policy |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| normalization/normalize_trace/test_trace | execution_time | 244.130ns | 252.648ns ± 12.011ns | 247.227ns ± 2.500ns | 253.141ns | 287.999ns | 289.469ns | 290.759ns | 17.61% | 2.044 | 3.330 | 4.74% | 0.849ns | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| normalization/normalize_trace/test_trace | execution_time | [250.983ns; 254.312ns] or [-0.659%; +0.659%] | None | None | None |
Group 3
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 3d789de5 | 1763564597 | augusto.deoliveira/apmsp-2369.ensure-correct-interrupt-policy |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| benching serializing traces from their internal representation to msgpack | execution_time | 14.843ms | 14.897ms ± 0.034ms | 14.893ms ± 0.014ms | 14.906ms | 14.938ms | 15.019ms | 15.182ms | 1.94% | 3.775 | 25.584 | 0.23% | 0.002ms | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| benching serializing traces from their internal representation to msgpack | execution_time | [14.892ms; 14.902ms] or [-0.032%; +0.032%] | None | None | None |
Group 4
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 3d789de5 | 1763564597 | augusto.deoliveira/apmsp-2369.ensure-correct-interrupt-policy |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| two way interface | execution_time | 17.908µs | 23.251µs ± 9.062µs | 18.596µs ± 0.475µs | 27.216µs | 42.463µs | 45.800µs | 71.931µs | 286.81% | 2.025 | 4.672 | 38.88% | 0.641µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| two way interface | execution_time | [21.995µs; 24.506µs] or [-5.401%; +5.401%] | None | None | None |
Group 5
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 3d789de5 | 1763564597 | augusto.deoliveira/apmsp-2369.ensure-correct-interrupt-policy |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| single_flag_killswitch/rules-based | execution_time | 189.839ns | 192.510ns ± 2.007ns | 192.188ns ± 1.253ns | 193.367ns | 196.691ns | 198.213ns | 199.143ns | 3.62% | 1.111 | 0.751 | 1.04% | 0.142ns | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| single_flag_killswitch/rules-based | execution_time | [192.232ns; 192.788ns] or [-0.144%; +0.144%] | None | None | None |
Group 6
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 3d789de5 | 1763564597 | augusto.deoliveira/apmsp-2369.ensure-correct-interrupt-policy |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| write only interface | execution_time | 1.232µs | 3.208µs ± 1.389µs | 3.008µs ± 0.029µs | 3.032µs | 3.677µs | 13.665µs | 14.717µs | 389.28% | 7.337 | 55.127 | 43.18% | 0.098µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| write only interface | execution_time | [3.015µs; 3.400µs] or [-5.999%; +5.999%] | None | None | None |
Group 7
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 3d789de5 | 1763564597 | augusto.deoliveira/apmsp-2369.ensure-correct-interrupt-policy |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| benching deserializing traces from msgpack to their internal representation | execution_time | 63.478ms | 63.962ms ± 2.269ms | 63.660ms ± 0.060ms | 63.723ms | 63.974ms | 76.566ms | 85.867ms | 34.88% | 8.414 | 71.260 | 3.54% | 0.160ms | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| benching deserializing traces from msgpack to their internal representation | execution_time | [63.648ms; 64.277ms] or [-0.492%; +0.492%] | None | None | None |
Group 8
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 3d789de5 | 1763564597 | augusto.deoliveira/apmsp-2369.ensure-correct-interrupt-policy |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| credit_card/is_card_number/ | execution_time | 3.896µs | 3.915µs ± 0.003µs | 3.915µs ± 0.002µs | 3.916µs | 3.922µs | 3.923µs | 3.928µs | 0.34% | 0.052 | 5.070 | 0.09% | 0.000µs | 1 | 200 |
| credit_card/is_card_number/ | throughput | 254581799.823op/s | 255418065.592op/s ± 225526.481op/s | 255452166.583op/s ± 102133.657op/s | 255551698.130op/s | 255679803.001op/s | 255746252.840op/s | 256685424.628op/s | 0.48% | -0.033 | 5.145 | 0.09% | 15947.130op/s | 1 | 200 |
| credit_card/is_card_number/ 3782-8224-6310-005 | execution_time | 77.910µs | 79.270µs ± 0.761µs | 79.197µs ± 0.516µs | 79.756µs | 80.663µs | 81.046µs | 81.660µs | 3.11% | 0.437 | -0.184 | 0.96% | 0.054µs | 1 | 200 |
| credit_card/is_card_number/ 3782-8224-6310-005 | throughput | 12245894.054op/s | 12616287.145op/s ± 120662.195op/s | 12626809.887op/s ± 82445.611op/s | 12699522.688op/s | 12801935.488op/s | 12831960.985op/s | 12835402.567op/s | 1.65% | -0.390 | -0.246 | 0.95% | 8532.106op/s | 1 | 200 |
| credit_card/is_card_number/ 378282246310005 | execution_time | 71.519µs | 72.018µs ± 0.438µs | 71.892µs ± 0.148µs | 72.115µs | 73.000µs | 73.827µs | 74.110µs | 3.09% | 2.348 | 6.349 | 0.61% | 0.031µs | 1 | 200 |
| credit_card/is_card_number/ 378282246310005 | throughput | 13493520.701op/s | 13885840.520op/s ± 83345.456op/s | 13909809.492op/s ± 28726.573op/s | 13925801.276op/s | 13970204.976op/s | 13979179.689op/s | 13982382.198op/s | 0.52% | -2.297 | 6.071 | 0.60% | 5893.414op/s | 1 | 200 |
| credit_card/is_card_number/37828224631 | execution_time | 3.894µs | 3.916µs ± 0.003µs | 3.916µs ± 0.002µs | 3.918µs | 3.921µs | 3.922µs | 3.923µs | 0.20% | -1.496 | 11.923 | 0.08% | 0.000µs | 1 | 200 |
| credit_card/is_card_number/37828224631 | throughput | 254888649.574op/s | 255385629.597op/s ± 195197.836op/s | 255395173.124op/s ± 120809.472op/s | 255506183.250op/s | 255608563.395op/s | 255704292.927op/s | 256791016.837op/s | 0.55% | 1.523 | 12.139 | 0.08% | 13802.571op/s | 1 | 200 |
| credit_card/is_card_number/378282246310005 | execution_time | 68.233µs | 68.406µs ± 0.396µs | 68.322µs ± 0.031µs | 68.351µs | 68.696µs | 70.688µs | 71.173µs | 4.17% | 5.311 | 29.072 | 0.58% | 0.028µs | 1 | 200 |
| credit_card/is_card_number/378282246310005 | throughput | 14050189.955op/s | 14619100.076op/s ± 82070.212op/s | 14636622.692op/s ± 6598.873op/s | 14643468.888op/s | 14649317.391op/s | 14654324.581op/s | 14655593.552op/s | 0.13% | -5.262 | 28.538 | 0.56% | 5803.240op/s | 1 | 200 |
| credit_card/is_card_number/37828224631000521389798 | execution_time | 45.421µs | 45.723µs ± 0.098µs | 45.736µs ± 0.065µs | 45.795µs | 45.877µs | 45.902µs | 45.912µs | 0.39% | -0.345 | -0.335 | 0.21% | 0.007µs | 1 | 200 |
| credit_card/is_card_number/37828224631000521389798 | throughput | 21780594.425op/s | 21871030.106op/s ± 47145.604op/s | 21864472.433op/s ± 31227.252op/s | 21905638.515op/s | 21949018.238op/s | 21982918.466op/s | 22016345.377op/s | 0.69% | 0.355 | -0.322 | 0.22% | 3333.698op/s | 1 | 200 |
| credit_card/is_card_number/x371413321323331 | execution_time | 6.559µs | 6.618µs ± 0.019µs | 6.620µs ± 0.013µs | 6.634µs | 6.642µs | 6.644µs | 6.646µs | 0.40% | -0.906 | 0.554 | 0.28% | 0.001µs | 1 | 200 |
| credit_card/is_card_number/x371413321323331 | throughput | 150456444.253op/s | 151102868.676op/s ± 431830.054op/s | 151051478.746op/s ± 304869.106op/s | 151319158.296op/s | 151940180.066op/s | 152327429.573op/s | 152470829.114op/s | 0.94% | 0.920 | 0.592 | 0.29% | 30534.996op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/ | execution_time | 3.896µs | 3.915µs ± 0.003µs | 3.915µs ± 0.002µs | 3.916µs | 3.919µs | 3.922µs | 3.926µs | 0.29% | -1.056 | 12.790 | 0.07% | 0.000µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/ | throughput | 254682850.076op/s | 255423963.681op/s ± 172532.767op/s | 255427126.641op/s ± 101720.218op/s | 255531960.660op/s | 255625648.953op/s | 255684366.089op/s | 256646336.527op/s | 0.48% | 1.084 | 12.956 | 0.07% | 12199.909op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 | execution_time | 65.045µs | 65.736µs ± 0.081µs | 65.732µs ± 0.043µs | 65.779µs | 65.846µs | 65.895µs | 66.055µs | 0.49% | -2.696 | 26.055 | 0.12% | 0.006µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 | throughput | 15138806.530op/s | 15212467.606op/s ± 18752.258op/s | 15213357.646op/s ± 9940.061op/s | 15221778.704op/s | 15233252.763op/s | 15242165.377op/s | 15373871.452op/s | 1.06% | 2.773 | 26.775 | 0.12% | 1325.985op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/ 378282246310005 | execution_time | 53.356µs | 53.426µs ± 0.037µs | 53.417µs ± 0.017µs | 53.441µs | 53.504µs | 53.535µs | 53.551µs | 0.25% | 1.060 | 0.917 | 0.07% | 0.003µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/ 378282246310005 | throughput | 18673802.443op/s | 18717450.580op/s ± 12839.656op/s | 18720492.198op/s ± 6069.717op/s | 18725423.194op/s | 18733937.393op/s | 18736729.475op/s | 18742032.767op/s | 0.12% | -1.057 | 0.908 | 0.07% | 907.901op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/37828224631 | execution_time | 3.894µs | 3.915µs ± 0.003µs | 3.915µs ± 0.001µs | 3.916µs | 3.919µs | 3.920µs | 3.937µs | 0.56% | 0.348 | 24.628 | 0.08% | 0.000µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/37828224631 | throughput | 254027540.007op/s | 255438631.136op/s ± 194259.846op/s | 255452917.131op/s ± 92110.007op/s | 255531835.262op/s | 255632344.238op/s | 255680697.565op/s | 256819027.857op/s | 0.53% | -0.287 | 24.613 | 0.08% | 13736.245op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/378282246310005 | execution_time | 50.159µs | 50.221µs ± 0.034µs | 50.215µs ± 0.023µs | 50.243µs | 50.288µs | 50.311µs | 50.322µs | 0.21% | 0.672 | 0.160 | 0.07% | 0.002µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/378282246310005 | throughput | 19871927.415op/s | 19911976.384op/s ± 13398.345op/s | 19914193.722op/s ± 8938.787op/s | 19920999.789op/s | 19930619.025op/s | 19934978.082op/s | 19936490.316op/s | 0.11% | -0.669 | 0.154 | 0.07% | 947.406op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/37828224631000521389798 | execution_time | 45.441µs | 45.704µs ± 0.096µs | 45.710µs ± 0.075µs | 45.773µs | 45.862µs | 45.896µs | 45.918µs | 0.46% | -0.049 | -0.616 | 0.21% | 0.007µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/37828224631000521389798 | throughput | 21778038.628op/s | 21880164.631op/s ± 46177.263op/s | 21877173.380op/s ± 35719.097op/s | 21914285.926op/s | 21948747.000op/s | 21974619.222op/s | 22006438.541op/s | 0.59% | 0.058 | -0.612 | 0.21% | 3265.226op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/x371413321323331 | execution_time | 6.539µs | 6.618µs ± 0.017µs | 6.620µs ± 0.012µs | 6.632µs | 6.639µs | 6.644µs | 6.645µs | 0.37% | -1.063 | 1.798 | 0.26% | 0.001µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/x371413321323331 | throughput | 150495092.050op/s | 151110775.308op/s ± 398922.122op/s | 151047154.616op/s ± 277464.157op/s | 151342674.983op/s | 151872193.785op/s | 152108629.433op/s | 152932740.524op/s | 1.25% | 1.084 | 1.890 | 0.26% | 28208.054op/s | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| credit_card/is_card_number/ | execution_time | [3.915µs; 3.916µs] or [-0.012%; +0.012%] | None | None | None |
| credit_card/is_card_number/ | throughput | [255386809.791op/s; 255449321.393op/s] or [-0.012%; +0.012%] | None | None | None |
| credit_card/is_card_number/ 3782-8224-6310-005 | execution_time | [79.164µs; 79.375µs] or [-0.133%; +0.133%] | None | None | None |
| credit_card/is_card_number/ 3782-8224-6310-005 | throughput | [12599564.525op/s; 12633009.765op/s] or [-0.133%; +0.133%] | None | None | None |
| credit_card/is_card_number/ 378282246310005 | execution_time | [71.958µs; 72.079µs] or [-0.084%; +0.084%] | None | None | None |
| credit_card/is_card_number/ 378282246310005 | throughput | [13874289.642op/s; 13897391.399op/s] or [-0.083%; +0.083%] | None | None | None |
| credit_card/is_card_number/37828224631 | execution_time | [3.915µs; 3.916µs] or [-0.011%; +0.011%] | None | None | None |
| credit_card/is_card_number/37828224631 | throughput | [255358577.054op/s; 255412682.140op/s] or [-0.011%; +0.011%] | None | None | None |
| credit_card/is_card_number/378282246310005 | execution_time | [68.351µs; 68.461µs] or [-0.080%; +0.080%] | None | None | None |
| credit_card/is_card_number/378282246310005 | throughput | [14607725.934op/s; 14630474.218op/s] or [-0.078%; +0.078%] | None | None | None |
| credit_card/is_card_number/37828224631000521389798 | execution_time | [45.709µs; 45.736µs] or [-0.030%; +0.030%] | None | None | None |
| credit_card/is_card_number/37828224631000521389798 | throughput | [21864496.179op/s; 21877564.033op/s] or [-0.030%; +0.030%] | None | None | None |
| credit_card/is_card_number/x371413321323331 | execution_time | [6.615µs; 6.621µs] or [-0.040%; +0.040%] | None | None | None |
| credit_card/is_card_number/x371413321323331 | throughput | [151043021.184op/s; 151162716.169op/s] or [-0.040%; +0.040%] | None | None | None |
| credit_card/is_card_number_no_luhn/ | execution_time | [3.915µs; 3.915µs] or [-0.009%; +0.009%] | None | None | None |
| credit_card/is_card_number_no_luhn/ | throughput | [255400052.299op/s; 255447875.064op/s] or [-0.009%; +0.009%] | None | None | None |
| credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 | execution_time | [65.724µs; 65.747µs] or [-0.017%; +0.017%] | None | None | None |
| credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 | throughput | [15209868.723op/s; 15215066.489op/s] or [-0.017%; +0.017%] | None | None | None |
| credit_card/is_card_number_no_luhn/ 378282246310005 | execution_time | [53.421µs; 53.431µs] or [-0.010%; +0.010%] | None | None | None |
| credit_card/is_card_number_no_luhn/ 378282246310005 | throughput | [18715671.127op/s; 18719230.032op/s] or [-0.010%; +0.010%] | None | None | None |
| credit_card/is_card_number_no_luhn/37828224631 | execution_time | [3.914µs; 3.915µs] or [-0.011%; +0.011%] | None | None | None |
| credit_card/is_card_number_no_luhn/37828224631 | throughput | [255411708.589op/s; 255465553.682op/s] or [-0.011%; +0.011%] | None | None | None |
| credit_card/is_card_number_no_luhn/378282246310005 | execution_time | [50.216µs; 50.226µs] or [-0.009%; +0.009%] | None | None | None |
| credit_card/is_card_number_no_luhn/378282246310005 | throughput | [19910119.503op/s; 19913833.266op/s] or [-0.009%; +0.009%] | None | None | None |
| credit_card/is_card_number_no_luhn/37828224631000521389798 | execution_time | [45.690µs; 45.717µs] or [-0.029%; +0.029%] | None | None | None |
| credit_card/is_card_number_no_luhn/37828224631000521389798 | throughput | [21873764.906op/s; 21886564.355op/s] or [-0.029%; +0.029%] | None | None | None |
| credit_card/is_card_number_no_luhn/x371413321323331 | execution_time | [6.615µs; 6.620µs] or [-0.036%; +0.036%] | None | None | None |
| credit_card/is_card_number_no_luhn/x371413321323331 | throughput | [151055488.538op/s; 151166062.077op/s] or [-0.037%; +0.037%] | None | None | None |
Group 9
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 3d789de5 | 1763564597 | augusto.deoliveira/apmsp-2369.ensure-correct-interrupt-policy |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| tags/replace_trace_tags | execution_time | 2.343µs | 2.412µs ± 0.017µs | 2.411µs ± 0.007µs | 2.422µs | 2.440µs | 2.443µs | 2.445µs | 1.42% | -1.070 | 2.726 | 0.72% | 0.001µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| tags/replace_trace_tags | execution_time | [2.410µs; 2.415µs] or [-0.100%; +0.100%] | None | None | None |
Group 10
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 3d789de5 | 1763564597 | augusto.deoliveira/apmsp-2369.ensure-correct-interrupt-policy |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| receiver_entry_point/report/2597 | execution_time | 6.210ms | 6.459ms ± 0.045ms | 6.459ms ± 0.019ms | 6.478ms | 6.519ms | 6.588ms | 6.608ms | 2.32% | -0.915 | 7.577 | 0.70% | 0.003ms | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| receiver_entry_point/report/2597 | execution_time | [6.453ms; 6.465ms] or [-0.097%; +0.097%] | None | None | None |
Group 11
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 3d789de5 | 1763564597 | augusto.deoliveira/apmsp-2369.ensure-correct-interrupt-policy |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... | execution_time | 205.094µs | 205.633µs ± 0.400µs | 205.576µs ± 0.160µs | 205.736µs | 206.092µs | 207.578µs | 208.713µs | 1.53% | 4.119 | 25.415 | 0.19% | 0.028µs | 1 | 200 |
| normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... | throughput | 4791273.356op/s | 4863039.207op/s ± 9390.187op/s | 4864387.451op/s ± 3793.235op/s | 4868171.399op/s | 4871752.306op/s | 4874409.811op/s | 4875820.110op/s | 0.24% | -4.059 | 24.834 | 0.19% | 663.986op/s | 1 | 200 |
| normalization/normalize_name/normalize_name/bad-name | execution_time | 18.201µs | 18.295µs ± 0.082µs | 18.265µs ± 0.031µs | 18.319µs | 18.478µs | 18.540µs | 18.678µs | 2.27% | 1.625 | 2.632 | 0.45% | 0.006µs | 1 | 200 |
| normalization/normalize_name/normalize_name/bad-name | throughput | 53537718.447op/s | 54662062.163op/s ± 244535.349op/s | 54750679.668op/s ± 94335.923op/s | 54819459.731op/s | 54904849.791op/s | 54935165.956op/s | 54941604.923op/s | 0.35% | -1.599 | 2.497 | 0.45% | 17291.260op/s | 1 | 200 |
| normalization/normalize_name/normalize_name/good | execution_time | 10.549µs | 10.727µs ± 0.080µs | 10.718µs ± 0.048µs | 10.774µs | 10.855µs | 10.959µs | 11.008µs | 2.70% | 0.525 | 0.591 | 0.74% | 0.006µs | 1 | 200 |
| normalization/normalize_name/normalize_name/good | throughput | 90843590.222op/s | 93227071.081op/s ± 693677.384op/s | 93298962.383op/s ± 418660.878op/s | 93654295.906op/s | 94255219.898op/s | 94634900.468op/s | 94796469.808op/s | 1.61% | -0.474 | 0.501 | 0.74% | 49050.398op/s | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... | execution_time | [205.578µs; 205.689µs] or [-0.027%; +0.027%] | None | None | None |
| normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... | throughput | [4861737.817op/s; 4864340.596op/s] or [-0.027%; +0.027%] | None | None | None |
| normalization/normalize_name/normalize_name/bad-name | execution_time | [18.283µs; 18.306µs] or [-0.062%; +0.062%] | None | None | None |
| normalization/normalize_name/normalize_name/bad-name | throughput | [54628171.915op/s; 54695952.410op/s] or [-0.062%; +0.062%] | None | None | None |
| normalization/normalize_name/normalize_name/good | execution_time | [10.716µs; 10.738µs] or [-0.104%; +0.104%] | None | None | None |
| normalization/normalize_name/normalize_name/good | throughput | [93130934.068op/s; 93323208.095op/s] or [-0.103%; +0.103%] | None | None | None |
Group 12
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 3d789de5 | 1763564597 | augusto.deoliveira/apmsp-2369.ensure-correct-interrupt-policy |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| sdk_test_data/rules-based | execution_time | 145.533µs | 147.628µs ± 1.805µs | 147.430µs ± 0.630µs | 148.074µs | 149.158µs | 154.310µs | 165.978µs | 12.58% | 6.332 | 56.113 | 1.22% | 0.128µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| sdk_test_data/rules-based | execution_time | [147.378µs; 147.878µs] or [-0.169%; +0.169%] | None | None | None |
Group 13
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 3d789de5 | 1763564597 | augusto.deoliveira/apmsp-2369.ensure-correct-interrupt-policy |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| ip_address/quantize_peer_ip_address_benchmark | execution_time | 5.063µs | 5.136µs ± 0.042µs | 5.138µs ± 0.040µs | 5.165µs | 5.200µs | 5.202µs | 5.204µs | 1.27% | 0.062 | -1.238 | 0.81% | 0.003µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| ip_address/quantize_peer_ip_address_benchmark | execution_time | [5.130µs; 5.142µs] or [-0.112%; +0.112%] | None | None | None |
Group 14
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 3d789de5 | 1763564597 | augusto.deoliveira/apmsp-2369.ensure-correct-interrupt-policy |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| redis/obfuscate_redis_string | execution_time | 34.036µs | 34.624µs ± 1.080µs | 34.145µs ± 0.076µs | 34.247µs | 36.897µs | 36.942µs | 38.905µs | 13.94% | 1.791 | 1.556 | 3.11% | 0.076µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| redis/obfuscate_redis_string | execution_time | [34.475µs; 34.774µs] or [-0.432%; +0.432%] | None | None | None |
Group 15
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 3d789de5 | 1763564597 | augusto.deoliveira/apmsp-2369.ensure-correct-interrupt-policy |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... | execution_time | 533.802µs | 534.546µs ± 0.371µs | 534.479µs ± 0.187µs | 534.690µs | 535.367µs | 535.672µs | 535.912µs | 0.27% | 1.084 | 1.625 | 0.07% | 0.026µs | 1 | 200 |
| normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... | throughput | 1865977.177op/s | 1870748.947op/s ± 1295.971op/s | 1870979.561op/s ± 655.865op/s | 1871507.523op/s | 1872535.248op/s | 1873212.135op/s | 1873354.823op/s | 0.13% | -1.079 | 1.612 | 0.07% | 91.639op/s | 1 | 200 |
| normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて | execution_time | 380.239µs | 381.163µs ± 0.410µs | 381.106µs ± 0.228µs | 381.366µs | 381.905µs | 382.240µs | 383.094µs | 0.52% | 0.872 | 2.096 | 0.11% | 0.029µs | 1 | 200 |
| normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて | throughput | 2610326.292op/s | 2623552.569op/s ± 2817.891op/s | 2623942.644op/s ± 1566.334op/s | 2625248.090op/s | 2627416.101op/s | 2628903.480op/s | 2629922.457op/s | 0.23% | -0.862 | 2.056 | 0.11% | 199.255op/s | 1 | 200 |
| normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters | execution_time | 194.646µs | 195.027µs ± 0.306µs | 195.009µs ± 0.106µs | 195.119µs | 195.259µs | 195.361µs | 198.757µs | 1.92% | 9.120 | 109.235 | 0.16% | 0.022µs | 1 | 200 |
| normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters | throughput | 5031281.022op/s | 5127500.164op/s ± 7921.261op/s | 5127972.501op/s ± 2788.900op/s | 5130738.789op/s | 5134569.126op/s | 5136598.316op/s | 5137539.846op/s | 0.19% | -8.989 | 107.129 | 0.15% | 560.118op/s | 1 | 200 |
| normalization/normalize_service/normalize_service/[empty string] | execution_time | 37.086µs | 37.285µs ± 0.086µs | 37.286µs ± 0.065µs | 37.344µs | 37.416µs | 37.460µs | 37.484µs | 0.53% | -0.041 | -0.685 | 0.23% | 0.006µs | 1 | 200 |
| normalization/normalize_service/normalize_service/[empty string] | throughput | 26678214.818op/s | 26820406.814op/s ± 62009.516op/s | 26819772.242op/s ± 46873.709op/s | 26869083.554op/s | 26918727.599op/s | 26947681.452op/s | 26964463.033op/s | 0.54% | 0.050 | -0.683 | 0.23% | 4384.735op/s | 1 | 200 |
| normalization/normalize_service/normalize_service/test_ASCII | execution_time | 44.994µs | 45.137µs ± 0.052µs | 45.136µs ± 0.035µs | 45.170µs | 45.214µs | 45.284µs | 45.306µs | 0.38% | 0.302 | 0.499 | 0.11% | 0.004µs | 1 | 200 |
| normalization/normalize_service/normalize_service/test_ASCII | throughput | 22072110.995op/s | 22155047.456op/s ± 25349.127op/s | 22155258.869op/s ± 17109.107op/s | 22172942.466op/s | 22193719.295op/s | 22211431.459op/s | 22225274.914op/s | 0.32% | -0.293 | 0.489 | 0.11% | 1792.454op/s | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... | execution_time | [534.494µs; 534.597µs] or [-0.010%; +0.010%] | None | None | None |
| normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... | throughput | [1870569.338op/s; 1870928.556op/s] or [-0.010%; +0.010%] | None | None | None |
| normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて | execution_time | [381.106µs; 381.220µs] or [-0.015%; +0.015%] | None | None | None |
| normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて | throughput | [2623162.036op/s; 2623943.101op/s] or [-0.015%; +0.015%] | None | None | None |
| normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters | execution_time | [194.985µs; 195.070µs] or [-0.022%; +0.022%] | None | None | None |
| normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters | throughput | [5126402.353op/s; 5128597.974op/s] or [-0.021%; +0.021%] | None | None | None |
| normalization/normalize_service/normalize_service/[empty string] | execution_time | [37.273µs; 37.297µs] or [-0.032%; +0.032%] | None | None | None |
| normalization/normalize_service/normalize_service/[empty string] | throughput | [26811812.891op/s; 26829000.736op/s] or [-0.032%; +0.032%] | None | None | None |
| normalization/normalize_service/normalize_service/test_ASCII | execution_time | [45.129µs; 45.144µs] or [-0.016%; +0.016%] | None | None | None |
| normalization/normalize_service/normalize_service/test_ASCII | throughput | [22151534.311op/s; 22158560.601op/s] or [-0.016%; +0.016%] | None | None | None |
Group 16
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 3d789de5 | 1763564597 | augusto.deoliveira/apmsp-2369.ensure-correct-interrupt-policy |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| benching string interning on wordpress profile | execution_time | 159.823µs | 160.361µs ± 0.219µs | 160.327µs ± 0.116µs | 160.439µs | 160.767µs | 161.042µs | 161.167µs | 0.52% | 1.067 | 1.822 | 0.14% | 0.015µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| benching string interning on wordpress profile | execution_time | [160.330µs; 160.391µs] or [-0.019%; +0.019%] | None | None | None |
Group 17
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 3d789de5 | 1763564597 | augusto.deoliveira/apmsp-2369.ensure-correct-interrupt-policy |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| sql/obfuscate_sql_string | execution_time | 86.581µs | 86.932µs ± 1.726µs | 86.760µs ± 0.055µs | 86.822µs | 86.932µs | 88.579µs | 110.173µs | 26.99% | 12.587 | 164.197 | 1.98% | 0.122µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| sql/obfuscate_sql_string | execution_time | [86.693µs; 87.171µs] or [-0.275%; +0.275%] | None | None | None |
Baseline
Omitted due to size.