libdatadog
libdatadog copied to clipboard
ci(caching): switch to rust_cache for caching
What does this PR do?
A brief description of the change being made with this pull request.
Motivation
What inspired you to submit this pull request?
Additional Notes
Anything else we should know when reviewing?
How to test the change?
Describe here in detail how the change can be validated.
Codecov Report
:white_check_mark: All modified and coverable lines are covered by tests.
:white_check_mark: Project coverage is 71.00%. Comparing base (3e9119a) to head (9acedd0).
Additional details and impacted files
@@ Coverage Diff @@
## main #1342 +/- ##
==========================================
+ Coverage 70.95% 71.00% +0.04%
==========================================
Files 390 392 +2
Lines 62562 62669 +107
==========================================
+ Hits 44389 44496 +107
Misses 18173 18173
| Components | Coverage Δ | |
|---|---|---|
| libdd-crashtracker | 57.83% <ø> (+0.18%) |
:arrow_up: |
| libdd-crashtracker-ffi | 15.31% <ø> (+0.70%) |
:arrow_up: |
| libdd-alloc | 98.73% <ø> (ø) |
|
| libdd-data-pipeline | 86.00% <ø> (-0.02%) |
:arrow_down: |
| libdd-data-pipeline-ffi | 77.63% <ø> (-0.11%) |
:arrow_down: |
| libdd-common | 80.93% <ø> (ø) |
|
| libdd-common-ffi | 73.90% <ø> (ø) |
|
| libdd-telemetry | 59.98% <ø> (-0.04%) |
:arrow_down: |
| libdd-telemetry-ffi | 21.24% <ø> (ø) |
|
| libdd-dogstatsd-client | 83.75% <ø> (ø) |
|
| datadog-ipc | 82.71% <ø> (+0.10%) |
:arrow_up: |
| libdd-profiling | 79.68% <ø> (+0.02%) |
:arrow_up: |
| libdd-profiling-ffi | 62.13% <ø> (ø) |
|
| datadog-sidecar | 36.98% <ø> (+1.07%) |
:arrow_up: |
| datdog-sidecar-ffi | 16.40% <ø> (+5.41%) |
:arrow_up: |
| spawn-worker | 55.18% <ø> (ø) |
|
| libdd-tinybytes | 92.44% <ø> (ø) |
|
| libdd-trace-normalization | 98.24% <ø> (ø) |
|
| datadog-trace-obfuscation | 94.17% <ø> (ø) |
|
| libdd-trace-protobuf | 59.65% <ø> (ø) |
|
| libdd-trace-utils | 90.25% <ø> (+0.17%) |
:arrow_up: |
| datadog-tracer-flare | 62.06% <ø> (-1.43%) |
:arrow_down: |
| libdd-log | 75.57% <ø> (ø) |
:rocket: New features to boost your workflow:
- :snowflake: Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
Benchmarks
Comparison
Benchmark execution time: 2025-11-19 15:14:37
Comparing candidate commit 9acedd09 in PR branch ban/use-rust-cache with baseline commit 3e9119ad in branch main.
Found 0 performance improvements and 0 performance regressions! Performance is the same for 55 metrics, 2 unstable metrics.
Candidate
Candidate benchmark details
Group 1
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 9acedd09 | 1763564151 | ban/use-rust-cache |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| benching serializing traces from their internal representation to msgpack | execution_time | 14.847ms | 14.903ms ± 0.040ms | 14.895ms ± 0.014ms | 14.910ms | 14.965ms | 15.090ms | 15.127ms | 1.55% | 2.962 | 11.433 | 0.27% | 0.003ms | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| benching serializing traces from their internal representation to msgpack | execution_time | [14.897ms; 14.908ms] or [-0.037%; +0.037%] | None | None | None |
Group 2
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 9acedd09 | 1763564151 | ban/use-rust-cache |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| receiver_entry_point/report/2597 | execution_time | 6.136ms | 6.403ms ± 0.072ms | 6.421ms ± 0.017ms | 6.436ms | 6.464ms | 6.517ms | 6.560ms | 2.17% | -2.073 | 4.224 | 1.12% | 0.005ms | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| receiver_entry_point/report/2597 | execution_time | [6.393ms; 6.412ms] or [-0.155%; +0.155%] | None | None | None |
Group 3
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 9acedd09 | 1763564151 | ban/use-rust-cache |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| sdk_test_data/rules-based | execution_time | 144.412µs | 146.738µs ± 1.916µs | 146.428µs ± 0.581µs | 147.042µs | 148.674µs | 153.720µs | 166.155µs | 13.47% | 6.386 | 55.707 | 1.30% | 0.136µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| sdk_test_data/rules-based | execution_time | [146.473µs; 147.004µs] or [-0.181%; +0.181%] | None | None | None |
Group 4
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 9acedd09 | 1763564151 | ban/use-rust-cache |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... | execution_time | 534.050µs | 534.758µs ± 0.742µs | 534.680µs ± 0.199µs | 534.911µs | 535.347µs | 535.929µs | 543.982µs | 1.74% | 9.754 | 117.893 | 0.14% | 0.052µs | 1 | 200 |
| normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... | throughput | 1838296.120op/s | 1870009.099op/s ± 2560.298op/s | 1870278.784op/s ± 695.629op/s | 1870962.110op/s | 1871894.283op/s | 1872242.778op/s | 1872485.294op/s | 0.12% | -9.651 | 116.155 | 0.14% | 181.040op/s | 1 | 200 |
| normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて | execution_time | 380.313µs | 381.064µs ± 0.297µs | 381.048µs ± 0.176µs | 381.232µs | 381.559µs | 381.855µs | 382.120µs | 0.28% | 0.382 | 0.523 | 0.08% | 0.021µs | 1 | 200 |
| normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて | throughput | 2616979.853op/s | 2624234.870op/s ± 2042.332op/s | 2624340.691op/s ± 1215.848op/s | 2625519.225op/s | 2627307.318op/s | 2628817.519op/s | 2629413.141op/s | 0.19% | -0.377 | 0.516 | 0.08% | 144.415op/s | 1 | 200 |
| normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters | execution_time | 195.322µs | 196.160µs ± 0.340µs | 196.134µs ± 0.251µs | 196.418µs | 196.706µs | 196.946µs | 197.056µs | 0.47% | 0.110 | -0.435 | 0.17% | 0.024µs | 1 | 200 |
| normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters | throughput | 5074696.867op/s | 5097888.380op/s ± 8832.365op/s | 5098543.782op/s ± 6515.362op/s | 5104299.136op/s | 5112323.361op/s | 5115643.312op/s | 5119737.869op/s | 0.42% | -0.102 | -0.438 | 0.17% | 624.542op/s | 1 | 200 |
| normalization/normalize_service/normalize_service/[empty string] | execution_time | 36.950µs | 37.115µs ± 0.075µs | 37.106µs ± 0.046µs | 37.160µs | 37.242µs | 37.289µs | 37.411µs | 0.82% | 0.396 | 0.501 | 0.20% | 0.005µs | 1 | 200 |
| normalization/normalize_service/normalize_service/[empty string] | throughput | 26730442.602op/s | 26943575.347op/s ± 54713.275op/s | 26949460.531op/s ± 33469.083op/s | 26979042.147op/s | 27034462.142op/s | 27051925.711op/s | 27063514.292op/s | 0.42% | -0.382 | 0.472 | 0.20% | 3868.813op/s | 1 | 200 |
| normalization/normalize_service/normalize_service/test_ASCII | execution_time | 44.897µs | 45.080µs ± 0.144µs | 45.066µs ± 0.140µs | 45.203µs | 45.311µs | 45.394µs | 45.404µs | 0.75% | 0.300 | -1.086 | 0.32% | 0.010µs | 1 | 200 |
| normalization/normalize_service/normalize_service/test_ASCII | throughput | 22024464.285op/s | 22182824.919op/s ± 70806.406op/s | 22189491.353op/s ± 68866.352op/s | 22258725.161op/s | 22271552.336op/s | 22272329.299op/s | 22273302.329op/s | 0.38% | -0.293 | -1.095 | 0.32% | 5006.769op/s | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... | execution_time | [534.655µs; 534.861µs] or [-0.019%; +0.019%] | None | None | None |
| normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... | throughput | [1869654.266op/s; 1870363.932op/s] or [-0.019%; +0.019%] | None | None | None |
| normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて | execution_time | [381.023µs; 381.105µs] or [-0.011%; +0.011%] | None | None | None |
| normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて | throughput | [2623951.822op/s; 2624517.917op/s] or [-0.011%; +0.011%] | None | None | None |
| normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters | execution_time | [196.113µs; 196.207µs] or [-0.024%; +0.024%] | None | None | None |
| normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters | throughput | [5096664.299op/s; 5099112.461op/s] or [-0.024%; +0.024%] | None | None | None |
| normalization/normalize_service/normalize_service/[empty string] | execution_time | [37.104µs; 37.125µs] or [-0.028%; +0.028%] | None | None | None |
| normalization/normalize_service/normalize_service/[empty string] | throughput | [26935992.614op/s; 26951158.081op/s] or [-0.028%; +0.028%] | None | None | None |
| normalization/normalize_service/normalize_service/test_ASCII | execution_time | [45.060µs; 45.100µs] or [-0.044%; +0.044%] | None | None | None |
| normalization/normalize_service/normalize_service/test_ASCII | throughput | [22173011.832op/s; 22192638.005op/s] or [-0.044%; +0.044%] | None | None | None |
Group 5
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 9acedd09 | 1763564151 | ban/use-rust-cache |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| two way interface | execution_time | 17.819µs | 25.485µs ± 9.034µs | 18.229µs ± 0.201µs | 33.056µs | 41.946µs | 43.633µs | 62.603µs | 243.42% | 0.869 | 0.192 | 35.36% | 0.639µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| two way interface | execution_time | [24.233µs; 26.737µs] or [-4.913%; +4.913%] | None | None | None |
Group 6
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 9acedd09 | 1763564151 | ban/use-rust-cache |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... | execution_time | 205.813µs | 206.319µs ± 0.204µs | 206.301µs ± 0.134µs | 206.434µs | 206.695µs | 206.798µs | 206.943µs | 0.31% | 0.438 | -0.077 | 0.10% | 0.014µs | 1 | 200 |
| normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... | throughput | 4832238.396op/s | 4846870.701op/s ± 4787.686op/s | 4847290.692op/s ± 3140.597op/s | 4850367.157op/s | 4853526.602op/s | 4856107.052op/s | 4858782.762op/s | 0.24% | -0.433 | -0.083 | 0.10% | 338.540op/s | 1 | 200 |
| normalization/normalize_name/normalize_name/bad-name | execution_time | 18.188µs | 18.318µs ± 0.109µs | 18.274µs ± 0.033µs | 18.356µs | 18.524µs | 18.711µs | 18.858µs | 3.19% | 1.889 | 4.196 | 0.59% | 0.008µs | 1 | 200 |
| normalization/normalize_name/normalize_name/bad-name | throughput | 53028861.515op/s | 54592866.589op/s ± 321867.818op/s | 54723022.182op/s ± 97902.298op/s | 54800652.266op/s | 54867640.438op/s | 54936419.289op/s | 54982601.934op/s | 0.47% | -1.843 | 3.919 | 0.59% | 22759.492op/s | 1 | 200 |
| normalization/normalize_name/normalize_name/good | execution_time | 10.598µs | 10.737µs ± 0.086µs | 10.724µs ± 0.057µs | 10.785µs | 10.899µs | 10.973µs | 11.040µs | 2.95% | 0.802 | 0.558 | 0.80% | 0.006µs | 1 | 200 |
| normalization/normalize_name/normalize_name/good | throughput | 90577753.686op/s | 93142843.564op/s ± 744643.467op/s | 93251664.213op/s ± 497906.359op/s | 93710021.199op/s | 94203236.462op/s | 94348814.462op/s | 94359069.649op/s | 1.19% | -0.757 | 0.446 | 0.80% | 52654.245op/s | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... | execution_time | [206.291µs; 206.347µs] or [-0.014%; +0.014%] | None | None | None |
| normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... | throughput | [4846207.174op/s; 4847534.228op/s] or [-0.014%; +0.014%] | None | None | None |
| normalization/normalize_name/normalize_name/bad-name | execution_time | [18.303µs; 18.333µs] or [-0.083%; +0.083%] | None | None | None |
| normalization/normalize_name/normalize_name/bad-name | throughput | [54548258.805op/s; 54637474.373op/s] or [-0.082%; +0.082%] | None | None | None |
| normalization/normalize_name/normalize_name/good | execution_time | [10.725µs; 10.749µs] or [-0.111%; +0.111%] | None | None | None |
| normalization/normalize_name/normalize_name/good | throughput | [93039643.142op/s; 93246043.987op/s] or [-0.111%; +0.111%] | None | None | None |
Group 7
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 9acedd09 | 1763564151 | ban/use-rust-cache |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| credit_card/is_card_number/ | execution_time | 3.901µs | 3.915µs ± 0.003µs | 3.914µs ± 0.002µs | 3.916µs | 3.919µs | 3.923µs | 3.926µs | 0.30% | 0.368 | 3.884 | 0.07% | 0.000µs | 1 | 200 |
| credit_card/is_card_number/ | throughput | 254708315.613op/s | 255451800.413op/s ± 184152.799op/s | 255463213.297op/s ± 102911.738op/s | 255566971.326op/s | 255688597.188op/s | 255762163.908op/s | 256356101.200op/s | 0.35% | -0.355 | 3.903 | 0.07% | 13021.569op/s | 1 | 200 |
| credit_card/is_card_number/ 3782-8224-6310-005 | execution_time | 77.910µs | 79.268µs ± 0.747µs | 79.232µs ± 0.509µs | 79.796µs | 80.441µs | 80.929µs | 81.347µs | 2.67% | 0.093 | -0.478 | 0.94% | 0.053µs | 1 | 200 |
| credit_card/is_card_number/ 3782-8224-6310-005 | throughput | 12293037.588op/s | 12616485.943op/s ± 118748.054op/s | 12621238.459op/s ± 81121.836op/s | 12693163.416op/s | 12825531.530op/s | 12833686.297op/s | 12835402.607op/s | 1.70% | -0.051 | -0.502 | 0.94% | 8396.755op/s | 1 | 200 |
| credit_card/is_card_number/ 378282246310005 | execution_time | 71.442µs | 71.639µs ± 0.278µs | 71.533µs ± 0.037µs | 71.600µs | 72.320µs | 72.847µs | 72.994µs | 2.04% | 2.696 | 7.455 | 0.39% | 0.020µs | 1 | 200 |
| credit_card/is_card_number/ 378282246310005 | throughput | 13699784.297op/s | 13959032.164op/s ± 53618.003op/s | 13979627.490op/s ± 7158.276op/s | 13985315.070op/s | 13993073.359op/s | 13996694.946op/s | 13997460.861op/s | 0.13% | -2.671 | 7.280 | 0.38% | 3791.365op/s | 1 | 200 |
| credit_card/is_card_number/37828224631 | execution_time | 3.896µs | 3.915µs ± 0.004µs | 3.915µs ± 0.001µs | 3.916µs | 3.920µs | 3.923µs | 3.952µs | 0.96% | 4.557 | 38.892 | 0.11% | 0.000µs | 1 | 200 |
| credit_card/is_card_number/37828224631 | throughput | 253016934.699op/s | 255408911.241op/s ± 280740.342op/s | 255445149.936op/s ± 97034.602op/s | 255530045.628op/s | 255642373.261op/s | 255700397.729op/s | 256662780.882op/s | 0.48% | -4.490 | 38.378 | 0.11% | 19851.340op/s | 1 | 200 |
| credit_card/is_card_number/378282246310005 | execution_time | 68.236µs | 68.533µs ± 0.478µs | 68.341µs ± 0.051µs | 68.518µs | 69.462µs | 70.465µs | 70.820µs | 3.63% | 2.775 | 7.777 | 0.70% | 0.034µs | 1 | 200 |
| credit_card/is_card_number/378282246310005 | throughput | 14120367.391op/s | 14592130.077op/s ± 99942.141op/s | 14632578.203op/s ± 10979.668op/s | 14640554.593op/s | 14649647.258op/s | 14652795.492op/s | 14654952.143op/s | 0.15% | -2.733 | 7.498 | 0.68% | 7066.977op/s | 1 | 200 |
| credit_card/is_card_number/37828224631000521389798 | execution_time | 45.467µs | 45.711µs ± 0.076µs | 45.717µs ± 0.049µs | 45.765µs | 45.823µs | 45.877µs | 45.911µs | 0.43% | -0.247 | 0.140 | 0.17% | 0.005µs | 1 | 200 |
| credit_card/is_card_number/37828224631000521389798 | throughput | 21781109.989op/s | 21876773.919op/s ± 36270.980op/s | 21873717.636op/s ± 23670.874op/s | 21897929.003op/s | 21939406.465op/s | 21950640.158op/s | 21994112.809op/s | 0.55% | 0.257 | 0.148 | 0.17% | 2564.746op/s | 1 | 200 |
| credit_card/is_card_number/x371413321323331 | execution_time | 6.544µs | 6.616µs ± 0.019µs | 6.618µs ± 0.014µs | 6.632µs | 6.638µs | 6.642µs | 6.644µs | 0.39% | -1.045 | 1.536 | 0.28% | 0.001µs | 1 | 200 |
| credit_card/is_card_number/x371413321323331 | throughput | 150515438.278op/s | 151152764.859op/s ± 429225.187op/s | 151108447.378op/s ± 323480.537op/s | 151414314.260op/s | 151814783.916op/s | 152711722.444op/s | 152807831.275op/s | 1.12% | 1.066 | 1.617 | 0.28% | 30350.804op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/ | execution_time | 3.903µs | 3.915µs ± 0.003µs | 3.914µs ± 0.001µs | 3.916µs | 3.920µs | 3.922µs | 3.933µs | 0.49% | 2.190 | 13.418 | 0.07% | 0.000µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/ | throughput | 254228945.210op/s | 255438820.729op/s ± 188412.383op/s | 255462524.454op/s ± 86495.270op/s | 255550103.742op/s | 255633862.812op/s | 255663965.159op/s | 256241368.534op/s | 0.30% | -2.166 | 13.301 | 0.07% | 13322.767op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 | execution_time | 65.571µs | 65.707µs ± 0.055µs | 65.696µs ± 0.028µs | 65.737µs | 65.809µs | 65.848µs | 65.885µs | 0.29% | 0.703 | 0.536 | 0.08% | 0.004µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 | throughput | 15177985.691op/s | 15219026.696op/s ± 12717.950op/s | 15221734.411op/s ± 6428.540op/s | 15227039.640op/s | 15236262.605op/s | 15243420.570op/s | 15250603.296op/s | 0.19% | -0.698 | 0.529 | 0.08% | 899.295op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/ 378282246310005 | execution_time | 53.371µs | 53.440µs ± 0.038µs | 53.436µs ± 0.024µs | 53.461µs | 53.514µs | 53.552µs | 53.565µs | 0.24% | 0.792 | 0.704 | 0.07% | 0.003µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/ 378282246310005 | throughput | 18669027.438op/s | 18712493.551op/s ± 13382.479op/s | 18713871.280op/s ± 8374.422op/s | 18721360.458op/s | 18730540.230op/s | 18735084.544op/s | 18736769.026op/s | 0.12% | -0.788 | 0.694 | 0.07% | 946.284op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/37828224631 | execution_time | 3.894µs | 3.915µs ± 0.003µs | 3.915µs ± 0.002µs | 3.917µs | 3.921µs | 3.922µs | 3.923µs | 0.21% | -1.096 | 9.180 | 0.08% | 0.000µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/37828224631 | throughput | 254897498.782op/s | 255408814.380op/s ± 208969.972op/s | 255442512.663op/s ± 132955.441op/s | 255536637.566op/s | 255658565.835op/s | 255698929.245op/s | 256828290.234op/s | 0.54% | 1.120 | 9.362 | 0.08% | 14776.408op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/378282246310005 | execution_time | 50.162µs | 50.217µs ± 0.035µs | 50.211µs ± 0.022µs | 50.234µs | 50.293µs | 50.311µs | 50.314µs | 0.21% | 0.875 | 0.434 | 0.07% | 0.002µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/378282246310005 | throughput | 19875021.887op/s | 19913737.600op/s ± 13817.303op/s | 19915800.973op/s ± 8551.455op/s | 19923328.557op/s | 19931642.836op/s | 19934532.106op/s | 19935427.158op/s | 0.10% | -0.871 | 0.427 | 0.07% | 977.031op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/37828224631000521389798 | execution_time | 45.349µs | 45.720µs ± 0.097µs | 45.729µs ± 0.067µs | 45.791µs | 45.859µs | 45.904µs | 45.953µs | 0.49% | -0.453 | 0.338 | 0.21% | 0.007µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/37828224631000521389798 | throughput | 21761219.996op/s | 21872333.314op/s ± 46228.084op/s | 21867955.802op/s ± 32085.708op/s | 21902165.618op/s | 21949278.849op/s | 21977887.739op/s | 22051147.385op/s | 0.84% | 0.467 | 0.367 | 0.21% | 3268.819op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/x371413321323331 | execution_time | 6.536µs | 6.621µs ± 0.018µs | 6.623µs ± 0.012µs | 6.635µs | 6.641µs | 6.650µs | 6.652µs | 0.44% | -1.116 | 1.836 | 0.27% | 0.001µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/x371413321323331 | throughput | 150334524.145op/s | 151031662.348op/s ± 411761.983op/s | 150992671.977op/s ± 272038.928op/s | 151218933.403op/s | 151861006.162op/s | 152057163.849op/s | 152994766.304op/s | 1.33% | 1.137 | 1.935 | 0.27% | 29115.969op/s | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| credit_card/is_card_number/ | execution_time | [3.914µs; 3.915µs] or [-0.010%; +0.010%] | None | None | None |
| credit_card/is_card_number/ | throughput | [255426278.606op/s; 255477322.220op/s] or [-0.010%; +0.010%] | None | None | None |
| credit_card/is_card_number/ 3782-8224-6310-005 | execution_time | [79.165µs; 79.372µs] or [-0.131%; +0.131%] | None | None | None |
| credit_card/is_card_number/ 3782-8224-6310-005 | throughput | [12600028.605op/s; 12632943.282op/s] or [-0.130%; +0.130%] | None | None | None |
| credit_card/is_card_number/ 378282246310005 | execution_time | [71.601µs; 71.678µs] or [-0.054%; +0.054%] | None | None | None |
| credit_card/is_card_number/ 378282246310005 | throughput | [13951601.224op/s; 13966463.103op/s] or [-0.053%; +0.053%] | None | None | None |
| credit_card/is_card_number/37828224631 | execution_time | [3.915µs; 3.916µs] or [-0.015%; +0.015%] | None | None | None |
| credit_card/is_card_number/37828224631 | throughput | [255370003.329op/s; 255447819.152op/s] or [-0.015%; +0.015%] | None | None | None |
| credit_card/is_card_number/378282246310005 | execution_time | [68.467µs; 68.600µs] or [-0.097%; +0.097%] | None | None | None |
| credit_card/is_card_number/378282246310005 | throughput | [14578279.057op/s; 14605981.096op/s] or [-0.095%; +0.095%] | None | None | None |
| credit_card/is_card_number/37828224631000521389798 | execution_time | [45.700µs; 45.721µs] or [-0.023%; +0.023%] | None | None | None |
| credit_card/is_card_number/37828224631000521389798 | throughput | [21871747.110op/s; 21881800.728op/s] or [-0.023%; +0.023%] | None | None | None |
| credit_card/is_card_number/x371413321323331 | execution_time | [6.613µs; 6.618µs] or [-0.039%; +0.039%] | None | None | None |
| credit_card/is_card_number/x371413321323331 | throughput | [151093278.376op/s; 151212251.342op/s] or [-0.039%; +0.039%] | None | None | None |
| credit_card/is_card_number_no_luhn/ | execution_time | [3.914µs; 3.915µs] or [-0.010%; +0.010%] | None | None | None |
| credit_card/is_card_number_no_luhn/ | throughput | [255412708.585op/s; 255464932.874op/s] or [-0.010%; +0.010%] | None | None | None |
| credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 | execution_time | [65.700µs; 65.715µs] or [-0.012%; +0.012%] | None | None | None |
| credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 | throughput | [15217264.110op/s; 15220789.281op/s] or [-0.012%; +0.012%] | None | None | None |
| credit_card/is_card_number_no_luhn/ 378282246310005 | execution_time | [53.435µs; 53.446µs] or [-0.010%; +0.010%] | None | None | None |
| credit_card/is_card_number_no_luhn/ 378282246310005 | throughput | [18710638.868op/s; 18714348.234op/s] or [-0.010%; +0.010%] | None | None | None |
| credit_card/is_card_number_no_luhn/37828224631 | execution_time | [3.915µs; 3.916µs] or [-0.011%; +0.011%] | None | None | None |
| credit_card/is_card_number_no_luhn/37828224631 | throughput | [255379853.152op/s; 255437775.608op/s] or [-0.011%; +0.011%] | None | None | None |
| credit_card/is_card_number_no_luhn/378282246310005 | execution_time | [50.212µs; 50.221µs] or [-0.010%; +0.010%] | None | None | None |
| credit_card/is_card_number_no_luhn/378282246310005 | throughput | [19911822.654op/s; 19915652.545op/s] or [-0.010%; +0.010%] | None | None | None |
| credit_card/is_card_number_no_luhn/37828224631000521389798 | execution_time | [45.707µs; 45.733µs] or [-0.029%; +0.029%] | None | None | None |
| credit_card/is_card_number_no_luhn/37828224631000521389798 | throughput | [21865926.547op/s; 21878740.082op/s] or [-0.029%; +0.029%] | None | None | None |
| credit_card/is_card_number_no_luhn/x371413321323331 | execution_time | [6.619µs; 6.624µs] or [-0.038%; +0.038%] | None | None | None |
| credit_card/is_card_number_no_luhn/x371413321323331 | throughput | [150974596.097op/s; 151088728.598op/s] or [-0.038%; +0.038%] | None | None | None |
Group 8
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 9acedd09 | 1763564151 | ban/use-rust-cache |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| ip_address/quantize_peer_ip_address_benchmark | execution_time | 5.021µs | 5.102µs ± 0.063µs | 5.072µs ± 0.033µs | 5.158µs | 5.200µs | 5.204µs | 5.205µs | 2.63% | 0.513 | -1.377 | 1.24% | 0.004µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| ip_address/quantize_peer_ip_address_benchmark | execution_time | [5.093µs; 5.111µs] or [-0.172%; +0.172%] | None | None | None |
Group 9
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 9acedd09 | 1763564151 | ban/use-rust-cache |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| benching deserializing traces from msgpack to their internal representation | execution_time | 61.155ms | 61.681ms ± 2.171ms | 61.380ms ± 0.086ms | 61.479ms | 61.756ms | 75.352ms | 81.090ms | 32.11% | 8.111 | 65.454 | 3.51% | 0.154ms | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| benching deserializing traces from msgpack to their internal representation | execution_time | [61.380ms; 61.982ms] or [-0.488%; +0.488%] | None | None | None |
Group 10
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 9acedd09 | 1763564151 | ban/use-rust-cache |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| benching string interning on wordpress profile | execution_time | 159.054µs | 160.015µs ± 0.543µs | 160.004µs ± 0.150µs | 160.132µs | 160.426µs | 160.852µs | 166.579µs | 4.11% | 8.820 | 104.913 | 0.34% | 0.038µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| benching string interning on wordpress profile | execution_time | [159.940µs; 160.090µs] or [-0.047%; +0.047%] | None | None | None |
Group 11
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 9acedd09 | 1763564151 | ban/use-rust-cache |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| normalization/normalize_trace/test_trace | execution_time | 243.425ns | 253.898ns ± 13.445ns | 247.858ns ± 2.983ns | 252.840ns | 283.718ns | 288.507ns | 292.093ns | 17.85% | 1.465 | 0.647 | 5.28% | 0.951ns | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| normalization/normalize_trace/test_trace | execution_time | [252.035ns; 255.762ns] or [-0.734%; +0.734%] | None | None | None |
Group 12
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 9acedd09 | 1763564151 | ban/use-rust-cache |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| sql/obfuscate_sql_string | execution_time | 85.941µs | 86.199µs ± 0.159µs | 86.177µs ± 0.046µs | 86.223µs | 86.334µs | 86.852µs | 87.721µs | 1.79% | 6.229 | 50.637 | 0.18% | 0.011µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| sql/obfuscate_sql_string | execution_time | [86.177µs; 86.221µs] or [-0.026%; +0.026%] | None | None | None |
Group 13
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 9acedd09 | 1763564151 | ban/use-rust-cache |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| redis/obfuscate_redis_string | execution_time | 33.938µs | 34.492µs ± 0.906µs | 34.066µs ± 0.068µs | 34.238µs | 36.417µs | 36.497µs | 37.519µs | 10.13% | 1.704 | 1.082 | 2.62% | 0.064µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| redis/obfuscate_redis_string | execution_time | [34.367µs; 34.618µs] or [-0.364%; +0.364%] | None | None | None |
Group 14
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 9acedd09 | 1763564151 | ban/use-rust-cache |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| concentrator/add_spans_to_concentrator | execution_time | 10.581ms | 10.619ms ± 0.015ms | 10.618ms ± 0.009ms | 10.626ms | 10.645ms | 10.658ms | 10.707ms | 0.84% | 1.229 | 5.217 | 0.14% | 0.001ms | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| concentrator/add_spans_to_concentrator | execution_time | [10.617ms; 10.621ms] or [-0.020%; +0.020%] | None | None | None |
Group 15
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 9acedd09 | 1763564151 | ban/use-rust-cache |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| tags/replace_trace_tags | execution_time | 2.329µs | 2.404µs ± 0.020µs | 2.405µs ± 0.009µs | 2.417µs | 2.426µs | 2.430µs | 2.431µs | 1.11% | -2.021 | 4.632 | 0.82% | 0.001µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| tags/replace_trace_tags | execution_time | [2.401µs; 2.407µs] or [-0.114%; +0.114%] | None | None | None |
Group 16
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 9acedd09 | 1763564151 | ban/use-rust-cache |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| write only interface | execution_time | 1.181µs | 3.221µs ± 1.424µs | 3.004µs ± 0.031µs | 3.030µs | 3.660µs | 13.914µs | 14.710µs | 389.61% | 7.313 | 54.800 | 44.09% | 0.101µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| write only interface | execution_time | [3.024µs; 3.418µs] or [-6.125%; +6.125%] | None | None | None |
Group 17
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 9acedd09 | 1763564151 | ban/use-rust-cache |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| single_flag_killswitch/rules-based | execution_time | 189.863ns | 192.198ns ± 1.703ns | 192.085ns ± 1.154ns | 193.103ns | 195.320ns | 197.575ns | 198.928ns | 3.56% | 1.003 | 1.354 | 0.88% | 0.120ns | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| single_flag_killswitch/rules-based | execution_time | [191.962ns; 192.434ns] or [-0.123%; +0.123%] | None | None | None |
Baseline
Omitted due to size.
Artifact Size Benchmark Report
aarch64-alpine-linux-musl
| Artifact | Baseline | Commit | Change |
|---|---|---|---|
| /aarch64-alpine-linux-musl/lib/libdatadog_profiling.so | 7.57 MB | 7.57 MB | 0% (0 B) 👌 |
| /aarch64-alpine-linux-musl/lib/libdatadog_profiling.a | 83.05 MB | 83.05 MB | 0% (0 B) 👌 |
aarch64-unknown-linux-gnu
| Artifact | Baseline | Commit | Change |
|---|---|---|---|
| /aarch64-unknown-linux-gnu/lib/libdatadog_profiling.a | 96.25 MB | 96.25 MB | 0% (0 B) 👌 |
| /aarch64-unknown-linux-gnu/lib/libdatadog_profiling.so | 9.55 MB | 9.55 MB | 0% (0 B) 👌 |
libdatadog-x64-windows
| Artifact | Baseline | Commit | Change |
|---|---|---|---|
| /libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.dll | 19.07 MB | 19.07 MB | 0% (0 B) 👌 |
| /libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.lib | 65.49 KB | 65.49 KB | 0% (0 B) 👌 |
| /libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.pdb | 132.16 MB | 132.16 MB | +0% (+8.00 KB) 👌 |
| /libdatadog-x64-windows/debug/static/datadog_profiling_ffi.lib | 696.66 MB | 696.66 MB | 0% (0 B) 👌 |
| /libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.dll | 6.34 MB | 6.34 MB | 0% (0 B) 👌 |
| /libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.lib | 65.49 KB | 65.49 KB | 0% (0 B) 👌 |
| /libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.pdb | 19.07 MB | 19.07 MB | 0% (0 B) 👌 |
| /libdatadog-x64-windows/release/static/datadog_profiling_ffi.lib | 36.91 MB | 36.91 MB | 0% (0 B) 👌 |
libdatadog-x86-windows
| Artifact | Baseline | Commit | Change |
|---|---|---|---|
| /libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.dll | 16.16 MB | 16.16 MB | 0% (0 B) 👌 |
| /libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.lib | 66.50 KB | 66.50 KB | 0% (0 B) 👌 |
| /libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.pdb | 134.40 MB | 134.41 MB | +0% (+8.00 KB) 👌 |
| /libdatadog-x86-windows/debug/static/datadog_profiling_ffi.lib | 684.68 MB | 684.68 MB | 0% (0 B) 👌 |
| /libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.dll | 4.86 MB | 4.86 MB | 0% (0 B) 👌 |
| /libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.lib | 66.50 KB | 66.50 KB | 0% (0 B) 👌 |
| /libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.pdb | 20.23 MB | 20.23 MB | 0% (0 B) 👌 |
| /libdatadog-x86-windows/release/static/datadog_profiling_ffi.lib | 34.64 MB | 34.64 MB | 0% (0 B) 👌 |
x86_64-alpine-linux-musl
| Artifact | Baseline | Commit | Change |
|---|---|---|---|
| /x86_64-alpine-linux-musl/lib/libdatadog_profiling.a | 71.98 MB | 71.98 MB | 0% (0 B) 👌 |
| /x86_64-alpine-linux-musl/lib/libdatadog_profiling.so | 8.92 MB | 8.92 MB | 0% (0 B) 👌 |
x86_64-unknown-linux-gnu
| Artifact | Baseline | Commit | Change |
|---|---|---|---|
| /x86_64-unknown-linux-gnu/lib/libdatadog_profiling.a | 90.98 MB | 90.98 MB | 0% (0 B) 👌 |
| /x86_64-unknown-linux-gnu/lib/libdatadog_profiling.so | 10.27 MB | 10.27 MB | 0% (0 B) 👌 |
/merge
View all feedbacks in Devflow UI.
2025-11-19 15:29:17 UTC :information_source: Start processing command /merge
2025-11-19 15:29:23 UTC :information_source: MergeQueue: pull request added to the queue
The expected merge time in main is approximately 35m (p90).
2025-11-19 15:53:00 UTC :information_source: MergeQueue: This merge request was merged