libdatadog
libdatadog copied to clipboard
Add endpoints collection
What does this PR do?
A brief description of the change being made with this pull request.
Motivation
What inspired you to submit this pull request?
Additional Notes
Anything else we should know when reviewing?
How to test the change?
Describe here in detail how the change can be validated.
Benchmarks
Comparison
Benchmark execution time: 2025-10-21 15:37:47
Comparing candidate commit 436bbdf5 in PR branch estringana/add-routes-collection with baseline commit 0b1fc792 in branch main.
Found 0 performance improvements and 0 performance regressions! Performance is the same for 53 metrics, 2 unstable metrics.
Candidate
Candidate benchmark details
Group 1
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 436bbdf5 | 1761060291 | estringana/add-routes-collection |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... | execution_time | 204.822µs | 205.274µs ± 0.280µs | 205.234µs ± 0.144µs | 205.403µs | 205.617µs | 205.881µs | 207.172µs | 0.94% | 2.940 | 16.909 | 0.14% | 0.020µs | 1 | 200 |
| normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... | throughput | 4826904.592op/s | 4871538.440op/s ± 6616.499op/s | 4872480.280op/s ± 3430.106op/s | 4875635.069op/s | 4879286.454op/s | 4881848.841op/s | 4882282.237op/s | 0.20% | -2.899 | 16.560 | 0.14% | 467.857op/s | 1 | 200 |
| normalization/normalize_name/normalize_name/bad-name | execution_time | 18.193µs | 18.277µs ± 0.064µs | 18.275µs ± 0.031µs | 18.296µs | 18.414µs | 18.516µs | 18.543µs | 1.47% | 1.672 | 3.962 | 0.35% | 0.005µs | 1 | 200 |
| normalization/normalize_name/normalize_name/bad-name | throughput | 53928535.174op/s | 54714053.012op/s ± 191893.631op/s | 54720455.501op/s ± 92759.404op/s | 54844674.352op/s | 54956708.317op/s | 54962638.270op/s | 54967236.755op/s | 0.45% | -1.638 | 3.837 | 0.35% | 13568.929op/s | 1 | 200 |
| normalization/normalize_name/normalize_name/good | execution_time | 10.897µs | 11.074µs ± 0.082µs | 11.069µs ± 0.047µs | 11.117µs | 11.198µs | 11.255µs | 11.723µs | 5.90% | 2.590 | 17.977 | 0.74% | 0.006µs | 1 | 200 |
| normalization/normalize_name/normalize_name/good | throughput | 85303628.423op/s | 90302798.636op/s ± 658222.291op/s | 90339792.285op/s ± 386184.414op/s | 90723567.727op/s | 91184730.672op/s | 91483950.497op/s | 91769477.895op/s | 1.58% | -2.313 | 15.302 | 0.73% | 46543.345op/s | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... | execution_time | [205.236µs; 205.313µs] or [-0.019%; +0.019%] | None | None | None |
| normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... | throughput | [4870621.457op/s; 4872455.424op/s] or [-0.019%; +0.019%] | None | None | None |
| normalization/normalize_name/normalize_name/bad-name | execution_time | [18.268µs; 18.286µs] or [-0.049%; +0.049%] | None | None | None |
| normalization/normalize_name/normalize_name/bad-name | throughput | [54687458.400op/s; 54740647.623op/s] or [-0.049%; +0.049%] | None | None | None |
| normalization/normalize_name/normalize_name/good | execution_time | [11.063µs; 11.086µs] or [-0.103%; +0.103%] | None | None | None |
| normalization/normalize_name/normalize_name/good | throughput | [90211575.357op/s; 90394021.915op/s] or [-0.101%; +0.101%] | None | None | None |
Group 2
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 436bbdf5 | 1761060291 | estringana/add-routes-collection |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| two way interface | execution_time | 17.505µs | 25.707µs ± 9.438µs | 18.406µs ± 0.841µs | 34.345µs | 43.151µs | 44.342µs | 67.767µs | 268.17% | 0.951 | 0.592 | 36.62% | 0.667µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| two way interface | execution_time | [24.399µs; 27.015µs] or [-5.088%; +5.088%] | None | None | None |
Group 3
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 436bbdf5 | 1761060291 | estringana/add-routes-collection |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| write only interface | execution_time | 1.294µs | 3.233µs ± 1.442µs | 3.026µs ± 0.029µs | 3.054µs | 3.720µs | 13.897µs | 14.953µs | 394.10% | 7.376 | 55.507 | 44.50% | 0.102µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| write only interface | execution_time | [3.033µs; 3.432µs] or [-6.182%; +6.182%] | None | None | None |
Group 4
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 436bbdf5 | 1761060291 | estringana/add-routes-collection |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| normalization/normalize_trace/test_trace | execution_time | 243.804ns | 253.029ns ± 12.553ns | 247.351ns ± 2.383ns | 255.129ns | 286.908ns | 296.607ns | 297.196ns | 20.15% | 2.045 | 3.429 | 4.95% | 0.888ns | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| normalization/normalize_trace/test_trace | execution_time | [251.289ns; 254.768ns] or [-0.688%; +0.688%] | None | None | None |
Group 5
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 436bbdf5 | 1761060291 | estringana/add-routes-collection |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... | execution_time | 534.210µs | 534.926µs ± 0.687µs | 534.855µs ± 0.204µs | 535.068µs | 535.446µs | 535.726µs | 543.591µs | 1.63% | 10.124 | 125.058 | 0.13% | 0.049µs | 1 | 200 |
| normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... | throughput | 1839619.982op/s | 1869419.409op/s ± 2369.425op/s | 1869665.508op/s ± 714.074op/s | 1870321.840op/s | 1871024.040op/s | 1871375.024op/s | 1871924.263op/s | 0.12% | -10.030 | 123.464 | 0.13% | 167.544op/s | 1 | 200 |
| normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて | execution_time | 381.782µs | 382.558µs ± 0.292µs | 382.550µs ± 0.189µs | 382.741µs | 383.023µs | 383.325µs | 383.478µs | 0.24% | 0.205 | 0.261 | 0.08% | 0.021µs | 1 | 200 |
| normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて | throughput | 2607709.751op/s | 2613982.718op/s ± 1991.987op/s | 2614039.758op/s ± 1291.877op/s | 2615310.906op/s | 2617118.872op/s | 2618099.305op/s | 2619292.846op/s | 0.20% | -0.200 | 0.257 | 0.08% | 140.855op/s | 1 | 200 |
| normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters | execution_time | 195.215µs | 195.579µs ± 0.150µs | 195.576µs ± 0.098µs | 195.676µs | 195.837µs | 196.006µs | 196.042µs | 0.24% | 0.402 | 0.446 | 0.08% | 0.011µs | 1 | 200 |
| normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters | throughput | 5100958.027op/s | 5113023.715op/s ± 3931.689op/s | 5113091.493op/s ± 2553.820op/s | 5115527.113op/s | 5119184.932op/s | 5121284.021op/s | 5122557.871op/s | 0.19% | -0.397 | 0.439 | 0.08% | 278.012op/s | 1 | 200 |
| normalization/normalize_service/normalize_service/[empty string] | execution_time | 37.761µs | 37.843µs ± 0.033µs | 37.841µs ± 0.022µs | 37.863µs | 37.898µs | 37.926µs | 37.940µs | 0.26% | 0.234 | 0.048 | 0.09% | 0.002µs | 1 | 200 |
| normalization/normalize_service/normalize_service/[empty string] | throughput | 26357501.541op/s | 26425004.685op/s ± 22903.598op/s | 26426092.747op/s ± 15087.054op/s | 26441028.166op/s | 26458629.812op/s | 26473906.834op/s | 26482140.791op/s | 0.21% | -0.229 | 0.044 | 0.09% | 1619.529op/s | 1 | 200 |
| normalization/normalize_service/normalize_service/test_ASCII | execution_time | 45.772µs | 45.870µs ± 0.041µs | 45.869µs ± 0.027µs | 45.896µs | 45.938µs | 45.963µs | 46.079µs | 0.46% | 0.688 | 2.301 | 0.09% | 0.003µs | 1 | 200 |
| normalization/normalize_service/normalize_service/test_ASCII | throughput | 21702001.142op/s | 21800820.983op/s ± 19632.543op/s | 21801335.332op/s ± 13023.526op/s | 21814120.430op/s | 21830326.098op/s | 21837711.250op/s | 21847475.973op/s | 0.21% | -0.678 | 2.255 | 0.09% | 1388.230op/s | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... | execution_time | [534.831µs; 535.021µs] or [-0.018%; +0.018%] | None | None | None |
| normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... | throughput | [1869091.029op/s; 1869747.788op/s] or [-0.018%; +0.018%] | None | None | None |
| normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて | execution_time | [382.518µs; 382.599µs] or [-0.011%; +0.011%] | None | None | None |
| normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて | throughput | [2613706.648op/s; 2614258.788op/s] or [-0.011%; +0.011%] | None | None | None |
| normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters | execution_time | [195.558µs; 195.600µs] or [-0.011%; +0.011%] | None | None | None |
| normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters | throughput | [5112478.820op/s; 5113568.609op/s] or [-0.011%; +0.011%] | None | None | None |
| normalization/normalize_service/normalize_service/[empty string] | execution_time | [37.838µs; 37.848µs] or [-0.012%; +0.012%] | None | None | None |
| normalization/normalize_service/normalize_service/[empty string] | throughput | [26421830.467op/s; 26428178.904op/s] or [-0.012%; +0.012%] | None | None | None |
| normalization/normalize_service/normalize_service/test_ASCII | execution_time | [45.864µs; 45.876µs] or [-0.012%; +0.012%] | None | None | None |
| normalization/normalize_service/normalize_service/test_ASCII | throughput | [21798100.101op/s; 21803541.864op/s] or [-0.012%; +0.012%] | None | None | None |
Group 6
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 436bbdf5 | 1761060291 | estringana/add-routes-collection |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| benching string interning on wordpress profile | execution_time | 166.392µs | 167.028µs ± 0.641µs | 166.960µs ± 0.153µs | 167.121µs | 167.414µs | 168.095µs | 175.258µs | 4.97% | 10.716 | 134.425 | 0.38% | 0.045µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| benching string interning on wordpress profile | execution_time | [166.939µs; 167.117µs] or [-0.053%; +0.053%] | None | None | None |
Group 7
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 436bbdf5 | 1761060291 | estringana/add-routes-collection |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| ip_address/quantize_peer_ip_address_benchmark | execution_time | 4.999µs | 5.088µs ± 0.058µs | 5.083µs ± 0.054µs | 5.146µs | 5.167µs | 5.191µs | 5.193µs | 2.16% | 0.247 | -1.457 | 1.14% | 0.004µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| ip_address/quantize_peer_ip_address_benchmark | execution_time | [5.080µs; 5.096µs] or [-0.158%; +0.158%] | None | None | None |
Group 8
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 436bbdf5 | 1761060291 | estringana/add-routes-collection |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| benching deserializing traces from msgpack to their internal representation | execution_time | 59.344ms | 59.699ms ± 1.704ms | 59.463ms ± 0.047ms | 59.511ms | 59.680ms | 72.027ms | 75.305ms | 26.64% | 7.994 | 63.258 | 2.85% | 0.121ms | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| benching deserializing traces from msgpack to their internal representation | execution_time | [59.462ms; 59.935ms] or [-0.396%; +0.396%] | None | None | None |
Group 9
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 436bbdf5 | 1761060291 | estringana/add-routes-collection |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| redis/obfuscate_redis_string | execution_time | 34.390µs | 35.087µs ± 1.115µs | 34.595µs ± 0.057µs | 34.646µs | 37.481µs | 37.517µs | 38.306µs | 10.73% | 1.706 | 0.970 | 3.17% | 0.079µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| redis/obfuscate_redis_string | execution_time | [34.933µs; 35.242µs] or [-0.441%; +0.441%] | None | None | None |
Group 10
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 436bbdf5 | 1761060291 | estringana/add-routes-collection |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| credit_card/is_card_number/ | execution_time | 3.895µs | 3.913µs ± 0.003µs | 3.913µs ± 0.002µs | 3.914µs | 3.916µs | 3.918µs | 3.926µs | 0.35% | -0.558 | 8.993 | 0.07% | 0.000µs | 1 | 200 |
| credit_card/is_card_number/ | throughput | 254704662.172op/s | 255588762.934op/s ± 179774.706op/s | 255584038.799op/s ± 105638.851op/s | 255695367.980op/s | 255832683.687op/s | 255915698.887op/s | 256714655.032op/s | 0.44% | 0.581 | 9.065 | 0.07% | 12711.991op/s | 1 | 200 |
| credit_card/is_card_number/ 3782-8224-6310-005 | execution_time | 78.345µs | 80.440µs ± 0.950µs | 80.420µs ± 0.651µs | 81.022µs | 82.067µs | 82.833µs | 83.209µs | 3.47% | 0.217 | -0.213 | 1.18% | 0.067µs | 1 | 200 |
| credit_card/is_card_number/ 3782-8224-6310-005 | throughput | 12017913.281op/s | 12433340.508op/s ± 146592.226op/s | 12434767.610op/s ± 100589.901op/s | 12539924.370op/s | 12676389.154op/s | 12727161.542op/s | 12763980.213op/s | 2.65% | -0.156 | -0.263 | 1.18% | 10365.636op/s | 1 | 200 |
| credit_card/is_card_number/ 378282246310005 | execution_time | 71.473µs | 72.027µs ± 0.382µs | 71.934µs ± 0.265µs | 72.256µs | 72.781µs | 73.047µs | 73.235µs | 1.81% | 0.766 | 0.080 | 0.53% | 0.027µs | 1 | 200 |
| credit_card/is_card_number/ 378282246310005 | throughput | 13654662.581op/s | 13884062.315op/s ± 73365.594op/s | 13901707.147op/s ± 51122.958op/s | 13939800.292op/s | 13977792.144op/s | 13985828.599op/s | 13991383.321op/s | 0.65% | -0.742 | 0.027 | 0.53% | 5187.731op/s | 1 | 200 |
| credit_card/is_card_number/37828224631 | execution_time | 3.895µs | 3.912µs ± 0.003µs | 3.912µs ± 0.002µs | 3.914µs | 3.917µs | 3.918µs | 3.922µs | 0.26% | -0.496 | 5.324 | 0.07% | 0.000µs | 1 | 200 |
| credit_card/is_card_number/37828224631 | throughput | 254962695.247op/s | 255617033.668op/s ± 189300.888op/s | 255620078.960op/s ± 128037.562op/s | 255755710.471op/s | 255867688.776op/s | 255895039.312op/s | 256734845.036op/s | 0.44% | 0.511 | 5.405 | 0.07% | 13385.594op/s | 1 | 200 |
| credit_card/is_card_number/378282246310005 | execution_time | 68.427µs | 69.014µs ± 0.343µs | 68.977µs ± 0.204µs | 69.174µs | 69.640µs | 69.935µs | 70.384µs | 2.04% | 1.002 | 1.527 | 0.50% | 0.024µs | 1 | 200 |
| credit_card/is_card_number/378282246310005 | throughput | 14207799.381op/s | 14490132.360op/s ± 71737.606op/s | 14497679.739op/s ± 42819.603op/s | 14541193.966op/s | 14586639.733op/s | 14597750.143op/s | 14614159.659op/s | 0.80% | -0.965 | 1.401 | 0.49% | 5072.615op/s | 1 | 200 |
| credit_card/is_card_number/37828224631000521389798 | execution_time | 45.384µs | 45.686µs ± 0.095µs | 45.691µs ± 0.059µs | 45.747µs | 45.838µs | 45.887µs | 45.925µs | 0.51% | -0.288 | 0.365 | 0.21% | 0.007µs | 1 | 200 |
| credit_card/is_card_number/37828224631000521389798 | throughput | 21774836.065op/s | 21888726.707op/s ± 45349.848op/s | 21886236.842op/s ± 28090.766op/s | 21916040.901op/s | 21966940.208op/s | 22007555.549op/s | 22034033.023op/s | 0.68% | 0.302 | 0.378 | 0.21% | 3206.718op/s | 1 | 200 |
| credit_card/is_card_number/x371413321323331 | execution_time | 6.427µs | 6.435µs ± 0.005µs | 6.434µs ± 0.003µs | 6.437µs | 6.444µs | 6.446µs | 6.477µs | 0.66% | 2.781 | 18.529 | 0.08% | 0.000µs | 1 | 200 |
| credit_card/is_card_number/x371413321323331 | throughput | 154396405.245op/s | 155405678.869op/s ± 127479.595op/s | 155422452.575op/s ± 69637.942op/s | 155488172.888op/s | 155566272.457op/s | 155586520.079op/s | 155602998.788op/s | 0.12% | -2.749 | 18.206 | 0.08% | 9014.169op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/ | execution_time | 3.893µs | 3.912µs ± 0.003µs | 3.912µs ± 0.001µs | 3.913µs | 3.917µs | 3.919µs | 3.921µs | 0.25% | -0.693 | 9.273 | 0.07% | 0.000µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/ | throughput | 255004475.294op/s | 255625016.408op/s ± 188455.169op/s | 255654544.630op/s ± 97846.727op/s | 255735726.288op/s | 255837112.264op/s | 255919373.174op/s | 256874558.921op/s | 0.48% | 0.717 | 9.418 | 0.07% | 13325.793op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 | execution_time | 61.523µs | 62.860µs ± 0.598µs | 62.856µs ± 0.449µs | 63.277µs | 63.831µs | 64.132µs | 64.747µs | 3.01% | 0.306 | -0.320 | 0.95% | 0.042µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 | throughput | 15444620.117op/s | 15909831.122op/s ± 150909.161op/s | 15909261.834op/s ± 113581.744op/s | 16028518.106op/s | 16144594.776op/s | 16192258.113op/s | 16253971.094op/s | 2.17% | -0.262 | -0.373 | 0.95% | 10670.889op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/ 378282246310005 | execution_time | 53.852µs | 54.247µs ± 0.121µs | 54.270µs ± 0.071µs | 54.327µs | 54.416µs | 54.461µs | 54.516µs | 0.45% | -0.684 | 0.513 | 0.22% | 0.009µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/ 378282246310005 | throughput | 18343175.025op/s | 18434436.560op/s ± 41253.159op/s | 18426238.847op/s ± 24178.747op/s | 18457488.734op/s | 18506811.072op/s | 18548381.793op/s | 18569242.850op/s | 0.78% | 0.697 | 0.538 | 0.22% | 2917.039op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/37828224631 | execution_time | 3.893µs | 3.912µs ± 0.002µs | 3.912µs ± 0.001µs | 3.913µs | 3.915µs | 3.917µs | 3.918µs | 0.17% | -2.017 | 16.595 | 0.06% | 0.000µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/37828224631 | throughput | 255207678.867op/s | 255644802.668op/s ± 159897.328op/s | 255648959.686op/s ± 88079.559op/s | 255728622.427op/s | 255847936.427op/s | 255901054.294op/s | 256886275.130op/s | 0.48% | 2.044 | 16.839 | 0.06% | 11306.448op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/378282246310005 | execution_time | 50.225µs | 50.730µs ± 0.164µs | 50.725µs ± 0.082µs | 50.809µs | 50.968µs | 51.285µs | 51.356µs | 1.25% | 0.479 | 2.629 | 0.32% | 0.012µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/378282246310005 | throughput | 19471747.232op/s | 19712465.162op/s ± 63606.972op/s | 19714301.947op/s ± 31711.550op/s | 19743849.480op/s | 19824499.017op/s | 19870239.236op/s | 19910401.184op/s | 0.99% | -0.436 | 2.560 | 0.32% | 4497.692op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/37828224631000521389798 | execution_time | 45.466µs | 45.692µs ± 0.088µs | 45.698µs ± 0.057µs | 45.754µs | 45.834µs | 45.900µs | 45.916µs | 0.48% | -0.054 | -0.072 | 0.19% | 0.006µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/37828224631000521389798 | throughput | 21778664.526op/s | 21885535.240op/s ± 42246.577op/s | 21882993.636op/s ± 27320.220op/s | 21911341.861op/s | 21950266.516op/s | 21986973.955op/s | 21994331.488op/s | 0.51% | 0.065 | -0.072 | 0.19% | 2987.284op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/x371413321323331 | execution_time | 6.426µs | 6.434µs ± 0.004µs | 6.434µs ± 0.003µs | 6.437µs | 6.441µs | 6.445µs | 6.447µs | 0.20% | 0.505 | 0.023 | 0.06% | 0.000µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/x371413321323331 | throughput | 155106386.523op/s | 155413174.876op/s ± 96396.548op/s | 155424083.121op/s ± 64477.502op/s | 155480316.214op/s | 155555381.607op/s | 155592396.221op/s | 155609580.266op/s | 0.12% | -0.501 | 0.018 | 0.06% | 6816.265op/s | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| credit_card/is_card_number/ | execution_time | [3.912µs; 3.913µs] or [-0.010%; +0.010%] | None | None | None |
| credit_card/is_card_number/ | throughput | [255563847.889op/s; 255613677.980op/s] or [-0.010%; +0.010%] | None | None | None |
| credit_card/is_card_number/ 3782-8224-6310-005 | execution_time | [80.308µs; 80.572µs] or [-0.164%; +0.164%] | None | None | None |
| credit_card/is_card_number/ 3782-8224-6310-005 | throughput | [12413024.235op/s; 12453656.780op/s] or [-0.163%; +0.163%] | None | None | None |
| credit_card/is_card_number/ 378282246310005 | execution_time | [71.974µs; 72.080µs] or [-0.074%; +0.074%] | None | None | None |
| credit_card/is_card_number/ 378282246310005 | throughput | [13873894.549op/s; 13894230.081op/s] or [-0.073%; +0.073%] | None | None | None |
| credit_card/is_card_number/37828224631 | execution_time | [3.912µs; 3.913µs] or [-0.010%; +0.010%] | None | None | None |
| credit_card/is_card_number/37828224631 | throughput | [255590798.386op/s; 255643268.951op/s] or [-0.010%; +0.010%] | None | None | None |
| credit_card/is_card_number/378282246310005 | execution_time | [68.967µs; 69.062µs] or [-0.069%; +0.069%] | None | None | None |
| credit_card/is_card_number/378282246310005 | throughput | [14480190.218op/s; 14500074.503op/s] or [-0.069%; +0.069%] | None | None | None |
| credit_card/is_card_number/37828224631000521389798 | execution_time | [45.673µs; 45.699µs] or [-0.029%; +0.029%] | None | None | None |
| credit_card/is_card_number/37828224631000521389798 | throughput | [21882441.654op/s; 21895011.759op/s] or [-0.029%; +0.029%] | None | None | None |
| credit_card/is_card_number/x371413321323331 | execution_time | [6.434µs; 6.436µs] or [-0.011%; +0.011%] | None | None | None |
| credit_card/is_card_number/x371413321323331 | throughput | [155388011.423op/s; 155423346.314op/s] or [-0.011%; +0.011%] | None | None | None |
| credit_card/is_card_number_no_luhn/ | execution_time | [3.912µs; 3.912µs] or [-0.010%; +0.010%] | None | None | None |
| credit_card/is_card_number_no_luhn/ | throughput | [255598898.334op/s; 255651134.482op/s] or [-0.010%; +0.010%] | None | None | None |
| credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 | execution_time | [62.777µs; 62.943µs] or [-0.132%; +0.132%] | None | None | None |
| credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 | throughput | [15888916.564op/s; 15930745.681op/s] or [-0.131%; +0.131%] | None | None | None |
| credit_card/is_card_number_no_luhn/ 378282246310005 | execution_time | [54.230µs; 54.263µs] or [-0.031%; +0.031%] | None | None | None |
| credit_card/is_card_number_no_luhn/ 378282246310005 | throughput | [18428719.269op/s; 18440153.851op/s] or [-0.031%; +0.031%] | None | None | None |
| credit_card/is_card_number_no_luhn/37828224631 | execution_time | [3.911µs; 3.912µs] or [-0.009%; +0.009%] | None | None | None |
| credit_card/is_card_number_no_luhn/37828224631 | throughput | [255622642.436op/s; 255666962.900op/s] or [-0.009%; +0.009%] | None | None | None |
| credit_card/is_card_number_no_luhn/378282246310005 | execution_time | [50.707µs; 50.753µs] or [-0.045%; +0.045%] | None | None | None |
| credit_card/is_card_number_no_luhn/378282246310005 | throughput | [19703649.848op/s; 19721280.477op/s] or [-0.045%; +0.045%] | None | None | None |
| credit_card/is_card_number_no_luhn/37828224631000521389798 | execution_time | [45.680µs; 45.705µs] or [-0.027%; +0.027%] | None | None | None |
| credit_card/is_card_number_no_luhn/37828224631000521389798 | throughput | [21879680.270op/s; 21891390.209op/s] or [-0.027%; +0.027%] | None | None | None |
| credit_card/is_card_number_no_luhn/x371413321323331 | execution_time | [6.434µs; 6.435µs] or [-0.009%; +0.009%] | None | None | None |
| credit_card/is_card_number_no_luhn/x371413321323331 | throughput | [155399815.241op/s; 155426534.510op/s] or [-0.009%; +0.009%] | None | None | None |
Group 11
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 436bbdf5 | 1761060291 | estringana/add-routes-collection |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| sql/obfuscate_sql_string | execution_time | 87.974µs | 88.255µs ± 0.277µs | 88.211µs ± 0.062µs | 88.306µs | 88.460µs | 88.582µs | 91.787µs | 4.05% | 10.488 | 130.056 | 0.31% | 0.020µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| sql/obfuscate_sql_string | execution_time | [88.217µs; 88.294µs] or [-0.044%; +0.044%] | None | None | None |
Group 12
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 436bbdf5 | 1761060291 | estringana/add-routes-collection |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| benching serializing traces from their internal representation to msgpack | execution_time | 14.777ms | 14.821ms ± 0.035ms | 14.813ms ± 0.011ms | 14.829ms | 14.882ms | 14.948ms | 15.076ms | 1.77% | 3.553 | 18.159 | 0.24% | 0.002ms | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| benching serializing traces from their internal representation to msgpack | execution_time | [14.816ms; 14.826ms] or [-0.033%; +0.033%] | None | None | None |
Group 13
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 436bbdf5 | 1761060291 | estringana/add-routes-collection |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| receiver_entry_point/report/2597 | execution_time | 6.098ms | 6.144ms ± 0.031ms | 6.139ms ± 0.016ms | 6.157ms | 6.200ms | 6.233ms | 6.306ms | 2.72% | 1.440 | 3.758 | 0.50% | 0.002ms | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| receiver_entry_point/report/2597 | execution_time | [6.140ms; 6.148ms] or [-0.069%; +0.069%] | None | None | None |
Group 14
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 436bbdf5 | 1761060291 | estringana/add-routes-collection |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| concentrator/add_spans_to_concentrator | execution_time | 10.625ms | 10.653ms ± 0.014ms | 10.652ms ± 0.010ms | 10.663ms | 10.676ms | 10.693ms | 10.710ms | 0.55% | 0.540 | 0.755 | 0.13% | 0.001ms | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| concentrator/add_spans_to_concentrator | execution_time | [10.651ms; 10.655ms] or [-0.018%; +0.018%] | None | None | None |
Group 15
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 436bbdf5 | 1761060291 | estringana/add-routes-collection |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| tags/replace_trace_tags | execution_time | 2.438µs | 2.479µs ± 0.027µs | 2.478µs ± 0.015µs | 2.487µs | 2.541µs | 2.544µs | 2.546µs | 2.74% | 0.865 | 0.275 | 1.10% | 0.002µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| tags/replace_trace_tags | execution_time | [2.475µs; 2.482µs] or [-0.152%; +0.152%] | None | None | None |
Baseline
Omitted due to size.
✅ Tests
🎉 All green!
❄️ No new flaky tests detected
🧪 All tests passed
🔗 Commit SHA: 436bbdf | Docs | Was this helpful? Give us feedback!
Codecov Report
:x: Patch coverage is 6.15385% with 61 lines in your changes missing coverage. Please review.
:white_check_mark: Project coverage is 71.69%. Comparing base (0b1fc79) to head (436bbdf).
Additional details and impacted files
@@ Coverage Diff @@
## main #1182 +/- ##
==========================================
- Coverage 71.71% 71.69% -0.02%
==========================================
Files 356 357 +1
Lines 56993 57045 +52
==========================================
+ Hits 40872 40901 +29
- Misses 16121 16144 +23
| Components | Coverage Δ | |
|---|---|---|
| datadog-crashtracker | 49.05% <ø> (ø) |
|
| datadog-crashtracker-ffi | 5.86% <ø> (ø) |
|
| datadog-alloc | 98.73% <ø> (ø) |
|
| data-pipeline | 87.99% <ø> (+0.16%) |
:arrow_up: |
| data-pipeline-ffi | 88.19% <ø> (ø) |
|
| ddcommon | 84.31% <ø> (ø) |
|
| ddcommon-ffi | 73.84% <ø> (ø) |
|
| ddtelemetry | 59.48% <12.12%> (-0.50%) |
:arrow_down: |
| ddtelemetry-ffi | 21.24% <ø> (ø) |
|
| dogstatsd-client | 83.26% <ø> (ø) |
|
| datadog-ipc | 82.39% <ø> (ø) |
|
| datadog-profiling | 76.90% <ø> (ø) |
|
| datadog-profiling-ffi | 62.12% <ø> (ø) |
|
| datadog-sidecar | 36.54% <0.00%> (-0.13%) |
:arrow_down: |
| datdog-sidecar-ffi | 11.06% <0.00%> (+0.11%) |
:arrow_up: |
| spawn-worker | 55.18% <ø> (ø) |
|
| tinybytes | 92.22% <ø> (ø) |
|
| datadog-trace-normalization | 98.24% <ø> (ø) |
|
| datadog-trace-obfuscation | 94.17% <ø> (ø) |
|
| datadog-trace-protobuf | 59.65% <ø> (ø) |
|
| datadog-trace-utils | 89.99% <ø> (ø) |
|
| datadog-tracer-flare | 62.42% <ø> (ø) |
|
| datadog-log | 76.31% <ø> (ø) |
:rocket: New features to boost your workflow:
- :snowflake: Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
Artifact Size Benchmark Report
aarch64-alpine-linux-musl
| Artifact | Baseline | Commit | Change |
|---|---|---|---|
| /aarch64-alpine-linux-musl/lib/libdatadog_profiling.a | 71.31 MB | 71.47 MB | +.22% (+167.81 KB) 🔍 |
| /aarch64-alpine-linux-musl/lib/libdatadog_profiling.so | 7.25 MB | 7.25 MB | 0% (0 B) 👌 |
aarch64-unknown-linux-gnu
| Artifact | Baseline | Commit | Change |
|---|---|---|---|
| /aarch64-unknown-linux-gnu/lib/libdatadog_profiling.so | 9.20 MB | 9.27 MB | +.72% (+68.13 KB) 🔍 |
| /aarch64-unknown-linux-gnu/lib/libdatadog_profiling.a | 83.67 MB | 83.83 MB | +.19% (+168.47 KB) 🔍 |
libdatadog-x64-windows
| Artifact | Baseline | Commit | Change |
|---|---|---|---|
| /libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.dll | 18.58 MB | 18.62 MB | +.19% (+37.00 KB) 🔍 |
| /libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.lib | 65.77 KB | 65.77 KB | 0% (0 B) 👌 |
| /libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.pdb | 129.37 MB | 129.57 MB | +.15% (+208.00 KB) 🔍 |
| /libdatadog-x64-windows/debug/static/datadog_profiling_ffi.lib | 675.79 MB | 678.34 MB | +.37% (+2.55 MB) 🔍 |
| /libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.dll | 5.93 MB | 5.94 MB | +.14% (+9.00 KB) 🔍 |
| /libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.lib | 65.77 KB | 65.77 KB | 0% (0 B) 👌 |
| /libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.pdb | 17.52 MB | 17.57 MB | +.26% (+48.00 KB) 🔍 |
| /libdatadog-x64-windows/release/static/datadog_profiling_ffi.lib | 32.48 MB | 32.55 MB | +.21% (+72.39 KB) 🔍 |
libdatadog-x86-windows
| Artifact | Baseline | Commit | Change |
|---|---|---|---|
| /libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.dll | 15.83 MB | 15.87 MB | +.20% (+34.00 KB) 🔍 |
| /libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.lib | 66.79 KB | 66.79 KB | 0% (0 B) 👌 |
| /libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.pdb | 131.73 MB | 131.93 MB | +.15% (+208.00 KB) 🔍 |
| /libdatadog-x86-windows/debug/static/datadog_profiling_ffi.lib | 664.92 MB | 666.97 MB | +.30% (+2.04 MB) 🔍 |
| /libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.dll | 4.54 MB | 4.55 MB | +.21% (+10.00 KB) 🔍 |
| /libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.lib | 66.79 KB | 66.79 KB | 0% (0 B) 👌 |
| /libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.pdb | 18.65 MB | 18.70 MB | +.29% (+56.00 KB) 🔍 |
| /libdatadog-x86-windows/release/static/datadog_profiling_ffi.lib | 30.49 MB | 30.57 MB | +.25% (+80.59 KB) 🔍 |
x86_64-alpine-linux-musl
| Artifact | Baseline | Commit | Change |
|---|---|---|---|
| /x86_64-alpine-linux-musl/lib/libdatadog_profiling.a | 63.93 MB | 64.06 MB | +.20% (+135.60 KB) 🔍 |
| /x86_64-alpine-linux-musl/lib/libdatadog_profiling.so | 8.56 MB | 8.57 MB | +.18% (+16.00 KB) 🔍 |
x86_64-unknown-linux-gnu
| Artifact | Baseline | Commit | Change |
|---|---|---|---|
| /x86_64-unknown-linux-gnu/lib/libdatadog_profiling.a | 78.39 MB | 78.54 MB | +.18% (+148.67 KB) 🔍 |
| /x86_64-unknown-linux-gnu/lib/libdatadog_profiling.so | 9.90 MB | 9.91 MB | +.18% (+19.05 KB) 🔍 |