libdatadog
libdatadog copied to clipboard
Test
What does this PR do?
A brief description of the change being made with this pull request.
Motivation
What inspired you to submit this pull request?
Additional Notes
Anything else we should know when reviewing?
How to test the change?
Describe here in detail how the change can be validated.
Benchmarks
Comparison
Benchmark execution time: 2025-03-14 10:51:14
Comparing candidate commit 17e62bcc in PR branch ganeshnj/test/size-benchmark with baseline commit fc9530e3 in branch main.
Found 1 performance improvements and 0 performance regressions! Performance is the same for 51 metrics, 2 unstable metrics.
scenario:benching deserializing traces from msgpack to their internal representation
- 🟩
execution_time[-3.082ms; -2.986ms] or [-5.409%; -5.241%]
Candidate
Candidate benchmark details
Group 1
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 17e62bcc | 1741948785 | ganeshnj/test/size-benchmark |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| ip_address/quantize_peer_ip_address_benchmark | execution_time | 5.045µs | 5.105µs ± 0.036µs | 5.098µs ± 0.030µs | 5.137µs | 5.157µs | 5.160µs | 5.230µs | 2.57% | 0.376 | -0.908 | 0.70% | 0.003µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| ip_address/quantize_peer_ip_address_benchmark | execution_time | [5.100µs; 5.110µs] or [-0.097%; +0.097%] | None | None | None |
Group 2
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 17e62bcc | 1741948785 | ganeshnj/test/size-benchmark |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... | execution_time | 504.556µs | 505.693µs ± 0.553µs | 505.617µs ± 0.262µs | 505.943µs | 506.509µs | 507.662µs | 509.334µs | 0.74% | 2.090 | 10.307 | 0.11% | 0.039µs | 1 | 200 |
| normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... | throughput | 1963349.715op/s | 1977486.728op/s ± 2158.840op/s | 1977781.058op/s ± 1023.211op/s | 1978673.799op/s | 1980285.444op/s | 1981281.853op/s | 1981939.685op/s | 0.21% | -2.064 | 10.117 | 0.11% | 152.653op/s | 1 | 200 |
| normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて | execution_time | 452.421µs | 453.649µs ± 0.895µs | 453.578µs ± 0.237µs | 453.788µs | 454.313µs | 456.265µs | 463.712µs | 2.23% | 7.937 | 81.752 | 0.20% | 0.063µs | 1 | 200 |
| normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて | throughput | 2156511.868op/s | 2204357.866op/s ± 4284.417op/s | 2204692.468op/s ± 1154.162op/s | 2205953.134op/s | 2207467.961op/s | 2209007.276op/s | 2210329.666op/s | 0.26% | -7.815 | 79.826 | 0.19% | 302.954op/s | 1 | 200 |
| normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters | execution_time | 174.061µs | 176.767µs ± 0.621µs | 176.793µs ± 0.207µs | 176.975µs | 177.196µs | 177.365µs | 183.761µs | 3.94% | 6.679 | 80.533 | 0.35% | 0.044µs | 1 | 200 |
| normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters | throughput | 5441843.877op/s | 5657216.632op/s ± 19419.461op/s | 5656333.720op/s ± 6644.622op/s | 5664478.958op/s | 5678676.771op/s | 5686271.386op/s | 5745126.031op/s | 1.57% | -6.283 | 75.779 | 0.34% | 1373.163op/s | 1 | 200 |
| normalization/normalize_service/normalize_service/[empty string] | execution_time | 37.570µs | 37.678µs ± 0.052µs | 37.667µs ± 0.034µs | 37.715µs | 37.778µs | 37.805µs | 37.819µs | 0.40% | 0.533 | -0.226 | 0.14% | 0.004µs | 1 | 200 |
| normalization/normalize_service/normalize_service/[empty string] | throughput | 26441938.883op/s | 26541080.846op/s ± 36766.364op/s | 26548179.467op/s ± 24116.155op/s | 26566975.636op/s | 26595584.709op/s | 26611794.590op/s | 26616775.687op/s | 0.26% | -0.526 | -0.233 | 0.14% | 2599.775op/s | 1 | 200 |
| normalization/normalize_service/normalize_service/test_ASCII | execution_time | 48.228µs | 48.330µs ± 0.045µs | 48.328µs ± 0.028µs | 48.358µs | 48.400µs | 48.443µs | 48.556µs | 0.47% | 0.748 | 2.220 | 0.09% | 0.003µs | 1 | 200 |
| normalization/normalize_service/normalize_service/test_ASCII | throughput | 20594642.210op/s | 20691135.973op/s ± 19456.811op/s | 20692152.501op/s ± 11884.140op/s | 20703686.544op/s | 20720409.068op/s | 20727461.446op/s | 20734818.402op/s | 0.21% | -0.738 | 2.176 | 0.09% | 1375.804op/s | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... | execution_time | [505.616µs; 505.770µs] or [-0.015%; +0.015%] | None | None | None |
| normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... | throughput | [1977187.533op/s; 1977785.922op/s] or [-0.015%; +0.015%] | None | None | None |
| normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて | execution_time | [453.524µs; 453.773µs] or [-0.027%; +0.027%] | None | None | None |
| normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて | throughput | [2203764.087op/s; 2204951.645op/s] or [-0.027%; +0.027%] | None | None | None |
| normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters | execution_time | [176.681µs; 176.853µs] or [-0.049%; +0.049%] | None | None | None |
| normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters | throughput | [5654525.282op/s; 5659907.983op/s] or [-0.048%; +0.048%] | None | None | None |
| normalization/normalize_service/normalize_service/[empty string] | execution_time | [37.670µs; 37.685µs] or [-0.019%; +0.019%] | None | None | None |
| normalization/normalize_service/normalize_service/[empty string] | throughput | [26535985.382op/s; 26546176.311op/s] or [-0.019%; +0.019%] | None | None | None |
| normalization/normalize_service/normalize_service/test_ASCII | execution_time | [48.324µs; 48.336µs] or [-0.013%; +0.013%] | None | None | None |
| normalization/normalize_service/normalize_service/test_ASCII | throughput | [20688439.446op/s; 20693832.500op/s] or [-0.013%; +0.013%] | None | None | None |
Group 3
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 17e62bcc | 1741948785 | ganeshnj/test/size-benchmark |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| concentrator/add_spans_to_concentrator | execution_time | 5.933ms | 5.945ms ± 0.007ms | 5.944ms ± 0.003ms | 5.947ms | 5.953ms | 5.981ms | 5.990ms | 0.78% | 3.527 | 19.843 | 0.11% | 0.000ms | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| concentrator/add_spans_to_concentrator | execution_time | [5.944ms; 5.946ms] or [-0.015%; +0.015%] | None | None | None |
Group 4
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 17e62bcc | 1741948785 | ganeshnj/test/size-benchmark |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| two way interface | execution_time | 17.586µs | 25.443µs ± 10.169µs | 17.886µs ± 0.094µs | 33.965µs | 43.345µs | 46.348µs | 79.347µs | 343.62% | 1.437 | 3.361 | 39.87% | 0.719µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| two way interface | execution_time | [24.034µs; 26.852µs] or [-5.539%; +5.539%] | None | None | None |
Group 5
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 17e62bcc | 1741948785 | ganeshnj/test/size-benchmark |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| tags/replace_trace_tags | execution_time | 2.361µs | 2.416µs ± 0.020µs | 2.415µs ± 0.011µs | 2.424µs | 2.453µs | 2.462µs | 2.466µs | 2.10% | 0.149 | 0.510 | 0.82% | 0.001µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| tags/replace_trace_tags | execution_time | [2.413µs; 2.419µs] or [-0.114%; +0.114%] | None | None | None |
Group 6
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 17e62bcc | 1741948785 | ganeshnj/test/size-benchmark |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| sql/obfuscate_sql_string | execution_time | 69.344µs | 69.588µs ± 0.215µs | 69.565µs ± 0.045µs | 69.619µs | 69.674µs | 70.023µs | 72.197µs | 3.78% | 9.555 | 109.584 | 0.31% | 0.015µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| sql/obfuscate_sql_string | execution_time | [69.558µs; 69.618µs] or [-0.043%; +0.043%] | None | None | None |
Group 7
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 17e62bcc | 1741948785 | ganeshnj/test/size-benchmark |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... | execution_time | 208.563µs | 209.057µs ± 0.181µs | 209.048µs ± 0.118µs | 209.171µs | 209.384µs | 209.423µs | 209.510µs | 0.22% | 0.020 | -0.139 | 0.09% | 0.013µs | 1 | 200 |
| normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... | throughput | 4773045.024op/s | 4783383.274op/s ± 4131.786op/s | 4783601.495op/s ± 2692.938op/s | 4786097.663op/s | 4790090.612op/s | 4792876.885op/s | 4794717.500op/s | 0.23% | -0.015 | -0.137 | 0.09% | 292.161op/s | 1 | 200 |
| normalization/normalize_name/normalize_name/bad-name | execution_time | 18.212µs | 18.312µs ± 0.045µs | 18.312µs ± 0.031µs | 18.341µs | 18.382µs | 18.403µs | 18.470µs | 0.86% | 0.163 | -0.123 | 0.25% | 0.003µs | 1 | 200 |
| normalization/normalize_name/normalize_name/bad-name | throughput | 54141334.361op/s | 54609554.028op/s ± 134717.819op/s | 54608185.150op/s ± 91163.585op/s | 54713813.431op/s | 54842602.997op/s | 54856087.821op/s | 54908471.270op/s | 0.55% | -0.149 | -0.140 | 0.25% | 9525.988op/s | 1 | 200 |
| normalization/normalize_name/normalize_name/good | execution_time | 10.641µs | 10.700µs ± 0.024µs | 10.696µs ± 0.017µs | 10.720µs | 10.735µs | 10.747µs | 10.786µs | 0.84% | 0.159 | 0.040 | 0.22% | 0.002µs | 1 | 200 |
| normalization/normalize_name/normalize_name/good | throughput | 92713238.666op/s | 93456643.957op/s ± 210459.798op/s | 93494945.351op/s ± 150246.728op/s | 93600952.858op/s | 93822350.393op/s | 93895182.696op/s | 93976673.544op/s | 0.52% | -0.146 | 0.025 | 0.22% | 14881.755op/s | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... | execution_time | [209.032µs; 209.082µs] or [-0.012%; +0.012%] | None | None | None |
| normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... | throughput | [4782810.648op/s; 4783955.900op/s] or [-0.012%; +0.012%] | None | None | None |
| normalization/normalize_name/normalize_name/bad-name | execution_time | [18.306µs; 18.318µs] or [-0.034%; +0.034%] | None | None | None |
| normalization/normalize_name/normalize_name/bad-name | throughput | [54590883.433op/s; 54628224.622op/s] or [-0.034%; +0.034%] | None | None | None |
| normalization/normalize_name/normalize_name/good | execution_time | [10.697µs; 10.704µs] or [-0.031%; +0.031%] | None | None | None |
| normalization/normalize_name/normalize_name/good | throughput | [93427476.253op/s; 93485811.660op/s] or [-0.031%; +0.031%] | None | None | None |
Group 8
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 17e62bcc | 1741948785 | ganeshnj/test/size-benchmark |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| redis/obfuscate_redis_string | execution_time | 35.044µs | 35.593µs ± 0.904µs | 35.156µs ± 0.070µs | 35.374µs | 37.503µs | 37.550µs | 38.842µs | 10.48% | 1.717 | 1.209 | 2.53% | 0.064µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| redis/obfuscate_redis_string | execution_time | [35.468µs; 35.718µs] or [-0.352%; +0.352%] | None | None | None |
Group 9
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 17e62bcc | 1741948785 | ganeshnj/test/size-benchmark |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| credit_card/is_card_number/ | execution_time | 3.896µs | 3.914µs ± 0.003µs | 3.914µs ± 0.001µs | 3.916µs | 3.919µs | 3.920µs | 3.921µs | 0.17% | -1.695 | 13.015 | 0.06% | 0.000µs | 1 | 200 |
| credit_card/is_card_number/ | throughput | 255036190.874op/s | 255462936.175op/s ± 164850.861op/s | 255465066.954op/s ± 86407.383op/s | 255551727.452op/s | 255647629.385op/s | 255844082.136op/s | 256665437.607op/s | 0.47% | 1.718 | 13.204 | 0.06% | 11656.716op/s | 1 | 200 |
| credit_card/is_card_number/ 3782-8224-6310-005 | execution_time | 81.729µs | 82.373µs ± 0.284µs | 82.335µs ± 0.104µs | 82.483µs | 82.676µs | 82.910µs | 85.311µs | 3.61% | 5.558 | 55.958 | 0.34% | 0.020µs | 1 | 200 |
| credit_card/is_card_number/ 3782-8224-6310-005 | throughput | 11721871.879op/s | 12139980.549op/s ± 41044.596op/s | 12145446.915op/s ± 15336.088op/s | 12155318.266op/s | 12190239.093op/s | 12216864.747op/s | 12235624.019op/s | 0.74% | -5.284 | 52.374 | 0.34% | 2902.291op/s | 1 | 200 |
| credit_card/is_card_number/ 378282246310005 | execution_time | 76.378µs | 76.982µs ± 0.276µs | 76.957µs ± 0.162µs | 77.113µs | 77.476µs | 77.758µs | 77.830µs | 1.13% | 0.666 | 0.527 | 0.36% | 0.020µs | 1 | 200 |
| credit_card/is_card_number/ 378282246310005 | throughput | 12848582.030op/s | 12990264.888op/s ± 46437.477op/s | 12994271.479op/s ± 27412.472op/s | 13023633.337op/s | 13057480.864op/s | 13075880.905op/s | 13092710.794op/s | 0.76% | -0.644 | 0.488 | 0.36% | 3283.625op/s | 1 | 200 |
| credit_card/is_card_number/37828224631 | execution_time | 3.895µs | 3.914µs ± 0.003µs | 3.914µs ± 0.001µs | 3.916µs | 3.918µs | 3.920µs | 3.921µs | 0.18% | -1.464 | 10.176 | 0.07% | 0.000µs | 1 | 200 |
| credit_card/is_card_number/37828224631 | throughput | 255036216.640op/s | 255479531.753op/s ± 181468.193op/s | 255491313.299op/s ± 87285.711op/s | 255570678.072op/s | 255736009.842op/s | 255906129.940op/s | 256723982.933op/s | 0.48% | 1.485 | 10.331 | 0.07% | 12831.739op/s | 1 | 200 |
| credit_card/is_card_number/378282246310005 | execution_time | 73.042µs | 74.021µs ± 0.458µs | 74.011µs ± 0.307µs | 74.265µs | 74.870µs | 75.034µs | 75.529µs | 2.05% | 0.376 | -0.035 | 0.62% | 0.032µs | 1 | 200 |
| credit_card/is_card_number/378282246310005 | throughput | 13239921.600op/s | 13510197.657op/s ± 83450.385op/s | 13511441.495op/s ± 56003.883op/s | 13569831.387op/s | 13646373.185op/s | 13685642.446op/s | 13690688.010op/s | 1.33% | -0.343 | -0.072 | 0.62% | 5900.833op/s | 1 | 200 |
| credit_card/is_card_number/37828224631000521389798 | execution_time | 51.944µs | 52.173µs ± 0.098µs | 52.153µs ± 0.053µs | 52.229µs | 52.361µs | 52.427µs | 52.458µs | 0.59% | 0.658 | 0.251 | 0.19% | 0.007µs | 1 | 200 |
| credit_card/is_card_number/37828224631000521389798 | throughput | 19062863.665op/s | 19166955.171op/s ± 35979.330op/s | 19174524.727op/s ± 19592.622op/s | 19190376.506op/s | 19217054.679op/s | 19234278.817op/s | 19251513.199op/s | 0.40% | -0.647 | 0.239 | 0.19% | 2544.123op/s | 1 | 200 |
| credit_card/is_card_number/x371413321323331 | execution_time | 6.428µs | 6.561µs ± 0.075µs | 6.555µs ± 0.051µs | 6.609µs | 6.691µs | 6.722µs | 6.777µs | 3.39% | 0.255 | -0.487 | 1.14% | 0.005µs | 1 | 200 |
| credit_card/is_card_number/x371413321323331 | throughput | 147554335.428op/s | 152430323.772op/s ± 1738945.846op/s | 152553065.888op/s ± 1171957.151op/s | 153538358.489op/s | 155292684.772op/s | 155471444.358op/s | 155564209.383op/s | 1.97% | -0.206 | -0.534 | 1.14% | 122962.040op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/ | execution_time | 3.890µs | 3.915µs ± 0.006µs | 3.914µs ± 0.001µs | 3.916µs | 3.919µs | 3.920µs | 3.981µs | 1.72% | 7.972 | 98.566 | 0.14% | 0.000µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/ | throughput | 251180109.208op/s | 255460965.831op/s ± 363134.105op/s | 255487904.685op/s ± 88712.296op/s | 255566431.349op/s | 255779027.415op/s | 255897714.811op/s | 257045469.493op/s | 0.61% | -7.813 | 96.514 | 0.14% | 25677.459op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 | execution_time | 63.503µs | 63.889µs ± 0.130µs | 63.888µs ± 0.066µs | 63.952µs | 64.095µs | 64.279µs | 64.312µs | 0.66% | 0.072 | 1.588 | 0.20% | 0.009µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 | throughput | 15549202.281op/s | 15652315.475op/s ± 31833.701op/s | 15652347.995op/s ± 16076.746op/s | 15668631.009op/s | 15703410.239op/s | 15739635.782op/s | 15747347.550op/s | 0.61% | -0.050 | 1.581 | 0.20% | 2250.983op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/ 378282246310005 | execution_time | 57.404µs | 57.547µs ± 0.072µs | 57.539µs ± 0.031µs | 57.575µs | 57.639µs | 57.775µs | 57.983µs | 0.77% | 2.443 | 12.349 | 0.12% | 0.005µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/ 378282246310005 | throughput | 17246458.232op/s | 17377128.236op/s ± 21576.970op/s | 17379592.014op/s ± 9233.926op/s | 17388410.190op/s | 17404895.214op/s | 17413969.106op/s | 17420538.815op/s | 0.24% | -2.412 | 12.129 | 0.12% | 1525.722op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/37828224631 | execution_time | 3.896µs | 3.914µs ± 0.003µs | 3.914µs ± 0.002µs | 3.916µs | 3.919µs | 3.921µs | 3.927µs | 0.33% | -0.520 | 4.263 | 0.09% | 0.000µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/37828224631 | throughput | 254662054.188op/s | 255506703.010op/s ± 218640.495op/s | 255506331.379op/s ± 116759.616op/s | 255611266.164op/s | 255841178.921op/s | 255950746.680op/s | 256699211.694op/s | 0.47% | 0.535 | 4.316 | 0.09% | 15460.218op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/378282246310005 | execution_time | 54.576µs | 54.820µs ± 0.242µs | 54.697µs ± 0.054µs | 55.028µs | 55.211µs | 55.567µs | 55.628µs | 1.70% | 1.371 | 1.097 | 0.44% | 0.017µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/378282246310005 | throughput | 17976397.874op/s | 18241866.273op/s ± 79935.182op/s | 18282659.812op/s ± 18052.357op/s | 18295665.761op/s | 18310445.942op/s | 18320361.471op/s | 18323000.863op/s | 0.22% | -1.355 | 1.030 | 0.44% | 5652.271op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/37828224631000521389798 | execution_time | 51.956µs | 52.155µs ± 0.087µs | 52.149µs ± 0.058µs | 52.214µs | 52.309µs | 52.351µs | 52.380µs | 0.44% | 0.251 | -0.323 | 0.17% | 0.006µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/37828224631000521389798 | throughput | 19091117.629op/s | 19173692.102op/s ± 32129.416op/s | 19175659.393op/s ± 21364.111op/s | 19194542.032op/s | 19225377.510op/s | 19239612.870op/s | 19246895.060op/s | 0.37% | -0.242 | -0.327 | 0.17% | 2271.893op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/x371413321323331 | execution_time | 6.431µs | 6.564µs ± 0.084µs | 6.556µs ± 0.064µs | 6.629µs | 6.720µs | 6.763µs | 6.806µs | 3.82% | 0.461 | -0.346 | 1.27% | 0.006µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/x371413321323331 | throughput | 146930185.891op/s | 152381875.585op/s ± 1934803.011op/s | 152540024.120op/s ± 1497727.592op/s | 153699663.154op/s | 155315771.719op/s | 155466366.283op/s | 155507125.675op/s | 1.95% | -0.407 | -0.428 | 1.27% | 136811.233op/s | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| credit_card/is_card_number/ | execution_time | [3.914µs; 3.915µs] or [-0.009%; +0.009%] | None | None | None |
| credit_card/is_card_number/ | throughput | [255440089.431op/s; 255485782.919op/s] or [-0.009%; +0.009%] | None | None | None |
| credit_card/is_card_number/ 3782-8224-6310-005 | execution_time | [82.334µs; 82.413µs] or [-0.048%; +0.048%] | None | None | None |
| credit_card/is_card_number/ 3782-8224-6310-005 | throughput | [12134292.163op/s; 12145668.935op/s] or [-0.047%; +0.047%] | None | None | None |
| credit_card/is_card_number/ 378282246310005 | execution_time | [76.943µs; 77.020µs] or [-0.050%; +0.050%] | None | None | None |
| credit_card/is_card_number/ 378282246310005 | throughput | [12983829.101op/s; 12996700.676op/s] or [-0.050%; +0.050%] | None | None | None |
| credit_card/is_card_number/37828224631 | execution_time | [3.914µs; 3.915µs] or [-0.010%; +0.010%] | None | None | None |
| credit_card/is_card_number/37828224631 | throughput | [255454382.006op/s; 255504681.499op/s] or [-0.010%; +0.010%] | None | None | None |
| credit_card/is_card_number/378282246310005 | execution_time | [73.957µs; 74.084µs] or [-0.086%; +0.086%] | None | None | None |
| credit_card/is_card_number/378282246310005 | throughput | [13498632.237op/s; 13521763.078op/s] or [-0.086%; +0.086%] | None | None | None |
| credit_card/is_card_number/37828224631000521389798 | execution_time | [52.160µs; 52.187µs] or [-0.026%; +0.026%] | None | None | None |
| credit_card/is_card_number/37828224631000521389798 | throughput | [19161968.782op/s; 19171941.560op/s] or [-0.026%; +0.026%] | None | None | None |
| credit_card/is_card_number/x371413321323331 | execution_time | [6.551µs; 6.572µs] or [-0.159%; +0.159%] | None | None | None |
| credit_card/is_card_number/x371413321323331 | throughput | [152189322.602op/s; 152671324.942op/s] or [-0.158%; +0.158%] | None | None | None |
| credit_card/is_card_number_no_luhn/ | execution_time | [3.914µs; 3.915µs] or [-0.020%; +0.020%] | None | None | None |
| credit_card/is_card_number_no_luhn/ | throughput | [255410638.936op/s; 255511292.725op/s] or [-0.020%; +0.020%] | None | None | None |
| credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 | execution_time | [63.871µs; 63.907µs] or [-0.028%; +0.028%] | None | None | None |
| credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 | throughput | [15647903.630op/s; 15656727.319op/s] or [-0.028%; +0.028%] | None | None | None |
| credit_card/is_card_number_no_luhn/ 378282246310005 | execution_time | [57.537µs; 57.557µs] or [-0.017%; +0.017%] | None | None | None |
| credit_card/is_card_number_no_luhn/ 378282246310005 | throughput | [17374137.876op/s; 17380118.597op/s] or [-0.017%; +0.017%] | None | None | None |
| credit_card/is_card_number_no_luhn/37828224631 | execution_time | [3.913µs; 3.914µs] or [-0.012%; +0.012%] | None | None | None |
| credit_card/is_card_number_no_luhn/37828224631 | throughput | [255476401.540op/s; 255537004.480op/s] or [-0.012%; +0.012%] | None | None | None |
| credit_card/is_card_number_no_luhn/378282246310005 | execution_time | [54.787µs; 54.853µs] or [-0.061%; +0.061%] | None | None | None |
| credit_card/is_card_number_no_luhn/378282246310005 | throughput | [18230788.025op/s; 18252944.520op/s] or [-0.061%; +0.061%] | None | None | None |
| credit_card/is_card_number_no_luhn/37828224631000521389798 | execution_time | [52.143µs; 52.167µs] or [-0.023%; +0.023%] | None | None | None |
| credit_card/is_card_number_no_luhn/37828224631000521389798 | throughput | [19169239.274op/s; 19178144.930op/s] or [-0.023%; +0.023%] | None | None | None |
| credit_card/is_card_number_no_luhn/x371413321323331 | execution_time | [6.552µs; 6.575µs] or [-0.177%; +0.177%] | None | None | None |
| credit_card/is_card_number_no_luhn/x371413321323331 | throughput | [152113730.496op/s; 152650020.674op/s] or [-0.176%; +0.176%] | None | None | None |
Group 10
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 17e62bcc | 1741948785 | ganeshnj/test/size-benchmark |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| write only interface | execution_time | 1.177µs | 3.193µs ± 1.429µs | 2.986µs ± 0.027µs | 3.014µs | 3.673µs | 13.864µs | 14.908µs | 399.26% | 7.339 | 55.042 | 44.64% | 0.101µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| write only interface | execution_time | [2.995µs; 3.391µs] or [-6.203%; +6.203%] | None | None | None |
Group 11
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 17e62bcc | 1741948785 | ganeshnj/test/size-benchmark |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| benching deserializing traces from msgpack to their internal representation | execution_time | 53.522ms | 53.948ms ± 0.279ms | 53.987ms ± 0.208ms | 54.152ms | 54.295ms | 54.649ms | 55.394ms | 2.61% | 0.755 | 2.301 | 0.52% | 0.020ms | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| benching deserializing traces from msgpack to their internal representation | execution_time | [53.910ms; 53.987ms] or [-0.072%; +0.072%] | None | None | None |
Group 12
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 17e62bcc | 1741948785 | ganeshnj/test/size-benchmark |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| benching string interning on wordpress profile | execution_time | 147.047µs | 147.894µs ± 0.310µs | 147.861µs ± 0.154µs | 148.028µs | 148.323µs | 149.091µs | 149.406µs | 1.05% | 1.397 | 5.647 | 0.21% | 0.022µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| benching string interning on wordpress profile | execution_time | [147.851µs; 147.937µs] or [-0.029%; +0.029%] | None | None | None |
Group 13
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 17e62bcc | 1741948785 | ganeshnj/test/size-benchmark |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| normalization/normalize_trace/test_trace | execution_time | 245.251ns | 253.675ns ± 10.580ns | 249.779ns ± 2.874ns | 254.220ns | 280.467ns | 285.073ns | 288.858ns | 15.65% | 1.872 | 2.211 | 4.16% | 0.748ns | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| normalization/normalize_trace/test_trace | execution_time | [252.209ns; 255.141ns] or [-0.578%; +0.578%] | None | None | None |
Baseline
Omitted due to size.
Codecov Report
All modified and coverable lines are covered by tests :white_check_mark:
Project coverage is 72.59%. Comparing base (
9a4a791) to head (17e62bc). Report is 1 commits behind head on main.
Additional details and impacted files
@@ Coverage Diff @@
## main #923 +/- ##
==========================================
+ Coverage 72.44% 72.59% +0.14%
==========================================
Files 333 334 +1
Lines 50097 50480 +383
==========================================
+ Hits 36294 36644 +350
- Misses 13803 13836 +33
| Components | Coverage Δ | |
|---|---|---|
| crashtracker | 42.90% <ø> (+0.02%) |
:arrow_up: |
| crashtracker-ffi | 6.25% <ø> (ø) |
|
| datadog-alloc | 98.73% <ø> (ø) |
|
| data-pipeline | 92.08% <ø> (ø) |
|
| data-pipeline-ffi | 90.28% <ø> (ø) |
|
| ddcommon | 79.19% <ø> (ø) |
|
| ddcommon-ffi | 61.05% <ø> (ø) |
|
| ddtelemetry | 61.74% <ø> (ø) |
|
| ddtelemetry-ffi | 22.46% <ø> (ø) |
|
| dogstatsd | 89.59% <ø> (ø) |
|
| dogstatsd-client | 82.57% <ø> (ø) |
|
| ipc | 82.40% <ø> (ø) |
|
| profiling | 81.94% <ø> (ø) |
|
| profiling-ffi | 70.68% <ø> (ø) |
|
| serverless | 0.00% <ø> (ø) |
|
| sidecar | 40.63% <ø> (ø) |
|
| sidecar-ffi | 3.23% <ø> (ø) |
|
| spawn-worker | 54.37% <ø> (ø) |
|
| tinybytes | 91.21% <ø> (ø) |
|
| trace-mini-agent | 74.66% <ø> (ø) |
|
| trace-normalization | 98.23% <ø> (ø) |
|
| trace-obfuscation | 96.07% <ø> (ø) |
|
| trace-protobuf | 78.13% <ø> (ø) |
|
| trace-utils | 92.85% <ø> (-0.12%) |
:arrow_down: |
🚀 New features to boost your workflow:
- ❄ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
Artifact Size Benchmark Report
aarch64-alpine-linux-musl
| Artifact | Baseline | Commit | Change |
|---|---|---|---|
| /aarch64-alpine-linux-musl/lib/libdatadog_profiling.a | 84.05 MB | 84.05 MB | 0% (0 B) 👌 |
| /aarch64-alpine-linux-musl/lib/libdatadog_profiling.so.debug | 26.56 MB | 26.56 MB | 0% (0 B) 👌 |
| /aarch64-alpine-linux-musl/lib/libdatadog_profiling.so | 8.60 MB | 8.60 MB | 0% (0 B) 👌 |
aarch64-apple-darwin
| Artifact | Baseline | Commit | Change |
|---|---|---|---|
| /aarch64-apple-darwin/lib/libdatadog_profiling.a | 47.32 MB | 47.32 MB | 0% (0 B) 👌 |
| /aarch64-apple-darwin/lib/libdatadog_profiling.dylib | 8.85 MB | 8.85 MB | 0% (0 B) 👌 |
aarch64-unknown-linux-gnu
| Artifact | Baseline | Commit | Change |
|---|---|---|---|
| /aarch64-unknown-linux-gnu/lib/libdatadog_profiling.so | 8.53 MB | 8.53 MB | 0% (0 B) 👌 |
| /aarch64-unknown-linux-gnu/lib/libdatadog_profiling.a | 78.73 MB | 78.73 MB | 0% (0 B) 👌 |
| /aarch64-unknown-linux-gnu/lib/libdatadog_profiling.so.debug | 25.22 MB | 25.22 MB | 0% (0 B) 👌 |
i686-alpine-linux-musl
| Artifact | Baseline | Commit | Change |
|---|---|---|---|
| /i686-alpine-linux-musl/lib/libdatadog_profiling.a | 72.87 MB | 72.87 MB | 0% (0 B) 👌 |
| /i686-alpine-linux-musl/lib/libdatadog_profiling.so | 9.12 MB | 9.12 MB | 0% (0 B) 👌 |
| /i686-alpine-linux-musl/lib/libdatadog_profiling.so.debug | 25.76 MB | 25.76 MB | 0% (0 B) 👌 |
i686-unknown-linux-gnu
| Artifact | Baseline | Commit | Change |
|---|---|---|---|
| /i686-unknown-linux-gnu/lib/libdatadog_profiling.a | 74.60 MB | 74.60 MB | 0% (0 B) 👌 |
| /i686-unknown-linux-gnu/lib/libdatadog_profiling.so | 9.01 MB | 9.01 MB | 0% (0 B) 👌 |
| /i686-unknown-linux-gnu/lib/libdatadog_profiling.so.debug | 23.42 MB | 23.42 MB | 0% (0 B) 👌 |
libdatadog-x64-windows
| Artifact | Baseline | Commit | Change |
|---|---|---|---|
| /libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.dll | 19.17 MB | 19.17 MB | 0% (0 B) 👌 |
| /libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.lib | 54.81 KB | 54.81 KB | 0% (0 B) 👌 |
| /libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.pdb | 133.08 MB | 133.08 MB | +0% (+8.00 KB) 👌 |
| /libdatadog-x64-windows/debug/static/datadog_profiling_ffi.lib | 860.13 MB | 860.13 MB | 0% (0 B) 👌 |
| /libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.dll | 5.86 MB | 5.86 MB | 0% (0 B) 👌 |
| /libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.lib | 54.81 KB | 54.81 KB | 0% (0 B) 👌 |
| /libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.pdb | 17.80 MB | 17.80 MB | 0% (0 B) 👌 |
| /libdatadog-x64-windows/release/static/datadog_profiling_ffi.lib | 30.05 MB | 30.05 MB | 0% (0 B) 👌 |
libdatadog-x86-windows
| Artifact | Baseline | Commit | Change |
|---|---|---|---|
| /libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.dll | 16.31 MB | 16.31 MB | 0% (0 B) 👌 |
| /libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.lib | 55.66 KB | 55.66 KB | 0% (0 B) 👌 |
| /libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.pdb | 135.24 MB | 135.24 MB | 0% (0 B) 👌 |
| /libdatadog-x86-windows/debug/static/datadog_profiling_ffi.lib | 850.34 MB | 850.34 MB | 0% (0 B) 👌 |
| /libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.dll | 4.45 MB | 4.45 MB | 0% (0 B) 👌 |
| /libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.lib | 55.66 KB | 55.66 KB | 0% (0 B) 👌 |
| /libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.pdb | 18.37 MB | 18.37 MB | 0% (0 B) 👌 |
| /libdatadog-x86-windows/release/static/datadog_profiling_ffi.lib | 27.59 MB | 27.59 MB | 0% (0 B) 👌 |
x86_64-alpine-linux-musl
| Artifact | Baseline | Commit | Change |
|---|---|---|---|
| /x86_64-alpine-linux-musl/lib/libdatadog_profiling.a | 72.87 MB | 72.87 MB | 0% (0 B) 👌 |
| /x86_64-alpine-linux-musl/lib/libdatadog_profiling.so | 9.12 MB | 9.12 MB | 0% (0 B) 👌 |
| /x86_64-alpine-linux-musl/lib/libdatadog_profiling.so.debug | 25.76 MB | 25.76 MB | 0% (0 B) 👌 |
x86_64-apple-darwin
| Artifact | Baseline | Commit | Change |
|---|---|---|---|
| /x86_64-apple-darwin/lib/libdatadog_profiling.a | 47.32 MB | 47.32 MB | 0% (0 B) 👌 |
| /x86_64-apple-darwin/lib/libdatadog_profiling.dylib | 8.85 MB | 8.85 MB | 0% (0 B) 👌 |
x86_64-unknown-linux-gnu
| Artifact | Baseline | Commit | Change |
|---|---|---|---|
| /x86_64-unknown-linux-gnu/lib/libdatadog_profiling.a | 74.60 MB | 74.60 MB | 0% (0 B) 👌 |
| /x86_64-unknown-linux-gnu/lib/libdatadog_profiling.so | 9.01 MB | 9.01 MB | 0% (0 B) 👌 |
| /x86_64-unknown-linux-gnu/lib/libdatadog_profiling.so.debug | 23.42 MB | 23.42 MB | 0% (0 B) 👌 |
Is this PR still relevant? Can we close it?