libdatadog
libdatadog copied to clipboard
[experimental] do not merge
What does this PR do?
A brief description of the change being made with this pull request.
Motivation
What inspired you to submit this pull request?
Additional Notes
Anything else we should know when reviewing?
How to test the change?
Describe here in detail how the change can be validated.
Benchmarks
Comparison
Benchmark execution time: 2025-03-17 20:04:58
Comparing candidate commit 2b587dd9 in PR branch jordan.gonzalez/experimental with baseline commit 99c1190a in branch main.
Found 0 performance improvements and 1 performance regressions! Performance is the same for 51 metrics, 2 unstable metrics.
scenario:concentrator/add_spans_to_concentrator
- 🟥
execution_time[+308.108µs; +310.813µs] or [+5.102%; +5.147%]
Candidate
Candidate benchmark details
Group 1
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 2b587dd9 | 1742241205 | jordan.gonzalez/experimental |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| sql/obfuscate_sql_string | execution_time | 65.428µs | 65.636µs ± 0.240µs | 65.592µs ± 0.074µs | 65.693µs | 65.853µs | 66.186µs | 68.498µs | 4.43% | 8.662 | 98.897 | 0.37% | 0.017µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| sql/obfuscate_sql_string | execution_time | [65.603µs; 65.670µs] or [-0.051%; +0.051%] | None | None | None |
Group 2
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 2b587dd9 | 1742241205 | jordan.gonzalez/experimental |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| benching string interning on wordpress profile | execution_time | 148.379µs | 149.565µs ± 0.309µs | 149.533µs ± 0.152µs | 149.689µs | 150.033µs | 150.728µs | 151.242µs | 1.14% | 1.325 | 6.273 | 0.21% | 0.022µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| benching string interning on wordpress profile | execution_time | [149.522µs; 149.608µs] or [-0.029%; +0.029%] | None | None | None |
Group 3
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 2b587dd9 | 1742241205 | jordan.gonzalez/experimental |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| benching deserializing traces from msgpack to their internal representation | execution_time | 53.956ms | 54.298ms ± 0.382ms | 54.124ms ± 0.092ms | 54.330ms | 55.064ms | 55.250ms | 55.526ms | 2.59% | 1.446 | 0.665 | 0.70% | 0.027ms | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| benching deserializing traces from msgpack to their internal representation | execution_time | [54.245ms; 54.351ms] or [-0.097%; +0.097%] | None | None | None |
Group 4
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 2b587dd9 | 1742241205 | jordan.gonzalez/experimental |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| redis/obfuscate_redis_string | execution_time | 31.869µs | 32.804µs ± 1.312µs | 31.968µs ± 0.061µs | 34.164µs | 35.011µs | 35.185µs | 36.028µs | 12.70% | 0.963 | -0.959 | 3.99% | 0.093µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| redis/obfuscate_redis_string | execution_time | [32.622µs; 32.986µs] or [-0.554%; +0.554%] | None | None | None |
Group 5
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 2b587dd9 | 1742241205 | jordan.gonzalez/experimental |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| tags/replace_trace_tags | execution_time | 2.415µs | 2.442µs ± 0.019µs | 2.437µs ± 0.008µs | 2.446µs | 2.493µs | 2.505µs | 2.514µs | 3.15% | 1.786 | 3.223 | 0.80% | 0.001µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| tags/replace_trace_tags | execution_time | [2.439µs; 2.444µs] or [-0.111%; +0.111%] | None | None | None |
Group 6
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 2b587dd9 | 1742241205 | jordan.gonzalez/experimental |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| write only interface | execution_time | 1.189µs | 3.181µs ± 1.427µs | 2.980µs ± 0.028µs | 3.017µs | 3.675µs | 13.866µs | 14.986µs | 402.84% | 7.368 | 55.345 | 44.75% | 0.101µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| write only interface | execution_time | [2.983µs; 3.379µs] or [-6.217%; +6.217%] | None | None | None |
Group 7
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 2b587dd9 | 1742241205 | jordan.gonzalez/experimental |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| ip_address/quantize_peer_ip_address_benchmark | execution_time | 5.007µs | 5.087µs ± 0.040µs | 5.086µs ± 0.041µs | 5.129µs | 5.136µs | 5.139µs | 5.155µs | 1.34% | -0.220 | -1.391 | 0.79% | 0.003µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| ip_address/quantize_peer_ip_address_benchmark | execution_time | [5.081µs; 5.093µs] or [-0.110%; +0.110%] | None | None | None |
Group 8
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 2b587dd9 | 1742241205 | jordan.gonzalez/experimental |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| normalization/normalize_trace/test_trace | execution_time | 245.345ns | 254.763ns ± 11.991ns | 249.245ns ± 2.036ns | 254.176ns | 278.049ns | 293.176ns | 297.097ns | 19.20% | 1.876 | 2.620 | 4.69% | 0.848ns | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| normalization/normalize_trace/test_trace | execution_time | [253.101ns; 256.424ns] or [-0.652%; +0.652%] | None | None | None |
Group 9
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 2b587dd9 | 1742241205 | jordan.gonzalez/experimental |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| concentrator/add_spans_to_concentrator | execution_time | 6.338ms | 6.348ms ± 0.006ms | 6.348ms ± 0.003ms | 6.350ms | 6.356ms | 6.359ms | 6.396ms | 0.76% | 2.999 | 22.643 | 0.09% | 0.000ms | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| concentrator/add_spans_to_concentrator | execution_time | [6.347ms; 6.349ms] or [-0.013%; +0.013%] | None | None | None |
Group 10
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 2b587dd9 | 1742241205 | jordan.gonzalez/experimental |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... | execution_time | 208.540µs | 209.028µs ± 0.214µs | 209.012µs ± 0.096µs | 209.114µs | 209.298µs | 209.394µs | 211.082µs | 0.99% | 4.457 | 41.259 | 0.10% | 0.015µs | 1 | 200 |
| normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... | throughput | 4737505.356op/s | 4784046.912op/s ± 4865.093op/s | 4784405.072op/s ± 2195.582op/s | 4786495.700op/s | 4790223.537op/s | 4792761.639op/s | 4795233.538op/s | 0.23% | -4.386 | 40.393 | 0.10% | 344.014op/s | 1 | 200 |
| normalization/normalize_name/normalize_name/bad-name | execution_time | 18.282µs | 18.336µs ± 0.025µs | 18.330µs ± 0.010µs | 18.345µs | 18.383µs | 18.426µs | 18.443µs | 0.62% | 1.364 | 3.383 | 0.13% | 0.002µs | 1 | 200 |
| normalization/normalize_name/normalize_name/bad-name | throughput | 54222459.126op/s | 54537668.750op/s ± 72765.362op/s | 54556571.813op/s ± 28714.892op/s | 54577648.210op/s | 54641992.406op/s | 54670853.547op/s | 54699041.701op/s | 0.26% | -1.350 | 3.334 | 0.13% | 5145.288op/s | 1 | 200 |
| normalization/normalize_name/normalize_name/good | execution_time | 10.690µs | 10.748µs ± 0.036µs | 10.743µs ± 0.024µs | 10.770µs | 10.820µs | 10.846µs | 10.903µs | 1.49% | 0.968 | 1.236 | 0.33% | 0.003µs | 1 | 200 |
| normalization/normalize_name/normalize_name/good | throughput | 91716452.238op/s | 93038873.569op/s ± 309692.659op/s | 93083202.331op/s ± 206672.278op/s | 93270698.472op/s | 93440139.249op/s | 93473076.356op/s | 93549139.204op/s | 0.50% | -0.945 | 1.152 | 0.33% | 21898.578op/s | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... | execution_time | [208.999µs; 209.058µs] or [-0.014%; +0.014%] | None | None | None |
| normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... | throughput | [4783372.657op/s; 4784721.167op/s] or [-0.014%; +0.014%] | None | None | None |
| normalization/normalize_name/normalize_name/bad-name | execution_time | [18.333µs; 18.339µs] or [-0.019%; +0.019%] | None | None | None |
| normalization/normalize_name/normalize_name/bad-name | throughput | [54527584.170op/s; 54547753.329op/s] or [-0.018%; +0.018%] | None | None | None |
| normalization/normalize_name/normalize_name/good | execution_time | [10.743µs; 10.753µs] or [-0.046%; +0.046%] | None | None | None |
| normalization/normalize_name/normalize_name/good | throughput | [92995953.145op/s; 93081793.994op/s] or [-0.046%; +0.046%] | None | None | None |
Group 11
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 2b587dd9 | 1742241205 | jordan.gonzalez/experimental |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... | execution_time | 504.464µs | 505.739µs ± 0.541µs | 505.718µs ± 0.302µs | 506.030µs | 506.409µs | 507.112µs | 510.134µs | 0.87% | 2.613 | 20.640 | 0.11% | 0.038µs | 1 | 200 |
| normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... | throughput | 1960268.836op/s | 1977307.362op/s ± 2109.012op/s | 1977386.390op/s ± 1178.505op/s | 1978419.456op/s | 1980368.019op/s | 1981751.600op/s | 1982302.226op/s | 0.25% | -2.563 | 20.155 | 0.11% | 149.130op/s | 1 | 200 |
| normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて | execution_time | 452.311µs | 453.236µs ± 0.307µs | 453.214µs ± 0.200µs | 453.419µs | 453.827µs | 453.962µs | 454.047µs | 0.18% | 0.338 | 0.030 | 0.07% | 0.022µs | 1 | 200 |
| normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて | throughput | 2202417.109op/s | 2206358.786op/s ± 1494.813op/s | 2206463.415op/s ± 972.537op/s | 2207411.229op/s | 2208453.045op/s | 2209386.997op/s | 2210870.385op/s | 0.20% | -0.335 | 0.029 | 0.07% | 105.699op/s | 1 | 200 |
| normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters | execution_time | 175.680µs | 176.777µs ± 0.336µs | 176.813µs ± 0.228µs | 177.035µs | 177.242µs | 177.364µs | 177.419µs | 0.34% | -0.637 | 0.198 | 0.19% | 0.024µs | 1 | 200 |
| normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters | throughput | 5636369.485op/s | 5656867.558op/s ± 10779.379op/s | 5655685.326op/s ± 7287.094op/s | 5663701.963op/s | 5677076.102op/s | 5685774.815op/s | 5692157.304op/s | 0.64% | 0.647 | 0.217 | 0.19% | 762.217op/s | 1 | 200 |
| normalization/normalize_service/normalize_service/[empty string] | execution_time | 37.559µs | 37.662µs ± 0.049µs | 37.660µs ± 0.030µs | 37.688µs | 37.746µs | 37.802µs | 37.878µs | 0.58% | 0.874 | 1.732 | 0.13% | 0.003µs | 1 | 200 |
| normalization/normalize_service/normalize_service/[empty string] | throughput | 26400703.118op/s | 26551819.743op/s ± 34662.299op/s | 26553620.290op/s ± 21025.466op/s | 26576010.539op/s | 26602504.109op/s | 26610278.175op/s | 26624954.238op/s | 0.27% | -0.862 | 1.693 | 0.13% | 2450.995op/s | 1 | 200 |
| normalization/normalize_service/normalize_service/test_ASCII | execution_time | 48.224µs | 48.339µs ± 0.047µs | 48.333µs ± 0.028µs | 48.363µs | 48.426µs | 48.466µs | 48.519µs | 0.39% | 0.858 | 1.335 | 0.10% | 0.003µs | 1 | 200 |
| normalization/normalize_service/normalize_service/test_ASCII | throughput | 20610622.481op/s | 20687370.141op/s ± 19933.919op/s | 20689990.007op/s ± 11968.957op/s | 20700550.135op/s | 20714552.977op/s | 20722612.632op/s | 20736723.961op/s | 0.23% | -0.851 | 1.317 | 0.10% | 1409.541op/s | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... | execution_time | [505.664µs; 505.814µs] or [-0.015%; +0.015%] | None | None | None |
| normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... | throughput | [1977015.074op/s; 1977599.651op/s] or [-0.015%; +0.015%] | None | None | None |
| normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて | execution_time | [453.193µs; 453.278µs] or [-0.009%; +0.009%] | None | None | None |
| normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて | throughput | [2206151.619op/s; 2206565.953op/s] or [-0.009%; +0.009%] | None | None | None |
| normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters | execution_time | [176.730µs; 176.824µs] or [-0.026%; +0.026%] | None | None | None |
| normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters | throughput | [5655373.639op/s; 5658361.476op/s] or [-0.026%; +0.026%] | None | None | None |
| normalization/normalize_service/normalize_service/[empty string] | execution_time | [37.655µs; 37.669µs] or [-0.018%; +0.018%] | None | None | None |
| normalization/normalize_service/normalize_service/[empty string] | throughput | [26547015.881op/s; 26556623.604op/s] or [-0.018%; +0.018%] | None | None | None |
| normalization/normalize_service/normalize_service/test_ASCII | execution_time | [48.332µs; 48.345µs] or [-0.013%; +0.013%] | None | None | None |
| normalization/normalize_service/normalize_service/test_ASCII | throughput | [20684607.491op/s; 20690132.790op/s] or [-0.013%; +0.013%] | None | None | None |
Group 12
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 2b587dd9 | 1742241205 | jordan.gonzalez/experimental |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| two way interface | execution_time | 17.993µs | 26.783µs ± 11.219µs | 18.451µs ± 0.358µs | 35.947µs | 46.379µs | 47.522µs | 89.645µs | 385.86% | 1.519 | 4.170 | 41.78% | 0.793µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| two way interface | execution_time | [25.228µs; 28.338µs] or [-5.805%; +5.805%] | None | None | None |
Group 13
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 2b587dd9 | 1742241205 | jordan.gonzalez/experimental |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| credit_card/is_card_number/ | execution_time | 3.899µs | 3.915µs ± 0.003µs | 3.915µs ± 0.002µs | 3.916µs | 3.919µs | 3.920µs | 3.923µs | 0.20% | -1.094 | 5.583 | 0.07% | 0.000µs | 1 | 200 |
| credit_card/is_card_number/ | throughput | 254918882.239op/s | 255449141.590op/s ± 171912.029op/s | 255438741.524op/s ± 100567.997op/s | 255537706.311op/s | 255718314.715op/s | 255879471.176op/s | 256458263.224op/s | 0.40% | 1.107 | 5.651 | 0.07% | 12156.016op/s | 1 | 200 |
| credit_card/is_card_number/ 3782-8224-6310-005 | execution_time | 81.741µs | 82.076µs ± 0.230µs | 81.992µs ± 0.120µs | 82.206µs | 82.493µs | 82.724µs | 83.255µs | 1.54% | 1.416 | 3.043 | 0.28% | 0.016µs | 1 | 200 |
| credit_card/is_card_number/ 3782-8224-6310-005 | throughput | 12011284.700op/s | 12183975.102op/s ± 34052.021op/s | 12196355.735op/s ± 17869.562op/s | 12209504.491op/s | 12221557.732op/s | 12226682.893op/s | 12233722.255op/s | 0.31% | -1.391 | 2.899 | 0.28% | 2407.841op/s | 1 | 200 |
| credit_card/is_card_number/ 378282246310005 | execution_time | 76.408µs | 76.800µs ± 0.249µs | 76.771µs ± 0.189µs | 76.957µs | 77.237µs | 77.421µs | 77.733µs | 1.25% | 0.781 | 0.328 | 0.32% | 0.018µs | 1 | 200 |
| credit_card/is_card_number/ 378282246310005 | throughput | 12864496.102op/s | 13021033.065op/s ± 42062.230op/s | 13025790.770op/s ± 32031.266op/s | 13057932.564op/s | 13073810.741op/s | 13083406.172op/s | 13087585.117op/s | 0.47% | -0.764 | 0.277 | 0.32% | 2974.249op/s | 1 | 200 |
| credit_card/is_card_number/37828224631 | execution_time | 3.894µs | 3.915µs ± 0.003µs | 3.915µs ± 0.001µs | 3.916µs | 3.918µs | 3.920µs | 3.922µs | 0.18% | -2.515 | 19.290 | 0.07% | 0.000µs | 1 | 200 |
| credit_card/is_card_number/37828224631 | throughput | 254984446.947op/s | 255451156.892op/s ± 170517.257op/s | 255452639.088op/s ± 89552.007op/s | 255532708.187op/s | 255693332.324op/s | 255795847.976op/s | 256820648.822op/s | 0.54% | 2.545 | 19.578 | 0.07% | 12057.391op/s | 1 | 200 |
| credit_card/is_card_number/378282246310005 | execution_time | 71.857µs | 72.362µs ± 0.355µs | 72.342µs ± 0.275µs | 72.562µs | 73.011µs | 73.287µs | 73.784µs | 1.99% | 0.910 | 0.732 | 0.49% | 0.025µs | 1 | 200 |
| credit_card/is_card_number/378282246310005 | throughput | 13553145.197op/s | 13819680.305op/s ± 67415.099op/s | 13823246.424op/s ± 52805.593op/s | 13876876.302op/s | 13898925.657op/s | 13911769.304op/s | 13916548.167op/s | 0.67% | -0.882 | 0.635 | 0.49% | 4766.967op/s | 1 | 200 |
| credit_card/is_card_number/37828224631000521389798 | execution_time | 51.917µs | 52.151µs ± 0.095µs | 52.156µs ± 0.063µs | 52.210µs | 52.303µs | 52.362µs | 52.465µs | 0.59% | 0.072 | 0.098 | 0.18% | 0.007µs | 1 | 200 |
| credit_card/is_card_number/37828224631000521389798 | throughput | 19060286.196op/s | 19175259.024op/s ± 35035.600op/s | 19173189.172op/s ± 23036.826op/s | 19200303.863op/s | 19230701.734op/s | 19253065.513op/s | 19261436.277op/s | 0.46% | -0.061 | 0.087 | 0.18% | 2477.391op/s | 1 | 200 |
| credit_card/is_card_number/x371413321323331 | execution_time | 6.430µs | 6.449µs ± 0.022µs | 6.444µs ± 0.003µs | 6.447µs | 6.482µs | 6.561µs | 6.567µs | 1.91% | 3.691 | 14.448 | 0.34% | 0.002µs | 1 | 200 |
| credit_card/is_card_number/x371413321323331 | throughput | 152283676.230op/s | 155057120.716op/s ± 526185.110op/s | 155195026.001op/s ± 77330.919op/s | 155272147.204op/s | 155397817.556op/s | 155468280.962op/s | 155524517.458op/s | 0.21% | -3.662 | 14.231 | 0.34% | 37206.906op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/ | execution_time | 3.892µs | 3.915µs ± 0.005µs | 3.915µs ± 0.002µs | 3.916µs | 3.921µs | 3.924µs | 3.960µs | 1.15% | 3.750 | 42.830 | 0.12% | 0.000µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/ | throughput | 252539279.989op/s | 255417359.969op/s ± 304197.817op/s | 255438847.942op/s ± 99775.967op/s | 255522172.937op/s | 255732135.740op/s | 255906605.384op/s | 256907648.387op/s | 0.58% | -3.640 | 41.858 | 0.12% | 21510.034op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 | execution_time | 63.963µs | 64.260µs ± 0.095µs | 64.247µs ± 0.049µs | 64.307µs | 64.420µs | 64.530µs | 64.718µs | 0.73% | 1.146 | 4.182 | 0.15% | 0.007µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 | throughput | 15451771.159op/s | 15561923.620op/s ± 22859.736op/s | 15565008.305op/s ± 11862.666op/s | 15575428.984op/s | 15591328.809op/s | 15602667.954op/s | 15633939.720op/s | 0.44% | -1.124 | 4.102 | 0.15% | 1616.427op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/ 378282246310005 | execution_time | 58.151µs | 58.296µs ± 0.124µs | 58.271µs ± 0.027µs | 58.302µs | 58.484µs | 58.819µs | 59.353µs | 1.86% | 4.855 | 32.392 | 0.21% | 0.009µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/ 378282246310005 | throughput | 16848356.271op/s | 17153830.306op/s ± 35983.145op/s | 17161162.573op/s ± 8069.306op/s | 17167925.165op/s | 17183460.492op/s | 17195964.434op/s | 17196601.951op/s | 0.21% | -4.787 | 31.584 | 0.21% | 2544.393op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/37828224631 | execution_time | 3.897µs | 3.915µs ± 0.003µs | 3.915µs ± 0.002µs | 3.917µs | 3.920µs | 3.921µs | 3.921µs | 0.16% | -1.058 | 4.998 | 0.08% | 0.000µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/37828224631 | throughput | 255006435.045op/s | 255402699.200op/s ± 201471.070op/s | 255401746.948op/s ± 122417.851op/s | 255522485.979op/s | 255735350.687op/s | 255879052.005op/s | 256581130.250op/s | 0.46% | 1.072 | 5.081 | 0.08% | 14246.156op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/378282246310005 | execution_time | 54.575µs | 54.818µs ± 0.253µs | 54.692µs ± 0.055µs | 55.009µs | 55.246µs | 55.692µs | 55.924µs | 2.25% | 1.660 | 2.630 | 0.46% | 0.018µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/378282246310005 | throughput | 17881441.936op/s | 18242539.367op/s ± 83592.266op/s | 18284172.308op/s ± 18280.222op/s | 18298009.178op/s | 18311227.172op/s | 18320265.989op/s | 18323545.756op/s | 0.22% | -1.634 | 2.491 | 0.46% | 5910.866op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/37828224631000521389798 | execution_time | 51.857µs | 52.151µs ± 0.096µs | 52.157µs ± 0.060µs | 52.209µs | 52.296µs | 52.360µs | 52.502µs | 0.66% | -0.126 | 0.777 | 0.18% | 0.007µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/37828224631000521389798 | throughput | 19046778.193op/s | 19175283.380op/s ± 35366.158op/s | 19172969.002op/s ± 21989.442op/s | 19196739.914op/s | 19238535.215op/s | 19262246.305op/s | 19283859.721op/s | 0.58% | 0.142 | 0.770 | 0.18% | 2500.765op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/x371413321323331 | execution_time | 6.430µs | 6.453µs ± 0.027µs | 6.444µs ± 0.004µs | 6.450µs | 6.504µs | 6.551µs | 6.628µs | 2.86% | 3.667 | 16.976 | 0.42% | 0.002µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/x371413321323331 | throughput | 150869769.565op/s | 154977297.454op/s ± 635204.256op/s | 155183294.404op/s ± 98381.670op/s | 155271822.046op/s | 155385879.469op/s | 155471336.285op/s | 155512025.095op/s | 0.21% | -3.599 | 16.323 | 0.41% | 44915.724op/s | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| credit_card/is_card_number/ | execution_time | [3.914µs; 3.915µs] or [-0.009%; +0.009%] | None | None | None |
| credit_card/is_card_number/ | throughput | [255425316.236op/s; 255472966.943op/s] or [-0.009%; +0.009%] | None | None | None |
| credit_card/is_card_number/ 3782-8224-6310-005 | execution_time | [82.044µs; 82.108µs] or [-0.039%; +0.039%] | None | None | None |
| credit_card/is_card_number/ 3782-8224-6310-005 | throughput | [12179255.820op/s; 12188694.385op/s] or [-0.039%; +0.039%] | None | None | None |
| credit_card/is_card_number/ 378282246310005 | execution_time | [76.765µs; 76.834µs] or [-0.045%; +0.045%] | None | None | None |
| credit_card/is_card_number/ 378282246310005 | throughput | [13015203.644op/s; 13026862.485op/s] or [-0.045%; +0.045%] | None | None | None |
| credit_card/is_card_number/37828224631 | execution_time | [3.914µs; 3.915µs] or [-0.009%; +0.009%] | None | None | None |
| credit_card/is_card_number/37828224631 | throughput | [255427524.840op/s; 255474788.944op/s] or [-0.009%; +0.009%] | None | None | None |
| credit_card/is_card_number/378282246310005 | execution_time | [72.313µs; 72.411µs] or [-0.068%; +0.068%] | None | None | None |
| credit_card/is_card_number/378282246310005 | throughput | [13810337.221op/s; 13829023.389op/s] or [-0.068%; +0.068%] | None | None | None |
| credit_card/is_card_number/37828224631000521389798 | execution_time | [52.138µs; 52.164µs] or [-0.025%; +0.025%] | None | None | None |
| credit_card/is_card_number/37828224631000521389798 | throughput | [19170403.427op/s; 19180114.621op/s] or [-0.025%; +0.025%] | None | None | None |
| credit_card/is_card_number/x371413321323331 | execution_time | [6.446µs; 6.452µs] or [-0.048%; +0.048%] | None | None | None |
| credit_card/is_card_number/x371413321323331 | throughput | [154984196.521op/s; 155130044.912op/s] or [-0.047%; +0.047%] | None | None | None |
| credit_card/is_card_number_no_luhn/ | execution_time | [3.915µs; 3.916µs] or [-0.017%; +0.017%] | None | None | None |
| credit_card/is_card_number_no_luhn/ | throughput | [255375201.077op/s; 255459518.861op/s] or [-0.017%; +0.017%] | None | None | None |
| credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 | execution_time | [64.246µs; 64.273µs] or [-0.020%; +0.020%] | None | None | None |
| credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 | throughput | [15558755.480op/s; 15565091.760op/s] or [-0.020%; +0.020%] | None | None | None |
| credit_card/is_card_number_no_luhn/ 378282246310005 | execution_time | [58.279µs; 58.313µs] or [-0.029%; +0.029%] | None | None | None |
| credit_card/is_card_number_no_luhn/ 378282246310005 | throughput | [17148843.388op/s; 17158817.224op/s] or [-0.029%; +0.029%] | None | None | None |
| credit_card/is_card_number_no_luhn/37828224631 | execution_time | [3.915µs; 3.916µs] or [-0.011%; +0.011%] | None | None | None |
| credit_card/is_card_number_no_luhn/37828224631 | throughput | [255374777.248op/s; 255430621.153op/s] or [-0.011%; +0.011%] | None | None | None |
| credit_card/is_card_number_no_luhn/378282246310005 | execution_time | [54.783µs; 54.853µs] or [-0.064%; +0.064%] | None | None | None |
| credit_card/is_card_number_no_luhn/378282246310005 | throughput | [18230954.283op/s; 18254124.451op/s] or [-0.064%; +0.064%] | None | None | None |
| credit_card/is_card_number_no_luhn/37828224631000521389798 | execution_time | [52.137µs; 52.164µs] or [-0.026%; +0.026%] | None | None | None |
| credit_card/is_card_number_no_luhn/37828224631000521389798 | throughput | [19170381.970op/s; 19180184.789op/s] or [-0.026%; +0.026%] | None | None | None |
| credit_card/is_card_number_no_luhn/x371413321323331 | execution_time | [6.449µs; 6.456µs] or [-0.058%; +0.058%] | None | None | None |
| credit_card/is_card_number_no_luhn/x371413321323331 | throughput | [154889264.253op/s; 155065330.655op/s] or [-0.057%; +0.057%] | None | None | None |
Baseline
Omitted due to size.
Codecov Report
All modified and coverable lines are covered by tests :white_check_mark:
Project coverage is 72.87%. Comparing base (
99c1190) to head (2b587dd).
Additional details and impacted files
@@ Coverage Diff @@
## main #937 +/- ##
==========================================
+ Coverage 72.85% 72.87% +0.02%
==========================================
Files 334 334
Lines 50974 51027 +53
==========================================
+ Hits 37135 37186 +51
- Misses 13839 13841 +2
| Components | Coverage Δ | |
|---|---|---|
| crashtracker | 42.85% <ø> (ø) |
|
| crashtracker-ffi | 6.25% <ø> (ø) |
|
| datadog-alloc | 98.73% <ø> (ø) |
|
| data-pipeline | 91.96% <ø> (ø) |
|
| data-pipeline-ffi | 90.28% <ø> (ø) |
|
| ddcommon | 81.37% <ø> (ø) |
|
| ddcommon-ffi | 66.10% <ø> (ø) |
|
| ddtelemetry | 61.87% <ø> (ø) |
|
| ddtelemetry-ffi | 22.46% <ø> (ø) |
|
| dogstatsd | 90.04% <100.00%> (+0.34%) |
:arrow_up: |
| dogstatsd-client | 82.57% <ø> (ø) |
|
| ipc | 82.47% <ø> (-0.05%) |
:arrow_down: |
| profiling | 81.86% <ø> (ø) |
|
| profiling-ffi | 70.68% <ø> (ø) |
|
| serverless | 0.00% <ø> (ø) |
|
| sidecar | 41.53% <ø> (ø) |
|
| sidecar-ffi | 5.58% <ø> (ø) |
|
| spawn-worker | 54.37% <ø> (ø) |
|
| tinybytes | 91.24% <ø> (ø) |
|
| trace-mini-agent | 74.66% <ø> (ø) |
|
| trace-normalization | 98.24% <ø> (ø) |
|
| trace-obfuscation | 96.00% <ø> (ø) |
|
| trace-protobuf | 78.13% <ø> (ø) |
|
| trace-utils | 92.87% <ø> (ø) |
🚀 New features to boost your workflow:
- ❄ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
This pull request has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. To override this behavior, add the keep-open label or update the PR.