libdatadog
libdatadog copied to clipboard
Useless change.
What does this PR do?
A brief description of the change being made with this pull request.
Motivation
What inspired you to submit this pull request?
Additional Notes
Anything else we should know when reviewing?
How to test the change?
Describe here in detail how the change can be validated.
Benchmarks
Comparison
Benchmark execution time: 2025-03-28 13:33:40
Comparing candidate commit 02a6290e in PR branch julio/run-integration-tests with baseline commit 1faf4097 in branch main.
Found 0 performance improvements and 2 performance regressions! Performance is the same for 50 metrics, 2 unstable metrics.
scenario:normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて
- 🟥
execution_time[+27.803µs; +28.082µs] or [+6.107%; +6.168%] - 🟥
throughput[-127627.824op/s; -126392.414op/s] or [-5.811%; -5.754%]
Candidate
Candidate benchmark details
Group 1
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 02a6290e | 1743168099 | julio/run-integration-tests |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| two way interface | execution_time | 17.331µs | 25.372µs ± 11.283µs | 17.533µs ± 0.091µs | 34.823µs | 44.997µs | 51.903µs | 106.209µs | 505.78% | 2.343 | 11.796 | 44.36% | 0.798µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| two way interface | execution_time | [23.808µs; 26.935µs] or [-6.164%; +6.164%] | None | None | None |
Group 2
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 02a6290e | 1743168099 | julio/run-integration-tests |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| concentrator/add_spans_to_concentrator | execution_time | 5.997ms | 6.020ms ± 0.014ms | 6.018ms ± 0.004ms | 6.021ms | 6.032ms | 6.093ms | 6.097ms | 1.31% | 3.709 | 15.010 | 0.24% | 0.001ms | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| concentrator/add_spans_to_concentrator | execution_time | [6.018ms; 6.022ms] or [-0.033%; +0.033%] | None | None | None |
Group 3
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 02a6290e | 1743168099 | julio/run-integration-tests |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| redis/obfuscate_redis_string | execution_time | 33.138µs | 33.866µs ± 0.926µs | 33.277µs ± 0.074µs | 34.768µs | 35.549µs | 35.600µs | 36.334µs | 9.19% | 0.993 | -0.788 | 2.73% | 0.065µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| redis/obfuscate_redis_string | execution_time | [33.738µs; 33.995µs] or [-0.379%; +0.379%] | None | None | None |
Group 4
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 02a6290e | 1743168099 | julio/run-integration-tests |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| normalization/normalize_trace/test_trace | execution_time | 244.933ns | 254.325ns ± 12.418ns | 249.281ns ± 2.942ns | 255.030ns | 281.636ns | 293.951ns | 296.007ns | 18.74% | 1.772 | 2.098 | 4.87% | 0.878ns | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| normalization/normalize_trace/test_trace | execution_time | [252.604ns; 256.046ns] or [-0.677%; +0.677%] | None | None | None |
Group 5
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 02a6290e | 1743168099 | julio/run-integration-tests |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... | execution_time | 208.611µs | 209.091µs ± 0.174µs | 209.078µs ± 0.097µs | 209.183µs | 209.401µs | 209.527µs | 209.933µs | 0.41% | 0.765 | 2.353 | 0.08% | 0.012µs | 1 | 200 |
| normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... | throughput | 4763418.218op/s | 4782614.216op/s ± 3966.702op/s | 4782902.717op/s ± 2221.213op/s | 4785073.283op/s | 4788136.657op/s | 4790253.712op/s | 4793605.330op/s | 0.22% | -0.756 | 2.319 | 0.08% | 280.488op/s | 1 | 200 |
| normalization/normalize_name/normalize_name/bad-name | execution_time | 18.596µs | 18.670µs ± 0.031µs | 18.663µs ± 0.014µs | 18.683µs | 18.730µs | 18.786µs | 18.809µs | 0.78% | 1.471 | 3.387 | 0.17% | 0.002µs | 1 | 200 |
| normalization/normalize_name/normalize_name/bad-name | throughput | 53166348.945op/s | 53561472.682op/s ± 89761.411op/s | 53581564.309op/s ± 41186.464op/s | 53615337.895op/s | 53656340.869op/s | 53721581.486op/s | 53775005.378op/s | 0.36% | -1.454 | 3.328 | 0.17% | 6347.090op/s | 1 | 200 |
| normalization/normalize_name/normalize_name/good | execution_time | 10.858µs | 10.918µs ± 0.036µs | 10.911µs ± 0.025µs | 10.943µs | 10.983µs | 10.998µs | 11.023µs | 1.02% | 0.488 | -0.541 | 0.33% | 0.003µs | 1 | 200 |
| normalization/normalize_name/normalize_name/good | throughput | 90718835.114op/s | 91594649.968op/s ± 299818.695op/s | 91646815.874op/s ± 208492.079op/s | 91809887.185op/s | 92025948.075op/s | 92069682.119op/s | 92102168.227op/s | 0.50% | -0.476 | -0.557 | 0.33% | 21200.383op/s | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... | execution_time | [209.067µs; 209.115µs] or [-0.012%; +0.012%] | None | None | None |
| normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... | throughput | [4782064.469op/s; 4783163.962op/s] or [-0.011%; +0.011%] | None | None | None |
| normalization/normalize_name/normalize_name/bad-name | execution_time | [18.666µs; 18.675µs] or [-0.023%; +0.023%] | None | None | None |
| normalization/normalize_name/normalize_name/bad-name | throughput | [53549032.614op/s; 53573912.750op/s] or [-0.023%; +0.023%] | None | None | None |
| normalization/normalize_name/normalize_name/good | execution_time | [10.913µs; 10.923µs] or [-0.045%; +0.045%] | None | None | None |
| normalization/normalize_name/normalize_name/good | throughput | [91553097.981op/s; 91636201.956op/s] or [-0.045%; +0.045%] | None | None | None |
Group 6
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 02a6290e | 1743168099 | julio/run-integration-tests |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| sql/obfuscate_sql_string | execution_time | 65.449µs | 65.679µs ± 0.288µs | 65.645µs ± 0.055µs | 65.707µs | 65.845µs | 66.204µs | 69.422µs | 5.75% | 11.199 | 142.272 | 0.44% | 0.020µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| sql/obfuscate_sql_string | execution_time | [65.639µs; 65.719µs] or [-0.061%; +0.061%] | None | None | None |
Group 7
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 02a6290e | 1743168099 | julio/run-integration-tests |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| benching string interning on wordpress profile | execution_time | 147.237µs | 148.011µs ± 0.358µs | 147.991µs ± 0.174µs | 148.153µs | 148.422µs | 149.096µs | 151.048µs | 2.07% | 3.563 | 26.083 | 0.24% | 0.025µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| benching string interning on wordpress profile | execution_time | [147.962µs; 148.061µs] or [-0.034%; +0.034%] | None | None | None |
Group 8
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 02a6290e | 1743168099 | julio/run-integration-tests |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| write only interface | execution_time | 1.218µs | 3.179µs ± 1.417µs | 2.985µs ± 0.028µs | 3.013µs | 3.657µs | 13.869µs | 14.931µs | 400.13% | 7.391 | 55.624 | 44.46% | 0.100µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| write only interface | execution_time | [2.982µs; 3.375µs] or [-6.178%; +6.178%] | None | None | None |
Group 9
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 02a6290e | 1743168099 | julio/run-integration-tests |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| ip_address/quantize_peer_ip_address_benchmark | execution_time | 4.954µs | 5.016µs ± 0.052µs | 4.988µs ± 0.024µs | 5.069µs | 5.111µs | 5.114µs | 5.116µs | 2.58% | 0.652 | -1.121 | 1.04% | 0.004µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| ip_address/quantize_peer_ip_address_benchmark | execution_time | [5.009µs; 5.023µs] or [-0.145%; +0.145%] | None | None | None |
Group 10
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 02a6290e | 1743168099 | julio/run-integration-tests |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| benching deserializing traces from msgpack to their internal representation | execution_time | 55.087ms | 55.405ms ± 0.180ms | 55.370ms ± 0.061ms | 55.443ms | 55.765ms | 56.218ms | 56.494ms | 2.03% | 2.944 | 11.751 | 0.32% | 0.013ms | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| benching deserializing traces from msgpack to their internal representation | execution_time | [55.380ms; 55.430ms] or [-0.045%; +0.045%] | None | None | None |
Group 11
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 02a6290e | 1743168099 | julio/run-integration-tests |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| credit_card/is_card_number/ | execution_time | 3.897µs | 3.914µs ± 0.003µs | 3.914µs ± 0.002µs | 3.916µs | 3.918µs | 3.919µs | 3.921µs | 0.17% | -1.035 | 3.920 | 0.08% | 0.000µs | 1 | 200 |
| credit_card/is_card_number/ | throughput | 255058952.060op/s | 255499460.723op/s ± 193172.635op/s | 255497623.880op/s ± 117920.487op/s | 255590632.442op/s | 255860656.064op/s | 255907574.782op/s | 256583346.204op/s | 0.42% | 1.046 | 3.982 | 0.08% | 13659.368op/s | 1 | 200 |
| credit_card/is_card_number/ 3782-8224-6310-005 | execution_time | 81.668µs | 82.005µs ± 0.205µs | 81.952µs ± 0.073µs | 82.039µs | 82.413µs | 82.731µs | 83.095µs | 1.39% | 2.113 | 6.290 | 0.25% | 0.014µs | 1 | 200 |
| credit_card/is_card_number/ 3782-8224-6310-005 | throughput | 12034411.314op/s | 12194482.965op/s ± 30269.487op/s | 12202244.609op/s ± 10830.412op/s | 12212111.056op/s | 12227228.448op/s | 12237724.717op/s | 12244684.527op/s | 0.35% | -2.085 | 6.122 | 0.25% | 2140.376op/s | 1 | 200 |
| credit_card/is_card_number/ 378282246310005 | execution_time | 76.288µs | 76.746µs ± 0.397µs | 76.612µs ± 0.185µs | 76.898µs | 77.577µs | 77.972µs | 78.619µs | 2.62% | 1.637 | 3.096 | 0.52% | 0.028µs | 1 | 200 |
| credit_card/is_card_number/ 378282246310005 | throughput | 12719497.504op/s | 13030316.721op/s ± 66775.938op/s | 13052717.835op/s ± 31544.227op/s | 13078241.403op/s | 13094699.539op/s | 13104814.755op/s | 13108298.864op/s | 0.43% | -1.601 | 2.903 | 0.51% | 4721.772op/s | 1 | 200 |
| credit_card/is_card_number/37828224631 | execution_time | 3.897µs | 3.914µs ± 0.003µs | 3.915µs ± 0.002µs | 3.916µs | 3.918µs | 3.918µs | 3.919µs | 0.12% | -1.641 | 6.741 | 0.07% | 0.000µs | 1 | 200 |
| credit_card/is_card_number/37828224631 | throughput | 255145832.071op/s | 255483791.047op/s ± 176494.831op/s | 255456214.829op/s ± 98538.430op/s | 255573707.458op/s | 255778875.947op/s | 255945130.815op/s | 256584248.057op/s | 0.44% | 1.654 | 6.831 | 0.07% | 12480.069op/s | 1 | 200 |
| credit_card/is_card_number/378282246310005 | execution_time | 71.880µs | 72.297µs ± 0.352µs | 72.218µs ± 0.216µs | 72.449µs | 72.941µs | 73.387µs | 73.875µs | 2.29% | 1.460 | 3.001 | 0.49% | 0.025µs | 1 | 200 |
| credit_card/is_card_number/378282246310005 | throughput | 13536335.517op/s | 13832171.094op/s ± 66900.421op/s | 13846980.610op/s ± 41522.487op/s | 13888009.093op/s | 13898927.169op/s | 13905286.600op/s | 13912132.771op/s | 0.47% | -1.419 | 2.787 | 0.48% | 4730.574op/s | 1 | 200 |
| credit_card/is_card_number/37828224631000521389798 | execution_time | 51.828µs | 52.135µs ± 0.115µs | 52.128µs ± 0.064µs | 52.199µs | 52.347µs | 52.471µs | 52.576µs | 0.86% | 0.543 | 1.387 | 0.22% | 0.008µs | 1 | 200 |
| credit_card/is_card_number/37828224631000521389798 | throughput | 19020171.883op/s | 19180971.510op/s ± 42276.351op/s | 19183661.276op/s ± 23559.679op/s | 19205916.383op/s | 19245466.456op/s | 19283479.016op/s | 19294434.681op/s | 0.58% | -0.523 | 1.351 | 0.22% | 2989.389op/s | 1 | 200 |
| credit_card/is_card_number/x371413321323331 | execution_time | 6.429µs | 6.444µs ± 0.004µs | 6.443µs ± 0.002µs | 6.446µs | 6.451µs | 6.454µs | 6.455µs | 0.18% | -0.027 | 1.156 | 0.06% | 0.000µs | 1 | 200 |
| credit_card/is_card_number/x371413321323331 | throughput | 154923721.266op/s | 155189807.511op/s ± 99490.323op/s | 155199919.335op/s ± 58114.419op/s | 155245458.403op/s | 155331621.635op/s | 155505308.221op/s | 155544126.507op/s | 0.22% | 0.033 | 1.164 | 0.06% | 7035.028op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/ | execution_time | 3.893µs | 3.914µs ± 0.003µs | 3.914µs ± 0.002µs | 3.916µs | 3.919µs | 3.920µs | 3.923µs | 0.23% | -1.594 | 10.609 | 0.08% | 0.000µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/ | throughput | 254898570.115op/s | 255474591.388op/s ± 202820.273op/s | 255475877.045op/s ± 110529.584op/s | 255584856.597op/s | 255766821.643op/s | 255926040.273op/s | 256883595.952op/s | 0.55% | 1.618 | 10.791 | 0.08% | 14341.559op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 | execution_time | 64.110µs | 64.287µs ± 0.074µs | 64.278µs ± 0.039µs | 64.321µs | 64.422µs | 64.512µs | 64.624µs | 0.54% | 1.184 | 3.017 | 0.12% | 0.005µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 | throughput | 15474055.118op/s | 15555167.594op/s ± 17975.376op/s | 15557474.423op/s ± 9452.538op/s | 15565988.704op/s | 15579539.551op/s | 15587144.658op/s | 15598214.004op/s | 0.26% | -1.171 | 2.975 | 0.12% | 1271.051op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/ 378282246310005 | execution_time | 58.149µs | 58.293µs ± 0.106µs | 58.267µs ± 0.031µs | 58.303µs | 58.529µs | 58.672µs | 58.896µs | 1.08% | 2.849 | 10.177 | 0.18% | 0.007µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/ 378282246310005 | throughput | 16979163.901op/s | 17154868.269op/s ± 30922.256op/s | 17162488.806op/s ± 9069.084op/s | 17170151.837op/s | 17184174.244op/s | 17191614.240op/s | 17197074.778op/s | 0.20% | -2.827 | 10.023 | 0.18% | 2186.534op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/37828224631 | execution_time | 3.896µs | 3.914µs ± 0.003µs | 3.914µs ± 0.001µs | 3.916µs | 3.919µs | 3.921µs | 3.922µs | 0.20% | -0.802 | 4.657 | 0.08% | 0.000µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/37828224631 | throughput | 254963607.562op/s | 255493654.694op/s ± 202072.105op/s | 255484326.050op/s ± 86510.714op/s | 255567993.865op/s | 255819354.672op/s | 255943414.295op/s | 256640845.551op/s | 0.45% | 0.816 | 4.725 | 0.08% | 14288.656op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/378282246310005 | execution_time | 54.558µs | 54.747µs ± 0.175µs | 54.677µs ± 0.039µs | 54.778µs | 55.177µs | 55.325µs | 55.595µs | 1.68% | 2.274 | 5.441 | 0.32% | 0.012µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/378282246310005 | throughput | 17987107.078op/s | 18266103.204op/s ± 58054.439op/s | 18289306.243op/s ± 12980.629op/s | 18298190.310op/s | 18310742.913op/s | 18323010.294op/s | 18329211.264op/s | 0.22% | -2.253 | 5.307 | 0.32% | 4105.069op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/37828224631000521389798 | execution_time | 51.906µs | 52.132µs ± 0.101µs | 52.123µs ± 0.063µs | 52.185µs | 52.304µs | 52.411µs | 52.457µs | 0.64% | 0.630 | 0.574 | 0.19% | 0.007µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/37828224631000521389798 | throughput | 19063056.719op/s | 19181970.118op/s ± 37119.685op/s | 19185251.338op/s ± 23134.689op/s | 19208704.905op/s | 19235859.779op/s | 19247460.538op/s | 19265686.358op/s | 0.42% | -0.617 | 0.552 | 0.19% | 2624.758op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/x371413321323331 | execution_time | 6.429µs | 6.442µs ± 0.004µs | 6.443µs ± 0.002µs | 6.444µs | 6.448µs | 6.451µs | 6.454µs | 0.17% | -0.597 | 0.982 | 0.06% | 0.000µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/x371413321323331 | throughput | 154950679.189op/s | 155231865.918op/s ± 100654.620op/s | 155218967.943op/s ± 52744.501op/s | 155280500.651op/s | 155431381.485op/s | 155527244.907op/s | 155552882.321op/s | 0.22% | 0.602 | 0.988 | 0.06% | 7117.356op/s | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| credit_card/is_card_number/ | execution_time | [3.913µs; 3.914µs] or [-0.010%; +0.010%] | None | None | None |
| credit_card/is_card_number/ | throughput | [255472688.853op/s; 255526232.592op/s] or [-0.010%; +0.010%] | None | None | None |
| credit_card/is_card_number/ 3782-8224-6310-005 | execution_time | [81.976µs; 82.033µs] or [-0.035%; +0.035%] | None | None | None |
| credit_card/is_card_number/ 3782-8224-6310-005 | throughput | [12190287.905op/s; 12198678.025op/s] or [-0.034%; +0.034%] | None | None | None |
| credit_card/is_card_number/ 378282246310005 | execution_time | [76.691µs; 76.801µs] or [-0.072%; +0.072%] | None | None | None |
| credit_card/is_card_number/ 378282246310005 | throughput | [13021062.219op/s; 13039571.224op/s] or [-0.071%; +0.071%] | None | None | None |
| credit_card/is_card_number/37828224631 | execution_time | [3.914µs; 3.915µs] or [-0.010%; +0.010%] | None | None | None |
| credit_card/is_card_number/37828224631 | throughput | [255459330.561op/s; 255508251.533op/s] or [-0.010%; +0.010%] | None | None | None |
| credit_card/is_card_number/378282246310005 | execution_time | [72.248µs; 72.346µs] or [-0.067%; +0.067%] | None | None | None |
| credit_card/is_card_number/378282246310005 | throughput | [13822899.339op/s; 13841442.849op/s] or [-0.067%; +0.067%] | None | None | None |
| credit_card/is_card_number/37828224631000521389798 | execution_time | [52.119µs; 52.151µs] or [-0.031%; +0.031%] | None | None | None |
| credit_card/is_card_number/37828224631000521389798 | throughput | [19175112.414op/s; 19186830.606op/s] or [-0.031%; +0.031%] | None | None | None |
| credit_card/is_card_number/x371413321323331 | execution_time | [6.443µs; 6.444µs] or [-0.009%; +0.009%] | None | None | None |
| credit_card/is_card_number/x371413321323331 | throughput | [155176019.110op/s; 155203595.913op/s] or [-0.009%; +0.009%] | None | None | None |
| credit_card/is_card_number_no_luhn/ | execution_time | [3.914µs; 3.915µs] or [-0.011%; +0.011%] | None | None | None |
| credit_card/is_card_number_no_luhn/ | throughput | [255446482.449op/s; 255502700.327op/s] or [-0.011%; +0.011%] | None | None | None |
| credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 | execution_time | [64.277µs; 64.298µs] or [-0.016%; +0.016%] | None | None | None |
| credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 | throughput | [15552676.379op/s; 15557658.808op/s] or [-0.016%; +0.016%] | None | None | None |
| credit_card/is_card_number_no_luhn/ 378282246310005 | execution_time | [58.278µs; 58.307µs] or [-0.025%; +0.025%] | None | None | None |
| credit_card/is_card_number_no_luhn/ 378282246310005 | throughput | [17150582.742op/s; 17159153.797op/s] or [-0.025%; +0.025%] | None | None | None |
| credit_card/is_card_number_no_luhn/37828224631 | execution_time | [3.914µs; 3.914µs] or [-0.011%; +0.011%] | None | None | None |
| credit_card/is_card_number_no_luhn/37828224631 | throughput | [255465649.444op/s; 255521659.944op/s] or [-0.011%; +0.011%] | None | None | None |
| credit_card/is_card_number_no_luhn/378282246310005 | execution_time | [54.722µs; 54.771µs] or [-0.044%; +0.044%] | None | None | None |
| credit_card/is_card_number_no_luhn/378282246310005 | throughput | [18258057.417op/s; 18274148.991op/s] or [-0.044%; +0.044%] | None | None | None |
| credit_card/is_card_number_no_luhn/37828224631000521389798 | execution_time | [52.118µs; 52.146µs] or [-0.027%; +0.027%] | None | None | None |
| credit_card/is_card_number_no_luhn/37828224631000521389798 | throughput | [19176825.687op/s; 19187114.550op/s] or [-0.027%; +0.027%] | None | None | None |
| credit_card/is_card_number_no_luhn/x371413321323331 | execution_time | [6.441µs; 6.443µs] or [-0.009%; +0.009%] | None | None | None |
| credit_card/is_card_number_no_luhn/x371413321323331 | throughput | [155217916.156op/s; 155245815.680op/s] or [-0.009%; +0.009%] | None | None | None |
Group 12
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 02a6290e | 1743168099 | julio/run-integration-tests |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... | execution_time | 502.289µs | 504.102µs ± 0.461µs | 504.113µs ± 0.244µs | 504.330µs | 504.730µs | 505.141µs | 507.266µs | 0.63% | 1.195 | 11.023 | 0.09% | 0.033µs | 1 | 200 |
| normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... | throughput | 1971354.251op/s | 1983727.473op/s ± 1810.999op/s | 1983682.339op/s ± 961.203op/s | 1984707.990op/s | 1986540.230op/s | 1987854.543op/s | 1990883.964op/s | 0.36% | -1.163 | 10.828 | 0.09% | 128.057op/s | 1 | 200 |
| normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて | execution_time | 482.084µs | 483.218µs ± 0.828µs | 483.116µs ± 0.232µs | 483.367µs | 483.784µs | 484.259µs | 492.603µs | 1.96% | 8.246 | 85.902 | 0.17% | 0.059µs | 1 | 200 |
| normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて | throughput | 2030034.033op/s | 2069463.847op/s ± 3495.881op/s | 2069895.806op/s ± 994.926op/s | 2070770.037op/s | 2072092.990op/s | 2073058.598op/s | 2074325.937op/s | 0.21% | -8.145 | 84.293 | 0.17% | 247.196op/s | 1 | 200 |
| normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters | execution_time | 177.480µs | 177.907µs ± 0.164µs | 177.901µs ± 0.081µs | 177.982µs | 178.210µs | 178.388µs | 178.397µs | 0.28% | 0.389 | 0.575 | 0.09% | 0.012µs | 1 | 200 |
| normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters | throughput | 5605467.765op/s | 5620925.991op/s ± 5181.120op/s | 5621104.258op/s ± 2570.150op/s | 5623667.079op/s | 5629268.193op/s | 5631409.482op/s | 5634433.812op/s | 0.24% | -0.383 | 0.569 | 0.09% | 366.360op/s | 1 | 200 |
| normalization/normalize_service/normalize_service/[empty string] | execution_time | 37.526µs | 37.626µs ± 0.039µs | 37.622µs ± 0.026µs | 37.652µs | 37.692µs | 37.714µs | 37.791µs | 0.45% | 0.415 | 0.982 | 0.10% | 0.003µs | 1 | 200 |
| normalization/normalize_service/normalize_service/[empty string] | throughput | 26461401.934op/s | 26577202.977op/s ± 27572.161op/s | 26580116.601op/s ± 18452.046op/s | 26595971.470op/s | 26618224.944op/s | 26630959.341op/s | 26648062.204op/s | 0.26% | -0.407 | 0.963 | 0.10% | 1949.646op/s | 1 | 200 |
| normalization/normalize_service/normalize_service/test_ASCII | execution_time | 48.102µs | 48.299µs ± 0.234µs | 48.120µs ± 0.017µs | 48.529µs | 48.633µs | 48.701µs | 49.582µs | 3.04% | 1.173 | 2.587 | 0.48% | 0.017µs | 1 | 200 |
| normalization/normalize_service/normalize_service/test_ASCII | throughput | 20168542.526op/s | 20704931.421op/s ± 99874.264op/s | 20781439.207op/s ± 7489.205op/s | 20786206.274op/s | 20788024.672op/s | 20788779.476op/s | 20789213.368op/s | 0.04% | -1.128 | 2.252 | 0.48% | 7062.177op/s | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... | execution_time | [504.038µs; 504.166µs] or [-0.013%; +0.013%] | None | None | None |
| normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... | throughput | [1983476.486op/s; 1983978.460op/s] or [-0.013%; +0.013%] | None | None | None |
| normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて | execution_time | [483.104µs; 483.333µs] or [-0.024%; +0.024%] | None | None | None |
| normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて | throughput | [2068979.352op/s; 2069948.343op/s] or [-0.023%; +0.023%] | None | None | None |
| normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters | execution_time | [177.884µs; 177.930µs] or [-0.013%; +0.013%] | None | None | None |
| normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters | throughput | [5620207.937op/s; 5621644.044op/s] or [-0.013%; +0.013%] | None | None | None |
| normalization/normalize_service/normalize_service/[empty string] | execution_time | [37.621µs; 37.632µs] or [-0.014%; +0.014%] | None | None | None |
| normalization/normalize_service/normalize_service/[empty string] | throughput | [26573381.740op/s; 26581024.213op/s] or [-0.014%; +0.014%] | None | None | None |
| normalization/normalize_service/normalize_service/test_ASCII | execution_time | [48.266µs; 48.331µs] or [-0.067%; +0.067%] | None | None | None |
| normalization/normalize_service/normalize_service/test_ASCII | throughput | [20691089.808op/s; 20718773.033op/s] or [-0.067%; +0.067%] | None | None | None |
Group 13
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 02a6290e | 1743168099 | julio/run-integration-tests |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| tags/replace_trace_tags | execution_time | 2.317µs | 2.361µs ± 0.017µs | 2.358µs ± 0.006µs | 2.367µs | 2.400µs | 2.405µs | 2.408µs | 2.11% | 0.626 | 1.376 | 0.70% | 0.001µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| tags/replace_trace_tags | execution_time | [2.359µs; 2.364µs] or [-0.097%; +0.097%] | None | None | None |
Baseline
Omitted due to size.