libdatadog
libdatadog copied to clipboard
Fix integration test.
What does this PR do?
Fix integration test due to a missing field in the snapshot.
Benchmarks
Comparison
Benchmark execution time: 2025-03-28 13:50:19
Comparing candidate commit 663b3bcf in PR branch julio/fix-integration-test with baseline commit 1faf4097 in branch main.
Found 0 performance improvements and 0 performance regressions! Performance is the same for 52 metrics, 2 unstable metrics.
Candidate
Candidate benchmark details
Group 1
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 663b3bcf | 1743169038 | julio/fix-integration-test |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| benching string interning on wordpress profile | execution_time | 147.164µs | 148.223µs ± 0.941µs | 148.089µs ± 0.420µs | 148.599µs | 149.317µs | 150.629µs | 157.708µs | 6.50% | 5.543 | 50.429 | 0.63% | 0.067µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| benching string interning on wordpress profile | execution_time | [148.093µs; 148.354µs] or [-0.088%; +0.088%] | None | None | None |
Group 2
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 663b3bcf | 1743169038 | julio/fix-integration-test |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| credit_card/is_card_number/ | execution_time | 3.901µs | 3.915µs ± 0.003µs | 3.915µs ± 0.001µs | 3.917µs | 3.919µs | 3.921µs | 3.921µs | 0.14% | -0.926 | 3.443 | 0.07% | 0.000µs | 1 | 200 |
| credit_card/is_card_number/ | throughput | 255038075.467op/s | 255410725.681op/s ± 179728.851op/s | 255404827.151op/s ± 94728.251op/s | 255499382.873op/s | 255703978.352op/s | 255911949.302op/s | 256355745.490op/s | 0.37% | 0.936 | 3.487 | 0.07% | 12708.749op/s | 1 | 200 |
| credit_card/is_card_number/ 3782-8224-6310-005 | execution_time | 81.716µs | 82.163µs ± 0.554µs | 82.013µs ± 0.134µs | 82.256µs | 82.829µs | 84.253µs | 87.630µs | 6.85% | 5.895 | 48.926 | 0.67% | 0.039µs | 1 | 200 |
| credit_card/is_card_number/ 3782-8224-6310-005 | throughput | 11411638.375op/s | 12171532.584op/s ± 79047.848op/s | 12193148.061op/s ± 19977.089op/s | 12208371.903op/s | 12222935.056op/s | 12228892.273op/s | 12237441.677op/s | 0.36% | -5.584 | 44.447 | 0.65% | 5589.527op/s | 1 | 200 |
| credit_card/is_card_number/ 378282246310005 | execution_time | 76.330µs | 76.747µs ± 0.358µs | 76.630µs ± 0.187µs | 76.960µs | 77.394µs | 77.701µs | 78.461µs | 2.39% | 1.623 | 3.914 | 0.46% | 0.025µs | 1 | 200 |
| credit_card/is_card_number/ 378282246310005 | throughput | 12745145.826op/s | 13030105.366op/s ± 60257.500op/s | 13049639.484op/s ± 31965.164op/s | 13075833.898op/s | 13090690.960op/s | 13100057.942op/s | 13100936.717op/s | 0.39% | -1.578 | 3.650 | 0.46% | 4260.849op/s | 1 | 200 |
| credit_card/is_card_number/37828224631 | execution_time | 3.897µs | 3.915µs ± 0.003µs | 3.916µs ± 0.001µs | 3.917µs | 3.919µs | 3.921µs | 3.925µs | 0.23% | -1.459 | 9.443 | 0.07% | 0.000µs | 1 | 200 |
| credit_card/is_card_number/37828224631 | throughput | 254807445.286op/s | 255398090.382op/s ± 185788.331op/s | 255392427.636op/s ± 94377.146op/s | 255479319.944op/s | 255687845.714op/s | 255879807.670op/s | 256633122.152op/s | 0.49% | 1.480 | 9.573 | 0.07% | 13137.219op/s | 1 | 200 |
| credit_card/is_card_number/378282246310005 | execution_time | 71.956µs | 72.359µs ± 0.480µs | 72.240µs ± 0.210µs | 72.489µs | 73.101µs | 74.186µs | 75.749µs | 4.86% | 3.348 | 17.148 | 0.66% | 0.034µs | 1 | 200 |
| credit_card/is_card_number/378282246310005 | throughput | 13201521.993op/s | 13820518.748op/s ± 89692.874op/s | 13842783.955op/s ± 40259.649op/s | 13880331.224op/s | 13891429.544op/s | 13896187.011op/s | 13897367.839op/s | 0.39% | -3.196 | 15.749 | 0.65% | 6342.244op/s | 1 | 200 |
| credit_card/is_card_number/37828224631000521389798 | execution_time | 51.849µs | 52.153µs ± 0.104µs | 52.152µs ± 0.075µs | 52.227µs | 52.319µs | 52.372µs | 52.387µs | 0.45% | -0.125 | -0.305 | 0.20% | 0.007µs | 1 | 200 |
| credit_card/is_card_number/37828224631000521389798 | throughput | 19088671.053op/s | 19174286.591op/s ± 38255.390op/s | 19174772.710op/s ± 27454.689op/s | 19199856.001op/s | 19237184.323op/s | 19258416.996op/s | 19286592.945op/s | 0.58% | 0.135 | -0.299 | 0.20% | 2705.065op/s | 1 | 200 |
| credit_card/is_card_number/x371413321323331 | execution_time | 6.430µs | 6.443µs ± 0.005µs | 6.443µs ± 0.003µs | 6.446µs | 6.450µs | 6.453µs | 6.461µs | 0.28% | -0.000 | 0.533 | 0.08% | 0.000µs | 1 | 200 |
| credit_card/is_card_number/x371413321323331 | throughput | 154778183.018op/s | 155211170.893op/s ± 119191.326op/s | 155209266.009op/s ± 72600.553op/s | 155285305.983op/s | 155426159.078op/s | 155485118.775op/s | 155530346.456op/s | 0.21% | 0.006 | 0.529 | 0.08% | 8428.100op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/ | execution_time | 3.899µs | 3.915µs ± 0.003µs | 3.915µs ± 0.002µs | 3.917µs | 3.920µs | 3.923µs | 3.938µs | 0.59% | 0.910 | 10.005 | 0.09% | 0.000µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/ | throughput | 253939416.657op/s | 255418730.003op/s ± 227087.764op/s | 255430753.897op/s ± 123962.492op/s | 255534928.867op/s | 255748664.712op/s | 255927809.398op/s | 256466850.806op/s | 0.41% | -0.880 | 9.874 | 0.09% | 16057.530op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 | execution_time | 64.011µs | 64.294µs ± 0.141µs | 64.258µs ± 0.054µs | 64.332µs | 64.591µs | 64.745µs | 65.104µs | 1.32% | 1.924 | 6.132 | 0.22% | 0.010µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 | throughput | 15360114.941op/s | 15553508.223op/s ± 33897.773op/s | 15562362.427op/s ± 13045.423op/s | 15571937.035op/s | 15587043.037op/s | 15612542.287op/s | 15622347.768op/s | 0.39% | -1.895 | 5.956 | 0.22% | 2396.934op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/ 378282246310005 | execution_time | 58.175µs | 58.303µs ± 0.075µs | 58.290µs ± 0.022µs | 58.312µs | 58.463µs | 58.624µs | 58.678µs | 0.67% | 2.742 | 9.131 | 0.13% | 0.005µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/ 378282246310005 | throughput | 17042126.850op/s | 17151679.910op/s ± 21887.046op/s | 17155713.384op/s ± 6582.767op/s | 17162183.986op/s | 17173402.607op/s | 17183995.486op/s | 17189504.089op/s | 0.20% | -2.729 | 9.058 | 0.13% | 1547.648op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/37828224631 | execution_time | 3.903µs | 3.915µs ± 0.003µs | 3.915µs ± 0.002µs | 3.917µs | 3.920µs | 3.922µs | 3.928µs | 0.32% | -0.183 | 1.716 | 0.08% | 0.000µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/37828224631 | throughput | 254602449.983op/s | 255428661.600op/s ± 213933.297op/s | 255422428.271op/s ± 123820.577op/s | 255542170.847op/s | 255816643.539op/s | 255940016.685op/s | 256243798.875op/s | 0.32% | 0.192 | 1.716 | 0.08% | 15127.369op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/378282246310005 | execution_time | 54.546µs | 54.785µs ± 0.218µs | 54.684µs ± 0.052µs | 54.835µs | 55.222µs | 55.552µs | 55.615µs | 1.70% | 1.749 | 2.515 | 0.40% | 0.015µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/378282246310005 | throughput | 17980799.454op/s | 18253588.134op/s ± 72070.545op/s | 18286720.184op/s ± 17540.134op/s | 18300139.539op/s | 18308588.742op/s | 18326722.323op/s | 18333074.700op/s | 0.25% | -1.732 | 2.431 | 0.39% | 5096.157op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/37828224631000521389798 | execution_time | 51.925µs | 52.146µs ± 0.094µs | 52.140µs ± 0.061µs | 52.215µs | 52.291µs | 52.331µs | 52.601µs | 0.88% | 0.335 | 1.953 | 0.18% | 0.007µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/37828224631000521389798 | throughput | 19010917.415op/s | 19176875.373op/s ± 34499.285op/s | 19179035.397op/s ± 22412.687op/s | 19196977.917op/s | 19236558.025op/s | 19256977.622op/s | 19258586.546op/s | 0.41% | -0.315 | 1.882 | 0.18% | 2439.468op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/x371413321323331 | execution_time | 6.429µs | 6.443µs ± 0.004µs | 6.443µs ± 0.003µs | 6.446µs | 6.449µs | 6.452µs | 6.455µs | 0.19% | -0.355 | 0.623 | 0.07% | 0.000µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/x371413321323331 | throughput | 154908848.819op/s | 155207002.632op/s ± 105317.820op/s | 155208575.274op/s ± 60868.986op/s | 155265257.994op/s | 155421613.348op/s | 155460017.563op/s | 155542255.178op/s | 0.21% | 0.360 | 0.628 | 0.07% | 7447.094op/s | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| credit_card/is_card_number/ | execution_time | [3.915µs; 3.916µs] or [-0.010%; +0.010%] | None | None | None |
| credit_card/is_card_number/ | throughput | [255385816.991op/s; 255435634.371op/s] or [-0.010%; +0.010%] | None | None | None |
| credit_card/is_card_number/ 3782-8224-6310-005 | execution_time | [82.086µs; 82.239µs] or [-0.093%; +0.093%] | None | None | None |
| credit_card/is_card_number/ 3782-8224-6310-005 | throughput | [12160577.313op/s; 12182487.856op/s] or [-0.090%; +0.090%] | None | None | None |
| credit_card/is_card_number/ 378282246310005 | execution_time | [76.697µs; 76.797µs] or [-0.065%; +0.065%] | None | None | None |
| credit_card/is_card_number/ 378282246310005 | throughput | [13021754.257op/s; 13038456.476op/s] or [-0.064%; +0.064%] | None | None | None |
| credit_card/is_card_number/37828224631 | execution_time | [3.915µs; 3.916µs] or [-0.010%; +0.010%] | None | None | None |
| credit_card/is_card_number/37828224631 | throughput | [255372341.906op/s; 255423838.858op/s] or [-0.010%; +0.010%] | None | None | None |
| credit_card/is_card_number/378282246310005 | execution_time | [72.293µs; 72.426µs] or [-0.092%; +0.092%] | None | None | None |
| credit_card/is_card_number/378282246310005 | throughput | [13808088.179op/s; 13832949.318op/s] or [-0.090%; +0.090%] | None | None | None |
| credit_card/is_card_number/37828224631000521389798 | execution_time | [52.139µs; 52.168µs] or [-0.028%; +0.028%] | None | None | None |
| credit_card/is_card_number/37828224631000521389798 | throughput | [19168984.762op/s; 19179588.420op/s] or [-0.028%; +0.028%] | None | None | None |
| credit_card/is_card_number/x371413321323331 | execution_time | [6.442µs; 6.444µs] or [-0.011%; +0.011%] | None | None | None |
| credit_card/is_card_number/x371413321323331 | throughput | [155194652.122op/s; 155227689.665op/s] or [-0.011%; +0.011%] | None | None | None |
| credit_card/is_card_number_no_luhn/ | execution_time | [3.915µs; 3.916µs] or [-0.012%; +0.012%] | None | None | None |
| credit_card/is_card_number_no_luhn/ | throughput | [255387257.823op/s; 255450202.183op/s] or [-0.012%; +0.012%] | None | None | None |
| credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 | execution_time | [64.275µs; 64.314µs] or [-0.030%; +0.030%] | None | None | None |
| credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 | throughput | [15548810.318op/s; 15558206.129op/s] or [-0.030%; +0.030%] | None | None | None |
| credit_card/is_card_number_no_luhn/ 378282246310005 | execution_time | [58.293µs; 58.314µs] or [-0.018%; +0.018%] | None | None | None |
| credit_card/is_card_number_no_luhn/ 378282246310005 | throughput | [17148646.576op/s; 17154713.244op/s] or [-0.018%; +0.018%] | None | None | None |
| credit_card/is_card_number_no_luhn/37828224631 | execution_time | [3.915µs; 3.915µs] or [-0.012%; +0.012%] | None | None | None |
| credit_card/is_card_number_no_luhn/37828224631 | throughput | [255399012.503op/s; 255458310.698op/s] or [-0.012%; +0.012%] | None | None | None |
| credit_card/is_card_number_no_luhn/378282246310005 | execution_time | [54.754µs; 54.815µs] or [-0.055%; +0.055%] | None | None | None |
| credit_card/is_card_number_no_luhn/378282246310005 | throughput | [18243599.849op/s; 18263576.418op/s] or [-0.055%; +0.055%] | None | None | None |
| credit_card/is_card_number_no_luhn/37828224631000521389798 | execution_time | [52.133µs; 52.159µs] or [-0.025%; +0.025%] | None | None | None |
| credit_card/is_card_number_no_luhn/37828224631000521389798 | throughput | [19172094.104op/s; 19181656.642op/s] or [-0.025%; +0.025%] | None | None | None |
| credit_card/is_card_number_no_luhn/x371413321323331 | execution_time | [6.442µs; 6.444µs] or [-0.009%; +0.009%] | None | None | None |
| credit_card/is_card_number_no_luhn/x371413321323331 | throughput | [155192406.595op/s; 155221598.669op/s] or [-0.009%; +0.009%] | None | None | None |
Group 3
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 663b3bcf | 1743169038 | julio/fix-integration-test |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| normalization/normalize_trace/test_trace | execution_time | 246.910ns | 257.128ns ± 10.864ns | 251.186ns ± 2.543ns | 261.512ns | 282.980ns | 286.066ns | 288.563ns | 14.88% | 1.290 | 0.475 | 4.21% | 0.768ns | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| normalization/normalize_trace/test_trace | execution_time | [255.622ns; 258.634ns] or [-0.586%; +0.586%] | None | None | None |
Group 4
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 663b3bcf | 1743169038 | julio/fix-integration-test |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... | execution_time | 502.753µs | 504.463µs ± 0.989µs | 504.275µs ± 0.551µs | 505.041µs | 505.928µs | 506.171µs | 512.584µs | 1.65% | 2.915 | 20.939 | 0.20% | 0.070µs | 1 | 200 |
| normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... | throughput | 1950899.966op/s | 1982314.712op/s ± 3864.886op/s | 1983044.310op/s ± 2168.501op/s | 1984759.200op/s | 1986873.861op/s | 1987820.869op/s | 1989048.080op/s | 0.30% | -2.832 | 20.047 | 0.19% | 273.289op/s | 1 | 200 |
| normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて | execution_time | 454.025µs | 455.309µs ± 0.553µs | 455.267µs ± 0.386µs | 455.733µs | 456.183µs | 456.485µs | 456.791µs | 0.33% | 0.044 | -0.425 | 0.12% | 0.039µs | 1 | 200 |
| normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて | throughput | 2189184.988op/s | 2196311.701op/s ± 2665.413op/s | 2196512.531op/s ± 1862.446op/s | 2198069.771op/s | 2200716.030op/s | 2202091.393op/s | 2202523.585op/s | 0.27% | -0.038 | -0.427 | 0.12% | 188.473op/s | 1 | 200 |
| normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters | execution_time | 177.294µs | 177.734µs ± 0.516µs | 177.665µs ± 0.086µs | 177.780µs | 177.952µs | 178.072µs | 182.723µs | 2.85% | 8.848 | 82.212 | 0.29% | 0.036µs | 1 | 200 |
| normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters | throughput | 5472766.247op/s | 5626446.554op/s ± 15915.701op/s | 5628576.033op/s ± 2734.382op/s | 5630627.924op/s | 5633980.333op/s | 5639316.439op/s | 5640349.575op/s | 0.21% | -8.796 | 81.560 | 0.28% | 1125.410op/s | 1 | 200 |
| normalization/normalize_service/normalize_service/[empty string] | execution_time | 37.559µs | 37.657µs ± 0.042µs | 37.657µs ± 0.026µs | 37.683µs | 37.720µs | 37.753µs | 37.835µs | 0.47% | 0.422 | 1.109 | 0.11% | 0.003µs | 1 | 200 |
| normalization/normalize_service/normalize_service/[empty string] | throughput | 26430835.534op/s | 26555654.009op/s ± 29521.973op/s | 26555766.166op/s ± 18413.597op/s | 26573691.965op/s | 26603858.589op/s | 26614981.997op/s | 26624994.516op/s | 0.26% | -0.412 | 1.083 | 0.11% | 2087.519op/s | 1 | 200 |
| normalization/normalize_service/normalize_service/test_ASCII | execution_time | 48.097µs | 48.321µs ± 0.206µs | 48.259µs ± 0.156µs | 48.528µs | 48.637µs | 48.701µs | 48.815µs | 1.15% | 0.312 | -1.459 | 0.42% | 0.015µs | 1 | 200 |
| normalization/normalize_service/normalize_service/test_ASCII | throughput | 20485460.388op/s | 20695322.584op/s ± 88057.081op/s | 20721665.002op/s ± 67168.425op/s | 20786491.156op/s | 20789439.203op/s | 20790731.706op/s | 20791308.045op/s | 0.34% | -0.307 | -1.467 | 0.42% | 6226.576op/s | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... | execution_time | [504.326µs; 504.600µs] or [-0.027%; +0.027%] | None | None | None |
| normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... | throughput | [1981779.076op/s; 1982850.348op/s] or [-0.027%; +0.027%] | None | None | None |
| normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて | execution_time | [455.233µs; 455.386µs] or [-0.017%; +0.017%] | None | None | None |
| normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて | throughput | [2195942.300op/s; 2196681.102op/s] or [-0.017%; +0.017%] | None | None | None |
| normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters | execution_time | [177.662µs; 177.805µs] or [-0.040%; +0.040%] | None | None | None |
| normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters | throughput | [5624240.791op/s; 5628652.317op/s] or [-0.039%; +0.039%] | None | None | None |
| normalization/normalize_service/normalize_service/[empty string] | execution_time | [37.651µs; 37.663µs] or [-0.015%; +0.015%] | None | None | None |
| normalization/normalize_service/normalize_service/[empty string] | throughput | [26551562.548op/s; 26559745.471op/s] or [-0.015%; +0.015%] | None | None | None |
| normalization/normalize_service/normalize_service/test_ASCII | execution_time | [48.292µs; 48.350µs] or [-0.059%; +0.059%] | None | None | None |
| normalization/normalize_service/normalize_service/test_ASCII | throughput | [20683118.719op/s; 20707526.448op/s] or [-0.059%; +0.059%] | None | None | None |
Group 5
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 663b3bcf | 1743169038 | julio/fix-integration-test |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| concentrator/add_spans_to_concentrator | execution_time | 6.020ms | 6.037ms ± 0.007ms | 6.036ms ± 0.004ms | 6.040ms | 6.046ms | 6.071ms | 6.090ms | 0.89% | 2.740 | 15.444 | 0.12% | 0.001ms | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| concentrator/add_spans_to_concentrator | execution_time | [6.036ms; 6.038ms] or [-0.017%; +0.017%] | None | None | None |
Group 6
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 663b3bcf | 1743169038 | julio/fix-integration-test |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| write only interface | execution_time | 1.252µs | 3.210µs ± 1.511µs | 3.005µs ± 0.027µs | 3.029µs | 3.659µs | 13.927µs | 16.968µs | 464.63% | 7.592 | 59.205 | 46.95% | 0.107µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| write only interface | execution_time | [3.001µs; 3.419µs] or [-6.523%; +6.523%] | None | None | None |
Group 7
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 663b3bcf | 1743169038 | julio/fix-integration-test |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| ip_address/quantize_peer_ip_address_benchmark | execution_time | 4.949µs | 5.018µs ± 0.044µs | 5.017µs ± 0.038µs | 5.055µs | 5.088µs | 5.092µs | 5.094µs | 1.54% | 0.412 | -1.324 | 0.88% | 0.003µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| ip_address/quantize_peer_ip_address_benchmark | execution_time | [5.012µs; 5.024µs] or [-0.122%; +0.122%] | None | None | None |
Group 8
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 663b3bcf | 1743169038 | julio/fix-integration-test |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| tags/replace_trace_tags | execution_time | 2.344µs | 2.394µs ± 0.016µs | 2.393µs ± 0.006µs | 2.400µs | 2.420µs | 2.430µs | 2.456µs | 2.62% | -0.334 | 2.493 | 0.68% | 0.001µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| tags/replace_trace_tags | execution_time | [2.392µs; 2.396µs] or [-0.095%; +0.095%] | None | None | None |
Group 9
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 663b3bcf | 1743169038 | julio/fix-integration-test |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| two way interface | execution_time | 17.378µs | 25.599µs ± 11.313µs | 17.585µs ± 0.105µs | 35.367µs | 41.962µs | 54.853µs | 96.745µs | 450.16% | 2.030 | 7.962 | 44.08% | 0.800µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| two way interface | execution_time | [24.031µs; 27.167µs] or [-6.125%; +6.125%] | None | None | None |
Group 10
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 663b3bcf | 1743169038 | julio/fix-integration-test |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| benching deserializing traces from msgpack to their internal representation | execution_time | 56.816ms | 57.047ms ± 0.129ms | 57.032ms ± 0.062ms | 57.091ms | 57.300ms | 57.450ms | 57.799ms | 1.34% | 1.877 | 6.607 | 0.23% | 0.009ms | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| benching deserializing traces from msgpack to their internal representation | execution_time | [57.029ms; 57.065ms] or [-0.031%; +0.031%] | None | None | None |
Group 11
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 663b3bcf | 1743169038 | julio/fix-integration-test |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| redis/obfuscate_redis_string | execution_time | 32.764µs | 33.582µs ± 1.046µs | 32.987µs ± 0.155µs | 34.776µs | 35.467µs | 35.556µs | 36.824µs | 11.63% | 1.009 | -0.686 | 3.11% | 0.074µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| redis/obfuscate_redis_string | execution_time | [33.437µs; 33.727µs] or [-0.432%; +0.432%] | None | None | None |
Group 12
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 663b3bcf | 1743169038 | julio/fix-integration-test |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... | execution_time | 208.734µs | 209.204µs ± 0.165µs | 209.201µs ± 0.098µs | 209.302µs | 209.457µs | 209.578µs | 209.733µs | 0.25% | -0.035 | 0.380 | 0.08% | 0.012µs | 1 | 200 |
| normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... | throughput | 4767971.312op/s | 4780016.010op/s ± 3764.156op/s | 4780083.622op/s ± 2241.120op/s | 4782285.141op/s | 4786150.571op/s | 4788565.838op/s | 4790791.460op/s | 0.22% | 0.041 | 0.378 | 0.08% | 266.166op/s | 1 | 200 |
| normalization/normalize_name/normalize_name/bad-name | execution_time | 18.598µs | 18.695µs ± 0.052µs | 18.709µs ± 0.034µs | 18.731µs | 18.763µs | 18.789µs | 18.817µs | 0.58% | -0.463 | -0.764 | 0.28% | 0.004µs | 1 | 200 |
| normalization/normalize_name/normalize_name/bad-name | throughput | 53143003.318op/s | 53491909.609op/s ± 149122.888op/s | 53451191.723op/s ± 95894.318op/s | 53602539.238op/s | 53760635.010op/s | 53767351.169op/s | 53769320.502op/s | 0.60% | 0.472 | -0.762 | 0.28% | 10544.581op/s | 1 | 200 |
| normalization/normalize_name/normalize_name/good | execution_time | 10.906µs | 10.967µs ± 0.037µs | 10.969µs ± 0.029µs | 10.994µs | 11.024µs | 11.039µs | 11.056µs | 0.79% | 0.050 | -0.993 | 0.33% | 0.003µs | 1 | 200 |
| normalization/normalize_name/normalize_name/good | throughput | 90447807.093op/s | 91183655.846op/s ± 303438.424op/s | 91165374.096op/s ± 239034.686op/s | 91427285.473op/s | 91631622.283op/s | 91674912.389op/s | 91694974.551op/s | 0.58% | -0.040 | -1.000 | 0.33% | 21456.337op/s | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... | execution_time | [209.182µs; 209.227µs] or [-0.011%; +0.011%] | None | None | None |
| normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... | throughput | [4779494.334op/s; 4780537.686op/s] or [-0.011%; +0.011%] | None | None | None |
| normalization/normalize_name/normalize_name/bad-name | execution_time | [18.687µs; 18.702µs] or [-0.039%; +0.039%] | None | None | None |
| normalization/normalize_name/normalize_name/bad-name | throughput | [53471242.611op/s; 53512576.607op/s] or [-0.039%; +0.039%] | None | None | None |
| normalization/normalize_name/normalize_name/good | execution_time | [10.962µs; 10.972µs] or [-0.046%; +0.046%] | None | None | None |
| normalization/normalize_name/normalize_name/good | throughput | [91141602.199op/s; 91225709.493op/s] or [-0.046%; +0.046%] | None | None | None |
Group 13
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 663b3bcf | 1743169038 | julio/fix-integration-test |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| sql/obfuscate_sql_string | execution_time | 66.208µs | 66.432µs ± 0.217µs | 66.408µs ± 0.042µs | 66.451µs | 66.549µs | 67.118µs | 69.050µs | 3.98% | 9.278 | 105.717 | 0.33% | 0.015µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| sql/obfuscate_sql_string | execution_time | [66.402µs; 66.462µs] or [-0.045%; +0.045%] | None | None | None |
Baseline
Omitted due to size.