libdatadog icon indicating copy to clipboard operation
libdatadog copied to clipboard

Fix integration test.

Open hoolioh opened this issue 8 months ago • 1 comments

What does this PR do?

Fix integration test due to a missing field in the snapshot.

hoolioh avatar Mar 28 '25 11:03 hoolioh

Benchmarks

Comparison

Benchmark execution time: 2025-03-28 13:50:19

Comparing candidate commit 663b3bcf in PR branch julio/fix-integration-test with baseline commit 1faf4097 in branch main.

Found 0 performance improvements and 0 performance regressions! Performance is the same for 52 metrics, 2 unstable metrics.

Candidate

Candidate benchmark details

Group 1

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 663b3bcf 1743169038 julio/fix-integration-test
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching string interning on wordpress profile execution_time 147.164µs 148.223µs ± 0.941µs 148.089µs ± 0.420µs 148.599µs 149.317µs 150.629µs 157.708µs 6.50% 5.543 50.429 0.63% 0.067µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching string interning on wordpress profile execution_time [148.093µs; 148.354µs] or [-0.088%; +0.088%] None None None

Group 2

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 663b3bcf 1743169038 julio/fix-integration-test
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
credit_card/is_card_number/ execution_time 3.901µs 3.915µs ± 0.003µs 3.915µs ± 0.001µs 3.917µs 3.919µs 3.921µs 3.921µs 0.14% -0.926 3.443 0.07% 0.000µs 1 200
credit_card/is_card_number/ throughput 255038075.467op/s 255410725.681op/s ± 179728.851op/s 255404827.151op/s ± 94728.251op/s 255499382.873op/s 255703978.352op/s 255911949.302op/s 256355745.490op/s 0.37% 0.936 3.487 0.07% 12708.749op/s 1 200
credit_card/is_card_number/ 3782-8224-6310-005 execution_time 81.716µs 82.163µs ± 0.554µs 82.013µs ± 0.134µs 82.256µs 82.829µs 84.253µs 87.630µs 6.85% 5.895 48.926 0.67% 0.039µs 1 200
credit_card/is_card_number/ 3782-8224-6310-005 throughput 11411638.375op/s 12171532.584op/s ± 79047.848op/s 12193148.061op/s ± 19977.089op/s 12208371.903op/s 12222935.056op/s 12228892.273op/s 12237441.677op/s 0.36% -5.584 44.447 0.65% 5589.527op/s 1 200
credit_card/is_card_number/ 378282246310005 execution_time 76.330µs 76.747µs ± 0.358µs 76.630µs ± 0.187µs 76.960µs 77.394µs 77.701µs 78.461µs 2.39% 1.623 3.914 0.46% 0.025µs 1 200
credit_card/is_card_number/ 378282246310005 throughput 12745145.826op/s 13030105.366op/s ± 60257.500op/s 13049639.484op/s ± 31965.164op/s 13075833.898op/s 13090690.960op/s 13100057.942op/s 13100936.717op/s 0.39% -1.578 3.650 0.46% 4260.849op/s 1 200
credit_card/is_card_number/37828224631 execution_time 3.897µs 3.915µs ± 0.003µs 3.916µs ± 0.001µs 3.917µs 3.919µs 3.921µs 3.925µs 0.23% -1.459 9.443 0.07% 0.000µs 1 200
credit_card/is_card_number/37828224631 throughput 254807445.286op/s 255398090.382op/s ± 185788.331op/s 255392427.636op/s ± 94377.146op/s 255479319.944op/s 255687845.714op/s 255879807.670op/s 256633122.152op/s 0.49% 1.480 9.573 0.07% 13137.219op/s 1 200
credit_card/is_card_number/378282246310005 execution_time 71.956µs 72.359µs ± 0.480µs 72.240µs ± 0.210µs 72.489µs 73.101µs 74.186µs 75.749µs 4.86% 3.348 17.148 0.66% 0.034µs 1 200
credit_card/is_card_number/378282246310005 throughput 13201521.993op/s 13820518.748op/s ± 89692.874op/s 13842783.955op/s ± 40259.649op/s 13880331.224op/s 13891429.544op/s 13896187.011op/s 13897367.839op/s 0.39% -3.196 15.749 0.65% 6342.244op/s 1 200
credit_card/is_card_number/37828224631000521389798 execution_time 51.849µs 52.153µs ± 0.104µs 52.152µs ± 0.075µs 52.227µs 52.319µs 52.372µs 52.387µs 0.45% -0.125 -0.305 0.20% 0.007µs 1 200
credit_card/is_card_number/37828224631000521389798 throughput 19088671.053op/s 19174286.591op/s ± 38255.390op/s 19174772.710op/s ± 27454.689op/s 19199856.001op/s 19237184.323op/s 19258416.996op/s 19286592.945op/s 0.58% 0.135 -0.299 0.20% 2705.065op/s 1 200
credit_card/is_card_number/x371413321323331 execution_time 6.430µs 6.443µs ± 0.005µs 6.443µs ± 0.003µs 6.446µs 6.450µs 6.453µs 6.461µs 0.28% -0.000 0.533 0.08% 0.000µs 1 200
credit_card/is_card_number/x371413321323331 throughput 154778183.018op/s 155211170.893op/s ± 119191.326op/s 155209266.009op/s ± 72600.553op/s 155285305.983op/s 155426159.078op/s 155485118.775op/s 155530346.456op/s 0.21% 0.006 0.529 0.08% 8428.100op/s 1 200
credit_card/is_card_number_no_luhn/ execution_time 3.899µs 3.915µs ± 0.003µs 3.915µs ± 0.002µs 3.917µs 3.920µs 3.923µs 3.938µs 0.59% 0.910 10.005 0.09% 0.000µs 1 200
credit_card/is_card_number_no_luhn/ throughput 253939416.657op/s 255418730.003op/s ± 227087.764op/s 255430753.897op/s ± 123962.492op/s 255534928.867op/s 255748664.712op/s 255927809.398op/s 256466850.806op/s 0.41% -0.880 9.874 0.09% 16057.530op/s 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time 64.011µs 64.294µs ± 0.141µs 64.258µs ± 0.054µs 64.332µs 64.591µs 64.745µs 65.104µs 1.32% 1.924 6.132 0.22% 0.010µs 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput 15360114.941op/s 15553508.223op/s ± 33897.773op/s 15562362.427op/s ± 13045.423op/s 15571937.035op/s 15587043.037op/s 15612542.287op/s 15622347.768op/s 0.39% -1.895 5.956 0.22% 2396.934op/s 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time 58.175µs 58.303µs ± 0.075µs 58.290µs ± 0.022µs 58.312µs 58.463µs 58.624µs 58.678µs 0.67% 2.742 9.131 0.13% 0.005µs 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 throughput 17042126.850op/s 17151679.910op/s ± 21887.046op/s 17155713.384op/s ± 6582.767op/s 17162183.986op/s 17173402.607op/s 17183995.486op/s 17189504.089op/s 0.20% -2.729 9.058 0.13% 1547.648op/s 1 200
credit_card/is_card_number_no_luhn/37828224631 execution_time 3.903µs 3.915µs ± 0.003µs 3.915µs ± 0.002µs 3.917µs 3.920µs 3.922µs 3.928µs 0.32% -0.183 1.716 0.08% 0.000µs 1 200
credit_card/is_card_number_no_luhn/37828224631 throughput 254602449.983op/s 255428661.600op/s ± 213933.297op/s 255422428.271op/s ± 123820.577op/s 255542170.847op/s 255816643.539op/s 255940016.685op/s 256243798.875op/s 0.32% 0.192 1.716 0.08% 15127.369op/s 1 200
credit_card/is_card_number_no_luhn/378282246310005 execution_time 54.546µs 54.785µs ± 0.218µs 54.684µs ± 0.052µs 54.835µs 55.222µs 55.552µs 55.615µs 1.70% 1.749 2.515 0.40% 0.015µs 1 200
credit_card/is_card_number_no_luhn/378282246310005 throughput 17980799.454op/s 18253588.134op/s ± 72070.545op/s 18286720.184op/s ± 17540.134op/s 18300139.539op/s 18308588.742op/s 18326722.323op/s 18333074.700op/s 0.25% -1.732 2.431 0.39% 5096.157op/s 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time 51.925µs 52.146µs ± 0.094µs 52.140µs ± 0.061µs 52.215µs 52.291µs 52.331µs 52.601µs 0.88% 0.335 1.953 0.18% 0.007µs 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput 19010917.415op/s 19176875.373op/s ± 34499.285op/s 19179035.397op/s ± 22412.687op/s 19196977.917op/s 19236558.025op/s 19256977.622op/s 19258586.546op/s 0.41% -0.315 1.882 0.18% 2439.468op/s 1 200
credit_card/is_card_number_no_luhn/x371413321323331 execution_time 6.429µs 6.443µs ± 0.004µs 6.443µs ± 0.003µs 6.446µs 6.449µs 6.452µs 6.455µs 0.19% -0.355 0.623 0.07% 0.000µs 1 200
credit_card/is_card_number_no_luhn/x371413321323331 throughput 154908848.819op/s 155207002.632op/s ± 105317.820op/s 155208575.274op/s ± 60868.986op/s 155265257.994op/s 155421613.348op/s 155460017.563op/s 155542255.178op/s 0.21% 0.360 0.628 0.07% 7447.094op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
credit_card/is_card_number/ execution_time [3.915µs; 3.916µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/ throughput [255385816.991op/s; 255435634.371op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 execution_time [82.086µs; 82.239µs] or [-0.093%; +0.093%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 throughput [12160577.313op/s; 12182487.856op/s] or [-0.090%; +0.090%] None None None
credit_card/is_card_number/ 378282246310005 execution_time [76.697µs; 76.797µs] or [-0.065%; +0.065%] None None None
credit_card/is_card_number/ 378282246310005 throughput [13021754.257op/s; 13038456.476op/s] or [-0.064%; +0.064%] None None None
credit_card/is_card_number/37828224631 execution_time [3.915µs; 3.916µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/37828224631 throughput [255372341.906op/s; 255423838.858op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/378282246310005 execution_time [72.293µs; 72.426µs] or [-0.092%; +0.092%] None None None
credit_card/is_card_number/378282246310005 throughput [13808088.179op/s; 13832949.318op/s] or [-0.090%; +0.090%] None None None
credit_card/is_card_number/37828224631000521389798 execution_time [52.139µs; 52.168µs] or [-0.028%; +0.028%] None None None
credit_card/is_card_number/37828224631000521389798 throughput [19168984.762op/s; 19179588.420op/s] or [-0.028%; +0.028%] None None None
credit_card/is_card_number/x371413321323331 execution_time [6.442µs; 6.444µs] or [-0.011%; +0.011%] None None None
credit_card/is_card_number/x371413321323331 throughput [155194652.122op/s; 155227689.665op/s] or [-0.011%; +0.011%] None None None
credit_card/is_card_number_no_luhn/ execution_time [3.915µs; 3.916µs] or [-0.012%; +0.012%] None None None
credit_card/is_card_number_no_luhn/ throughput [255387257.823op/s; 255450202.183op/s] or [-0.012%; +0.012%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time [64.275µs; 64.314µs] or [-0.030%; +0.030%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput [15548810.318op/s; 15558206.129op/s] or [-0.030%; +0.030%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time [58.293µs; 58.314µs] or [-0.018%; +0.018%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 throughput [17148646.576op/s; 17154713.244op/s] or [-0.018%; +0.018%] None None None
credit_card/is_card_number_no_luhn/37828224631 execution_time [3.915µs; 3.915µs] or [-0.012%; +0.012%] None None None
credit_card/is_card_number_no_luhn/37828224631 throughput [255399012.503op/s; 255458310.698op/s] or [-0.012%; +0.012%] None None None
credit_card/is_card_number_no_luhn/378282246310005 execution_time [54.754µs; 54.815µs] or [-0.055%; +0.055%] None None None
credit_card/is_card_number_no_luhn/378282246310005 throughput [18243599.849op/s; 18263576.418op/s] or [-0.055%; +0.055%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time [52.133µs; 52.159µs] or [-0.025%; +0.025%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput [19172094.104op/s; 19181656.642op/s] or [-0.025%; +0.025%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 execution_time [6.442µs; 6.444µs] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 throughput [155192406.595op/s; 155221598.669op/s] or [-0.009%; +0.009%] None None None

Group 3

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 663b3bcf 1743169038 julio/fix-integration-test
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_trace/test_trace execution_time 246.910ns 257.128ns ± 10.864ns 251.186ns ± 2.543ns 261.512ns 282.980ns 286.066ns 288.563ns 14.88% 1.290 0.475 4.21% 0.768ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_trace/test_trace execution_time [255.622ns; 258.634ns] or [-0.586%; +0.586%] None None None

Group 4

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 663b3bcf 1743169038 julio/fix-integration-test
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time 502.753µs 504.463µs ± 0.989µs 504.275µs ± 0.551µs 505.041µs 505.928µs 506.171µs 512.584µs 1.65% 2.915 20.939 0.20% 0.070µs 1 200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput 1950899.966op/s 1982314.712op/s ± 3864.886op/s 1983044.310op/s ± 2168.501op/s 1984759.200op/s 1986873.861op/s 1987820.869op/s 1989048.080op/s 0.30% -2.832 20.047 0.19% 273.289op/s 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time 454.025µs 455.309µs ± 0.553µs 455.267µs ± 0.386µs 455.733µs 456.183µs 456.485µs 456.791µs 0.33% 0.044 -0.425 0.12% 0.039µs 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput 2189184.988op/s 2196311.701op/s ± 2665.413op/s 2196512.531op/s ± 1862.446op/s 2198069.771op/s 2200716.030op/s 2202091.393op/s 2202523.585op/s 0.27% -0.038 -0.427 0.12% 188.473op/s 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time 177.294µs 177.734µs ± 0.516µs 177.665µs ± 0.086µs 177.780µs 177.952µs 178.072µs 182.723µs 2.85% 8.848 82.212 0.29% 0.036µs 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput 5472766.247op/s 5626446.554op/s ± 15915.701op/s 5628576.033op/s ± 2734.382op/s 5630627.924op/s 5633980.333op/s 5639316.439op/s 5640349.575op/s 0.21% -8.796 81.560 0.28% 1125.410op/s 1 200
normalization/normalize_service/normalize_service/[empty string] execution_time 37.559µs 37.657µs ± 0.042µs 37.657µs ± 0.026µs 37.683µs 37.720µs 37.753µs 37.835µs 0.47% 0.422 1.109 0.11% 0.003µs 1 200
normalization/normalize_service/normalize_service/[empty string] throughput 26430835.534op/s 26555654.009op/s ± 29521.973op/s 26555766.166op/s ± 18413.597op/s 26573691.965op/s 26603858.589op/s 26614981.997op/s 26624994.516op/s 0.26% -0.412 1.083 0.11% 2087.519op/s 1 200
normalization/normalize_service/normalize_service/test_ASCII execution_time 48.097µs 48.321µs ± 0.206µs 48.259µs ± 0.156µs 48.528µs 48.637µs 48.701µs 48.815µs 1.15% 0.312 -1.459 0.42% 0.015µs 1 200
normalization/normalize_service/normalize_service/test_ASCII throughput 20485460.388op/s 20695322.584op/s ± 88057.081op/s 20721665.002op/s ± 67168.425op/s 20786491.156op/s 20789439.203op/s 20790731.706op/s 20791308.045op/s 0.34% -0.307 -1.467 0.42% 6226.576op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time [504.326µs; 504.600µs] or [-0.027%; +0.027%] None None None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput [1981779.076op/s; 1982850.348op/s] or [-0.027%; +0.027%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time [455.233µs; 455.386µs] or [-0.017%; +0.017%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput [2195942.300op/s; 2196681.102op/s] or [-0.017%; +0.017%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time [177.662µs; 177.805µs] or [-0.040%; +0.040%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput [5624240.791op/s; 5628652.317op/s] or [-0.039%; +0.039%] None None None
normalization/normalize_service/normalize_service/[empty string] execution_time [37.651µs; 37.663µs] or [-0.015%; +0.015%] None None None
normalization/normalize_service/normalize_service/[empty string] throughput [26551562.548op/s; 26559745.471op/s] or [-0.015%; +0.015%] None None None
normalization/normalize_service/normalize_service/test_ASCII execution_time [48.292µs; 48.350µs] or [-0.059%; +0.059%] None None None
normalization/normalize_service/normalize_service/test_ASCII throughput [20683118.719op/s; 20707526.448op/s] or [-0.059%; +0.059%] None None None

Group 5

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 663b3bcf 1743169038 julio/fix-integration-test
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
concentrator/add_spans_to_concentrator execution_time 6.020ms 6.037ms ± 0.007ms 6.036ms ± 0.004ms 6.040ms 6.046ms 6.071ms 6.090ms 0.89% 2.740 15.444 0.12% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
concentrator/add_spans_to_concentrator execution_time [6.036ms; 6.038ms] or [-0.017%; +0.017%] None None None

Group 6

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 663b3bcf 1743169038 julio/fix-integration-test
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
write only interface execution_time 1.252µs 3.210µs ± 1.511µs 3.005µs ± 0.027µs 3.029µs 3.659µs 13.927µs 16.968µs 464.63% 7.592 59.205 46.95% 0.107µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
write only interface execution_time [3.001µs; 3.419µs] or [-6.523%; +6.523%] None None None

Group 7

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 663b3bcf 1743169038 julio/fix-integration-test
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
ip_address/quantize_peer_ip_address_benchmark execution_time 4.949µs 5.018µs ± 0.044µs 5.017µs ± 0.038µs 5.055µs 5.088µs 5.092µs 5.094µs 1.54% 0.412 -1.324 0.88% 0.003µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
ip_address/quantize_peer_ip_address_benchmark execution_time [5.012µs; 5.024µs] or [-0.122%; +0.122%] None None None

Group 8

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 663b3bcf 1743169038 julio/fix-integration-test
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
tags/replace_trace_tags execution_time 2.344µs 2.394µs ± 0.016µs 2.393µs ± 0.006µs 2.400µs 2.420µs 2.430µs 2.456µs 2.62% -0.334 2.493 0.68% 0.001µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
tags/replace_trace_tags execution_time [2.392µs; 2.396µs] or [-0.095%; +0.095%] None None None

Group 9

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 663b3bcf 1743169038 julio/fix-integration-test
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
two way interface execution_time 17.378µs 25.599µs ± 11.313µs 17.585µs ± 0.105µs 35.367µs 41.962µs 54.853µs 96.745µs 450.16% 2.030 7.962 44.08% 0.800µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
two way interface execution_time [24.031µs; 27.167µs] or [-6.125%; +6.125%] None None None

Group 10

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 663b3bcf 1743169038 julio/fix-integration-test
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching deserializing traces from msgpack to their internal representation execution_time 56.816ms 57.047ms ± 0.129ms 57.032ms ± 0.062ms 57.091ms 57.300ms 57.450ms 57.799ms 1.34% 1.877 6.607 0.23% 0.009ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching deserializing traces from msgpack to their internal representation execution_time [57.029ms; 57.065ms] or [-0.031%; +0.031%] None None None

Group 11

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 663b3bcf 1743169038 julio/fix-integration-test
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
redis/obfuscate_redis_string execution_time 32.764µs 33.582µs ± 1.046µs 32.987µs ± 0.155µs 34.776µs 35.467µs 35.556µs 36.824µs 11.63% 1.009 -0.686 3.11% 0.074µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
redis/obfuscate_redis_string execution_time [33.437µs; 33.727µs] or [-0.432%; +0.432%] None None None

Group 12

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 663b3bcf 1743169038 julio/fix-integration-test
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time 208.734µs 209.204µs ± 0.165µs 209.201µs ± 0.098µs 209.302µs 209.457µs 209.578µs 209.733µs 0.25% -0.035 0.380 0.08% 0.012µs 1 200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput 4767971.312op/s 4780016.010op/s ± 3764.156op/s 4780083.622op/s ± 2241.120op/s 4782285.141op/s 4786150.571op/s 4788565.838op/s 4790791.460op/s 0.22% 0.041 0.378 0.08% 266.166op/s 1 200
normalization/normalize_name/normalize_name/bad-name execution_time 18.598µs 18.695µs ± 0.052µs 18.709µs ± 0.034µs 18.731µs 18.763µs 18.789µs 18.817µs 0.58% -0.463 -0.764 0.28% 0.004µs 1 200
normalization/normalize_name/normalize_name/bad-name throughput 53143003.318op/s 53491909.609op/s ± 149122.888op/s 53451191.723op/s ± 95894.318op/s 53602539.238op/s 53760635.010op/s 53767351.169op/s 53769320.502op/s 0.60% 0.472 -0.762 0.28% 10544.581op/s 1 200
normalization/normalize_name/normalize_name/good execution_time 10.906µs 10.967µs ± 0.037µs 10.969µs ± 0.029µs 10.994µs 11.024µs 11.039µs 11.056µs 0.79% 0.050 -0.993 0.33% 0.003µs 1 200
normalization/normalize_name/normalize_name/good throughput 90447807.093op/s 91183655.846op/s ± 303438.424op/s 91165374.096op/s ± 239034.686op/s 91427285.473op/s 91631622.283op/s 91674912.389op/s 91694974.551op/s 0.58% -0.040 -1.000 0.33% 21456.337op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time [209.182µs; 209.227µs] or [-0.011%; +0.011%] None None None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput [4779494.334op/s; 4780537.686op/s] or [-0.011%; +0.011%] None None None
normalization/normalize_name/normalize_name/bad-name execution_time [18.687µs; 18.702µs] or [-0.039%; +0.039%] None None None
normalization/normalize_name/normalize_name/bad-name throughput [53471242.611op/s; 53512576.607op/s] or [-0.039%; +0.039%] None None None
normalization/normalize_name/normalize_name/good execution_time [10.962µs; 10.972µs] or [-0.046%; +0.046%] None None None
normalization/normalize_name/normalize_name/good throughput [91141602.199op/s; 91225709.493op/s] or [-0.046%; +0.046%] None None None

Group 13

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 663b3bcf 1743169038 julio/fix-integration-test
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sql/obfuscate_sql_string execution_time 66.208µs 66.432µs ± 0.217µs 66.408µs ± 0.042µs 66.451µs 66.549µs 67.118µs 69.050µs 3.98% 9.278 105.717 0.33% 0.015µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sql/obfuscate_sql_string execution_time [66.402µs; 66.462µs] or [-0.045%; +0.045%] None None None

Baseline

Omitted due to size.

pr-commenter[bot] avatar Mar 28 '25 12:03 pr-commenter[bot]