libdatadog icon indicating copy to clipboard operation
libdatadog copied to clipboard
verified publisher icon DataDog

Add NoAllocString for decoding v04 traces

Open ekump opened this issue 1 year ago • 1 comments

What does this PR do?

A brief description of the change being made with this pull request.

Motivation

What inspired you to submit this pull request?

Additional Notes

Anything else we should know when reviewing?

How to test the change?

Describe here in detail how the change can be validated.

ekump avatar Aug 15 '24 21:08 ekump

Benchmarks

Comparison

Benchmark execution time: 2024-08-15 22:44:33

Comparing candidate commit c6f6530 in PR branch ekump/side-by-side-no-alloc-span-impl with baseline commit 16528ff in branch main.

Found 4 performance improvements and 0 performance regressions! Performance is the same for 45 metrics, 3 unstable metrics.

scenario:credit_card/is_card_number/37828224631000521389798

  • 🟩 execution_time [-9.439µs; -8.842µs] or [-8.027%; -7.520%]
  • 🟩 throughput [+693252.469op/s; +738024.223op/s] or [+8.150%; +8.676%]

scenario:credit_card/is_card_number_no_luhn/37828224631000521389798

  • 🟩 execution_time [-9.261µs; -8.719µs] or [-7.894%; -7.432%]
  • 🟩 throughput [+685981.037op/s; +726881.929op/s] or [+8.046%; +8.526%]

Candidate

Candidate benchmark details

Group 1

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz c6f6530 1723761255 ekump/side-by-side-no-alloc-span-impl
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time 506.407µs 508.042µs ± 0.533µs 508.055µs ± 0.216µs 508.257µs 508.482µs 509.055µs 513.218µs 1.02% 4.332 43.505 0.10% 0.038µs 1 200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput 1948490.396op/s 1968342.387op/s ± 2055.126op/s 1968292.544op/s ± 835.353op/s 1969189.254op/s 1971425.715op/s 1972389.113op/s 1974695.095op/s 0.33% -4.249 42.551 0.10% 145.319op/s 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time 388.598µs 390.196µs ± 0.620µs 390.139µs ± 0.398µs 390.599µs 391.158µs 391.813µs 392.524µs 0.61% 0.569 0.845 0.16% 0.044µs 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput 2547614.038op/s 2562820.107op/s ± 4069.793op/s 2563188.420op/s ± 2612.297op/s 2565699.697op/s 2569016.437op/s 2570727.049op/s 2573354.042op/s 0.40% -0.557 0.820 0.16% 287.778op/s 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time 180.826µs 181.032µs ± 0.125µs 181.055µs ± 0.100µs 181.134µs 181.209µs 181.234µs 181.240µs 0.10% -0.319 -1.183 0.07% 0.009µs 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput 5517530.945op/s 5523894.791op/s ± 3821.802op/s 5523194.726op/s ± 3064.122op/s 5527127.361op/s 5529727.718op/s 5529890.331op/s 5530181.912op/s 0.13% 0.320 -1.183 0.07% 270.242op/s 1 200
normalization/normalize_service/normalize_service/[empty string] execution_time 45.628µs 45.742µs ± 0.051µs 45.736µs ± 0.031µs 45.771µs 45.832µs 45.894µs 45.958µs 0.48% 0.821 1.426 0.11% 0.004µs 1 200
normalization/normalize_service/normalize_service/[empty string] throughput 21759148.303op/s 21862007.287op/s ± 24464.260op/s 21864629.897op/s ± 14722.944op/s 21878796.462op/s 21895127.529op/s 21907234.362op/s 21916140.904op/s 0.24% -0.812 1.398 0.11% 1729.884op/s 1 200
normalization/normalize_service/normalize_service/test_ASCII execution_time 50.424µs 50.942µs ± 0.179µs 50.993µs ± 0.054µs 51.043µs 51.116µs 51.175µs 51.190µs 0.39% -1.641 1.629 0.35% 0.013µs 1 200
normalization/normalize_service/normalize_service/test_ASCII throughput 19534885.859op/s 19630299.212op/s ± 69476.622op/s 19610367.379op/s ± 20769.454op/s 19634632.981op/s 19802338.647op/s 19815494.803op/s 19831960.301op/s 1.13% 1.651 1.651 0.35% 4912.739op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time [507.968µs; 508.116µs] or [-0.015%; +0.015%] None None None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput [1968057.567op/s; 1968627.208op/s] or [-0.014%; +0.014%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time [390.110µs; 390.282µs] or [-0.022%; +0.022%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput [2562256.073op/s; 2563384.141op/s] or [-0.022%; +0.022%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time [181.014µs; 181.049µs] or [-0.010%; +0.010%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput [5523365.126op/s; 5524424.456op/s] or [-0.010%; +0.010%] None None None
normalization/normalize_service/normalize_service/[empty string] execution_time [45.734µs; 45.749µs] or [-0.016%; +0.016%] None None None
normalization/normalize_service/normalize_service/[empty string] throughput [21858616.776op/s; 21865397.798op/s] or [-0.016%; +0.016%] None None None
normalization/normalize_service/normalize_service/test_ASCII execution_time [50.917µs; 50.967µs] or [-0.049%; +0.049%] None None None
normalization/normalize_service/normalize_service/test_ASCII throughput [19620670.420op/s; 19639928.003op/s] or [-0.049%; +0.049%] None None None

Group 2

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz c6f6530 1723761255 ekump/side-by-side-no-alloc-span-impl
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
two way interface execution_time 17.123µs 23.221µs ± 16.114µs 17.327µs ± 0.055µs 17.422µs 50.991µs 54.015µs 161.169µs 830.13% 4.901 33.134 69.22% 1.139µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
two way interface execution_time [20.988µs; 25.454µs] or [-9.617%; +9.617%] None None None

Group 3

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz c6f6530 1723761255 ekump/side-by-side-no-alloc-span-impl
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching deserializing traces from msgpack using serde to protobuf execution_time 597.795µs 598.854µs ± 0.768µs 598.791µs ± 0.277µs 599.096µs 599.496µs 600.025µs 607.920µs 1.52% 8.245 95.210 0.13% 0.054µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching deserializing traces from msgpack using serde to protobuf execution_time [598.747µs; 598.960µs] or [-0.018%; +0.018%] None None None

Group 4

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz c6f6530 1723761255 ekump/side-by-side-no-alloc-span-impl
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
tags/replace_trace_tags execution_time 2.619µs 2.674µs ± 0.023µs 2.667µs ± 0.006µs 2.675µs 2.729µs 2.734µs 2.738µs 2.65% 1.087 1.355 0.87% 0.002µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
tags/replace_trace_tags execution_time [2.670µs; 2.677µs] or [-0.120%; +0.120%] None None None

Group 5

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz c6f6530 1723761255 ekump/side-by-side-no-alloc-span-impl
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching deserializing traces from msgpack to their internal representation execution_time 555.665µs 557.310µs ± 3.027µs 557.133µs ± 0.331µs 557.449µs 557.974µs 558.736µs 599.225µs 7.56% 13.369 182.676 0.54% 0.214µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching deserializing traces from msgpack to their internal representation execution_time [556.891µs; 557.730µs] or [-0.075%; +0.075%] None None None

Group 6

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz c6f6530 1723761255 ekump/side-by-side-no-alloc-span-impl
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching string interning on wordpress profile execution_time 133.800µs 134.329µs ± 0.265µs 134.281µs ± 0.165µs 134.471µs 134.831µs 135.168µs 135.253µs 0.72% 0.994 1.023 0.20% 0.019µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching string interning on wordpress profile execution_time [134.293µs; 134.366µs] or [-0.027%; +0.027%] None None None

Group 7

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz c6f6530 1723761255 ekump/side-by-side-no-alloc-span-impl
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sql/obfuscate_sql_string execution_time 74.164µs 74.295µs ± 0.154µs 74.281µs ± 0.028µs 74.307µs 74.382µs 74.712µs 76.206µs 2.59% 9.952 117.475 0.21% 0.011µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sql/obfuscate_sql_string execution_time [74.274µs; 74.317µs] or [-0.029%; +0.029%] None None None

Group 8

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz c6f6530 1723761255 ekump/side-by-side-no-alloc-span-impl
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
redis/obfuscate_redis_string execution_time 37.322µs 37.847µs ± 0.866µs 37.466µs ± 0.090µs 37.571µs 39.668µs 39.712µs 41.036µs 9.53% 1.734 1.284 2.28% 0.061µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
redis/obfuscate_redis_string execution_time [37.727µs; 37.967µs] or [-0.317%; +0.317%] None None None

Group 9

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz c6f6530 1723761255 ekump/side-by-side-no-alloc-span-impl
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_trace/test_trace execution_time 296.456ns 307.368ns ± 13.549ns 301.466ns ± 3.293ns 310.008ns 340.760ns 341.940ns 347.542ns 15.28% 1.610 1.312 4.40% 0.958ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_trace/test_trace execution_time [305.490ns; 309.245ns] or [-0.611%; +0.611%] None None None

Group 10

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz c6f6530 1723761255 ekump/side-by-side-no-alloc-span-impl
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
credit_card/is_card_number/ execution_time 2.415µs 2.416µs ± 0.001µs 2.416µs ± 0.001µs 2.417µs 2.417µs 2.419µs 2.420µs 0.15% 1.058 2.175 0.03% 0.000µs 1 200
credit_card/is_card_number/ throughput 413303891.797op/s 413896802.705op/s ± 128968.661op/s 413920509.780op/s ± 88357.561op/s 414002237.853op/s 414050550.851op/s 414114935.595op/s 414141527.339op/s 0.05% -1.055 2.162 0.03% 9119.461op/s 1 200
credit_card/is_card_number/ 3782-8224-6310-005 execution_time 105.248µs 107.786µs ± 1.953µs 107.083µs ± 1.229µs 109.084µs 111.907µs 112.780µs 112.904µs 5.44% 0.823 -0.282 1.81% 0.138µs 1 200
credit_card/is_card_number/ 3782-8224-6310-005 throughput 8857050.069op/s 9280653.556op/s ± 165815.765op/s 9338546.513op/s ± 107103.887op/s 9418123.647op/s 9467037.017op/s 9493165.467op/s 9501348.783op/s 1.74% -0.768 -0.402 1.78% 11724.945op/s 1 200
credit_card/is_card_number/ 378282246310005 execution_time 101.008µs 104.546µs ± 2.609µs 103.675µs ± 1.686µs 106.636µs 109.218µs 111.263µs 111.540µs 7.59% 0.668 -0.611 2.49% 0.185µs 1 200
credit_card/is_card_number/ 378282246310005 throughput 8965425.397op/s 9570989.112op/s ± 235176.774op/s 9645521.098op/s ± 159467.976op/s 9778213.487op/s 9855757.361op/s 9888071.723op/s 9900208.987op/s 2.64% -0.600 -0.745 2.45% 16629.509op/s 1 200
credit_card/is_card_number/37828224631 execution_time 2.415µs 2.416µs ± 0.005µs 2.416µs ± 0.000µs 2.416µs 2.417µs 2.418µs 2.482µs 2.73% 13.588 186.670 0.19% 0.000µs 1 200
credit_card/is_card_number/37828224631 throughput 402943237.561op/s 413868751.811op/s ± 785285.770op/s 413935674.397op/s ± 80937.410op/s 414013445.087op/s 414091787.586op/s 414121023.975op/s 414150916.594op/s 0.05% -13.564 186.228 0.19% 55528.089op/s 1 200
credit_card/is_card_number/378282246310005 execution_time 97.812µs 101.613µs ± 2.795µs 101.236µs ± 2.458µs 104.373µs 106.206µs 106.797µs 106.953µs 5.65% 0.312 -1.356 2.74% 0.198µs 1 200
credit_card/is_card_number/378282246310005 throughput 9349863.388op/s 9848659.934op/s ± 268793.817op/s 9877916.145op/s ± 243456.550op/s 10100623.030op/s 10182422.942op/s 10218345.166op/s 10223713.439op/s 3.50% -0.268 -1.392 2.72% 19006.593op/s 1 200
credit_card/is_card_number/37828224631000521389798 execution_time 105.675µs 108.445µs ± 1.084µs 108.379µs ± 0.659µs 109.020µs 110.356µs 111.349µs 111.926µs 3.27% 0.391 0.426 1.00% 0.077µs 1 200
credit_card/is_card_number/37828224631000521389798 throughput 8934507.180op/s 9222175.802op/s ± 91855.150op/s 9226885.242op/s ± 56453.533op/s 9284481.991op/s 9370724.654op/s 9412807.580op/s 9462942.405op/s 2.56% -0.324 0.349 0.99% 6495.140op/s 1 200
credit_card/is_card_number/x371413321323331 execution_time 22.443µs 23.595µs ± 0.464µs 23.599µs ± 0.303µs 23.885µs 24.344µs 24.618µs 25.178µs 6.69% 0.182 0.341 1.96% 0.033µs 1 200
credit_card/is_card_number/x371413321323331 throughput 39716978.501op/s 42398448.483op/s ± 831220.322op/s 42375052.768op/s ± 537295.135op/s 42945368.032op/s 43855873.609op/s 44332933.521op/s 44556970.986op/s 5.15% -0.050 0.211 1.96% 58776.153op/s 1 200
credit_card/is_card_number_no_luhn/ execution_time 2.414µs 2.416µs ± 0.001µs 2.416µs ± 0.001µs 2.416µs 2.417µs 2.418µs 2.418µs 0.09% 0.351 -0.351 0.03% 0.000µs 1 200
credit_card/is_card_number_no_luhn/ throughput 413586372.269op/s 413934879.157op/s ± 120277.440op/s 413951960.896op/s ± 91245.162op/s 414027750.210op/s 414101378.255op/s 414155324.815op/s 414173414.409op/s 0.05% -0.350 -0.353 0.03% 8504.899op/s 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time 88.863µs 89.904µs ± 0.488µs 89.837µs ± 0.190µs 90.039µs 90.943µs 91.361µs 91.905µs 2.30% 1.155 2.460 0.54% 0.035µs 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput 10880761.715op/s 11123349.843op/s ± 60045.272op/s 11131226.829op/s ± 23453.008op/s 11152263.041op/s 11205986.345op/s 11243360.771op/s 11253303.523op/s 1.10% -1.105 2.333 0.54% 4245.842op/s 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time 82.864µs 84.879µs ± 1.344µs 84.674µs ± 0.979µs 85.776µs 87.060µs 88.707µs 88.885µs 4.97% 0.647 -0.107 1.58% 0.095µs 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 throughput 11250445.012op/s 11784406.004op/s ± 184755.694op/s 11809963.901op/s ± 137257.967op/s 11933097.198op/s 12036261.032op/s 12066030.713op/s 12067905.079op/s 2.18% -0.579 -0.257 1.56% 13064.200op/s 1 200
credit_card/is_card_number_no_luhn/37828224631 execution_time 2.415µs 2.416µs ± 0.001µs 2.416µs ± 0.001µs 2.417µs 2.417µs 2.418µs 2.418µs 0.10% 0.495 -0.158 0.03% 0.000µs 1 200
credit_card/is_card_number_no_luhn/37828224631 throughput 413489428.091op/s 413901977.936op/s ± 127799.414op/s 413905980.630op/s ± 94292.002op/s 414003814.088op/s 414089780.029op/s 414114748.744op/s 414124300.740op/s 0.05% -0.494 -0.161 0.03% 9036.783op/s 1 200
credit_card/is_card_number_no_luhn/378282246310005 execution_time 81.374µs 84.270µs ± 0.843µs 84.340µs ± 0.570µs 84.829µs 85.521µs 86.011µs 86.130µs 2.12% -0.503 0.411 1.00% 0.060µs 1 200
credit_card/is_card_number_no_luhn/378282246310005 throughput 11610339.302op/s 11867806.340op/s ± 119395.076op/s 11856790.472op/s ± 80318.055op/s 11940089.102op/s 12080389.804op/s 12201392.757op/s 12288900.384op/s 3.64% 0.568 0.528 1.00% 8442.507op/s 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time 106.222µs 108.332µs ± 1.011µs 108.397µs ± 0.650µs 108.951µs 109.991µs 111.289µs 112.757µs 4.02% 0.563 1.501 0.93% 0.072µs 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput 8868594.324op/s 9231689.620op/s ± 85778.775op/s 9225358.557op/s ± 54980.475op/s 9295157.300op/s 9368620.590op/s 9400057.019op/s 9414242.778op/s 2.05% -0.477 1.244 0.93% 6065.475op/s 1 200
credit_card/is_card_number_no_luhn/x371413321323331 execution_time 22.396µs 23.632µs ± 0.475µs 23.608µs ± 0.341µs 23.972µs 24.410µs 24.739µs 24.838µs 5.21% 0.016 -0.333 2.01% 0.034µs 1 200
credit_card/is_card_number_no_luhn/x371413321323331 throughput 40261240.113op/s 42331961.551op/s ± 851615.852op/s 42358060.291op/s ± 617099.881op/s 42900657.303op/s 43735767.876op/s 44113898.405op/s 44651010.033op/s 5.41% 0.085 -0.318 2.01% 60218.334op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
credit_card/is_card_number/ execution_time [2.416µs; 2.416µs] or [-0.004%; +0.004%] None None None
credit_card/is_card_number/ throughput [413878928.889op/s; 413914676.521op/s] or [-0.004%; +0.004%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 execution_time [107.515µs; 108.056µs] or [-0.251%; +0.251%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 throughput [9257673.086op/s; 9303634.026op/s] or [-0.248%; +0.248%] None None None
credit_card/is_card_number/ 378282246310005 execution_time [104.185µs; 104.908µs] or [-0.346%; +0.346%] None None None
credit_card/is_card_number/ 378282246310005 throughput [9538395.873op/s; 9603582.351op/s] or [-0.341%; +0.341%] None None None
credit_card/is_card_number/37828224631 execution_time [2.416µs; 2.417µs] or [-0.027%; +0.027%] None None None
credit_card/is_card_number/37828224631 throughput [413759918.755op/s; 413977584.866op/s] or [-0.026%; +0.026%] None None None
credit_card/is_card_number/378282246310005 execution_time [101.225µs; 102.000µs] or [-0.381%; +0.381%] None None None
credit_card/is_card_number/378282246310005 throughput [9811407.696op/s; 9885912.172op/s] or [-0.378%; +0.378%] None None None
credit_card/is_card_number/37828224631000521389798 execution_time [108.295µs; 108.595µs] or [-0.139%; +0.139%] None None None
credit_card/is_card_number/37828224631000521389798 throughput [9209445.562op/s; 9234906.042op/s] or [-0.138%; +0.138%] None None None
credit_card/is_card_number/x371413321323331 execution_time [23.531µs; 23.659µs] or [-0.272%; +0.272%] None None None
credit_card/is_card_number/x371413321323331 throughput [42283249.340op/s; 42513647.625op/s] or [-0.272%; +0.272%] None None None
credit_card/is_card_number_no_luhn/ execution_time [2.416µs; 2.416µs] or [-0.004%; +0.004%] None None None
credit_card/is_card_number_no_luhn/ throughput [413918209.860op/s; 413951548.453op/s] or [-0.004%; +0.004%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time [89.836µs; 89.971µs] or [-0.075%; +0.075%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput [11115028.145op/s; 11131671.540op/s] or [-0.075%; +0.075%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time [84.693µs; 85.065µs] or [-0.219%; +0.219%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 throughput [11758800.642op/s; 11810011.366op/s] or [-0.217%; +0.217%] None None None
credit_card/is_card_number_no_luhn/37828224631 execution_time [2.416µs; 2.416µs] or [-0.004%; +0.004%] None None None
credit_card/is_card_number_no_luhn/37828224631 throughput [413884266.166op/s; 413919689.705op/s] or [-0.004%; +0.004%] None None None
credit_card/is_card_number_no_luhn/378282246310005 execution_time [84.153µs; 84.387µs] or [-0.139%; +0.139%] None None None
credit_card/is_card_number_no_luhn/378282246310005 throughput [11851259.331op/s; 11884353.349op/s] or [-0.139%; +0.139%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time [108.192µs; 108.472µs] or [-0.129%; +0.129%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput [9219801.507op/s; 9243577.733op/s] or [-0.129%; +0.129%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 execution_time [23.566µs; 23.698µs] or [-0.279%; +0.279%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 throughput [42213935.784op/s; 42449987.318op/s] or [-0.279%; +0.279%] None None None

Group 11

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz c6f6530 1723761255 ekump/side-by-side-no-alloc-span-impl
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
write only interface execution_time 1.442µs 2.910µs ± 1.399µs 2.749µs ± 0.021µs 2.769µs 2.965µs 12.765µs 15.714µs 471.63% 7.942 62.947 47.96% 0.099µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
write only interface execution_time [2.716µs; 3.104µs] or [-6.664%; +6.664%] None None None

Group 12

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz c6f6530 1723761255 ekump/side-by-side-no-alloc-span-impl
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching deserializing traces from msgpack to their internal no-alloc representation execution_time 422.424µs 423.193µs ± 0.447µs 423.169µs ± 0.146µs 423.309µs 423.562µs 425.391µs 427.169µs 0.95% 5.001 37.322 0.11% 0.032µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching deserializing traces from msgpack to their internal no-alloc representation execution_time [423.131µs; 423.255µs] or [-0.015%; +0.015%] None None None

Group 13

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz c6f6530 1723761255 ekump/side-by-side-no-alloc-span-impl
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time 280.975µs 282.632µs ± 2.413µs 281.429µs ± 0.208µs 282.935µs 289.265µs 289.827µs 289.868µs 3.00% 1.799 2.102 0.85% 0.171µs 1 200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput 3449840.802op/s 3538427.387op/s ± 29760.299op/s 3553294.081op/s ± 2630.963op/s 3555198.129op/s 3557684.103op/s 3558444.644op/s 3559031.570op/s 0.16% -1.777 2.008 0.84% 2104.371op/s 1 200
normalization/normalize_name/normalize_name/bad-name execution_time 27.108µs 27.399µs ± 0.137µs 27.394µs ± 0.093µs 27.487µs 27.619µs 27.716µs 27.763µs 1.35% 0.173 -0.426 0.50% 0.010µs 1 200
normalization/normalize_name/normalize_name/bad-name throughput 36019495.809op/s 36499061.378op/s ± 182469.270op/s 36504268.800op/s ± 123906.876op/s 36621053.875op/s 36789291.976op/s 36854764.745op/s 36889258.796op/s 1.05% -0.150 -0.442 0.50% 12902.526op/s 1 200
normalization/normalize_name/normalize_name/good execution_time 16.604µs 16.630µs ± 0.021µs 16.626µs ± 0.006µs 16.631µs 16.684µs 16.715µs 16.725µs 0.60% 2.407 6.144 0.13% 0.002µs 1 200
normalization/normalize_name/normalize_name/good throughput 59790824.102op/s 60131042.449op/s ± 77107.295op/s 60146680.790op/s ± 19919.003op/s 60168146.829op/s 60206028.123op/s 60223272.068op/s 60224901.401op/s 0.13% -2.398 6.100 0.13% 5452.309op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time [282.297µs; 282.966µs] or [-0.118%; +0.118%] None None None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput [3534302.896op/s; 3542551.878op/s] or [-0.117%; +0.117%] None None None
normalization/normalize_name/normalize_name/bad-name execution_time [27.380µs; 27.418µs] or [-0.069%; +0.069%] None None None
normalization/normalize_name/normalize_name/bad-name throughput [36473772.893op/s; 36524349.864op/s] or [-0.069%; +0.069%] None None None
normalization/normalize_name/normalize_name/good execution_time [16.627µs; 16.633µs] or [-0.018%; +0.018%] None None None
normalization/normalize_name/normalize_name/good throughput [60120356.120op/s; 60141728.779op/s] or [-0.018%; +0.018%] None None None

Baseline

Omitted due to size.

pr-commenter[bot] avatar Aug 15 '24 21:08 pr-commenter[bot]