libdatadog icon indicating copy to clipboard operation
libdatadog copied to clipboard

Refactor data-pipeline FFI API.

Open hoolioh opened this issue 1 year ago • 2 comments

What does this PR do?

A brief description of the change being made with this pull request.

Motivation

What inspired you to submit this pull request?

hoolioh avatar Sep 10 '24 15:09 hoolioh

Benchmarks

Comparison

Benchmark execution time: 2024-09-23 14:00:57

Comparing candidate commit 09a4537 in PR branch julio/refactor-ffi with baseline commit 5635814 in branch main.

Found 0 performance improvements and 1 performance regressions! Performance is the same for 50 metrics, 2 unstable metrics.

scenario:redis/obfuscate_redis_string

  • 🟥 execution_time [+0.837µs; +1.305µs] or [+2.183%; +3.403%]

Candidate

Candidate benchmark details

Group 1

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 09a4537 1727099380 julio/refactor-ffi
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
credit_card/is_card_number/ execution_time 2.415µs 2.416µs ± 0.001µs 2.416µs ± 0.001µs 2.417µs 2.418µs 2.418µs 2.419µs 0.12% 0.695 -0.171 0.04% 0.000µs 1 200
credit_card/is_card_number/ throughput 413385376.545op/s 413857875.173op/s ± 148277.338op/s 413876181.429op/s ± 107153.416op/s 413980053.393op/s 414036087.452op/s 414059488.281op/s 414137424.986op/s 0.06% -0.694 -0.174 0.04% 10484.791op/s 1 200
credit_card/is_card_number/ 3782-8224-6310-005 execution_time 110.697µs 115.783µs ± 1.425µs 116.062µs ± 0.924µs 116.798µs 117.778µs 118.305µs 118.393µs 2.01% -0.668 0.196 1.23% 0.101µs 1 200
credit_card/is_card_number/ 3782-8224-6310-005 throughput 8446454.334op/s 8638140.629op/s ± 107200.583op/s 8616102.084op/s ± 68040.856op/s 8701747.968op/s 8830571.276op/s 8894754.654op/s 9033646.908op/s 4.85% 0.734 0.339 1.24% 7580.226op/s 1 200
credit_card/is_card_number/ 378282246310005 execution_time 104.521µs 107.493µs ± 1.169µs 107.499µs ± 0.855µs 108.340µs 109.334µs 109.896µs 110.849µs 3.12% -0.041 -0.376 1.09% 0.083µs 1 200
credit_card/is_card_number/ 378282246310005 throughput 9021308.042op/s 9304043.535op/s ± 101285.568op/s 9302425.466op/s ± 73997.997op/s 9380587.846op/s 9469916.313op/s 9539358.492op/s 9567425.157op/s 2.85% 0.094 -0.375 1.09% 7161.971op/s 1 200
credit_card/is_card_number/37828224631 execution_time 2.415µs 2.416µs ± 0.001µs 2.416µs ± 0.001µs 2.417µs 2.418µs 2.419µs 2.432µs 0.63% 6.363 64.373 0.06% 0.000µs 1 200
credit_card/is_card_number/37828224631 throughput 411242959.240op/s 413826369.511op/s ± 241422.240op/s 413835814.066op/s ± 115557.299op/s 413970633.740op/s 414025884.571op/s 414042501.839op/s 414066661.831op/s 0.06% -6.318 63.711 0.06% 17071.130op/s 1 200
credit_card/is_card_number/378282246310005 execution_time 101.774µs 105.758µs ± 1.380µs 105.789µs ± 1.107µs 106.944µs 107.793µs 107.871µs 107.972µs 2.06% -0.384 -0.485 1.30% 0.098µs 1 200
credit_card/is_card_number/378282246310005 throughput 9261628.828op/s 9457115.156op/s ± 124041.151op/s 9452747.643op/s ± 99215.997op/s 9547860.562op/s 9655213.369op/s 9780802.919op/s 9825730.838op/s 3.95% 0.438 -0.389 1.31% 8771.034op/s 1 200
credit_card/is_card_number/37828224631000521389798 execution_time 103.765µs 106.618µs ± 0.446µs 106.655µs ± 0.233µs 106.878µs 107.208µs 107.598µs 108.154µs 1.41% -1.302 8.104 0.42% 0.032µs 1 200
credit_card/is_card_number/37828224631000521389798 throughput 9246087.774op/s 9379485.624op/s ± 39427.760op/s 9376013.817op/s ± 20445.746op/s 9397613.947op/s 9442986.127op/s 9474901.742op/s 9637165.833op/s 2.79% 1.410 8.761 0.42% 2787.964op/s 1 200
credit_card/is_card_number/x371413321323331 execution_time 21.676µs 22.413µs ± 0.382µs 22.383µs ± 0.279µs 22.669µs 23.084µs 23.312µs 23.377µs 4.44% 0.334 -0.631 1.70% 0.027µs 1 200
credit_card/is_card_number/x371413321323331 throughput 42777847.234op/s 44629847.466op/s ± 756920.530op/s 44676891.456op/s ± 555233.154op/s 45224134.404op/s 45819317.377op/s 45935054.610op/s 46134869.985op/s 3.26% -0.270 -0.692 1.69% 53522.364op/s 1 200
credit_card/is_card_number_no_luhn/ execution_time 2.415µs 2.417µs ± 0.002µs 2.417µs ± 0.001µs 2.418µs 2.422µs 2.424µs 2.434µs 0.73% 2.589 11.120 0.10% 0.000µs 1 200
credit_card/is_card_number_no_luhn/ throughput 410807626.742op/s 413671267.959op/s ± 414116.330op/s 413799270.450op/s ± 158171.439op/s 413949642.708op/s 414016455.548op/s 414045440.596op/s 414062014.419op/s 0.06% -2.570 10.931 0.10% 29282.447op/s 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time 86.967µs 87.304µs ± 0.248µs 87.266µs ± 0.070µs 87.321µs 87.721µs 88.480µs 88.962µs 1.94% 3.527 15.756 0.28% 0.018µs 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput 11240735.801op/s 11454338.804op/s ± 32175.823op/s 11459255.471op/s ± 9226.274op/s 11470934.659op/s 11483459.400op/s 11488292.605op/s 11498564.979op/s 0.34% -3.483 15.374 0.28% 2275.174op/s 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time 79.648µs 80.443µs ± 1.032µs 80.078µs ± 0.244µs 80.467µs 82.680µs 84.510µs 85.702µs 7.02% 2.601 7.432 1.28% 0.073µs 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 throughput 11668326.058op/s 12433142.871op/s ± 154486.514op/s 12487808.778op/s ± 38034.097op/s 12518843.372op/s 12545249.855op/s 12554472.841op/s 12555164.883op/s 0.54% -2.503 6.750 1.24% 10923.846op/s 1 200
credit_card/is_card_number_no_luhn/37828224631 execution_time 2.415µs 2.416µs ± 0.001µs 2.416µs ± 0.001µs 2.417µs 2.418µs 2.419µs 2.420µs 0.14% 0.848 0.546 0.04% 0.000µs 1 200
credit_card/is_card_number_no_luhn/37828224631 throughput 413265761.037op/s 413845756.327op/s ± 146829.742op/s 413849262.080op/s ± 111507.361op/s 413970281.805op/s 414019630.973op/s 414038370.383op/s 414047649.392op/s 0.05% -0.846 0.539 0.04% 10382.431op/s 1 200
credit_card/is_card_number_no_luhn/378282246310005 execution_time 76.657µs 77.018µs ± 0.244µs 76.970µs ± 0.112µs 77.119µs 77.335µs 77.799µs 78.887µs 2.49% 3.402 19.700 0.32% 0.017µs 1 200
credit_card/is_card_number_no_luhn/378282246310005 throughput 12676416.716op/s 12984162.730op/s ± 40662.550op/s 12991998.880op/s ± 18846.972op/s 13009053.326op/s 13022941.290op/s 13035366.266op/s 13045048.466op/s 0.41% -3.308 18.772 0.31% 2875.276op/s 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time 104.938µs 106.543µs ± 0.489µs 106.576µs ± 0.241µs 106.800µs 107.335µs 107.677µs 108.057µs 1.39% -0.130 0.885 0.46% 0.035µs 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput 9254398.694op/s 9386103.216op/s ± 43082.358op/s 9382998.008op/s ± 21204.423op/s 9405601.566op/s 9456595.763op/s 9488295.865op/s 9529413.244op/s 1.56% 0.170 0.893 0.46% 3046.383op/s 1 200
credit_card/is_card_number_no_luhn/x371413321323331 execution_time 21.751µs 22.341µs ± 0.302µs 22.317µs ± 0.214µs 22.509µs 22.879µs 23.209µs 23.281µs 4.32% 0.646 0.297 1.35% 0.021µs 1 200
credit_card/is_card_number_no_luhn/x371413321323331 throughput 42954182.659op/s 44769439.805op/s ± 601028.033op/s 44808626.632op/s ± 427123.583op/s 45258604.770op/s 45646902.986op/s 45837898.000op/s 45974692.076op/s 2.60% -0.572 0.148 1.34% 42499.100op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
credit_card/is_card_number/ execution_time [2.416µs; 2.416µs] or [-0.005%; +0.005%] None None None
credit_card/is_card_number/ throughput [413837325.360op/s; 413878424.986op/s] or [-0.005%; +0.005%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 execution_time [115.586µs; 115.981µs] or [-0.171%; +0.171%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 throughput [8623283.660op/s; 8652997.599op/s] or [-0.172%; +0.172%] None None None
credit_card/is_card_number/ 378282246310005 execution_time [107.331µs; 107.655µs] or [-0.151%; +0.151%] None None None
credit_card/is_card_number/ 378282246310005 throughput [9290006.329op/s; 9318080.740op/s] or [-0.151%; +0.151%] None None None
credit_card/is_card_number/37828224631 execution_time [2.416µs; 2.417µs] or [-0.008%; +0.008%] None None None
credit_card/is_card_number/37828224631 throughput [413792910.710op/s; 413859828.312op/s] or [-0.008%; +0.008%] None None None
credit_card/is_card_number/378282246310005 execution_time [105.567µs; 105.950µs] or [-0.181%; +0.181%] None None None
credit_card/is_card_number/378282246310005 throughput [9439924.245op/s; 9474306.066op/s] or [-0.182%; +0.182%] None None None
credit_card/is_card_number/37828224631000521389798 execution_time [106.556µs; 106.679µs] or [-0.058%; +0.058%] None None None
credit_card/is_card_number/37828224631000521389798 throughput [9374021.316op/s; 9384949.933op/s] or [-0.058%; +0.058%] None None None
credit_card/is_card_number/x371413321323331 execution_time [22.360µs; 22.466µs] or [-0.236%; +0.236%] None None None
credit_card/is_card_number/x371413321323331 throughput [44524945.561op/s; 44734749.372op/s] or [-0.235%; +0.235%] None None None
credit_card/is_card_number_no_luhn/ execution_time [2.417µs; 2.418µs] or [-0.014%; +0.014%] None None None
credit_card/is_card_number_no_luhn/ throughput [413613875.419op/s; 413728660.500op/s] or [-0.014%; +0.014%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time [87.270µs; 87.338µs] or [-0.039%; +0.039%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput [11449879.544op/s; 11458798.064op/s] or [-0.039%; +0.039%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time [80.300µs; 80.586µs] or [-0.178%; +0.178%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 throughput [12411732.526op/s; 12454553.216op/s] or [-0.172%; +0.172%] None None None
credit_card/is_card_number_no_luhn/37828224631 execution_time [2.416µs; 2.416µs] or [-0.005%; +0.005%] None None None
credit_card/is_card_number_no_luhn/37828224631 throughput [413825407.137op/s; 413866105.518op/s] or [-0.005%; +0.005%] None None None
credit_card/is_card_number_no_luhn/378282246310005 execution_time [76.984µs; 77.051µs] or [-0.044%; +0.044%] None None None
credit_card/is_card_number_no_luhn/378282246310005 throughput [12978527.292op/s; 12989798.168op/s] or [-0.043%; +0.043%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time [106.475µs; 106.610µs] or [-0.064%; +0.064%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput [9380132.415op/s; 9392074.016op/s] or [-0.064%; +0.064%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 execution_time [22.299µs; 22.383µs] or [-0.188%; +0.188%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 throughput [44686143.100op/s; 44852736.510op/s] or [-0.186%; +0.186%] None None None

Group 2

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 09a4537 1727099380 julio/refactor-ffi
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
two way interface execution_time 17.843µs 26.701µs ± 11.170µs 18.464µs ± 0.495µs 35.303µs 41.020µs 45.387µs 93.528µs 406.55% 2.069 9.008 41.73% 0.790µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
two way interface execution_time [25.153µs; 28.249µs] or [-5.798%; +5.798%] None None None

Group 3

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 09a4537 1727099380 julio/refactor-ffi
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching string interning on wordpress profile execution_time 142.961µs 144.081µs ± 0.475µs 144.064µs ± 0.255µs 144.305µs 144.927µs 145.249µs 146.699µs 1.83% 1.085 4.387 0.33% 0.034µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching string interning on wordpress profile execution_time [144.015µs; 144.147µs] or [-0.046%; +0.046%] None None None

Group 4

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 09a4537 1727099380 julio/refactor-ffi
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time 275.565µs 276.274µs ± 0.217µs 276.255µs ± 0.115µs 276.397µs 276.584µs 276.794µs 277.362µs 0.40% 0.205 3.687 0.08% 0.015µs 1 200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput 3605397.454op/s 3619602.392op/s ± 2849.113op/s 3619843.759op/s ± 1503.089op/s 3620956.975op/s 3623163.595op/s 3627795.853op/s 3628901.977op/s 0.25% -0.191 3.658 0.08% 201.463op/s 1 200
normalization/normalize_name/normalize_name/bad-name execution_time 28.077µs 28.108µs ± 0.037µs 28.081µs ± 0.003µs 28.125µs 28.171µs 28.210µs 28.233µs 0.54% 1.046 0.187 0.13% 0.003µs 1 200
normalization/normalize_name/normalize_name/bad-name throughput 35418917.244op/s 35577539.607op/s ± 46401.136op/s 35611456.412op/s ± 4097.654op/s 35613968.552op/s 35615548.577op/s 35615877.528op/s 35615950.466op/s 0.01% -1.042 0.171 0.13% 3281.056op/s 1 200
normalization/normalize_name/normalize_name/good execution_time 16.305µs 16.493µs ± 0.124µs 16.504µs ± 0.040µs 16.541µs 16.608µs 16.676µs 17.871µs 8.28% 6.752 74.022 0.75% 0.009µs 1 200
normalization/normalize_name/normalize_name/good throughput 55956206.207op/s 60634865.456op/s ± 435546.377op/s 60590718.427op/s ± 145952.519op/s 60900679.768op/s 61143991.192op/s 61296067.113op/s 61330816.344op/s 1.22% -6.090 64.766 0.72% 30797.780op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time [276.243µs; 276.304µs] or [-0.011%; +0.011%] None None None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput [3619207.533op/s; 3619997.252op/s] or [-0.011%; +0.011%] None None None
normalization/normalize_name/normalize_name/bad-name execution_time [28.103µs; 28.113µs] or [-0.018%; +0.018%] None None None
normalization/normalize_name/normalize_name/bad-name throughput [35571108.856op/s; 35583970.359op/s] or [-0.018%; +0.018%] None None None
normalization/normalize_name/normalize_name/good execution_time [16.476µs; 16.510µs] or [-0.104%; +0.104%] None None None
normalization/normalize_name/normalize_name/good throughput [60574502.917op/s; 60695227.995op/s] or [-0.100%; +0.100%] None None None

Group 5

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 09a4537 1727099380 julio/refactor-ffi
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching deserializing traces from msgpack to their internal representation execution_time 1.132µs 1.197µs ± 0.023µs 1.206µs ± 0.010µs 1.214µs 1.216µs 1.217µs 1.218µs 1.00% -1.477 1.285 1.91% 0.002µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching deserializing traces from msgpack to their internal representation execution_time [1.193µs; 1.200µs] or [-0.266%; +0.266%] None None None

Group 6

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 09a4537 1727099380 julio/refactor-ffi
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time 537.579µs 538.470µs ± 0.679µs 538.222µs ± 0.321µs 539.199µs 539.664µs 539.849µs 540.629µs 0.45% 0.801 -0.657 0.13% 0.048µs 1 200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput 1849698.706op/s 1857118.121op/s ± 2338.919op/s 1857968.474op/s ± 1109.277op/s 1858872.538op/s 1859894.559op/s 1860119.172op/s 1860190.287op/s 0.12% -0.799 -0.663 0.13% 165.387op/s 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time 467.129µs 467.689µs ± 0.297µs 467.687µs ± 0.196µs 467.871µs 468.038µs 468.406µs 469.311µs 0.35% 1.524 7.189 0.06% 0.021µs 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput 2130782.256op/s 2138174.738op/s ± 1357.004op/s 2138182.521op/s ± 897.626op/s 2139256.356op/s 2140078.308op/s 2140480.198op/s 2140737.491op/s 0.12% -1.511 7.109 0.06% 95.955op/s 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time 184.531µs 184.898µs ± 0.273µs 184.845µs ± 0.108µs 184.966µs 185.494µs 185.760µs 186.326µs 0.80% 2.020 5.446 0.15% 0.019µs 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput 5366933.198op/s 5408396.621op/s ± 7972.677op/s 5409940.251op/s ± 3158.309op/s 5412780.868op/s 5417182.474op/s 5419074.119op/s 5419145.135op/s 0.17% -2.006 5.363 0.15% 563.753op/s 1 200
normalization/normalize_service/normalize_service/[empty string] execution_time 44.743µs 44.861µs ± 0.066µs 44.850µs ± 0.029µs 44.879µs 45.013µs 45.065µs 45.222µs 0.83% 1.736 4.907 0.15% 0.005µs 1 200
normalization/normalize_service/normalize_service/[empty string] throughput 22112887.994op/s 22291307.443op/s ± 32914.980op/s 22296531.868op/s ± 14623.699op/s 22311282.730op/s 22330341.158op/s 22340558.757op/s 22349763.483op/s 0.24% -1.719 4.811 0.15% 2327.441op/s 1 200
normalization/normalize_service/normalize_service/test_ASCII execution_time 49.746µs 49.838µs ± 0.115µs 49.816µs ± 0.051µs 49.884µs 49.963µs 50.013µs 51.129µs 2.64% 7.199 77.257 0.23% 0.008µs 1 200
normalization/normalize_service/normalize_service/test_ASCII throughput 19558260.761op/s 20064991.199op/s ± 45588.312op/s 20073810.941op/s ± 20468.614op/s 20092820.655op/s 20096826.041op/s 20100331.506op/s 20101930.814op/s 0.14% -7.012 74.404 0.23% 3223.580op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time [538.375µs; 538.564µs] or [-0.017%; +0.017%] None None None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput [1856793.970op/s; 1857442.273op/s] or [-0.017%; +0.017%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time [467.648µs; 467.730µs] or [-0.009%; +0.009%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput [2137986.671op/s; 2138362.806op/s] or [-0.009%; +0.009%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time [184.860µs; 184.936µs] or [-0.020%; +0.020%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput [5407291.684op/s; 5409501.557op/s] or [-0.020%; +0.020%] None None None
normalization/normalize_service/normalize_service/[empty string] execution_time [44.851µs; 44.870µs] or [-0.021%; +0.021%] None None None
normalization/normalize_service/normalize_service/[empty string] throughput [22286745.744op/s; 22295869.143op/s] or [-0.020%; +0.020%] None None None
normalization/normalize_service/normalize_service/test_ASCII execution_time [49.822µs; 49.854µs] or [-0.032%; +0.032%] None None None
normalization/normalize_service/normalize_service/test_ASCII throughput [20058673.098op/s; 20071309.301op/s] or [-0.031%; +0.031%] None None None

Group 7

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 09a4537 1727099380 julio/refactor-ffi
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
write only interface execution_time 1.427µs 3.229µs ± 1.576µs 3.072µs ± 0.033µs 3.106µs 3.185µs 13.812µs 18.435µs 500.13% 8.038 65.847 48.68% 0.111µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
write only interface execution_time [3.011µs; 3.448µs] or [-6.764%; +6.764%] None None None

Group 8

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 09a4537 1727099380 julio/refactor-ffi
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
redis/obfuscate_redis_string execution_time 38.735µs 39.420µs ± 1.230µs 38.847µs ± 0.050µs 38.979µs 42.080µs 42.108µs 42.369µs 9.06% 1.694 0.901 3.11% 0.087µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
redis/obfuscate_redis_string execution_time [39.249µs; 39.590µs] or [-0.432%; +0.432%] None None None

Group 9

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 09a4537 1727099380 julio/refactor-ffi
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_trace/test_trace execution_time 298.411ns 307.464ns ± 11.799ns 301.789ns ± 2.328ns 307.770ns 335.395ns 345.879ns 346.975ns 14.97% 1.943 2.747 3.83% 0.834ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_trace/test_trace execution_time [305.828ns; 309.099ns] or [-0.532%; +0.532%] None None None

Group 10

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 09a4537 1727099380 julio/refactor-ffi
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
concentrator/add_spans_to_concentrator execution_time 8.983ms 9.025ms ± 0.026ms 9.022ms ± 0.013ms 9.036ms 9.061ms 9.076ms 9.210ms 2.08% 3.272 20.155 0.28% 0.002ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
concentrator/add_spans_to_concentrator execution_time [9.022ms; 9.029ms] or [-0.039%; +0.039%] None None None

Group 11

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 09a4537 1727099380 julio/refactor-ffi
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sql/obfuscate_sql_string execution_time 73.182µs 73.324µs ± 0.149µs 73.304µs ± 0.032µs 73.337µs 73.490µs 73.642µs 75.121µs 2.48% 9.160 105.767 0.20% 0.011µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sql/obfuscate_sql_string execution_time [73.303µs; 73.345µs] or [-0.028%; +0.028%] None None None

Group 12

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 09a4537 1727099380 julio/refactor-ffi
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
tags/replace_trace_tags execution_time 2.692µs 2.721µs ± 0.016µs 2.721µs ± 0.008µs 2.727µs 2.756µs 2.767µs 2.772µs 1.89% 0.835 1.024 0.58% 0.001µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
tags/replace_trace_tags execution_time [2.719µs; 2.723µs] or [-0.081%; +0.081%] None None None

Baseline

Omitted due to size.

pr-commenter[bot] avatar Sep 10 '24 15:09 pr-commenter[bot]

Codecov Report

Attention: Patch coverage is 91.27907% with 15 lines in your changes missing coverage. Please review.

Project coverage is 73.74%. Comparing base (48d6360) to head (09a4537). Report is 1 commits behind head on main.

Additional details and impacted files
@@            Coverage Diff             @@
##             main     #620      +/-   ##
==========================================
+ Coverage   73.56%   73.74%   +0.17%     
==========================================
  Files         255      255              
  Lines       36941    37080     +139     
==========================================
+ Hits        27176    27345     +169     
+ Misses       9765     9735      -30     
Components Coverage Δ
crashtracker 20.53% <ø> (ø)
datadog-alloc 98.73% <ø> (ø)
data-pipeline 93.21% <91.27%> (+1.55%) :arrow_up:
data-pipeline-ffi 82.50% <91.27%> (+82.50%) :arrow_up:
ddcommon 83.21% <ø> (+0.13%) :arrow_up:
ddcommon-ffi 69.90% <ø> (+0.38%) :arrow_up:
ddtelemetry 59.10% <ø> (ø)
ipc 83.58% <ø> (ø)
profiling 84.26% <ø> (ø)
profiling-ffi 77.42% <ø> (ø)
serverless 0.00% <ø> (ø)
sidecar 40.10% <ø> (ø)
sidecar-ffi 0.00% <ø> (ø)
spawn-worker 50.36% <ø> (ø)
tinybytes 94.77% <ø> (ø)
trace-mini-agent 72.47% <ø> (ø)
trace-normalization 98.25% <ø> (ø)
trace-obfuscation 95.73% <ø> (ø)
trace-protobuf 77.67% <ø> (ø)
trace-utils 93.41% <ø> (ø)

codecov-commenter avatar Sep 10 '24 15:09 codecov-commenter