libdatadog
libdatadog copied to clipboard
Refactor data-pipeline FFI API.
What does this PR do?
A brief description of the change being made with this pull request.
Motivation
What inspired you to submit this pull request?
Benchmarks
Comparison
Benchmark execution time: 2024-09-23 14:00:57
Comparing candidate commit 09a4537 in PR branch julio/refactor-ffi with baseline commit 5635814 in branch main.
Found 0 performance improvements and 1 performance regressions! Performance is the same for 50 metrics, 2 unstable metrics.
scenario:redis/obfuscate_redis_string
- 🟥
execution_time[+0.837µs; +1.305µs] or [+2.183%; +3.403%]
Candidate
Candidate benchmark details
Group 1
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 09a4537 | 1727099380 | julio/refactor-ffi |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| credit_card/is_card_number/ | execution_time | 2.415µs | 2.416µs ± 0.001µs | 2.416µs ± 0.001µs | 2.417µs | 2.418µs | 2.418µs | 2.419µs | 0.12% | 0.695 | -0.171 | 0.04% | 0.000µs | 1 | 200 |
| credit_card/is_card_number/ | throughput | 413385376.545op/s | 413857875.173op/s ± 148277.338op/s | 413876181.429op/s ± 107153.416op/s | 413980053.393op/s | 414036087.452op/s | 414059488.281op/s | 414137424.986op/s | 0.06% | -0.694 | -0.174 | 0.04% | 10484.791op/s | 1 | 200 |
| credit_card/is_card_number/ 3782-8224-6310-005 | execution_time | 110.697µs | 115.783µs ± 1.425µs | 116.062µs ± 0.924µs | 116.798µs | 117.778µs | 118.305µs | 118.393µs | 2.01% | -0.668 | 0.196 | 1.23% | 0.101µs | 1 | 200 |
| credit_card/is_card_number/ 3782-8224-6310-005 | throughput | 8446454.334op/s | 8638140.629op/s ± 107200.583op/s | 8616102.084op/s ± 68040.856op/s | 8701747.968op/s | 8830571.276op/s | 8894754.654op/s | 9033646.908op/s | 4.85% | 0.734 | 0.339 | 1.24% | 7580.226op/s | 1 | 200 |
| credit_card/is_card_number/ 378282246310005 | execution_time | 104.521µs | 107.493µs ± 1.169µs | 107.499µs ± 0.855µs | 108.340µs | 109.334µs | 109.896µs | 110.849µs | 3.12% | -0.041 | -0.376 | 1.09% | 0.083µs | 1 | 200 |
| credit_card/is_card_number/ 378282246310005 | throughput | 9021308.042op/s | 9304043.535op/s ± 101285.568op/s | 9302425.466op/s ± 73997.997op/s | 9380587.846op/s | 9469916.313op/s | 9539358.492op/s | 9567425.157op/s | 2.85% | 0.094 | -0.375 | 1.09% | 7161.971op/s | 1 | 200 |
| credit_card/is_card_number/37828224631 | execution_time | 2.415µs | 2.416µs ± 0.001µs | 2.416µs ± 0.001µs | 2.417µs | 2.418µs | 2.419µs | 2.432µs | 0.63% | 6.363 | 64.373 | 0.06% | 0.000µs | 1 | 200 |
| credit_card/is_card_number/37828224631 | throughput | 411242959.240op/s | 413826369.511op/s ± 241422.240op/s | 413835814.066op/s ± 115557.299op/s | 413970633.740op/s | 414025884.571op/s | 414042501.839op/s | 414066661.831op/s | 0.06% | -6.318 | 63.711 | 0.06% | 17071.130op/s | 1 | 200 |
| credit_card/is_card_number/378282246310005 | execution_time | 101.774µs | 105.758µs ± 1.380µs | 105.789µs ± 1.107µs | 106.944µs | 107.793µs | 107.871µs | 107.972µs | 2.06% | -0.384 | -0.485 | 1.30% | 0.098µs | 1 | 200 |
| credit_card/is_card_number/378282246310005 | throughput | 9261628.828op/s | 9457115.156op/s ± 124041.151op/s | 9452747.643op/s ± 99215.997op/s | 9547860.562op/s | 9655213.369op/s | 9780802.919op/s | 9825730.838op/s | 3.95% | 0.438 | -0.389 | 1.31% | 8771.034op/s | 1 | 200 |
| credit_card/is_card_number/37828224631000521389798 | execution_time | 103.765µs | 106.618µs ± 0.446µs | 106.655µs ± 0.233µs | 106.878µs | 107.208µs | 107.598µs | 108.154µs | 1.41% | -1.302 | 8.104 | 0.42% | 0.032µs | 1 | 200 |
| credit_card/is_card_number/37828224631000521389798 | throughput | 9246087.774op/s | 9379485.624op/s ± 39427.760op/s | 9376013.817op/s ± 20445.746op/s | 9397613.947op/s | 9442986.127op/s | 9474901.742op/s | 9637165.833op/s | 2.79% | 1.410 | 8.761 | 0.42% | 2787.964op/s | 1 | 200 |
| credit_card/is_card_number/x371413321323331 | execution_time | 21.676µs | 22.413µs ± 0.382µs | 22.383µs ± 0.279µs | 22.669µs | 23.084µs | 23.312µs | 23.377µs | 4.44% | 0.334 | -0.631 | 1.70% | 0.027µs | 1 | 200 |
| credit_card/is_card_number/x371413321323331 | throughput | 42777847.234op/s | 44629847.466op/s ± 756920.530op/s | 44676891.456op/s ± 555233.154op/s | 45224134.404op/s | 45819317.377op/s | 45935054.610op/s | 46134869.985op/s | 3.26% | -0.270 | -0.692 | 1.69% | 53522.364op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/ | execution_time | 2.415µs | 2.417µs ± 0.002µs | 2.417µs ± 0.001µs | 2.418µs | 2.422µs | 2.424µs | 2.434µs | 0.73% | 2.589 | 11.120 | 0.10% | 0.000µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/ | throughput | 410807626.742op/s | 413671267.959op/s ± 414116.330op/s | 413799270.450op/s ± 158171.439op/s | 413949642.708op/s | 414016455.548op/s | 414045440.596op/s | 414062014.419op/s | 0.06% | -2.570 | 10.931 | 0.10% | 29282.447op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 | execution_time | 86.967µs | 87.304µs ± 0.248µs | 87.266µs ± 0.070µs | 87.321µs | 87.721µs | 88.480µs | 88.962µs | 1.94% | 3.527 | 15.756 | 0.28% | 0.018µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 | throughput | 11240735.801op/s | 11454338.804op/s ± 32175.823op/s | 11459255.471op/s ± 9226.274op/s | 11470934.659op/s | 11483459.400op/s | 11488292.605op/s | 11498564.979op/s | 0.34% | -3.483 | 15.374 | 0.28% | 2275.174op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/ 378282246310005 | execution_time | 79.648µs | 80.443µs ± 1.032µs | 80.078µs ± 0.244µs | 80.467µs | 82.680µs | 84.510µs | 85.702µs | 7.02% | 2.601 | 7.432 | 1.28% | 0.073µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/ 378282246310005 | throughput | 11668326.058op/s | 12433142.871op/s ± 154486.514op/s | 12487808.778op/s ± 38034.097op/s | 12518843.372op/s | 12545249.855op/s | 12554472.841op/s | 12555164.883op/s | 0.54% | -2.503 | 6.750 | 1.24% | 10923.846op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/37828224631 | execution_time | 2.415µs | 2.416µs ± 0.001µs | 2.416µs ± 0.001µs | 2.417µs | 2.418µs | 2.419µs | 2.420µs | 0.14% | 0.848 | 0.546 | 0.04% | 0.000µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/37828224631 | throughput | 413265761.037op/s | 413845756.327op/s ± 146829.742op/s | 413849262.080op/s ± 111507.361op/s | 413970281.805op/s | 414019630.973op/s | 414038370.383op/s | 414047649.392op/s | 0.05% | -0.846 | 0.539 | 0.04% | 10382.431op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/378282246310005 | execution_time | 76.657µs | 77.018µs ± 0.244µs | 76.970µs ± 0.112µs | 77.119µs | 77.335µs | 77.799µs | 78.887µs | 2.49% | 3.402 | 19.700 | 0.32% | 0.017µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/378282246310005 | throughput | 12676416.716op/s | 12984162.730op/s ± 40662.550op/s | 12991998.880op/s ± 18846.972op/s | 13009053.326op/s | 13022941.290op/s | 13035366.266op/s | 13045048.466op/s | 0.41% | -3.308 | 18.772 | 0.31% | 2875.276op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/37828224631000521389798 | execution_time | 104.938µs | 106.543µs ± 0.489µs | 106.576µs ± 0.241µs | 106.800µs | 107.335µs | 107.677µs | 108.057µs | 1.39% | -0.130 | 0.885 | 0.46% | 0.035µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/37828224631000521389798 | throughput | 9254398.694op/s | 9386103.216op/s ± 43082.358op/s | 9382998.008op/s ± 21204.423op/s | 9405601.566op/s | 9456595.763op/s | 9488295.865op/s | 9529413.244op/s | 1.56% | 0.170 | 0.893 | 0.46% | 3046.383op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/x371413321323331 | execution_time | 21.751µs | 22.341µs ± 0.302µs | 22.317µs ± 0.214µs | 22.509µs | 22.879µs | 23.209µs | 23.281µs | 4.32% | 0.646 | 0.297 | 1.35% | 0.021µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/x371413321323331 | throughput | 42954182.659op/s | 44769439.805op/s ± 601028.033op/s | 44808626.632op/s ± 427123.583op/s | 45258604.770op/s | 45646902.986op/s | 45837898.000op/s | 45974692.076op/s | 2.60% | -0.572 | 0.148 | 1.34% | 42499.100op/s | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| credit_card/is_card_number/ | execution_time | [2.416µs; 2.416µs] or [-0.005%; +0.005%] | None | None | None |
| credit_card/is_card_number/ | throughput | [413837325.360op/s; 413878424.986op/s] or [-0.005%; +0.005%] | None | None | None |
| credit_card/is_card_number/ 3782-8224-6310-005 | execution_time | [115.586µs; 115.981µs] or [-0.171%; +0.171%] | None | None | None |
| credit_card/is_card_number/ 3782-8224-6310-005 | throughput | [8623283.660op/s; 8652997.599op/s] or [-0.172%; +0.172%] | None | None | None |
| credit_card/is_card_number/ 378282246310005 | execution_time | [107.331µs; 107.655µs] or [-0.151%; +0.151%] | None | None | None |
| credit_card/is_card_number/ 378282246310005 | throughput | [9290006.329op/s; 9318080.740op/s] or [-0.151%; +0.151%] | None | None | None |
| credit_card/is_card_number/37828224631 | execution_time | [2.416µs; 2.417µs] or [-0.008%; +0.008%] | None | None | None |
| credit_card/is_card_number/37828224631 | throughput | [413792910.710op/s; 413859828.312op/s] or [-0.008%; +0.008%] | None | None | None |
| credit_card/is_card_number/378282246310005 | execution_time | [105.567µs; 105.950µs] or [-0.181%; +0.181%] | None | None | None |
| credit_card/is_card_number/378282246310005 | throughput | [9439924.245op/s; 9474306.066op/s] or [-0.182%; +0.182%] | None | None | None |
| credit_card/is_card_number/37828224631000521389798 | execution_time | [106.556µs; 106.679µs] or [-0.058%; +0.058%] | None | None | None |
| credit_card/is_card_number/37828224631000521389798 | throughput | [9374021.316op/s; 9384949.933op/s] or [-0.058%; +0.058%] | None | None | None |
| credit_card/is_card_number/x371413321323331 | execution_time | [22.360µs; 22.466µs] or [-0.236%; +0.236%] | None | None | None |
| credit_card/is_card_number/x371413321323331 | throughput | [44524945.561op/s; 44734749.372op/s] or [-0.235%; +0.235%] | None | None | None |
| credit_card/is_card_number_no_luhn/ | execution_time | [2.417µs; 2.418µs] or [-0.014%; +0.014%] | None | None | None |
| credit_card/is_card_number_no_luhn/ | throughput | [413613875.419op/s; 413728660.500op/s] or [-0.014%; +0.014%] | None | None | None |
| credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 | execution_time | [87.270µs; 87.338µs] or [-0.039%; +0.039%] | None | None | None |
| credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 | throughput | [11449879.544op/s; 11458798.064op/s] or [-0.039%; +0.039%] | None | None | None |
| credit_card/is_card_number_no_luhn/ 378282246310005 | execution_time | [80.300µs; 80.586µs] or [-0.178%; +0.178%] | None | None | None |
| credit_card/is_card_number_no_luhn/ 378282246310005 | throughput | [12411732.526op/s; 12454553.216op/s] or [-0.172%; +0.172%] | None | None | None |
| credit_card/is_card_number_no_luhn/37828224631 | execution_time | [2.416µs; 2.416µs] or [-0.005%; +0.005%] | None | None | None |
| credit_card/is_card_number_no_luhn/37828224631 | throughput | [413825407.137op/s; 413866105.518op/s] or [-0.005%; +0.005%] | None | None | None |
| credit_card/is_card_number_no_luhn/378282246310005 | execution_time | [76.984µs; 77.051µs] or [-0.044%; +0.044%] | None | None | None |
| credit_card/is_card_number_no_luhn/378282246310005 | throughput | [12978527.292op/s; 12989798.168op/s] or [-0.043%; +0.043%] | None | None | None |
| credit_card/is_card_number_no_luhn/37828224631000521389798 | execution_time | [106.475µs; 106.610µs] or [-0.064%; +0.064%] | None | None | None |
| credit_card/is_card_number_no_luhn/37828224631000521389798 | throughput | [9380132.415op/s; 9392074.016op/s] or [-0.064%; +0.064%] | None | None | None |
| credit_card/is_card_number_no_luhn/x371413321323331 | execution_time | [22.299µs; 22.383µs] or [-0.188%; +0.188%] | None | None | None |
| credit_card/is_card_number_no_luhn/x371413321323331 | throughput | [44686143.100op/s; 44852736.510op/s] or [-0.186%; +0.186%] | None | None | None |
Group 2
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 09a4537 | 1727099380 | julio/refactor-ffi |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| two way interface | execution_time | 17.843µs | 26.701µs ± 11.170µs | 18.464µs ± 0.495µs | 35.303µs | 41.020µs | 45.387µs | 93.528µs | 406.55% | 2.069 | 9.008 | 41.73% | 0.790µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| two way interface | execution_time | [25.153µs; 28.249µs] or [-5.798%; +5.798%] | None | None | None |
Group 3
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 09a4537 | 1727099380 | julio/refactor-ffi |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| benching string interning on wordpress profile | execution_time | 142.961µs | 144.081µs ± 0.475µs | 144.064µs ± 0.255µs | 144.305µs | 144.927µs | 145.249µs | 146.699µs | 1.83% | 1.085 | 4.387 | 0.33% | 0.034µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| benching string interning on wordpress profile | execution_time | [144.015µs; 144.147µs] or [-0.046%; +0.046%] | None | None | None |
Group 4
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 09a4537 | 1727099380 | julio/refactor-ffi |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... | execution_time | 275.565µs | 276.274µs ± 0.217µs | 276.255µs ± 0.115µs | 276.397µs | 276.584µs | 276.794µs | 277.362µs | 0.40% | 0.205 | 3.687 | 0.08% | 0.015µs | 1 | 200 |
| normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... | throughput | 3605397.454op/s | 3619602.392op/s ± 2849.113op/s | 3619843.759op/s ± 1503.089op/s | 3620956.975op/s | 3623163.595op/s | 3627795.853op/s | 3628901.977op/s | 0.25% | -0.191 | 3.658 | 0.08% | 201.463op/s | 1 | 200 |
| normalization/normalize_name/normalize_name/bad-name | execution_time | 28.077µs | 28.108µs ± 0.037µs | 28.081µs ± 0.003µs | 28.125µs | 28.171µs | 28.210µs | 28.233µs | 0.54% | 1.046 | 0.187 | 0.13% | 0.003µs | 1 | 200 |
| normalization/normalize_name/normalize_name/bad-name | throughput | 35418917.244op/s | 35577539.607op/s ± 46401.136op/s | 35611456.412op/s ± 4097.654op/s | 35613968.552op/s | 35615548.577op/s | 35615877.528op/s | 35615950.466op/s | 0.01% | -1.042 | 0.171 | 0.13% | 3281.056op/s | 1 | 200 |
| normalization/normalize_name/normalize_name/good | execution_time | 16.305µs | 16.493µs ± 0.124µs | 16.504µs ± 0.040µs | 16.541µs | 16.608µs | 16.676µs | 17.871µs | 8.28% | 6.752 | 74.022 | 0.75% | 0.009µs | 1 | 200 |
| normalization/normalize_name/normalize_name/good | throughput | 55956206.207op/s | 60634865.456op/s ± 435546.377op/s | 60590718.427op/s ± 145952.519op/s | 60900679.768op/s | 61143991.192op/s | 61296067.113op/s | 61330816.344op/s | 1.22% | -6.090 | 64.766 | 0.72% | 30797.780op/s | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... | execution_time | [276.243µs; 276.304µs] or [-0.011%; +0.011%] | None | None | None |
| normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... | throughput | [3619207.533op/s; 3619997.252op/s] or [-0.011%; +0.011%] | None | None | None |
| normalization/normalize_name/normalize_name/bad-name | execution_time | [28.103µs; 28.113µs] or [-0.018%; +0.018%] | None | None | None |
| normalization/normalize_name/normalize_name/bad-name | throughput | [35571108.856op/s; 35583970.359op/s] or [-0.018%; +0.018%] | None | None | None |
| normalization/normalize_name/normalize_name/good | execution_time | [16.476µs; 16.510µs] or [-0.104%; +0.104%] | None | None | None |
| normalization/normalize_name/normalize_name/good | throughput | [60574502.917op/s; 60695227.995op/s] or [-0.100%; +0.100%] | None | None | None |
Group 5
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 09a4537 | 1727099380 | julio/refactor-ffi |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| benching deserializing traces from msgpack to their internal representation | execution_time | 1.132µs | 1.197µs ± 0.023µs | 1.206µs ± 0.010µs | 1.214µs | 1.216µs | 1.217µs | 1.218µs | 1.00% | -1.477 | 1.285 | 1.91% | 0.002µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| benching deserializing traces from msgpack to their internal representation | execution_time | [1.193µs; 1.200µs] or [-0.266%; +0.266%] | None | None | None |
Group 6
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 09a4537 | 1727099380 | julio/refactor-ffi |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... | execution_time | 537.579µs | 538.470µs ± 0.679µs | 538.222µs ± 0.321µs | 539.199µs | 539.664µs | 539.849µs | 540.629µs | 0.45% | 0.801 | -0.657 | 0.13% | 0.048µs | 1 | 200 |
| normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... | throughput | 1849698.706op/s | 1857118.121op/s ± 2338.919op/s | 1857968.474op/s ± 1109.277op/s | 1858872.538op/s | 1859894.559op/s | 1860119.172op/s | 1860190.287op/s | 0.12% | -0.799 | -0.663 | 0.13% | 165.387op/s | 1 | 200 |
| normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて | execution_time | 467.129µs | 467.689µs ± 0.297µs | 467.687µs ± 0.196µs | 467.871µs | 468.038µs | 468.406µs | 469.311µs | 0.35% | 1.524 | 7.189 | 0.06% | 0.021µs | 1 | 200 |
| normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて | throughput | 2130782.256op/s | 2138174.738op/s ± 1357.004op/s | 2138182.521op/s ± 897.626op/s | 2139256.356op/s | 2140078.308op/s | 2140480.198op/s | 2140737.491op/s | 0.12% | -1.511 | 7.109 | 0.06% | 95.955op/s | 1 | 200 |
| normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters | execution_time | 184.531µs | 184.898µs ± 0.273µs | 184.845µs ± 0.108µs | 184.966µs | 185.494µs | 185.760µs | 186.326µs | 0.80% | 2.020 | 5.446 | 0.15% | 0.019µs | 1 | 200 |
| normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters | throughput | 5366933.198op/s | 5408396.621op/s ± 7972.677op/s | 5409940.251op/s ± 3158.309op/s | 5412780.868op/s | 5417182.474op/s | 5419074.119op/s | 5419145.135op/s | 0.17% | -2.006 | 5.363 | 0.15% | 563.753op/s | 1 | 200 |
| normalization/normalize_service/normalize_service/[empty string] | execution_time | 44.743µs | 44.861µs ± 0.066µs | 44.850µs ± 0.029µs | 44.879µs | 45.013µs | 45.065µs | 45.222µs | 0.83% | 1.736 | 4.907 | 0.15% | 0.005µs | 1 | 200 |
| normalization/normalize_service/normalize_service/[empty string] | throughput | 22112887.994op/s | 22291307.443op/s ± 32914.980op/s | 22296531.868op/s ± 14623.699op/s | 22311282.730op/s | 22330341.158op/s | 22340558.757op/s | 22349763.483op/s | 0.24% | -1.719 | 4.811 | 0.15% | 2327.441op/s | 1 | 200 |
| normalization/normalize_service/normalize_service/test_ASCII | execution_time | 49.746µs | 49.838µs ± 0.115µs | 49.816µs ± 0.051µs | 49.884µs | 49.963µs | 50.013µs | 51.129µs | 2.64% | 7.199 | 77.257 | 0.23% | 0.008µs | 1 | 200 |
| normalization/normalize_service/normalize_service/test_ASCII | throughput | 19558260.761op/s | 20064991.199op/s ± 45588.312op/s | 20073810.941op/s ± 20468.614op/s | 20092820.655op/s | 20096826.041op/s | 20100331.506op/s | 20101930.814op/s | 0.14% | -7.012 | 74.404 | 0.23% | 3223.580op/s | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... | execution_time | [538.375µs; 538.564µs] or [-0.017%; +0.017%] | None | None | None |
| normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... | throughput | [1856793.970op/s; 1857442.273op/s] or [-0.017%; +0.017%] | None | None | None |
| normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて | execution_time | [467.648µs; 467.730µs] or [-0.009%; +0.009%] | None | None | None |
| normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて | throughput | [2137986.671op/s; 2138362.806op/s] or [-0.009%; +0.009%] | None | None | None |
| normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters | execution_time | [184.860µs; 184.936µs] or [-0.020%; +0.020%] | None | None | None |
| normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters | throughput | [5407291.684op/s; 5409501.557op/s] or [-0.020%; +0.020%] | None | None | None |
| normalization/normalize_service/normalize_service/[empty string] | execution_time | [44.851µs; 44.870µs] or [-0.021%; +0.021%] | None | None | None |
| normalization/normalize_service/normalize_service/[empty string] | throughput | [22286745.744op/s; 22295869.143op/s] or [-0.020%; +0.020%] | None | None | None |
| normalization/normalize_service/normalize_service/test_ASCII | execution_time | [49.822µs; 49.854µs] or [-0.032%; +0.032%] | None | None | None |
| normalization/normalize_service/normalize_service/test_ASCII | throughput | [20058673.098op/s; 20071309.301op/s] or [-0.031%; +0.031%] | None | None | None |
Group 7
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 09a4537 | 1727099380 | julio/refactor-ffi |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| write only interface | execution_time | 1.427µs | 3.229µs ± 1.576µs | 3.072µs ± 0.033µs | 3.106µs | 3.185µs | 13.812µs | 18.435µs | 500.13% | 8.038 | 65.847 | 48.68% | 0.111µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| write only interface | execution_time | [3.011µs; 3.448µs] or [-6.764%; +6.764%] | None | None | None |
Group 8
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 09a4537 | 1727099380 | julio/refactor-ffi |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| redis/obfuscate_redis_string | execution_time | 38.735µs | 39.420µs ± 1.230µs | 38.847µs ± 0.050µs | 38.979µs | 42.080µs | 42.108µs | 42.369µs | 9.06% | 1.694 | 0.901 | 3.11% | 0.087µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| redis/obfuscate_redis_string | execution_time | [39.249µs; 39.590µs] or [-0.432%; +0.432%] | None | None | None |
Group 9
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 09a4537 | 1727099380 | julio/refactor-ffi |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| normalization/normalize_trace/test_trace | execution_time | 298.411ns | 307.464ns ± 11.799ns | 301.789ns ± 2.328ns | 307.770ns | 335.395ns | 345.879ns | 346.975ns | 14.97% | 1.943 | 2.747 | 3.83% | 0.834ns | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| normalization/normalize_trace/test_trace | execution_time | [305.828ns; 309.099ns] or [-0.532%; +0.532%] | None | None | None |
Group 10
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 09a4537 | 1727099380 | julio/refactor-ffi |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| concentrator/add_spans_to_concentrator | execution_time | 8.983ms | 9.025ms ± 0.026ms | 9.022ms ± 0.013ms | 9.036ms | 9.061ms | 9.076ms | 9.210ms | 2.08% | 3.272 | 20.155 | 0.28% | 0.002ms | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| concentrator/add_spans_to_concentrator | execution_time | [9.022ms; 9.029ms] or [-0.039%; +0.039%] | None | None | None |
Group 11
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 09a4537 | 1727099380 | julio/refactor-ffi |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| sql/obfuscate_sql_string | execution_time | 73.182µs | 73.324µs ± 0.149µs | 73.304µs ± 0.032µs | 73.337µs | 73.490µs | 73.642µs | 75.121µs | 2.48% | 9.160 | 105.767 | 0.20% | 0.011µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| sql/obfuscate_sql_string | execution_time | [73.303µs; 73.345µs] or [-0.028%; +0.028%] | None | None | None |
Group 12
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 09a4537 | 1727099380 | julio/refactor-ffi |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| tags/replace_trace_tags | execution_time | 2.692µs | 2.721µs ± 0.016µs | 2.721µs ± 0.008µs | 2.727µs | 2.756µs | 2.767µs | 2.772µs | 1.89% | 0.835 | 1.024 | 0.58% | 0.001µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| tags/replace_trace_tags | execution_time | [2.719µs; 2.723µs] or [-0.081%; +0.081%] | None | None | None |
Baseline
Omitted due to size.
Codecov Report
Attention: Patch coverage is 91.27907% with 15 lines in your changes missing coverage. Please review.
Project coverage is 73.74%. Comparing base (
48d6360) to head (09a4537). Report is 1 commits behind head on main.
Additional details and impacted files
@@ Coverage Diff @@
## main #620 +/- ##
==========================================
+ Coverage 73.56% 73.74% +0.17%
==========================================
Files 255 255
Lines 36941 37080 +139
==========================================
+ Hits 27176 27345 +169
+ Misses 9765 9735 -30
| Components | Coverage Δ | |
|---|---|---|
| crashtracker | 20.53% <ø> (ø) |
|
| datadog-alloc | 98.73% <ø> (ø) |
|
| data-pipeline | 93.21% <91.27%> (+1.55%) |
:arrow_up: |
| data-pipeline-ffi | 82.50% <91.27%> (+82.50%) |
:arrow_up: |
| ddcommon | 83.21% <ø> (+0.13%) |
:arrow_up: |
| ddcommon-ffi | 69.90% <ø> (+0.38%) |
:arrow_up: |
| ddtelemetry | 59.10% <ø> (ø) |
|
| ipc | 83.58% <ø> (ø) |
|
| profiling | 84.26% <ø> (ø) |
|
| profiling-ffi | 77.42% <ø> (ø) |
|
| serverless | 0.00% <ø> (ø) |
|
| sidecar | 40.10% <ø> (ø) |
|
| sidecar-ffi | 0.00% <ø> (ø) |
|
| spawn-worker | 50.36% <ø> (ø) |
|
| tinybytes | 94.77% <ø> (ø) |
|
| trace-mini-agent | 72.47% <ø> (ø) |
|
| trace-normalization | 98.25% <ø> (ø) |
|
| trace-obfuscation | 95.73% <ø> (ø) |
|
| trace-protobuf | 77.67% <ø> (ø) |
|
| trace-utils | 93.41% <ø> (ø) |