libdatadog
libdatadog copied to clipboard
Prevent checking for a specific version since crates version can change.
What does this PR do?
Prevent tests from checking for a specific version in libdatadog_version field.
Motivation
Since we're going to versioning individual crates the ffi crate's version doesn't have to match the implementation one.
Benchmarks
Comparison
Benchmark execution time: 2025-10-27 19:09:23
Comparing candidate commit 7380a63b in PR branch julio/fix-version-profiling-tests with baseline commit c4cdaa24 in branch main.
Found 0 performance improvements and 0 performance regressions! Performance is the same for 55 metrics, 2 unstable metrics.
Candidate
Candidate benchmark details
Group 1
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 7380a63b | 1761591329 | julio/fix-version-profiling-tests |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| sdk_test_data/rules-based | execution_time | 120.756µs | 122.575µs ± 1.171µs | 122.377µs ± 0.434µs | 122.863µs | 123.772µs | 127.264µs | 133.719µs | 9.27% | 5.256 | 42.428 | 0.95% | 0.083µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| sdk_test_data/rules-based | execution_time | [122.413µs; 122.737µs] or [-0.132%; +0.132%] | None | None | None |
Group 2
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 7380a63b | 1761591329 | julio/fix-version-profiling-tests |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... | execution_time | 495.955µs | 496.847µs ± 0.531µs | 496.774µs ± 0.258µs | 497.060µs | 497.527µs | 497.979µs | 500.731µs | 0.80% | 3.642 | 23.013 | 0.11% | 0.038µs | 1 | 200 |
| normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... | throughput | 1997080.933op/s | 2012695.455op/s ± 2142.278op/s | 2012989.148op/s ± 1044.189op/s | 2013976.268op/s | 2014957.670op/s | 2015514.926op/s | 2016313.545op/s | 0.17% | -3.605 | 22.665 | 0.11% | 151.482op/s | 1 | 200 |
| normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて | execution_time | 370.130µs | 370.845µs ± 0.258µs | 370.825µs ± 0.158µs | 371.020µs | 371.312µs | 371.365µs | 371.671µs | 0.23% | 0.149 | 0.053 | 0.07% | 0.018µs | 1 | 200 |
| normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて | throughput | 2690552.534op/s | 2696542.818op/s ± 1876.337op/s | 2696689.023op/s ± 1152.335op/s | 2697760.349op/s | 2699297.069op/s | 2700799.744op/s | 2701751.216op/s | 0.19% | -0.145 | 0.051 | 0.07% | 132.677op/s | 1 | 200 |
| normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters | execution_time | 168.477µs | 168.828µs ± 0.161µs | 168.819µs ± 0.088µs | 168.908µs | 169.078µs | 169.339µs | 169.597µs | 0.46% | 0.924 | 3.069 | 0.10% | 0.011µs | 1 | 200 |
| normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters | throughput | 5896340.416op/s | 5923192.363op/s ± 5646.266op/s | 5923520.599op/s ± 3082.023op/s | 5926459.461op/s | 5931299.919op/s | 5934977.576op/s | 5935525.834op/s | 0.20% | -0.912 | 3.023 | 0.10% | 399.251op/s | 1 | 200 |
| normalization/normalize_service/normalize_service/[empty string] | execution_time | 36.662µs | 36.919µs ± 0.138µs | 36.925µs ± 0.111µs | 37.031µs | 37.138µs | 37.198µs | 37.217µs | 0.79% | 0.009 | -0.901 | 0.37% | 0.010µs | 1 | 200 |
| normalization/normalize_service/normalize_service/[empty string] | throughput | 26869598.519op/s | 27086870.804op/s ± 101152.076op/s | 27081851.632op/s ± 81270.524op/s | 27167591.246op/s | 27246919.632op/s | 27272032.333op/s | 27276006.228op/s | 0.72% | 0.003 | -0.904 | 0.37% | 7152.532op/s | 1 | 200 |
| normalization/normalize_service/normalize_service/test_ASCII | execution_time | 46.219µs | 46.366µs ± 0.133µs | 46.349µs ± 0.039µs | 46.390µs | 46.470µs | 46.578µs | 47.905µs | 3.36% | 8.306 | 90.078 | 0.29% | 0.009µs | 1 | 200 |
| normalization/normalize_service/normalize_service/test_ASCII | throughput | 20874846.251op/s | 21567499.689op/s ± 60386.793op/s | 21575368.696op/s ± 18335.311op/s | 21593091.507op/s | 21613137.334op/s | 21625473.505op/s | 21636274.512op/s | 0.28% | -8.110 | 86.911 | 0.28% | 4269.991op/s | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... | execution_time | [496.773µs; 496.920µs] or [-0.015%; +0.015%] | None | None | None |
| normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... | throughput | [2012398.555op/s; 2012992.354op/s] or [-0.015%; +0.015%] | None | None | None |
| normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて | execution_time | [370.810µs; 370.881µs] or [-0.010%; +0.010%] | None | None | None |
| normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて | throughput | [2696282.776op/s; 2696802.860op/s] or [-0.010%; +0.010%] | None | None | None |
| normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters | execution_time | [168.806µs; 168.850µs] or [-0.013%; +0.013%] | None | None | None |
| normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters | throughput | [5922409.845op/s; 5923974.882op/s] or [-0.013%; +0.013%] | None | None | None |
| normalization/normalize_service/normalize_service/[empty string] | execution_time | [36.900µs; 36.938µs] or [-0.052%; +0.052%] | None | None | None |
| normalization/normalize_service/normalize_service/[empty string] | throughput | [27072852.099op/s; 27100889.509op/s] or [-0.052%; +0.052%] | None | None | None |
| normalization/normalize_service/normalize_service/test_ASCII | execution_time | [46.348µs; 46.385µs] or [-0.040%; +0.040%] | None | None | None |
| normalization/normalize_service/normalize_service/test_ASCII | throughput | [21559130.660op/s; 21575868.717op/s] or [-0.039%; +0.039%] | None | None | None |
Group 3
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 7380a63b | 1761591329 | julio/fix-version-profiling-tests |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| benching serializing traces from their internal representation to msgpack | execution_time | 14.559ms | 14.621ms ± 0.034ms | 14.619ms ± 0.016ms | 14.633ms | 14.668ms | 14.754ms | 14.804ms | 1.27% | 2.201 | 7.715 | 0.23% | 0.002ms | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| benching serializing traces from their internal representation to msgpack | execution_time | [14.617ms; 14.626ms] or [-0.032%; +0.032%] | None | None | None |
Group 4
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 7380a63b | 1761591329 | julio/fix-version-profiling-tests |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... | execution_time | 185.463µs | 185.997µs ± 0.247µs | 185.981µs ± 0.191µs | 186.178µs | 186.450µs | 186.584µs | 186.815µs | 0.45% | 0.458 | 0.002 | 0.13% | 0.017µs | 1 | 200 |
| normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... | throughput | 5352886.357op/s | 5376449.615op/s ± 7149.321op/s | 5376892.977op/s ± 5520.531op/s | 5382366.875op/s | 5387168.638op/s | 5388474.775op/s | 5391903.060op/s | 0.28% | -0.450 | -0.011 | 0.13% | 505.533op/s | 1 | 200 |
| normalization/normalize_name/normalize_name/bad-name | execution_time | 17.790µs | 17.854µs ± 0.030µs | 17.851µs ± 0.015µs | 17.868µs | 17.905µs | 17.946µs | 18.017µs | 0.93% | 1.401 | 4.852 | 0.17% | 0.002µs | 1 | 200 |
| normalization/normalize_name/normalize_name/bad-name | throughput | 55504559.770op/s | 56010596.355op/s ± 94195.135op/s | 56018347.656op/s ± 46530.294op/s | 56061317.896op/s | 56142533.395op/s | 56178995.041op/s | 56211726.427op/s | 0.35% | -1.376 | 4.731 | 0.17% | 6660.602op/s | 1 | 200 |
| normalization/normalize_name/normalize_name/good | execution_time | 10.530µs | 10.578µs ± 0.022µs | 10.576µs ± 0.018µs | 10.596µs | 10.613µs | 10.620µs | 10.639µs | 0.59% | -0.045 | -0.597 | 0.20% | 0.002µs | 1 | 200 |
| normalization/normalize_name/normalize_name/good | throughput | 93996406.774op/s | 94533644.784op/s ± 193029.250op/s | 94550489.538op/s ± 157690.883op/s | 94665661.681op/s | 94890099.991op/s | 94949064.399op/s | 94968333.097op/s | 0.44% | 0.053 | -0.596 | 0.20% | 13649.229op/s | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... | execution_time | [185.962µs; 186.031µs] or [-0.018%; +0.018%] | None | None | None |
| normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... | throughput | [5375458.788op/s; 5377440.442op/s] or [-0.018%; +0.018%] | None | None | None |
| normalization/normalize_name/normalize_name/bad-name | execution_time | [17.850µs; 17.858µs] or [-0.023%; +0.023%] | None | None | None |
| normalization/normalize_name/normalize_name/bad-name | throughput | [55997541.815op/s; 56023650.895op/s] or [-0.023%; +0.023%] | None | None | None |
| normalization/normalize_name/normalize_name/good | execution_time | [10.575µs; 10.581µs] or [-0.028%; +0.028%] | None | None | None |
| normalization/normalize_name/normalize_name/good | throughput | [94506892.786op/s; 94560396.781op/s] or [-0.028%; +0.028%] | None | None | None |
Group 5
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 7380a63b | 1761591329 | julio/fix-version-profiling-tests |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| write only interface | execution_time | 1.220µs | 3.257µs ± 1.425µs | 3.045µs ± 0.029µs | 3.073µs | 3.704µs | 13.876µs | 14.910µs | 389.66% | 7.313 | 54.817 | 43.63% | 0.101µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| write only interface | execution_time | [3.059µs; 3.454µs] or [-6.062%; +6.062%] | None | None | None |
Group 6
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 7380a63b | 1761591329 | julio/fix-version-profiling-tests |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| redis/obfuscate_redis_string | execution_time | 33.538µs | 34.171µs ± 0.879µs | 33.778µs ± 0.081µs | 33.925µs | 36.029µs | 36.059µs | 37.371µs | 10.64% | 1.722 | 1.242 | 2.57% | 0.062µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| redis/obfuscate_redis_string | execution_time | [34.049µs; 34.292µs] or [-0.356%; +0.356%] | None | None | None |
Group 7
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 7380a63b | 1761591329 | julio/fix-version-profiling-tests |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| sql/obfuscate_sql_string | execution_time | 86.162µs | 86.352µs ± 0.155µs | 86.329µs ± 0.048µs | 86.386µs | 86.495µs | 86.896µs | 87.975µs | 1.91% | 6.625 | 61.975 | 0.18% | 0.011µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| sql/obfuscate_sql_string | execution_time | [86.331µs; 86.373µs] or [-0.025%; +0.025%] | None | None | None |
Group 8
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 7380a63b | 1761591329 | julio/fix-version-profiling-tests |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| two way interface | execution_time | 17.804µs | 25.928µs ± 10.183µs | 18.070µs ± 0.220µs | 34.499µs | 41.051µs | 52.829µs | 77.661µs | 329.78% | 1.272 | 2.662 | 39.18% | 0.720µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| two way interface | execution_time | [24.517µs; 27.339µs] or [-5.443%; +5.443%] | None | None | None |
Group 9
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 7380a63b | 1761591329 | julio/fix-version-profiling-tests |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| single_flag_killswitch/rules-based | execution_time | 171.693ns | 175.097ns ± 2.926ns | 174.430ns ± 1.905ns | 176.710ns | 181.098ns | 183.314ns | 184.818ns | 5.96% | 1.094 | 0.603 | 1.67% | 0.207ns | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| single_flag_killswitch/rules-based | execution_time | [174.691ns; 175.502ns] or [-0.232%; +0.232%] | None | None | None |
Group 10
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 7380a63b | 1761591329 | julio/fix-version-profiling-tests |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| credit_card/is_card_number/ | execution_time | 3.892µs | 3.912µs ± 0.003µs | 3.913µs ± 0.002µs | 3.914µs | 3.917µs | 3.919µs | 3.920µs | 0.19% | -1.483 | 10.396 | 0.08% | 0.000µs | 1 | 200 |
| credit_card/is_card_number/ | throughput | 255108352.708op/s | 255592520.648op/s ± 192831.656op/s | 255584705.740op/s ± 127670.739op/s | 255718577.959op/s | 255851924.881op/s | 255896113.427op/s | 256942600.108op/s | 0.53% | 1.506 | 10.581 | 0.08% | 13635.257op/s | 1 | 200 |
| credit_card/is_card_number/ 3782-8224-6310-005 | execution_time | 79.082µs | 81.241µs ± 0.997µs | 81.189µs ± 0.605µs | 81.831µs | 82.898µs | 83.823µs | 84.109µs | 3.60% | 0.231 | -0.015 | 1.22% | 0.071µs | 1 | 200 |
| credit_card/is_card_number/ 3782-8224-6310-005 | throughput | 11889321.437op/s | 12310842.410op/s ± 150764.843op/s | 12316913.087op/s ± 91744.718op/s | 12401414.752op/s | 12561029.877op/s | 12631910.354op/s | 12645031.053op/s | 2.66% | -0.161 | -0.079 | 1.22% | 10660.684op/s | 1 | 200 |
| credit_card/is_card_number/ 378282246310005 | execution_time | 71.476µs | 72.389µs ± 0.437µs | 72.389µs ± 0.354µs | 72.720µs | 73.071µs | 73.213µs | 73.568µs | 1.63% | 0.102 | -0.698 | 0.60% | 0.031µs | 1 | 200 |
| credit_card/is_card_number/ 378282246310005 | throughput | 13592849.058op/s | 13814751.011op/s ± 83431.748op/s | 13814216.902op/s ± 67449.195op/s | 13883731.747op/s | 13952356.030op/s | 13972697.855op/s | 13990752.721op/s | 1.28% | -0.078 | -0.710 | 0.60% | 5899.516op/s | 1 | 200 |
| credit_card/is_card_number/37828224631 | execution_time | 3.896µs | 3.912µs ± 0.003µs | 3.912µs ± 0.002µs | 3.914µs | 3.917µs | 3.918µs | 3.920µs | 0.21% | -0.644 | 5.419 | 0.07% | 0.000µs | 1 | 200 |
| credit_card/is_card_number/37828224631 | throughput | 255070409.708op/s | 255604756.531op/s ± 177336.671op/s | 255615685.167op/s ± 104972.515op/s | 255716487.321op/s | 255856696.881op/s | 255877169.153op/s | 256664596.888op/s | 0.41% | 0.659 | 5.500 | 0.07% | 12539.596op/s | 1 | 200 |
| credit_card/is_card_number/378282246310005 | execution_time | 68.455µs | 69.312µs ± 0.341µs | 69.300µs ± 0.241µs | 69.523µs | 69.898µs | 70.189µs | 70.235µs | 1.35% | 0.264 | -0.251 | 0.49% | 0.024µs | 1 | 200 |
| credit_card/is_card_number/378282246310005 | throughput | 14237841.473op/s | 14427841.823op/s ± 70839.948op/s | 14430054.708op/s ± 50452.369op/s | 14481562.885op/s | 14534736.390op/s | 14566393.058op/s | 14608091.109op/s | 1.23% | -0.239 | -0.271 | 0.49% | 5009.141op/s | 1 | 200 |
| credit_card/is_card_number/37828224631000521389798 | execution_time | 45.377µs | 45.621µs ± 0.122µs | 45.626µs ± 0.106µs | 45.729µs | 45.798µs | 45.824µs | 45.849µs | 0.49% | -0.160 | -1.021 | 0.27% | 0.009µs | 1 | 200 |
| credit_card/is_card_number/37828224631000521389798 | throughput | 21810860.579op/s | 21919947.253op/s ± 58560.196op/s | 21917211.047op/s ± 50971.791op/s | 21969717.515op/s | 22018569.478op/s | 22029887.156op/s | 22037395.256op/s | 0.55% | 0.168 | -1.017 | 0.27% | 4140.831op/s | 1 | 200 |
| credit_card/is_card_number/x371413321323331 | execution_time | 6.427µs | 6.436µs ± 0.005µs | 6.436µs ± 0.003µs | 6.438µs | 6.448µs | 6.451µs | 6.453µs | 0.27% | 0.983 | 0.965 | 0.08% | 0.000µs | 1 | 200 |
| credit_card/is_card_number/x371413321323331 | throughput | 154963439.092op/s | 155369773.175op/s ± 123531.563op/s | 155384440.593op/s ± 71127.155op/s | 155459529.998op/s | 155529939.513op/s | 155577480.554op/s | 155599941.843op/s | 0.14% | -0.978 | 0.954 | 0.08% | 8735.001op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/ | execution_time | 3.890µs | 3.912µs ± 0.004µs | 3.912µs ± 0.002µs | 3.914µs | 3.920µs | 3.923µs | 3.925µs | 0.33% | -0.144 | 5.854 | 0.10% | 0.000µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/ | throughput | 254770010.261op/s | 255597702.266op/s ± 251648.635op/s | 255611515.306op/s ± 152172.399op/s | 255766484.802op/s | 255884228.529op/s | 255948637.214op/s | 257077889.370op/s | 0.57% | 0.168 | 5.961 | 0.10% | 17794.246op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 | execution_time | 59.902µs | 62.172µs ± 1.019µs | 62.103µs ± 0.760µs | 62.880µs | 63.789µs | 64.193µs | 64.806µs | 4.35% | 0.124 | -0.655 | 1.63% | 0.072µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 | throughput | 15430614.148op/s | 16088811.548op/s ± 263187.840op/s | 16102243.189op/s ± 198118.735op/s | 16292920.280op/s | 16439117.461op/s | 16675783.361op/s | 16693907.620op/s | 3.67% | -0.058 | -0.663 | 1.63% | 18610.191op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/ 378282246310005 | execution_time | 53.917µs | 54.285µs ± 0.135µs | 54.312µs ± 0.075µs | 54.380µs | 54.459µs | 54.497µs | 54.504µs | 0.35% | -0.877 | 0.036 | 0.25% | 0.010µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/ 378282246310005 | throughput | 18347308.197op/s | 18421549.066op/s ± 45822.903op/s | 18412288.462op/s ± 25486.944op/s | 18442256.394op/s | 18514871.253op/s | 18540417.703op/s | 18547105.940op/s | 0.73% | 0.886 | 0.052 | 0.25% | 3240.169op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/37828224631 | execution_time | 3.895µs | 3.913µs ± 0.003µs | 3.913µs ± 0.002µs | 3.914µs | 3.917µs | 3.918µs | 3.919µs | 0.16% | -1.224 | 7.688 | 0.07% | 0.000µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/37828224631 | throughput | 255153104.835op/s | 255581330.131op/s ± 178376.684op/s | 255557667.158op/s ± 109415.705op/s | 255709736.151op/s | 255818438.821op/s | 255949976.363op/s | 256746524.509op/s | 0.47% | 1.241 | 7.811 | 0.07% | 12613.136op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/378282246310005 | execution_time | 50.196µs | 50.613µs ± 0.122µs | 50.616µs ± 0.050µs | 50.665µs | 50.764µs | 50.986µs | 51.111µs | 0.98% | 0.152 | 3.618 | 0.24% | 0.009µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/378282246310005 | throughput | 19565129.120op/s | 19757797.402op/s ± 47477.250op/s | 19756454.540op/s ± 19632.457op/s | 19775960.236op/s | 19830222.787op/s | 19899186.189op/s | 19922035.764op/s | 0.84% | -0.112 | 3.582 | 0.24% | 3357.149op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/37828224631000521389798 | execution_time | 45.343µs | 45.649µs ± 0.159µs | 45.646µs ± 0.132µs | 45.779µs | 45.892µs | 45.919µs | 45.956µs | 0.68% | -0.089 | -1.041 | 0.35% | 0.011µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/37828224631000521389798 | throughput | 21759754.033op/s | 21906768.975op/s ± 76257.286op/s | 21907583.356op/s ± 62973.634op/s | 21968339.679op/s | 22035390.397op/s | 22043915.694op/s | 22054138.580op/s | 0.67% | 0.099 | -1.039 | 0.35% | 5392.204op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/x371413321323331 | execution_time | 6.427µs | 6.436µs ± 0.005µs | 6.436µs ± 0.003µs | 6.439µs | 6.443µs | 6.447µs | 6.451µs | 0.23% | 0.244 | -0.031 | 0.07% | 0.000µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/x371413321323331 | throughput | 155011695.702op/s | 155371859.707op/s ± 108929.425op/s | 155367427.219op/s ± 77364.199op/s | 155447776.883op/s | 155545803.194op/s | 155582229.422op/s | 155588121.598op/s | 0.14% | -0.240 | -0.038 | 0.07% | 7702.474op/s | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| credit_card/is_card_number/ | execution_time | [3.912µs; 3.913µs] or [-0.010%; +0.010%] | None | None | None |
| credit_card/is_card_number/ | throughput | [255565796.035op/s; 255619245.261op/s] or [-0.010%; +0.010%] | None | None | None |
| credit_card/is_card_number/ 3782-8224-6310-005 | execution_time | [81.103µs; 81.380µs] or [-0.170%; +0.170%] | None | None | None |
| credit_card/is_card_number/ 3782-8224-6310-005 | throughput | [12289947.853op/s; 12331736.967op/s] or [-0.170%; +0.170%] | None | None | None |
| credit_card/is_card_number/ 378282246310005 | execution_time | [72.328µs; 72.450µs] or [-0.084%; +0.084%] | None | None | None |
| credit_card/is_card_number/ 378282246310005 | throughput | [13803188.173op/s; 13826313.849op/s] or [-0.084%; +0.084%] | None | None | None |
| credit_card/is_card_number/37828224631 | execution_time | [3.912µs; 3.913µs] or [-0.010%; +0.010%] | None | None | None |
| credit_card/is_card_number/37828224631 | throughput | [255580179.374op/s; 255629333.688op/s] or [-0.010%; +0.010%] | None | None | None |
| credit_card/is_card_number/378282246310005 | execution_time | [69.265µs; 69.359µs] or [-0.068%; +0.068%] | None | None | None |
| credit_card/is_card_number/378282246310005 | throughput | [14418024.087op/s; 14437659.558op/s] or [-0.068%; +0.068%] | None | None | None |
| credit_card/is_card_number/37828224631000521389798 | execution_time | [45.604µs; 45.638µs] or [-0.037%; +0.037%] | None | None | None |
| credit_card/is_card_number/37828224631000521389798 | throughput | [21911831.373op/s; 21928063.133op/s] or [-0.037%; +0.037%] | None | None | None |
| credit_card/is_card_number/x371413321323331 | execution_time | [6.436µs; 6.437µs] or [-0.011%; +0.011%] | None | None | None |
| credit_card/is_card_number/x371413321323331 | throughput | [155352652.888op/s; 155386893.462op/s] or [-0.011%; +0.011%] | None | None | None |
| credit_card/is_card_number_no_luhn/ | execution_time | [3.912µs; 3.913µs] or [-0.014%; +0.014%] | None | None | None |
| credit_card/is_card_number_no_luhn/ | throughput | [255562826.185op/s; 255632578.347op/s] or [-0.014%; +0.014%] | None | None | None |
| credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 | execution_time | [62.030µs; 62.313µs] or [-0.227%; +0.227%] | None | None | None |
| credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 | throughput | [16052336.245op/s; 16125286.852op/s] or [-0.227%; +0.227%] | None | None | None |
| credit_card/is_card_number_no_luhn/ 378282246310005 | execution_time | [54.266µs; 54.303µs] or [-0.034%; +0.034%] | None | None | None |
| credit_card/is_card_number_no_luhn/ 378282246310005 | throughput | [18415198.452op/s; 18427899.679op/s] or [-0.034%; +0.034%] | None | None | None |
| credit_card/is_card_number_no_luhn/37828224631 | execution_time | [3.912µs; 3.913µs] or [-0.010%; +0.010%] | None | None | None |
| credit_card/is_card_number_no_luhn/37828224631 | throughput | [255556608.838op/s; 255606051.424op/s] or [-0.010%; +0.010%] | None | None | None |
| credit_card/is_card_number_no_luhn/378282246310005 | execution_time | [50.596µs; 50.630µs] or [-0.033%; +0.033%] | None | None | None |
| credit_card/is_card_number_no_luhn/378282246310005 | throughput | [19751217.512op/s; 19764377.292op/s] or [-0.033%; +0.033%] | None | None | None |
| credit_card/is_card_number_no_luhn/37828224631000521389798 | execution_time | [45.627µs; 45.671µs] or [-0.048%; +0.048%] | None | None | None |
| credit_card/is_card_number_no_luhn/37828224631000521389798 | throughput | [21896200.449op/s; 21917337.502op/s] or [-0.048%; +0.048%] | None | None | None |
| credit_card/is_card_number_no_luhn/x371413321323331 | execution_time | [6.436µs; 6.437µs] or [-0.010%; +0.010%] | None | None | None |
| credit_card/is_card_number_no_luhn/x371413321323331 | throughput | [155356763.137op/s; 155386956.278op/s] or [-0.010%; +0.010%] | None | None | None |
Group 11
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 7380a63b | 1761591329 | julio/fix-version-profiling-tests |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| concentrator/add_spans_to_concentrator | execution_time | 10.692ms | 10.717ms ± 0.016ms | 10.716ms ± 0.008ms | 10.723ms | 10.735ms | 10.753ms | 10.835ms | 1.11% | 3.552 | 22.678 | 0.15% | 0.001ms | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| concentrator/add_spans_to_concentrator | execution_time | [10.715ms; 10.719ms] or [-0.020%; +0.020%] | None | None | None |
Group 12
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 7380a63b | 1761591329 | julio/fix-version-profiling-tests |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| benching string interning on wordpress profile | execution_time | 161.607µs | 162.636µs ± 0.356µs | 162.585µs ± 0.158µs | 162.753µs | 163.114µs | 163.967µs | 165.143µs | 1.57% | 3.141 | 18.424 | 0.22% | 0.025µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| benching string interning on wordpress profile | execution_time | [162.586µs; 162.685µs] or [-0.030%; +0.030%] | None | None | None |
Group 13
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 7380a63b | 1761591329 | julio/fix-version-profiling-tests |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| ip_address/quantize_peer_ip_address_benchmark | execution_time | 5.007µs | 5.084µs ± 0.034µs | 5.073µs ± 0.028µs | 5.119µs | 5.130µs | 5.138µs | 5.168µs | 1.87% | 0.083 | -1.250 | 0.66% | 0.002µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| ip_address/quantize_peer_ip_address_benchmark | execution_time | [5.079µs; 5.088µs] or [-0.092%; +0.092%] | None | None | None |
Group 14
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 7380a63b | 1761591329 | julio/fix-version-profiling-tests |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| receiver_entry_point/report/2597 | execution_time | 6.042ms | 6.313ms ± 0.131ms | 6.385ms ± 0.027ms | 6.401ms | 6.427ms | 6.477ms | 6.542ms | 2.46% | -0.890 | -0.839 | 2.06% | 0.009ms | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| receiver_entry_point/report/2597 | execution_time | [6.295ms; 6.331ms] or [-0.287%; +0.287%] | None | None | None |
Group 15
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 7380a63b | 1761591329 | julio/fix-version-profiling-tests |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| normalization/normalize_trace/test_trace | execution_time | 239.817ns | 252.314ns ± 14.945ns | 246.431ns ± 3.810ns | 254.823ns | 288.159ns | 302.457ns | 302.971ns | 22.94% | 1.871 | 2.800 | 5.91% | 1.057ns | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| normalization/normalize_trace/test_trace | execution_time | [250.243ns; 254.385ns] or [-0.821%; +0.821%] | None | None | None |
Group 16
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 7380a63b | 1761591329 | julio/fix-version-profiling-tests |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| benching deserializing traces from msgpack to their internal representation | execution_time | 63.103ms | 63.650ms ± 2.464ms | 63.330ms ± 0.069ms | 63.392ms | 63.732ms | 82.577ms | 84.806ms | 33.91% | 7.940 | 61.557 | 3.86% | 0.174ms | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| benching deserializing traces from msgpack to their internal representation | execution_time | [63.309ms; 63.992ms] or [-0.537%; +0.537%] | None | None | None |
Group 17
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 7380a63b | 1761591329 | julio/fix-version-profiling-tests |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| tags/replace_trace_tags | execution_time | 2.415µs | 2.437µs ± 0.016µs | 2.437µs ± 0.010µs | 2.443µs | 2.481µs | 2.485µs | 2.491µs | 2.22% | 1.283 | 1.893 | 0.67% | 0.001µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| tags/replace_trace_tags | execution_time | [2.435µs; 2.439µs] or [-0.093%; +0.093%] | None | None | None |
Baseline
Omitted due to size.
Codecov Report
:white_check_mark: All modified and coverable lines are covered by tests.
:white_check_mark: Project coverage is 71.92%. Comparing base (636b792) to head (7380a63).
:warning: Report is 2 commits behind head on main.
Additional details and impacted files
@@ Coverage Diff @@
## main #1280 +/- ##
==========================================
+ Coverage 71.80% 71.92% +0.11%
==========================================
Files 368 368
Lines 57967 58150 +183
==========================================
+ Hits 41626 41824 +198
+ Misses 16341 16326 -15
| Components | Coverage Δ | |
|---|---|---|
| datadog-crashtracker | 50.65% <ø> (+1.62%) |
:arrow_up: |
| datadog-crashtracker-ffi | 5.86% <ø> (ø) |
|
| datadog-alloc | 98.73% <ø> (ø) |
|
| data-pipeline | 87.86% <ø> (ø) |
|
| data-pipeline-ffi | 88.19% <ø> (ø) |
|
| ddcommon | 84.31% <ø> (ø) |
|
| ddcommon-ffi | 73.84% <ø> (ø) |
|
| ddtelemetry | 59.98% <ø> (-0.04%) |
:arrow_down: |
| ddtelemetry-ffi | 21.24% <ø> (ø) |
|
| dogstatsd-client | 83.26% <ø> (ø) |
|
| datadog-ipc | 82.39% <ø> (ø) |
|
| datadog-profiling | 76.91% <100.00%> (+0.01%) |
:arrow_up: |
| datadog-profiling-ffi | 62.22% <100.00%> (+0.10%) |
:arrow_up: |
| datadog-sidecar | 37.24% <ø> (ø) |
|
| datdog-sidecar-ffi | 13.71% <ø> (ø) |
|
| spawn-worker | 55.18% <ø> (ø) |
|
| tinybytes | 92.44% <ø> (+0.21%) |
:arrow_up: |
| datadog-trace-normalization | 98.24% <ø> (ø) |
|
| datadog-trace-obfuscation | 94.17% <ø> (ø) |
|
| datadog-trace-protobuf | 59.65% <ø> (ø) |
|
| datadog-trace-utils | 90.00% <ø> (-0.01%) |
:arrow_down: |
| datadog-tracer-flare | 61.03% <ø> (ø) |
|
| datadog-log | 75.57% <ø> (ø) |
:rocket: New features to boost your workflow:
- :snowflake: Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
Artifact Size Benchmark Report
aarch64-alpine-linux-musl
| Artifact | Baseline | Commit | Change |
|---|---|---|---|
| /aarch64-alpine-linux-musl/lib/libdatadog_profiling.so | 7.25 MB | 7.25 MB | 0% (0 B) 👌 |
| /aarch64-alpine-linux-musl/lib/libdatadog_profiling.a | 71.35 MB | 71.35 MB | 0% (0 B) 👌 |
aarch64-unknown-linux-gnu
| Artifact | Baseline | Commit | Change |
|---|---|---|---|
| /aarch64-unknown-linux-gnu/lib/libdatadog_profiling.a | 83.70 MB | 83.70 MB | 0% (0 B) 👌 |
| /aarch64-unknown-linux-gnu/lib/libdatadog_profiling.so | 9.20 MB | 9.20 MB | 0% (0 B) 👌 |
libdatadog-x64-windows
| Artifact | Baseline | Commit | Change |
|---|---|---|---|
| /libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.dll | 18.55 MB | 18.55 MB | 0% (0 B) 👌 |
| /libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.lib | 65.77 KB | 65.77 KB | 0% (0 B) 👌 |
| /libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.pdb | 129.26 MB | 129.24 MB | --.01% (-16.00 KB) 💪 |
| /libdatadog-x64-windows/debug/static/datadog_profiling_ffi.lib | 677.95 MB | 677.95 MB | 0% (0 B) 👌 |
| /libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.dll | 5.93 MB | 5.93 MB | 0% (0 B) 👌 |
| /libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.lib | 65.77 KB | 65.77 KB | 0% (0 B) 👌 |
| /libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.pdb | 17.51 MB | 17.51 MB | 0% (0 B) 👌 |
| /libdatadog-x64-windows/release/static/datadog_profiling_ffi.lib | 32.46 MB | 32.46 MB | 0% (0 B) 👌 |
libdatadog-x86-windows
| Artifact | Baseline | Commit | Change |
|---|---|---|---|
| /libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.dll | 15.81 MB | 15.81 MB | 0% (0 B) 👌 |
| /libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.lib | 66.79 KB | 66.79 KB | 0% (0 B) 👌 |
| /libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.pdb | 131.42 MB | 131.42 MB | 0% (0 B) 👌 |
| /libdatadog-x86-windows/debug/static/datadog_profiling_ffi.lib | 666.48 MB | 666.48 MB | 0% (0 B) 👌 |
| /libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.dll | 4.54 MB | 4.54 MB | 0% (0 B) 👌 |
| /libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.lib | 66.79 KB | 66.79 KB | 0% (0 B) 👌 |
| /libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.pdb | 18.66 MB | 18.66 MB | 0% (0 B) 👌 |
| /libdatadog-x86-windows/release/static/datadog_profiling_ffi.lib | 30.52 MB | 30.52 MB | 0% (0 B) 👌 |
x86_64-alpine-linux-musl
| Artifact | Baseline | Commit | Change |
|---|---|---|---|
| /x86_64-alpine-linux-musl/lib/libdatadog_profiling.a | 63.95 MB | 63.95 MB | 0% (0 B) 👌 |
| /x86_64-alpine-linux-musl/lib/libdatadog_profiling.so | 8.56 MB | 8.56 MB | 0% (0 B) 👌 |
x86_64-unknown-linux-gnu
| Artifact | Baseline | Commit | Change |
|---|---|---|---|
| /x86_64-unknown-linux-gnu/lib/libdatadog_profiling.a | 78.42 MB | 78.42 MB | 0% (0 B) 👌 |
| /x86_64-unknown-linux-gnu/lib/libdatadog_profiling.so | 9.91 MB | 9.91 MB | 0% (0 B) 👌 |