libdatadog
libdatadog copied to clipboard
ci(codecov): simplify codecov configuration
What does this PR do?
A brief description of the change being made with this pull request.
Motivation
What inspired you to submit this pull request?
Additional Notes
Anything else we should know when reviewing?
How to test the change?
Describe here in detail how the change can be validated.
Codecov Report
:white_check_mark: All modified and coverable lines are covered by tests.
:white_check_mark: Project coverage is 72.04%. Comparing base (3e9119a) to head (a99e306).
:warning: Report is 4 commits behind head on main.
Additional details and impacted files
@@ Coverage Diff @@
## main #1335 +/- ##
==========================================
+ Coverage 70.95% 72.04% +1.09%
==========================================
Files 390 373 -17
Lines 62562 61479 -1083
==========================================
- Hits 44389 44293 -96
+ Misses 18173 17186 -987
| Components | Coverage Δ | |
|---|---|---|
| libdd-crashtracker | 57.81% <ø> (+0.16%) |
:arrow_up: |
| libdd-crashtracker-ffi | 15.31% <ø> (+0.70%) |
:arrow_up: |
| libdd-alloc | 98.73% <ø> (ø) |
|
| libdd-data-pipeline | 86.00% <ø> (-0.02%) |
:arrow_down: |
| libdd-data-pipeline-ffi | 77.63% <ø> (-0.11%) |
:arrow_down: |
| libdd-common | 80.93% <ø> (ø) |
|
| libdd-common-ffi | 73.90% <ø> (ø) |
|
| libdd-telemetry | 60.02% <ø> (ø) |
|
| libdd-telemetry-ffi | 21.24% <ø> (ø) |
|
| libdd-dogstatsd-client | 83.75% <ø> (ø) |
|
| datadog-ipc | 82.61% <ø> (ø) |
|
| libdd-profiling | 79.65% <ø> (ø) |
|
| libdd-profiling-ffi | 62.13% <ø> (ø) |
|
| datadog-sidecar | 36.98% <ø> (+1.07%) |
:arrow_up: |
| datdog-sidecar-ffi | 16.40% <ø> (+5.41%) |
:arrow_up: |
| spawn-worker | 55.18% <ø> (ø) |
|
| libdd-tinybytes | 92.44% <ø> (ø) |
|
| libdd-trace-normalization | 98.24% <ø> (ø) |
|
| datadog-trace-obfuscation | 94.17% <ø> (ø) |
|
| libdd-trace-protobuf | 59.65% <ø> (ø) |
|
| libdd-trace-utils | 90.25% <ø> (+0.17%) |
:arrow_up: |
| datadog-tracer-flare | 62.06% <ø> (-1.43%) |
:arrow_down: |
| libdd-log | 75.57% <ø> (ø) |
:rocket: New features to boost your workflow:
- :snowflake: Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
Benchmarks
Comparison
Benchmark execution time: 2025-11-19 15:11:43
Comparing candidate commit a99e306d in PR branch ban/simplify-codecov with baseline commit 3e9119ad in branch main.
Found 0 performance improvements and 0 performance regressions! Performance is the same for 55 metrics, 2 unstable metrics.
Candidate
Candidate benchmark details
Group 1
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | a99e306d | 1763564198 | ban/simplify-codecov |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| redis/obfuscate_redis_string | execution_time | 33.866µs | 34.456µs ± 0.938µs | 34.018µs ± 0.032µs | 34.112µs | 36.429µs | 36.506µs | 38.004µs | 11.72% | 1.758 | 1.377 | 2.72% | 0.066µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| redis/obfuscate_redis_string | execution_time | [34.326µs; 34.586µs] or [-0.377%; +0.377%] | None | None | None |
Group 2
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | a99e306d | 1763564198 | ban/simplify-codecov |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| concentrator/add_spans_to_concentrator | execution_time | 10.604ms | 10.629ms ± 0.014ms | 10.627ms ± 0.008ms | 10.636ms | 10.652ms | 10.676ms | 10.717ms | 0.85% | 2.029 | 8.662 | 0.13% | 0.001ms | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| concentrator/add_spans_to_concentrator | execution_time | [10.627ms; 10.631ms] or [-0.019%; +0.019%] | None | None | None |
Group 3
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | a99e306d | 1763564198 | ban/simplify-codecov |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| single_flag_killswitch/rules-based | execution_time | 190.305ns | 192.867ns ± 1.953ns | 192.591ns ± 1.223ns | 193.648ns | 196.645ns | 199.055ns | 201.081ns | 4.41% | 1.246 | 1.914 | 1.01% | 0.138ns | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| single_flag_killswitch/rules-based | execution_time | [192.596ns; 193.138ns] or [-0.140%; +0.140%] | None | None | None |
Group 4
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | a99e306d | 1763564198 | ban/simplify-codecov |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| ip_address/quantize_peer_ip_address_benchmark | execution_time | 5.032µs | 5.098µs ± 0.035µs | 5.094µs ± 0.029µs | 5.132µs | 5.157µs | 5.162µs | 5.166µs | 1.40% | 0.296 | -1.224 | 0.68% | 0.002µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| ip_address/quantize_peer_ip_address_benchmark | execution_time | [5.094µs; 5.103µs] or [-0.094%; +0.094%] | None | None | None |
Group 5
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | a99e306d | 1763564198 | ban/simplify-codecov |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| sql/obfuscate_sql_string | execution_time | 85.980µs | 86.222µs ± 0.154µs | 86.196µs ± 0.051µs | 86.254µs | 86.397µs | 86.533µs | 87.947µs | 2.03% | 7.275 | 77.382 | 0.18% | 0.011µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| sql/obfuscate_sql_string | execution_time | [86.200µs; 86.243µs] or [-0.025%; +0.025%] | None | None | None |
Group 6
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | a99e306d | 1763564198 | ban/simplify-codecov |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| credit_card/is_card_number/ | execution_time | 3.894µs | 3.916µs ± 0.003µs | 3.915µs ± 0.002µs | 3.918µs | 3.920µs | 3.921µs | 3.923µs | 0.19% | -1.673 | 11.755 | 0.08% | 0.000µs | 1 | 200 |
| credit_card/is_card_number/ | throughput | 254919777.095op/s | 255380036.559op/s ± 200488.169op/s | 255396589.921op/s ± 138319.500op/s | 255502210.103op/s | 255634674.739op/s | 255726669.424op/s | 256827128.504op/s | 0.56% | 1.699 | 11.977 | 0.08% | 14176.654op/s | 1 | 200 |
| credit_card/is_card_number/ 3782-8224-6310-005 | execution_time | 77.870µs | 79.366µs ± 0.748µs | 79.333µs ± 0.538µs | 79.883µs | 80.733µs | 80.911µs | 81.093µs | 2.22% | 0.179 | -0.633 | 0.94% | 0.053µs | 1 | 200 |
| credit_card/is_card_number/ 3782-8224-6310-005 | throughput | 12331535.082op/s | 12600897.295op/s ± 118593.789op/s | 12605039.100op/s ± 85500.108op/s | 12688511.714op/s | 12786543.610op/s | 12828403.771op/s | 12841885.910op/s | 1.88% | -0.141 | -0.643 | 0.94% | 8385.847op/s | 1 | 200 |
| credit_card/is_card_number/ 378282246310005 | execution_time | 71.445µs | 71.772µs ± 0.342µs | 71.668µs ± 0.101µs | 71.802µs | 72.588µs | 73.345µs | 73.568µs | 2.65% | 2.676 | 8.255 | 0.48% | 0.024µs | 1 | 200 |
| credit_card/is_card_number/ 378282246310005 | throughput | 13592940.370op/s | 13933351.368op/s ± 65583.140op/s | 13953238.513op/s ± 19675.625op/s | 13969812.284op/s | 13985723.098op/s | 13993218.522op/s | 13996724.766op/s | 0.31% | -2.633 | 7.961 | 0.47% | 4637.428op/s | 1 | 200 |
| credit_card/is_card_number/37828224631 | execution_time | 3.895µs | 3.915µs ± 0.003µs | 3.915µs ± 0.002µs | 3.917µs | 3.921µs | 3.923µs | 3.924µs | 0.24% | -0.729 | 6.929 | 0.08% | 0.000µs | 1 | 200 |
| credit_card/is_card_number/37828224631 | throughput | 254816581.927op/s | 255413014.540op/s ± 205612.842op/s | 255426437.221op/s ± 115558.748op/s | 255533902.963op/s | 255681174.411op/s | 255732378.644op/s | 256708893.521op/s | 0.50% | 0.749 | 7.052 | 0.08% | 14539.024op/s | 1 | 200 |
| credit_card/is_card_number/378282246310005 | execution_time | 68.391µs | 68.731µs ± 0.460µs | 68.534µs ± 0.081µs | 68.787µs | 69.495µs | 70.563µs | 71.135µs | 3.79% | 2.621 | 8.011 | 0.67% | 0.033µs | 1 | 200 |
| credit_card/is_card_number/378282246310005 | throughput | 14057848.717op/s | 14550031.725op/s ± 95770.205op/s | 14591277.473op/s ± 17212.753op/s | 14603767.017op/s | 14616006.343op/s | 14617581.050op/s | 14621792.419op/s | 0.21% | -2.560 | 7.588 | 0.66% | 6771.976op/s | 1 | 200 |
| credit_card/is_card_number/37828224631000521389798 | execution_time | 45.457µs | 45.653µs ± 0.072µs | 45.651µs ± 0.049µs | 45.710µs | 45.762µs | 45.811µs | 45.836µs | 0.41% | -0.107 | -0.186 | 0.16% | 0.005µs | 1 | 200 |
| credit_card/is_card_number/37828224631000521389798 | throughput | 21816714.692op/s | 21904410.297op/s ± 34629.106op/s | 21905272.600op/s ± 23738.698op/s | 21924532.463op/s | 21966698.145op/s | 21978615.554op/s | 21998575.617op/s | 0.43% | 0.115 | -0.185 | 0.16% | 2448.648op/s | 1 | 200 |
| credit_card/is_card_number/x371413321323331 | execution_time | 6.552µs | 6.622µs ± 0.019µs | 6.627µs ± 0.011µs | 6.636µs | 6.644µs | 6.647µs | 6.649µs | 0.34% | -1.127 | 1.038 | 0.28% | 0.001µs | 1 | 200 |
| credit_card/is_card_number/x371413321323331 | throughput | 150399783.727op/s | 151011579.636op/s ± 424688.928op/s | 150904842.576op/s ± 249922.403op/s | 151207959.249op/s | 151836333.646op/s | 152223819.989op/s | 152636700.510op/s | 1.15% | 1.142 | 1.090 | 0.28% | 30030.042op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/ | execution_time | 3.898µs | 3.916µs ± 0.003µs | 3.916µs ± 0.002µs | 3.917µs | 3.920µs | 3.921µs | 3.921µs | 0.15% | -1.193 | 7.319 | 0.07% | 0.000µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/ | throughput | 255017481.423op/s | 255394076.538op/s ± 173274.358op/s | 255391343.754op/s ± 114825.569op/s | 255505397.589op/s | 255623636.218op/s | 255680332.106op/s | 256521313.959op/s | 0.44% | 1.209 | 7.438 | 0.07% | 12252.347op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 | execution_time | 65.577µs | 65.710µs ± 0.053µs | 65.705µs ± 0.035µs | 65.743µs | 65.804µs | 65.834µs | 65.869µs | 0.25% | 0.233 | 0.122 | 0.08% | 0.004µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 | throughput | 15181652.943op/s | 15218386.937op/s ± 12301.654op/s | 15219516.158op/s ± 8029.656op/s | 15226722.164op/s | 15236354.265op/s | 15245834.555op/s | 15249223.137op/s | 0.20% | -0.228 | 0.120 | 0.08% | 869.858op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/ 378282246310005 | execution_time | 53.363µs | 53.429µs ± 0.034µs | 53.422µs ± 0.021µs | 53.449µs | 53.493µs | 53.519µs | 53.550µs | 0.24% | 0.869 | 0.687 | 0.06% | 0.002µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/ 378282246310005 | throughput | 18674062.125op/s | 18716339.516op/s ± 11756.075op/s | 18718780.149op/s ± 7368.392op/s | 18724596.518op/s | 18732475.701op/s | 18734114.797op/s | 18739744.226op/s | 0.11% | -0.866 | 0.678 | 0.06% | 831.280op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/37828224631 | execution_time | 3.895µs | 3.915µs ± 0.003µs | 3.915µs ± 0.002µs | 3.917µs | 3.920µs | 3.921µs | 3.923µs | 0.21% | -1.250 | 9.574 | 0.07% | 0.000µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/37828224631 | throughput | 254887378.187op/s | 255418468.372op/s ± 189864.804op/s | 255426667.007op/s ± 106940.614op/s | 255522543.478op/s | 255669118.742op/s | 255758658.114op/s | 256713665.195op/s | 0.50% | 1.272 | 9.736 | 0.07% | 13425.469op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/378282246310005 | execution_time | 50.154µs | 50.211µs ± 0.030µs | 50.208µs ± 0.021µs | 50.230µs | 50.261µs | 50.290µs | 50.308µs | 0.20% | 0.512 | -0.070 | 0.06% | 0.002µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/378282246310005 | throughput | 19877372.513op/s | 19915908.245op/s ± 11936.656op/s | 19917089.143op/s ± 8442.952op/s | 19925407.245op/s | 19933214.065op/s | 19936960.328op/s | 19938601.072op/s | 0.11% | -0.509 | -0.075 | 0.06% | 844.049op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/37828224631000521389798 | execution_time | 45.473µs | 45.683µs ± 0.091µs | 45.672µs ± 0.064µs | 45.743µs | 45.831µs | 45.906µs | 46.080µs | 0.89% | 0.629 | 1.063 | 0.20% | 0.006µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/37828224631000521389798 | throughput | 21701416.845op/s | 21890247.013op/s ± 43386.240op/s | 21895131.621op/s ± 30908.741op/s | 21921928.507op/s | 21950302.529op/s | 21968830.282op/s | 21991027.460op/s | 0.44% | -0.614 | 1.012 | 0.20% | 3067.870op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/x371413321323331 | execution_time | 6.565µs | 6.619µs ± 0.019µs | 6.620µs ± 0.015µs | 6.635µs | 6.641µs | 6.650µs | 6.651µs | 0.46% | -0.533 | -0.444 | 0.28% | 0.001µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/x371413321323331 | throughput | 150363162.317op/s | 151091699.559op/s ± 426240.444op/s | 151057462.158op/s ± 344908.223op/s | 151409730.423op/s | 151900580.756op/s | 152108723.820op/s | 152325700.336op/s | 0.84% | 0.543 | -0.427 | 0.28% | 30139.751op/s | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| credit_card/is_card_number/ | execution_time | [3.915µs; 3.916µs] or [-0.011%; +0.011%] | None | None | None |
| credit_card/is_card_number/ | throughput | [255352250.827op/s; 255407822.291op/s] or [-0.011%; +0.011%] | None | None | None |
| credit_card/is_card_number/ 3782-8224-6310-005 | execution_time | [79.263µs; 79.470µs] or [-0.131%; +0.131%] | None | None | None |
| credit_card/is_card_number/ 3782-8224-6310-005 | throughput | [12584461.336op/s; 12617333.253op/s] or [-0.130%; +0.130%] | None | None | None |
| credit_card/is_card_number/ 378282246310005 | execution_time | [71.724µs; 71.819µs] or [-0.066%; +0.066%] | None | None | None |
| credit_card/is_card_number/ 378282246310005 | throughput | [13924262.175op/s; 13942440.560op/s] or [-0.065%; +0.065%] | None | None | None |
| credit_card/is_card_number/37828224631 | execution_time | [3.915µs; 3.916µs] or [-0.011%; +0.011%] | None | None | None |
| credit_card/is_card_number/37828224631 | throughput | [255384518.577op/s; 255441510.502op/s] or [-0.011%; +0.011%] | None | None | None |
| credit_card/is_card_number/378282246310005 | execution_time | [68.668µs; 68.795µs] or [-0.093%; +0.093%] | None | None | None |
| credit_card/is_card_number/378282246310005 | throughput | [14536758.896op/s; 14563304.555op/s] or [-0.091%; +0.091%] | None | None | None |
| credit_card/is_card_number/37828224631000521389798 | execution_time | [45.643µs; 45.663µs] or [-0.022%; +0.022%] | None | None | None |
| credit_card/is_card_number/37828224631000521389798 | throughput | [21899611.036op/s; 21909209.558op/s] or [-0.022%; +0.022%] | None | None | None |
| credit_card/is_card_number/x371413321323331 | execution_time | [6.619µs; 6.625µs] or [-0.039%; +0.039%] | None | None | None |
| credit_card/is_card_number/x371413321323331 | throughput | [150952721.835op/s; 151070437.437op/s] or [-0.039%; +0.039%] | None | None | None |
| credit_card/is_card_number_no_luhn/ | execution_time | [3.915µs; 3.916µs] or [-0.009%; +0.009%] | None | None | None |
| credit_card/is_card_number_no_luhn/ | throughput | [255370062.379op/s; 255418090.698op/s] or [-0.009%; +0.009%] | None | None | None |
| credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 | execution_time | [65.703µs; 65.717µs] or [-0.011%; +0.011%] | None | None | None |
| credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 | throughput | [15216682.046op/s; 15220091.828op/s] or [-0.011%; +0.011%] | None | None | None |
| credit_card/is_card_number_no_luhn/ 378282246310005 | execution_time | [53.425µs; 53.434µs] or [-0.009%; +0.009%] | None | None | None |
| credit_card/is_card_number_no_luhn/ 378282246310005 | throughput | [18714710.237op/s; 18717968.795op/s] or [-0.009%; +0.009%] | None | None | None |
| credit_card/is_card_number_no_luhn/37828224631 | execution_time | [3.915µs; 3.916µs] or [-0.010%; +0.010%] | None | None | None |
| credit_card/is_card_number_no_luhn/37828224631 | throughput | [255392154.937op/s; 255444781.808op/s] or [-0.010%; +0.010%] | None | None | None |
| credit_card/is_card_number_no_luhn/378282246310005 | execution_time | [50.207µs; 50.215µs] or [-0.008%; +0.008%] | None | None | None |
| credit_card/is_card_number_no_luhn/378282246310005 | throughput | [19914253.939op/s; 19917562.551op/s] or [-0.008%; +0.008%] | None | None | None |
| credit_card/is_card_number_no_luhn/37828224631000521389798 | execution_time | [45.670µs; 45.695µs] or [-0.028%; +0.028%] | None | None | None |
| credit_card/is_card_number_no_luhn/37828224631000521389798 | throughput | [21884234.097op/s; 21896259.928op/s] or [-0.027%; +0.027%] | None | None | None |
| credit_card/is_card_number_no_luhn/x371413321323331 | execution_time | [6.616µs; 6.621µs] or [-0.039%; +0.039%] | None | None | None |
| credit_card/is_card_number_no_luhn/x371413321323331 | throughput | [151032626.733op/s; 151150772.385op/s] or [-0.039%; +0.039%] | None | None | None |
Group 7
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | a99e306d | 1763564198 | ban/simplify-codecov |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| tags/replace_trace_tags | execution_time | 2.330µs | 2.406µs ± 0.018µs | 2.406µs ± 0.007µs | 2.415µs | 2.429µs | 2.435µs | 2.441µs | 1.48% | -1.908 | 5.169 | 0.76% | 0.001µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| tags/replace_trace_tags | execution_time | [2.403µs; 2.408µs] or [-0.106%; +0.106%] | None | None | None |
Group 8
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | a99e306d | 1763564198 | ban/simplify-codecov |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| receiver_entry_point/report/2597 | execution_time | 6.113ms | 6.392ms ± 0.066ms | 6.409ms ± 0.013ms | 6.420ms | 6.440ms | 6.478ms | 6.577ms | 2.61% | -2.366 | 6.384 | 1.02% | 0.005ms | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| receiver_entry_point/report/2597 | execution_time | [6.383ms; 6.401ms] or [-0.142%; +0.142%] | None | None | None |
Group 9
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | a99e306d | 1763564198 | ban/simplify-codecov |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| benching serializing traces from their internal representation to msgpack | execution_time | 14.810ms | 14.882ms ± 0.032ms | 14.878ms ± 0.015ms | 14.893ms | 14.926ms | 15.022ms | 15.032ms | 1.04% | 2.182 | 7.309 | 0.22% | 0.002ms | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| benching serializing traces from their internal representation to msgpack | execution_time | [14.878ms; 14.887ms] or [-0.030%; +0.030%] | None | None | None |
Group 10
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | a99e306d | 1763564198 | ban/simplify-codecov |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... | execution_time | 534.012µs | 535.038µs ± 1.187µs | 534.844µs ± 0.297µs | 535.151µs | 535.701µs | 542.965µs | 543.445µs | 1.61% | 5.672 | 35.042 | 0.22% | 0.084µs | 1 | 200 |
| normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... | throughput | 1840113.412op/s | 1869036.137op/s ± 4096.452op/s | 1869703.549op/s ± 1036.919op/s | 1870669.297op/s | 1871668.118op/s | 1872410.586op/s | 1872615.445op/s | 0.16% | -5.639 | 34.752 | 0.22% | 289.663op/s | 1 | 200 |
| normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて | execution_time | 380.188µs | 380.849µs ± 0.335µs | 380.802µs ± 0.231µs | 381.073µs | 381.425µs | 381.608µs | 381.741µs | 0.25% | 0.437 | -0.471 | 0.09% | 0.024µs | 1 | 200 |
| normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて | throughput | 2619577.148op/s | 2625717.449op/s ± 2308.242op/s | 2626036.928op/s ± 1592.543op/s | 2627436.827op/s | 2628979.041op/s | 2629899.071op/s | 2630276.449op/s | 0.16% | -0.434 | -0.475 | 0.09% | 163.217op/s | 1 | 200 |
| normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters | execution_time | 195.286µs | 195.793µs ± 0.231µs | 195.775µs ± 0.165µs | 195.958µs | 196.195µs | 196.383µs | 196.532µs | 0.39% | 0.327 | -0.071 | 0.12% | 0.016µs | 1 | 200 |
| normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters | throughput | 5088225.819op/s | 5107454.974op/s ± 6024.114op/s | 5107901.049op/s ± 4313.193op/s | 5111683.388op/s | 5116366.712op/s | 5120006.113op/s | 5120700.296op/s | 0.25% | -0.320 | -0.078 | 0.12% | 425.969op/s | 1 | 200 |
| normalization/normalize_service/normalize_service/[empty string] | execution_time | 37.049µs | 37.248µs ± 0.090µs | 37.250µs ± 0.057µs | 37.301µs | 37.398µs | 37.470µs | 37.690µs | 1.18% | 0.697 | 2.287 | 0.24% | 0.006µs | 1 | 200 |
| normalization/normalize_service/normalize_service/[empty string] | throughput | 26532179.369op/s | 26846933.609op/s ± 65087.970op/s | 26845497.255op/s ± 41480.053op/s | 26890974.920op/s | 26952761.885op/s | 26972279.327op/s | 26991048.858op/s | 0.54% | -0.669 | 2.178 | 0.24% | 4602.415op/s | 1 | 200 |
| normalization/normalize_service/normalize_service/test_ASCII | execution_time | 44.901µs | 45.095µs ± 0.167µs | 45.082µs ± 0.113µs | 45.192µs | 45.312µs | 45.348µs | 46.555µs | 3.27% | 3.395 | 27.608 | 0.37% | 0.012µs | 1 | 200 |
| normalization/normalize_service/normalize_service/test_ASCII | throughput | 21479749.489op/s | 22175870.773op/s ± 80927.089op/s | 22181649.057op/s ± 55650.344op/s | 22238676.100op/s | 22269557.404op/s | 22270935.963op/s | 22271312.594op/s | 0.40% | -3.202 | 25.412 | 0.36% | 5722.409op/s | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... | execution_time | [534.873µs; 535.202µs] or [-0.031%; +0.031%] | None | None | None |
| normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... | throughput | [1868468.408op/s; 1869603.866op/s] or [-0.030%; +0.030%] | None | None | None |
| normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて | execution_time | [380.802µs; 380.895µs] or [-0.012%; +0.012%] | None | None | None |
| normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて | throughput | [2625397.549op/s; 2626037.349op/s] or [-0.012%; +0.012%] | None | None | None |
| normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters | execution_time | [195.760µs; 195.825µs] or [-0.016%; +0.016%] | None | None | None |
| normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters | throughput | [5106620.090op/s; 5108289.858op/s] or [-0.016%; +0.016%] | None | None | None |
| normalization/normalize_service/normalize_service/[empty string] | execution_time | [37.236µs; 37.261µs] or [-0.034%; +0.034%] | None | None | None |
| normalization/normalize_service/normalize_service/[empty string] | throughput | [26837913.043op/s; 26855954.176op/s] or [-0.034%; +0.034%] | None | None | None |
| normalization/normalize_service/normalize_service/test_ASCII | execution_time | [45.072µs; 45.118µs] or [-0.051%; +0.051%] | None | None | None |
| normalization/normalize_service/normalize_service/test_ASCII | throughput | [22164655.057op/s; 22187086.489op/s] or [-0.051%; +0.051%] | None | None | None |
Group 11
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | a99e306d | 1763564198 | ban/simplify-codecov |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| benching string interning on wordpress profile | execution_time | 158.461µs | 159.341µs ± 0.257µs | 159.314µs ± 0.106µs | 159.438µs | 159.733µs | 160.068µs | 161.244µs | 1.21% | 1.984 | 15.976 | 0.16% | 0.018µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| benching string interning on wordpress profile | execution_time | [159.306µs; 159.377µs] or [-0.022%; +0.022%] | None | None | None |
Group 12
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | a99e306d | 1763564198 | ban/simplify-codecov |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| normalization/normalize_trace/test_trace | execution_time | 243.849ns | 253.830ns ± 13.037ns | 248.085ns ± 2.636ns | 253.890ns | 285.256ns | 295.694ns | 301.435ns | 21.51% | 1.916 | 2.673 | 5.12% | 0.922ns | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| normalization/normalize_trace/test_trace | execution_time | [252.023ns; 255.636ns] or [-0.712%; +0.712%] | None | None | None |
Group 13
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | a99e306d | 1763564198 | ban/simplify-codecov |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| write only interface | execution_time | 1.161µs | 3.272µs ± 1.452µs | 3.025µs ± 0.033µs | 3.059µs | 3.695µs | 14.371µs | 14.959µs | 394.52% | 7.222 | 53.755 | 44.25% | 0.103µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| write only interface | execution_time | [3.071µs; 3.473µs] or [-6.148%; +6.148%] | None | None | None |
Group 14
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | a99e306d | 1763564198 | ban/simplify-codecov |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| two way interface | execution_time | 18.151µs | 23.428µs ± 8.845µs | 18.472µs ± 0.105µs | 28.925µs | 42.644µs | 43.381µs | 62.562µs | 238.69% | 1.641 | 1.979 | 37.66% | 0.625µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| two way interface | execution_time | [22.202µs; 24.654µs] or [-5.232%; +5.232%] | None | None | None |
Group 15
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | a99e306d | 1763564198 | ban/simplify-codecov |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... | execution_time | 206.281µs | 207.058µs ± 0.299µs | 207.025µs ± 0.197µs | 207.258µs | 207.605µs | 207.729µs | 207.815µs | 0.38% | 0.223 | -0.154 | 0.14% | 0.021µs | 1 | 200 |
| normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... | throughput | 4811976.567op/s | 4829584.637op/s ± 6969.570op/s | 4830329.771op/s ± 4606.366op/s | 4834550.731op/s | 4840712.560op/s | 4843854.545op/s | 4847752.405op/s | 0.36% | -0.215 | -0.155 | 0.14% | 492.823op/s | 1 | 200 |
| normalization/normalize_name/normalize_name/bad-name | execution_time | 18.163µs | 18.246µs ± 0.059µs | 18.237µs ± 0.030µs | 18.267µs | 18.325µs | 18.476µs | 18.543µs | 1.68% | 1.829 | 5.680 | 0.32% | 0.004µs | 1 | 200 |
| normalization/normalize_name/normalize_name/bad-name | throughput | 53929366.126op/s | 54806858.458op/s ± 177065.051op/s | 54834224.416op/s ± 89128.668op/s | 54922092.556op/s | 55042996.561op/s | 55053301.105op/s | 55057875.543op/s | 0.41% | -1.787 | 5.468 | 0.32% | 12520.390op/s | 1 | 200 |
| normalization/normalize_name/normalize_name/good | execution_time | 10.581µs | 10.734µs ± 0.066µs | 10.733µs ± 0.045µs | 10.778µs | 10.839µs | 10.904µs | 10.934µs | 1.87% | 0.190 | 0.036 | 0.62% | 0.005µs | 1 | 200 |
| normalization/normalize_name/normalize_name/good | throughput | 91459382.185op/s | 93168227.932op/s ± 574529.849op/s | 93169360.071op/s ± 386707.629op/s | 93547254.349op/s | 94106885.675op/s | 94335889.807op/s | 94505246.859op/s | 1.43% | -0.154 | 0.004 | 0.62% | 40625.395op/s | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... | execution_time | [207.016µs; 207.099µs] or [-0.020%; +0.020%] | None | None | None |
| normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... | throughput | [4828618.722op/s; 4830550.553op/s] or [-0.020%; +0.020%] | None | None | None |
| normalization/normalize_name/normalize_name/bad-name | execution_time | [18.238µs; 18.254µs] or [-0.045%; +0.045%] | None | None | None |
| normalization/normalize_name/normalize_name/bad-name | throughput | [54782318.945op/s; 54831397.971op/s] or [-0.045%; +0.045%] | None | None | None |
| normalization/normalize_name/normalize_name/good | execution_time | [10.724µs; 10.743µs] or [-0.086%; +0.086%] | None | None | None |
| normalization/normalize_name/normalize_name/good | throughput | [93088603.621op/s; 93247852.244op/s] or [-0.085%; +0.085%] | None | None | None |
Group 16
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | a99e306d | 1763564198 | ban/simplify-codecov |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| benching deserializing traces from msgpack to their internal representation | execution_time | 62.872ms | 63.323ms ± 1.931ms | 63.059ms ± 0.093ms | 63.161ms | 63.441ms | 74.278ms | 82.723ms | 31.18% | 8.400 | 72.191 | 3.04% | 0.137ms | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| benching deserializing traces from msgpack to their internal representation | execution_time | [63.056ms; 63.591ms] or [-0.423%; +0.423%] | None | None | None |
Group 17
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | a99e306d | 1763564198 | ban/simplify-codecov |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| sdk_test_data/rules-based | execution_time | 144.649µs | 146.558µs ± 1.717µs | 146.260µs ± 0.603µs | 146.919µs | 148.426µs | 152.908µs | 162.391µs | 11.03% | 5.203 | 39.267 | 1.17% | 0.121µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| sdk_test_data/rules-based | execution_time | [146.320µs; 146.796µs] or [-0.162%; +0.162%] | None | None | None |
Baseline
Omitted due to size.
Artifact Size Benchmark Report
aarch64-alpine-linux-musl
| Artifact | Baseline | Commit | Change |
|---|---|---|---|
| /aarch64-alpine-linux-musl/lib/libdatadog_profiling.so | 7.57 MB | 7.50 MB | --.82% (-64.00 KB) 💪 |
| /aarch64-alpine-linux-musl/lib/libdatadog_profiling.a | 83.05 MB | 83.00 MB | --.05% (-49.22 KB) 💪 |
aarch64-unknown-linux-gnu
| Artifact | Baseline | Commit | Change |
|---|---|---|---|
| /aarch64-unknown-linux-gnu/lib/libdatadog_profiling.so | 9.55 MB | 9.55 MB | +.01% (+1.43 KB) 🔍 |
| /aarch64-unknown-linux-gnu/lib/libdatadog_profiling.a | 96.25 MB | 96.28 MB | +.03% (+35.14 KB) 🔍 |
libdatadog-x64-windows
| Artifact | Baseline | Commit | Change |
|---|---|---|---|
| /libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.dll | 19.07 MB | 19.07 MB | +0% (+512 B) 👌 |
| /libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.lib | 65.49 KB | 65.49 KB | 0% (0 B) 👌 |
| /libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.pdb | 132.16 MB | 132.16 MB | -0% (-8.00 KB) 👌 |
| /libdatadog-x64-windows/debug/static/datadog_profiling_ffi.lib | 696.66 MB | 701.00 MB | +.62% (+4.33 MB) 🔍 |
| /libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.dll | 6.34 MB | 6.34 MB | +.05% (+3.50 KB) 🔍 |
| /libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.lib | 65.49 KB | 65.49 KB | 0% (0 B) 👌 |
| /libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.pdb | 19.07 MB | 19.05 MB | --.08% (-16.00 KB) 💪 |
| /libdatadog-x64-windows/release/static/datadog_profiling_ffi.lib | 36.91 MB | 37.27 MB | +.96% (+365.31 KB) 🔍 |
libdatadog-x86-windows
| Artifact | Baseline | Commit | Change |
|---|---|---|---|
| /libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.dll | 16.16 MB | 16.17 MB | +.05% (+9.50 KB) 🔍 |
| /libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.lib | 66.50 KB | 66.50 KB | 0% (0 B) 👌 |
| /libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.pdb | 134.40 MB | 134.30 MB | --.07% (-104.00 KB) 💪 |
| /libdatadog-x86-windows/debug/static/datadog_profiling_ffi.lib | 684.68 MB | 688.20 MB | +.51% (+3.51 MB) 🔍 |
| /libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.dll | 4.86 MB | 4.86 MB | --.06% (-3.00 KB) 💪 |
| /libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.lib | 66.50 KB | 66.50 KB | 0% (0 B) 👌 |
| /libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.pdb | 20.23 MB | 20.21 MB | --.11% (-24.00 KB) 💪 |
| /libdatadog-x86-windows/release/static/datadog_profiling_ffi.lib | 34.65 MB | 34.99 MB | +.96% (+343.27 KB) 🔍 |
x86_64-alpine-linux-musl
| Artifact | Baseline | Commit | Change |
|---|---|---|---|
| /x86_64-alpine-linux-musl/lib/libdatadog_profiling.a | 71.98 MB | 71.93 MB | --.06% (-50.02 KB) 💪 |
| /x86_64-alpine-linux-musl/lib/libdatadog_profiling.so | 8.92 MB | 8.93 MB | +.08% (+8.00 KB) 🔍 |
x86_64-unknown-linux-gnu
| Artifact | Baseline | Commit | Change |
|---|---|---|---|
| /x86_64-unknown-linux-gnu/lib/libdatadog_profiling.a | 90.98 MB | 90.95 MB | --.03% (-31.48 KB) 💪 |
| /x86_64-unknown-linux-gnu/lib/libdatadog_profiling.so | 10.27 MB | 10.28 MB | +.01% (+1.39 KB) 🔍 |