libdatadog
libdatadog copied to clipboard
Add data-pipeline-ffi to nuget artifacts
What does this PR do?
A brief description of the change being made with this pull request.
Motivation
What inspired you to submit this pull request?
Additional Notes
Anything else we should know when reviewing?
How to test the change?
Describe here in detail how the change can be validated.
Codecov Report
All modified and coverable lines are covered by tests :white_check_mark:
Project coverage is 73.77%. Comparing base (
bc58fa5) to head (2711241). Report is 4 commits behind head on main.
Additional details and impacted files
@@ Coverage Diff @@
## main #650 +/- ##
==========================================
- Coverage 73.81% 73.77% -0.04%
==========================================
Files 257 257
Lines 37309 37329 +20
==========================================
Hits 27541 27541
- Misses 9768 9788 +20
| Components | Coverage Δ | |
|---|---|---|
| crashtracker | 20.36% <ø> (-0.12%) |
:arrow_down: |
| datadog-alloc | 98.73% <ø> (ø) |
|
| data-pipeline | 93.33% <ø> (+0.27%) |
:arrow_up: |
| data-pipeline-ffi | 0.00% <ø> (ø) |
|
| ddcommon | 83.08% <ø> (ø) |
|
| ddcommon-ffi | 69.52% <ø> (ø) |
|
| ddtelemetry | 59.10% <ø> (ø) |
|
| dogstatsd-client | 79.77% <ø> (ø) |
|
| ipc | 83.58% <ø> (ø) |
|
| profiling | 84.26% <ø> (ø) |
|
| profiling-ffi | 77.42% <ø> (ø) |
|
| serverless | 0.00% <ø> (ø) |
|
| sidecar | 38.19% <ø> (ø) |
|
| sidecar-ffi | 0.00% <ø> (ø) |
|
| spawn-worker | 50.36% <ø> (ø) |
|
| tinybytes | 94.77% <ø> (ø) |
|
| trace-mini-agent | 72.47% <ø> (ø) |
|
| trace-normalization | 98.25% <ø> (ø) |
|
| trace-obfuscation | 95.73% <ø> (ø) |
|
| trace-protobuf | 77.67% <ø> (ø) |
|
| trace-utils | 93.46% <ø> (-0.41%) |
:arrow_down: |
Benchmarks
Comparison
Benchmark execution time: 2024-10-01 15:16:35
Comparing candidate commit 2711241 in PR branch andrew.glaude/NET-tracer with baseline commit dcf22a9 in branch main.
Found 0 performance improvements and 0 performance regressions! Performance is the same for 51 metrics, 2 unstable metrics.
Candidate
Candidate benchmark details
Group 1
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 2711241 | 1727795175 | andrew.glaude/NET-tracer |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| tags/replace_trace_tags | execution_time | 2.722µs | 2.760µs ± 0.014µs | 2.759µs ± 0.011µs | 2.771µs | 2.784µs | 2.786µs | 2.788µs | 1.08% | -0.069 | -0.742 | 0.52% | 0.001µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| tags/replace_trace_tags | execution_time | [2.758µs; 2.762µs] or [-0.072%; +0.072%] | None | None | None |
Group 2
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 2711241 | 1727795175 | andrew.glaude/NET-tracer |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| two way interface | execution_time | 19.482µs | 26.854µs ± 10.507µs | 21.807µs ± 0.349µs | 36.538µs | 39.635µs | 41.059µs | 110.714µs | 407.69% | 3.893 | 24.289 | 39.03% | 0.743µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| two way interface | execution_time | [25.397µs; 28.310µs] or [-5.423%; +5.423%] | None | None | None |
Group 3
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 2711241 | 1727795175 | andrew.glaude/NET-tracer |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| benching string interning on wordpress profile | execution_time | 140.628µs | 141.879µs ± 0.400µs | 141.900µs ± 0.182µs | 142.041µs | 142.377µs | 143.132µs | 144.561µs | 1.88% | 1.568 | 10.311 | 0.28% | 0.028µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| benching string interning on wordpress profile | execution_time | [141.823µs; 141.934µs] or [-0.039%; +0.039%] | None | None | None |
Group 4
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 2711241 | 1727795175 | andrew.glaude/NET-tracer |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| write only interface | execution_time | 1.395µs | 3.197µs ± 1.550µs | 3.042µs ± 0.024µs | 3.061µs | 3.144µs | 13.887µs | 17.660µs | 480.53% | 7.944 | 63.637 | 48.36% | 0.110µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| write only interface | execution_time | [2.982µs; 3.411µs] or [-6.719%; +6.719%] | None | None | None |
Group 5
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 2711241 | 1727795175 | andrew.glaude/NET-tracer |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... | execution_time | 318.126µs | 318.447µs ± 0.151µs | 318.433µs ± 0.095µs | 318.542µs | 318.729µs | 318.838µs | 318.884µs | 0.14% | 0.402 | -0.149 | 0.05% | 0.011µs | 1 | 200 |
| normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... | throughput | 3135932.418op/s | 3140240.342op/s ± 1489.252op/s | 3140378.229op/s ± 940.490op/s | 3141255.336op/s | 3142425.505op/s | 3143057.523op/s | 3143409.727op/s | 0.10% | -0.400 | -0.152 | 0.05% | 105.306op/s | 1 | 200 |
| normalization/normalize_name/normalize_name/bad-name | execution_time | 29.290µs | 29.362µs ± 0.033µs | 29.360µs ± 0.021µs | 29.384µs | 29.414µs | 29.457µs | 29.483µs | 0.42% | 0.376 | 0.678 | 0.11% | 0.002µs | 1 | 200 |
| normalization/normalize_name/normalize_name/bad-name | throughput | 33917549.401op/s | 34057181.766op/s ± 38644.433op/s | 34059928.610op/s ± 24822.223op/s | 34080064.494op/s | 34124447.370op/s | 34134965.491op/s | 34141673.360op/s | 0.24% | -0.368 | 0.662 | 0.11% | 2732.574op/s | 1 | 200 |
| normalization/normalize_name/normalize_name/good | execution_time | 17.285µs | 17.305µs ± 0.029µs | 17.289µs ± 0.002µs | 17.327µs | 17.335µs | 17.374µs | 17.547µs | 1.49% | 3.550 | 24.251 | 0.16% | 0.002µs | 1 | 200 |
| normalization/normalize_name/normalize_name/good | throughput | 56990215.218op/s | 57787645.130op/s ± 94928.749op/s | 57841803.656op/s ± 5791.170op/s | 57845828.753op/s | 57849436.804op/s | 57853373.996op/s | 57854517.152op/s | 0.02% | -3.484 | 23.458 | 0.16% | 6712.476op/s | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... | execution_time | [318.426µs; 318.468µs] or [-0.007%; +0.007%] | None | None | None |
| normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... | throughput | [3140033.946op/s; 3140446.738op/s] or [-0.007%; +0.007%] | None | None | None |
| normalization/normalize_name/normalize_name/bad-name | execution_time | [29.358µs; 29.367µs] or [-0.016%; +0.016%] | None | None | None |
| normalization/normalize_name/normalize_name/bad-name | throughput | [34051826.019op/s; 34062537.512op/s] or [-0.016%; +0.016%] | None | None | None |
| normalization/normalize_name/normalize_name/good | execution_time | [17.301µs; 17.309µs] or [-0.023%; +0.023%] | None | None | None |
| normalization/normalize_name/normalize_name/good | throughput | [57774488.919op/s; 57800801.342op/s] or [-0.023%; +0.023%] | None | None | None |
Group 6
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 2711241 | 1727795175 | andrew.glaude/NET-tracer |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| credit_card/is_card_number/ | execution_time | 2.015µs | 2.016µs ± 0.002µs | 2.016µs ± 0.001µs | 2.017µs | 2.018µs | 2.019µs | 2.040µs | 1.16% | 9.709 | 117.152 | 0.09% | 0.000µs | 1 | 200 |
| credit_card/is_card_number/ | throughput | 490306414.819op/s | 495934777.712op/s ± 454477.216op/s | 496003794.464op/s ± 134528.901op/s | 496129775.151op/s | 496216494.294op/s | 496280781.274op/s | 496290230.527op/s | 0.06% | -9.640 | 115.985 | 0.09% | 32136.392op/s | 1 | 200 |
| credit_card/is_card_number/ 3782-8224-6310-005 | execution_time | 111.507µs | 112.538µs ± 0.746µs | 112.326µs ± 0.383µs | 112.849µs | 114.060µs | 114.451µs | 116.186µs | 3.44% | 1.433 | 2.492 | 0.66% | 0.053µs | 1 | 200 |
| credit_card/is_card_number/ 3782-8224-6310-005 | throughput | 8606866.481op/s | 8886261.651op/s ± 58397.519op/s | 8902694.848op/s ± 30365.216op/s | 8931666.331op/s | 8945950.342op/s | 8958870.659op/s | 8968009.799op/s | 0.73% | -1.386 | 2.242 | 0.66% | 4129.328op/s | 1 | 200 |
| credit_card/is_card_number/ 378282246310005 | execution_time | 103.566µs | 104.338µs ± 0.487µs | 104.259µs ± 0.352µs | 104.610µs | 105.294µs | 105.579µs | 106.034µs | 1.70% | 0.809 | 0.263 | 0.47% | 0.034µs | 1 | 200 |
| credit_card/is_card_number/ 378282246310005 | throughput | 9430915.937op/s | 9584483.560op/s ± 44588.072op/s | 9591523.506op/s ± 32252.691op/s | 9623429.969op/s | 9637037.642op/s | 9650402.437op/s | 9655657.139op/s | 0.67% | -0.787 | 0.205 | 0.46% | 3152.853op/s | 1 | 200 |
| credit_card/is_card_number/37828224631 | execution_time | 2.015µs | 2.016µs ± 0.002µs | 2.016µs ± 0.001µs | 2.017µs | 2.017µs | 2.017µs | 2.039µs | 1.14% | 11.909 | 156.366 | 0.09% | 0.000µs | 1 | 200 |
| credit_card/is_card_number/37828224631 | throughput | 490387379.341op/s | 495965416.123op/s ± 419027.353op/s | 495981162.915op/s ± 125236.858op/s | 496117450.941op/s | 496190271.896op/s | 496219712.016op/s | 496270915.703op/s | 0.06% | -11.866 | 155.618 | 0.08% | 29629.708op/s | 1 | 200 |
| credit_card/is_card_number/378282246310005 | execution_time | 99.921µs | 100.946µs ± 0.579µs | 100.852µs ± 0.342µs | 101.242µs | 101.822µs | 102.505µs | 104.124µs | 3.24% | 1.584 | 5.368 | 0.57% | 0.041µs | 1 | 200 |
| credit_card/is_card_number/378282246310005 | throughput | 9603929.113op/s | 9906558.738op/s ± 56286.874op/s | 9915487.503op/s ± 33630.814op/s | 9947210.215op/s | 9976973.208op/s | 9998211.619op/s | 10007897.141op/s | 0.93% | -1.503 | 4.888 | 0.57% | 3980.083op/s | 1 | 200 |
| credit_card/is_card_number/37828224631000521389798 | execution_time | 100.520µs | 101.064µs ± 0.549µs | 100.947µs ± 0.249µs | 101.213µs | 102.093µs | 103.383µs | 103.987µs | 3.01% | 2.497 | 8.028 | 0.54% | 0.039µs | 1 | 200 |
| credit_card/is_card_number/37828224631000521389798 | throughput | 9616563.569op/s | 9895043.179op/s ± 53084.298op/s | 9906169.266op/s ± 24424.105op/s | 9928331.856op/s | 9946555.912op/s | 9948133.189op/s | 9948264.053op/s | 0.42% | -2.436 | 7.660 | 0.54% | 3753.627op/s | 1 | 200 |
| credit_card/is_card_number/x371413321323331 | execution_time | 20.835µs | 20.853µs ± 0.021µs | 20.848µs ± 0.007µs | 20.854µs | 20.893µs | 20.923µs | 21.009µs | 0.77% | 3.296 | 16.897 | 0.10% | 0.001µs | 1 | 200 |
| credit_card/is_card_number/x371413321323331 | throughput | 47599408.141op/s | 47955805.125op/s ± 47383.001op/s | 47967250.360op/s ± 16822.525op/s | 47984062.095op/s | 47992334.664op/s | 47994830.237op/s | 47996798.614op/s | 0.06% | -3.272 | 16.641 | 0.10% | 3350.484op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/ | execution_time | 2.015µs | 2.016µs ± 0.001µs | 2.016µs ± 0.001µs | 2.017µs | 2.018µs | 2.018µs | 2.019µs | 0.13% | 0.791 | 0.007 | 0.04% | 0.000µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/ | throughput | 495413331.533op/s | 496008426.406op/s ± 180591.358op/s | 496041171.418op/s ± 128576.013op/s | 496162443.585op/s | 496228466.070op/s | 496257649.033op/s | 496271808.069op/s | 0.05% | -0.790 | 0.003 | 0.04% | 12769.737op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 | execution_time | 88.427µs | 90.090µs ± 0.819µs | 89.967µs ± 0.421µs | 90.496µs | 91.605µs | 92.265µs | 93.896µs | 4.37% | 0.936 | 2.013 | 0.91% | 0.058µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 | throughput | 10650068.679op/s | 11100973.165op/s ± 100075.722op/s | 11115235.103op/s ± 52067.081op/s | 11162896.784op/s | 11249500.582op/s | 11293841.681op/s | 11308812.703op/s | 1.74% | -0.853 | 1.717 | 0.90% | 7076.422op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/ 378282246310005 | execution_time | 80.984µs | 81.453µs ± 0.276µs | 81.369µs ± 0.055µs | 81.455µs | 81.998µs | 82.411µs | 83.471µs | 2.58% | 3.222 | 15.597 | 0.34% | 0.020µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/ 378282246310005 | throughput | 11980249.536op/s | 12277211.681op/s ± 41146.831op/s | 12289658.867op/s ± 8340.718op/s | 12296569.876op/s | 12301191.863op/s | 12342247.706op/s | 12348057.405op/s | 0.48% | -3.151 | 14.884 | 0.33% | 2909.520op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/37828224631 | execution_time | 2.015µs | 2.016µs ± 0.002µs | 2.016µs ± 0.000µs | 2.017µs | 2.017µs | 2.018µs | 2.048µs | 1.57% | 12.535 | 167.218 | 0.12% | 0.000µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/37828224631 | throughput | 488300770.430op/s | 495948912.450op/s ± 565133.274op/s | 495956787.060op/s ± 113685.054op/s | 496130005.871op/s | 496195543.990op/s | 496219992.921op/s | 496269373.295op/s | 0.06% | -12.493 | 166.452 | 0.11% | 39960.957op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/378282246310005 | execution_time | 77.232µs | 77.816µs ± 0.252µs | 77.759µs ± 0.059µs | 77.842µs | 78.241µs | 78.846µs | 79.100µs | 1.72% | 1.905 | 6.240 | 0.32% | 0.018µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/378282246310005 | throughput | 12642304.326op/s | 12850986.033op/s ± 41307.678op/s | 12860179.739op/s ± 9817.081op/s | 12868684.700op/s | 12904658.798op/s | 12921596.564op/s | 12948000.829op/s | 0.68% | -1.860 | 6.028 | 0.32% | 2920.894op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/37828224631000521389798 | execution_time | 100.511µs | 101.100µs ± 0.720µs | 100.934µs ± 0.242µs | 101.194µs | 102.284µs | 104.354µs | 105.827µs | 4.85% | 3.346 | 14.162 | 0.71% | 0.051µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/37828224631000521389798 | throughput | 9449384.373op/s | 9891665.164op/s ± 68852.792op/s | 9907483.618op/s ± 23851.235op/s | 9931010.325op/s | 9947249.785op/s | 9948655.012op/s | 9949189.789op/s | 0.42% | -3.244 | 13.294 | 0.69% | 4868.628op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/x371413321323331 | execution_time | 20.835µs | 20.858µs ± 0.038µs | 20.849µs ± 0.008µs | 20.855µs | 20.903µs | 20.985µs | 21.175µs | 1.56% | 6.001 | 43.904 | 0.18% | 0.003µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/x371413321323331 | throughput | 47226414.374op/s | 47943038.254op/s ± 87238.808op/s | 47963405.224op/s ± 17371.318op/s | 47980987.108op/s | 47989148.962op/s | 47992602.735op/s | 47995789.998op/s | 0.07% | -5.947 | 43.243 | 0.18% | 6168.715op/s | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| credit_card/is_card_number/ | execution_time | [2.016µs; 2.017µs] or [-0.013%; +0.013%] | None | None | None |
| credit_card/is_card_number/ | throughput | [495871791.541op/s; 495997763.883op/s] or [-0.013%; +0.013%] | None | None | None |
| credit_card/is_card_number/ 3782-8224-6310-005 | execution_time | [112.435µs; 112.642µs] or [-0.092%; +0.092%] | None | None | None |
| credit_card/is_card_number/ 3782-8224-6310-005 | throughput | [8878168.316op/s; 8894354.985op/s] or [-0.091%; +0.091%] | None | None | None |
| credit_card/is_card_number/ 378282246310005 | execution_time | [104.270µs; 104.405µs] or [-0.065%; +0.065%] | None | None | None |
| credit_card/is_card_number/ 378282246310005 | throughput | [9578304.082op/s; 9590663.038op/s] or [-0.064%; +0.064%] | None | None | None |
| credit_card/is_card_number/37828224631 | execution_time | [2.016µs; 2.017µs] or [-0.012%; +0.012%] | None | None | None |
| credit_card/is_card_number/37828224631 | throughput | [495907342.962op/s; 496023489.284op/s] or [-0.012%; +0.012%] | None | None | None |
| credit_card/is_card_number/378282246310005 | execution_time | [100.866µs; 101.027µs] or [-0.079%; +0.079%] | None | None | None |
| credit_card/is_card_number/378282246310005 | throughput | [9898757.919op/s; 9914359.557op/s] or [-0.079%; +0.079%] | None | None | None |
| credit_card/is_card_number/37828224631000521389798 | execution_time | [100.987µs; 101.140µs] or [-0.075%; +0.075%] | None | None | None |
| credit_card/is_card_number/37828224631000521389798 | throughput | [9887686.206op/s; 9902400.152op/s] or [-0.074%; +0.074%] | None | None | None |
| credit_card/is_card_number/x371413321323331 | execution_time | [20.850µs; 20.855µs] or [-0.014%; +0.014%] | None | None | None |
| credit_card/is_card_number/x371413321323331 | throughput | [47949238.297op/s; 47962371.953op/s] or [-0.014%; +0.014%] | None | None | None |
| credit_card/is_card_number_no_luhn/ | execution_time | [2.016µs; 2.016µs] or [-0.005%; +0.005%] | None | None | None |
| credit_card/is_card_number_no_luhn/ | throughput | [495983398.181op/s; 496033454.632op/s] or [-0.005%; +0.005%] | None | None | None |
| credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 | execution_time | [89.976µs; 90.203µs] or [-0.126%; +0.126%] | None | None | None |
| credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 | throughput | [11087103.632op/s; 11114842.697op/s] or [-0.125%; +0.125%] | None | None | None |
| credit_card/is_card_number_no_luhn/ 378282246310005 | execution_time | [81.414µs; 81.491µs] or [-0.047%; +0.047%] | None | None | None |
| credit_card/is_card_number_no_luhn/ 378282246310005 | throughput | [12271509.126op/s; 12282914.236op/s] or [-0.046%; +0.046%] | None | None | None |
| credit_card/is_card_number_no_luhn/37828224631 | execution_time | [2.016µs; 2.017µs] or [-0.016%; +0.016%] | None | None | None |
| credit_card/is_card_number_no_luhn/37828224631 | throughput | [495870590.414op/s; 496027234.487op/s] or [-0.016%; +0.016%] | None | None | None |
| credit_card/is_card_number_no_luhn/378282246310005 | execution_time | [77.781µs; 77.851µs] or [-0.045%; +0.045%] | None | None | None |
| credit_card/is_card_number_no_luhn/378282246310005 | throughput | [12845261.186op/s; 12856710.880op/s] or [-0.045%; +0.045%] | None | None | None |
| credit_card/is_card_number_no_luhn/37828224631000521389798 | execution_time | [101.000µs; 101.200µs] or [-0.099%; +0.099%] | None | None | None |
| credit_card/is_card_number_no_luhn/37828224631000521389798 | throughput | [9882122.829op/s; 9901207.499op/s] or [-0.096%; +0.096%] | None | None | None |
| credit_card/is_card_number_no_luhn/x371413321323331 | execution_time | [20.853µs; 20.863µs] or [-0.025%; +0.025%] | None | None | None |
| credit_card/is_card_number_no_luhn/x371413321323331 | throughput | [47930947.795op/s; 47955128.714op/s] or [-0.025%; +0.025%] | None | None | None |
Group 7
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 2711241 | 1727795175 | andrew.glaude/NET-tracer |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| normalization/normalize_trace/test_trace | execution_time | 306.541ns | 316.577ns ± 13.883ns | 309.862ns ± 2.495ns | 323.416ns | 348.880ns | 359.714ns | 360.111ns | 16.22% | 1.650 | 1.749 | 4.37% | 0.982ns | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| normalization/normalize_trace/test_trace | execution_time | [314.653ns; 318.501ns] or [-0.608%; +0.608%] | None | None | None |
Group 8
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 2711241 | 1727795175 | andrew.glaude/NET-tracer |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| redis/obfuscate_redis_string | execution_time | 37.997µs | 38.507µs ± 0.900µs | 38.092µs ± 0.049µs | 38.179µs | 40.414µs | 40.454µs | 41.799µs | 9.73% | 1.753 | 1.303 | 2.33% | 0.064µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| redis/obfuscate_redis_string | execution_time | [38.382µs; 38.631µs] or [-0.324%; +0.324%] | None | None | None |
Group 9
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 2711241 | 1727795175 | andrew.glaude/NET-tracer |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| benching deserializing traces from msgpack to their internal representation | execution_time | 1.144µs | 1.207µs ± 0.022µs | 1.216µs ± 0.011µs | 1.221µs | 1.230µs | 1.231µs | 1.231µs | 1.24% | -1.453 | 1.398 | 1.78% | 0.002µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| benching deserializing traces from msgpack to their internal representation | execution_time | [1.204µs; 1.210µs] or [-0.247%; +0.247%] | None | None | None |
Group 10
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 2711241 | 1727795175 | andrew.glaude/NET-tracer |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| concentrator/add_spans_to_concentrator | execution_time | 9.039ms | 9.070ms ± 0.025ms | 9.069ms ± 0.009ms | 9.078ms | 9.088ms | 9.100ms | 9.369ms | 3.31% | 8.869 | 105.489 | 0.27% | 0.002ms | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| concentrator/add_spans_to_concentrator | execution_time | [9.067ms; 9.073ms] or [-0.038%; +0.038%] | None | None | None |
Group 11
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 2711241 | 1727795175 | andrew.glaude/NET-tracer |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... | execution_time | 501.077µs | 502.596µs ± 0.270µs | 502.578µs ± 0.148µs | 502.748µs | 503.068µs | 503.214µs | 503.287µs | 0.14% | -0.614 | 4.218 | 0.05% | 0.019µs | 1 | 200 |
| normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... | throughput | 1986937.870op/s | 1989671.811op/s ± 1067.365op/s | 1989740.786op/s ± 585.063op/s | 1990243.825op/s | 1991307.027op/s | 1991910.824op/s | 1995702.145op/s | 0.30% | 0.624 | 4.266 | 0.05% | 75.474op/s | 1 | 200 |
| normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて | execution_time | 464.687µs | 465.379µs ± 0.287µs | 465.388µs ± 0.166µs | 465.545µs | 465.809µs | 466.162µs | 466.366µs | 0.21% | 0.090 | 0.622 | 0.06% | 0.020µs | 1 | 200 |
| normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて | throughput | 2144238.403op/s | 2148785.984op/s ± 1326.358op/s | 2148742.881op/s ± 765.374op/s | 2149538.531op/s | 2151158.634op/s | 2151849.310op/s | 2151984.713op/s | 0.15% | -0.085 | 0.617 | 0.06% | 93.788op/s | 1 | 200 |
| normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters | execution_time | 179.121µs | 180.760µs ± 0.537µs | 180.775µs ± 0.349µs | 181.111µs | 181.592µs | 181.813µs | 182.027µs | 0.69% | -0.203 | -0.177 | 0.30% | 0.038µs | 1 | 200 |
| normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters | throughput | 5493697.858op/s | 5532233.249op/s ± 16458.477op/s | 5531740.592op/s ± 10683.986op/s | 5542846.629op/s | 5558121.216op/s | 5573510.174op/s | 5582828.201op/s | 0.92% | 0.219 | -0.159 | 0.30% | 1163.790op/s | 1 | 200 |
| normalization/normalize_service/normalize_service/[empty string] | execution_time | 44.629µs | 44.980µs ± 0.133µs | 44.984µs ± 0.094µs | 45.069µs | 45.195µs | 45.265µs | 45.307µs | 0.72% | -0.122 | -0.216 | 0.29% | 0.009µs | 1 | 200 |
| normalization/normalize_service/normalize_service/[empty string] | throughput | 22071576.898op/s | 22232387.211op/s ± 65680.439op/s | 22230126.289op/s ± 46444.929op/s | 22279204.408op/s | 22336234.238op/s | 22384594.009op/s | 22406801.709op/s | 0.79% | 0.138 | -0.213 | 0.29% | 4644.308op/s | 1 | 200 |
| normalization/normalize_service/normalize_service/test_ASCII | execution_time | 50.344µs | 50.729µs ± 0.275µs | 50.654µs ± 0.110µs | 50.793µs | 51.410µs | 51.481µs | 51.635µs | 1.94% | 1.479 | 1.563 | 0.54% | 0.019µs | 1 | 200 |
| normalization/normalize_service/normalize_service/test_ASCII | throughput | 19366527.714op/s | 19713326.289op/s ± 106032.894op/s | 19741963.250op/s ± 43158.694op/s | 19780203.543op/s | 19822938.976op/s | 19856103.151op/s | 19863312.369op/s | 0.61% | -1.456 | 1.501 | 0.54% | 7497.658op/s | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... | execution_time | [502.558µs; 502.633µs] or [-0.007%; +0.007%] | None | None | None |
| normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... | throughput | [1989523.885op/s; 1989819.738op/s] or [-0.007%; +0.007%] | None | None | None |
| normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて | execution_time | [465.339µs; 465.419µs] or [-0.009%; +0.009%] | None | None | None |
| normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて | throughput | [2148602.164op/s; 2148969.804op/s] or [-0.009%; +0.009%] | None | None | None |
| normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters | execution_time | [180.686µs; 180.835µs] or [-0.041%; +0.041%] | None | None | None |
| normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters | throughput | [5529952.263op/s; 5534514.236op/s] or [-0.041%; +0.041%] | None | None | None |
| normalization/normalize_service/normalize_service/[empty string] | execution_time | [44.961µs; 44.998µs] or [-0.041%; +0.041%] | None | None | None |
| normalization/normalize_service/normalize_service/[empty string] | throughput | [22223284.534op/s; 22241489.888op/s] or [-0.041%; +0.041%] | None | None | None |
| normalization/normalize_service/normalize_service/test_ASCII | execution_time | [50.690µs; 50.767µs] or [-0.075%; +0.075%] | None | None | None |
| normalization/normalize_service/normalize_service/test_ASCII | throughput | [19698631.149op/s; 19728021.428op/s] or [-0.075%; +0.075%] | None | None | None |
Group 12
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 2711241 | 1727795175 | andrew.glaude/NET-tracer |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| sql/obfuscate_sql_string | execution_time | 76.403µs | 76.571µs ± 0.137µs | 76.561µs ± 0.031µs | 76.589µs | 76.647µs | 76.932µs | 78.264µs | 2.23% | 9.733 | 115.385 | 0.18% | 0.010µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| sql/obfuscate_sql_string | execution_time | [76.552µs; 76.590µs] or [-0.025%; +0.025%] | None | None | None |
Baseline
Omitted due to size.
👋 FYI, it's being taken into account in https://github.com/DataDog/libdatadog/pull/690
This pull request has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. To override this behavior, add the keep-open label or update the PR.