libdatadog
libdatadog copied to clipboard
try using an emit_metric macro
What does this PR do?
A brief description of the change being made with this pull request.
Motivation
What inspired you to submit this pull request?
Additional Notes
Anything else we should know when reviewing?
How to test the change?
Describe here in detail how the change can be validated.
Codecov Report
Attention: Patch coverage is 50.00000% with 2 lines in your changes missing coverage. Please review.
Project coverage is 73.66%. Comparing base (
cafd312) to head (73a93c7).
Additional details and impacted files
@@ Coverage Diff @@
## andrew.glaude/dogstatsd-client-SPLIT #649 +/- ##
========================================================================
- Coverage 73.83% 73.66% -0.18%
========================================================================
Files 255 255
Lines 37079 37116 +37
========================================================================
- Hits 27379 27342 -37
- Misses 9700 9774 +74
| Components | Coverage Δ | |
|---|---|---|
| crashtracker | 20.53% <ø> (ø) |
|
| datadog-alloc | 98.73% <ø> (ø) |
|
| data-pipeline | 93.39% <50.00%> (+0.06%) |
:arrow_up: |
| data-pipeline-ffi | 0.00% <ø> (ø) |
|
| ddcommon | 83.08% <ø> (ø) |
|
| ddcommon-ffi | 69.52% <ø> (ø) |
|
| ddtelemetry | 59.10% <ø> (ø) |
|
| dogstatsd-client | 78.44% <ø> (ø) |
|
| ipc | 83.58% <ø> (ø) |
|
| profiling | 83.57% <ø> (-0.70%) |
:arrow_down: |
| profiling-ffi | 77.42% <ø> (ø) |
|
| serverless | 0.00% <ø> (ø) |
|
| sidecar | 38.44% <ø> (ø) |
|
| sidecar-ffi | 0.00% <ø> (ø) |
|
| spawn-worker | 50.36% <ø> (ø) |
|
| tinybytes | 94.77% <ø> (ø) |
|
| trace-mini-agent | 72.47% <ø> (ø) |
|
| trace-normalization | 98.25% <ø> (ø) |
|
| trace-obfuscation | 95.73% <ø> (ø) |
|
| trace-protobuf | 77.67% <ø> (ø) |
|
| trace-utils | 93.82% <ø> (ø) |
Benchmarks
Comparison
Benchmark execution time: 2024-09-24 17:36:30
Comparing candidate commit 73a93c7 in PR branch andrew.glaude/macroTest with baseline commit cafd312 in branch andrew.glaude/dogstatsd-client-SPLIT.
Found 0 performance improvements and 0 performance regressions! Performance is the same for 51 metrics, 2 unstable metrics.
Candidate
Candidate benchmark details
Group 1
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 73a93c7 | 1727198761 | andrew.glaude/macroTest |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| benching string interning on wordpress profile | execution_time | 142.004µs | 143.071µs ± 0.421µs | 143.078µs ± 0.210µs | 143.289µs | 143.501µs | 144.329µs | 145.990µs | 2.04% | 1.742 | 11.718 | 0.29% | 0.030µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| benching string interning on wordpress profile | execution_time | [143.013µs; 143.130µs] or [-0.041%; +0.041%] | None | None | None |
Group 2
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 73a93c7 | 1727198761 | andrew.glaude/macroTest |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| credit_card/is_card_number/ | execution_time | 2.415µs | 2.416µs ± 0.001µs | 2.416µs ± 0.001µs | 2.417µs | 2.418µs | 2.421µs | 2.426µs | 0.43% | 3.566 | 23.398 | 0.05% | 0.000µs | 1 | 200 |
| credit_card/is_card_number/ | throughput | 412123213.191op/s | 413880351.417op/s ± 213767.279op/s | 413909913.156op/s ± 115930.004op/s | 414027468.707op/s | 414080276.068op/s | 414125022.286op/s | 414155824.053op/s | 0.06% | -3.547 | 23.183 | 0.05% | 15115.629op/s | 1 | 200 |
| credit_card/is_card_number/ 3782-8224-6310-005 | execution_time | 98.250µs | 99.209µs ± 0.672µs | 99.149µs ± 0.363µs | 99.432µs | 100.185µs | 101.747µs | 104.901µs | 5.80% | 3.764 | 25.873 | 0.68% | 0.048µs | 1 | 200 |
| credit_card/is_card_number/ 3782-8224-6310-005 | throughput | 9532770.598op/s | 10080211.996op/s ± 66634.319op/s | 10085818.836op/s ± 36884.330op/s | 10126907.708op/s | 10142623.565op/s | 10153798.030op/s | 10178135.511op/s | 0.92% | -3.500 | 22.918 | 0.66% | 4711.758op/s | 1 | 200 |
| credit_card/is_card_number/ 378282246310005 | execution_time | 90.737µs | 91.890µs ± 0.786µs | 91.826µs ± 0.511µs | 92.264µs | 93.281µs | 94.235µs | 95.793µs | 4.32% | 1.294 | 3.164 | 0.85% | 0.056µs | 1 | 200 |
| credit_card/is_card_number/ 378282246310005 | throughput | 10439185.138op/s | 10883317.234op/s ± 92152.363op/s | 10890135.176op/s ± 60313.477op/s | 10957575.209op/s | 10998441.219op/s | 11015898.974op/s | 11020902.608op/s | 1.20% | -1.208 | 2.740 | 0.84% | 6516.156op/s | 1 | 200 |
| credit_card/is_card_number/37828224631 | execution_time | 2.415µs | 2.416µs ± 0.001µs | 2.416µs ± 0.001µs | 2.417µs | 2.418µs | 2.418µs | 2.419µs | 0.14% | 0.956 | 0.371 | 0.04% | 0.000µs | 1 | 200 |
| credit_card/is_card_number/37828224631 | throughput | 413345001.666op/s | 413895680.759op/s ± 158744.417op/s | 413930361.806op/s ± 99829.989op/s | 414024083.018op/s | 414080802.171op/s | 414098356.840op/s | 414105271.983op/s | 0.04% | -0.954 | 0.366 | 0.04% | 11224.925op/s | 1 | 200 |
| credit_card/is_card_number/378282246310005 | execution_time | 86.930µs | 88.415µs ± 0.642µs | 88.434µs ± 0.423µs | 88.812µs | 89.370µs | 89.989µs | 90.512µs | 2.35% | 0.195 | -0.076 | 0.72% | 0.045µs | 1 | 200 |
| credit_card/is_card_number/378282246310005 | throughput | 11048269.597op/s | 11310908.036op/s ± 82058.392op/s | 11307880.510op/s ± 54150.986op/s | 11367086.630op/s | 11439097.428op/s | 11489699.967op/s | 11503536.676op/s | 1.73% | -0.155 | -0.118 | 0.72% | 5802.405op/s | 1 | 200 |
| credit_card/is_card_number/37828224631000521389798 | execution_time | 85.767µs | 86.163µs ± 0.169µs | 86.152µs ± 0.114µs | 86.282µs | 86.426µs | 86.522µs | 86.540µs | 0.45% | -0.096 | -0.394 | 0.20% | 0.012µs | 1 | 200 |
| credit_card/is_card_number/37828224631000521389798 | throughput | 11555308.688op/s | 11605909.781op/s ± 22800.362op/s | 11607338.162op/s ± 15299.053op/s | 11618603.162op/s | 11644619.505op/s | 11654720.917op/s | 11659499.592op/s | 0.45% | 0.105 | -0.393 | 0.20% | 1612.229op/s | 1 | 200 |
| credit_card/is_card_number/x371413321323331 | execution_time | 21.249µs | 21.792µs ± 0.297µs | 21.761µs ± 0.194µs | 21.954µs | 22.360µs | 22.557µs | 22.714µs | 4.38% | 0.669 | 0.098 | 1.36% | 0.021µs | 1 | 200 |
| credit_card/is_card_number/x371413321323331 | throughput | 44025428.090op/s | 45897823.650op/s ± 620393.595op/s | 45953087.335op/s ± 412544.308op/s | 46365564.761op/s | 46783865.148op/s | 46958825.555op/s | 47061250.474op/s | 2.41% | -0.602 | -0.020 | 1.35% | 43868.452op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/ | execution_time | 2.415µs | 2.416µs ± 0.001µs | 2.416µs ± 0.001µs | 2.417µs | 2.418µs | 2.418µs | 2.421µs | 0.23% | 1.469 | 4.553 | 0.04% | 0.000µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/ | throughput | 412988039.810op/s | 413893834.042op/s ± 156897.027op/s | 413926491.296op/s ± 105703.039op/s | 414020210.768op/s | 414072196.064op/s | 414091765.483op/s | 414099761.725op/s | 0.04% | -1.464 | 4.518 | 0.04% | 11094.295op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 | execution_time | 82.172µs | 83.248µs ± 0.440µs | 83.263µs ± 0.250µs | 83.467µs | 83.696µs | 84.211µs | 86.141µs | 3.46% | 2.306 | 14.784 | 0.53% | 0.031µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 | throughput | 11608915.033op/s | 12012653.200op/s ± 62808.392op/s | 12010150.279op/s ± 36158.721op/s | 12048949.205op/s | 12102216.306op/s | 12134623.785op/s | 12169618.738op/s | 1.33% | -2.130 | 13.529 | 0.52% | 4441.224op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/ 378282246310005 | execution_time | 75.060µs | 76.474µs ± 0.642µs | 76.461µs ± 0.420µs | 76.857µs | 77.637µs | 78.141µs | 78.435µs | 2.58% | 0.358 | 0.093 | 0.84% | 0.045µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/ 378282246310005 | throughput | 12749409.099op/s | 13077320.693op/s ± 109464.821op/s | 13078646.531op/s ± 71835.651op/s | 13153319.614op/s | 13247504.407op/s | 13295463.787op/s | 13322711.776op/s | 1.87% | -0.309 | 0.035 | 0.83% | 7740.332op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/37828224631 | execution_time | 2.415µs | 2.416µs ± 0.003µs | 2.416µs ± 0.001µs | 2.417µs | 2.418µs | 2.419µs | 2.454µs | 1.58% | 12.428 | 165.396 | 0.12% | 0.000µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/37828224631 | throughput | 407430572.905op/s | 413832280.375op/s ± 474336.681op/s | 413862069.541op/s ± 104910.316op/s | 413977310.265op/s | 414050789.016op/s | 414065029.764op/s | 414094251.613op/s | 0.06% | -12.383 | 164.578 | 0.11% | 33540.668op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/378282246310005 | execution_time | 70.558µs | 72.068µs ± 0.478µs | 72.094µs ± 0.289µs | 72.378µs | 72.725µs | 73.184µs | 73.689µs | 2.21% | -0.259 | 0.653 | 0.66% | 0.034µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/378282246310005 | throughput | 13570466.993op/s | 13876388.660op/s ± 92260.621op/s | 13870844.878op/s ± 55585.806op/s | 13928125.063op/s | 14053083.440op/s | 14093097.273op/s | 14172799.461op/s | 2.18% | 0.310 | 0.640 | 0.66% | 6523.811op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/37828224631000521389798 | execution_time | 85.697µs | 86.173µs ± 0.190µs | 86.162µs ± 0.139µs | 86.318µs | 86.504µs | 86.559µs | 86.587µs | 0.49% | 0.016 | -0.486 | 0.22% | 0.013µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/37828224631000521389798 | throughput | 11549112.007op/s | 11604629.527op/s ± 25560.043op/s | 11606062.876op/s ± 18777.301op/s | 11622707.831op/s | 11646199.627op/s | 11659628.267op/s | 11668982.677op/s | 0.54% | -0.006 | -0.483 | 0.22% | 1807.368op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/x371413321323331 | execution_time | 21.241µs | 21.724µs ± 0.237µs | 21.655µs ± 0.143µs | 21.866µs | 22.177µs | 22.270µs | 22.571µs | 4.23% | 0.776 | 0.230 | 1.09% | 0.017µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/x371413321323331 | throughput | 44304582.980op/s | 46036433.180op/s ± 498044.621op/s | 46179580.052op/s ± 305386.214op/s | 46384117.690op/s | 46645364.123op/s | 46897085.130op/s | 47079556.432op/s | 1.95% | -0.724 | 0.123 | 1.08% | 35217.073op/s | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| credit_card/is_card_number/ | execution_time | [2.416µs; 2.416µs] or [-0.007%; +0.007%] | None | None | None |
| credit_card/is_card_number/ | throughput | [413850725.327op/s; 413909977.506op/s] or [-0.007%; +0.007%] | None | None | None |
| credit_card/is_card_number/ 3782-8224-6310-005 | execution_time | [99.116µs; 99.302µs] or [-0.094%; +0.094%] | None | None | None |
| credit_card/is_card_number/ 3782-8224-6310-005 | throughput | [10070977.120op/s; 10089446.871op/s] or [-0.092%; +0.092%] | None | None | None |
| credit_card/is_card_number/ 378282246310005 | execution_time | [91.781µs; 91.999µs] or [-0.119%; +0.119%] | None | None | None |
| credit_card/is_card_number/ 378282246310005 | throughput | [10870545.803op/s; 10896088.665op/s] or [-0.117%; +0.117%] | None | None | None |
| credit_card/is_card_number/37828224631 | execution_time | [2.416µs; 2.416µs] or [-0.005%; +0.005%] | None | None | None |
| credit_card/is_card_number/37828224631 | throughput | [413873680.309op/s; 413917681.208op/s] or [-0.005%; +0.005%] | None | None | None |
| credit_card/is_card_number/378282246310005 | execution_time | [88.326µs; 88.504µs] or [-0.101%; +0.101%] | None | None | None |
| credit_card/is_card_number/378282246310005 | throughput | [11299535.532op/s; 11322280.540op/s] or [-0.101%; +0.101%] | None | None | None |
| credit_card/is_card_number/37828224631000521389798 | execution_time | [86.140µs; 86.187µs] or [-0.027%; +0.027%] | None | None | None |
| credit_card/is_card_number/37828224631000521389798 | throughput | [11602749.870op/s; 11609069.692op/s] or [-0.027%; +0.027%] | None | None | None |
| credit_card/is_card_number/x371413321323331 | execution_time | [21.750µs; 21.833µs] or [-0.189%; +0.189%] | None | None | None |
| credit_card/is_card_number/x371413321323331 | throughput | [45811843.065op/s; 45983804.236op/s] or [-0.187%; +0.187%] | None | None | None |
| credit_card/is_card_number_no_luhn/ | execution_time | [2.416µs; 2.416µs] or [-0.005%; +0.005%] | None | None | None |
| credit_card/is_card_number_no_luhn/ | throughput | [413872089.623op/s; 413915578.461op/s] or [-0.005%; +0.005%] | None | None | None |
| credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 | execution_time | [83.187µs; 83.309µs] or [-0.073%; +0.073%] | None | None | None |
| credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 | throughput | [12003948.561op/s; 12021357.839op/s] or [-0.072%; +0.072%] | None | None | None |
| credit_card/is_card_number_no_luhn/ 378282246310005 | execution_time | [76.385µs; 76.563µs] or [-0.116%; +0.116%] | None | None | None |
| credit_card/is_card_number_no_luhn/ 378282246310005 | throughput | [13062149.922op/s; 13092491.464op/s] or [-0.116%; +0.116%] | None | None | None |
| credit_card/is_card_number_no_luhn/37828224631 | execution_time | [2.416µs; 2.417µs] or [-0.016%; +0.016%] | None | None | None |
| credit_card/is_card_number_no_luhn/37828224631 | throughput | [413766541.873op/s; 413898018.877op/s] or [-0.016%; +0.016%] | None | None | None |
| credit_card/is_card_number_no_luhn/378282246310005 | execution_time | [72.002µs; 72.134µs] or [-0.092%; +0.092%] | None | None | None |
| credit_card/is_card_number_no_luhn/378282246310005 | throughput | [13863602.225op/s; 13889175.095op/s] or [-0.092%; +0.092%] | None | None | None |
| credit_card/is_card_number_no_luhn/37828224631000521389798 | execution_time | [86.147µs; 86.199µs] or [-0.031%; +0.031%] | None | None | None |
| credit_card/is_card_number_no_luhn/37828224631000521389798 | throughput | [11601087.150op/s; 11608171.903op/s] or [-0.031%; +0.031%] | None | None | None |
| credit_card/is_card_number_no_luhn/x371413321323331 | execution_time | [21.692µs; 21.757µs] or [-0.151%; +0.151%] | None | None | None |
| credit_card/is_card_number_no_luhn/x371413321323331 | throughput | [45967408.986op/s; 46105457.375op/s] or [-0.150%; +0.150%] | None | None | None |
Group 3
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 73a93c7 | 1727198761 | andrew.glaude/macroTest |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... | execution_time | 616.532µs | 617.596µs ± 0.564µs | 617.481µs ± 0.221µs | 617.718µs | 618.755µs | 619.317µs | 620.486µs | 0.49% | 1.903 | 5.151 | 0.09% | 0.040µs | 1 | 200 |
| normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... | throughput | 1611638.869op/s | 1619182.664op/s ± 1476.568op/s | 1619483.990op/s ± 579.154op/s | 1620049.648op/s | 1620822.889op/s | 1621220.919op/s | 1621975.826op/s | 0.15% | -1.893 | 5.100 | 0.09% | 104.409op/s | 1 | 200 |
| normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて | execution_time | 460.651µs | 461.275µs ± 0.253µs | 461.269µs ± 0.175µs | 461.438µs | 461.736µs | 461.944µs | 461.956µs | 0.15% | 0.415 | 0.111 | 0.05% | 0.018µs | 1 | 200 |
| normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて | throughput | 2164707.587op/s | 2167902.569op/s ± 1187.339op/s | 2167934.604op/s ± 820.698op/s | 2168772.445op/s | 2169686.165op/s | 2170412.726op/s | 2170842.072op/s | 0.13% | -0.411 | 0.109 | 0.05% | 83.958op/s | 1 | 200 |
| normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters | execution_time | 178.926µs | 179.334µs ± 0.798µs | 179.161µs ± 0.067µs | 179.222µs | 179.647µs | 183.145µs | 183.770µs | 2.57% | 4.363 | 17.810 | 0.44% | 0.056µs | 1 | 200 |
| normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters | throughput | 5441594.700op/s | 5576295.566op/s ± 24341.124op/s | 5581558.585op/s ± 2074.755op/s | 5583832.032op/s | 5585719.082op/s | 5586016.231op/s | 5588908.008op/s | 0.13% | -4.353 | 17.723 | 0.44% | 1721.177op/s | 1 | 200 |
| normalization/normalize_service/normalize_service/[empty string] | execution_time | 45.948µs | 46.094µs ± 0.055µs | 46.097µs ± 0.037µs | 46.132µs | 46.177µs | 46.218µs | 46.271µs | 0.38% | -0.089 | 0.037 | 0.12% | 0.004µs | 1 | 200 |
| normalization/normalize_service/normalize_service/[empty string] | throughput | 21611887.082op/s | 21694947.701op/s ± 25701.079op/s | 21693589.726op/s ± 17458.723op/s | 21711089.694op/s | 21739101.521op/s | 21753069.101op/s | 21763504.369op/s | 0.32% | 0.096 | 0.034 | 0.12% | 1817.341op/s | 1 | 200 |
| normalization/normalize_service/normalize_service/test_ASCII | execution_time | 48.882µs | 48.961µs ± 0.102µs | 48.943µs ± 0.007µs | 48.950µs | 49.012µs | 49.361µs | 50.039µs | 2.24% | 7.690 | 68.918 | 0.21% | 0.007µs | 1 | 200 |
| normalization/normalize_service/normalize_service/test_ASCII | throughput | 19984279.034op/s | 20424333.471op/s ± 42061.452op/s | 20432055.782op/s ± 2797.138op/s | 20434388.116op/s | 20438725.705op/s | 20456630.845op/s | 20457312.643op/s | 0.12% | -7.617 | 67.689 | 0.21% | 2974.194op/s | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... | execution_time | [617.518µs; 617.674µs] or [-0.013%; +0.013%] | None | None | None |
| normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... | throughput | [1618978.026op/s; 1619387.302op/s] or [-0.013%; +0.013%] | None | None | None |
| normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて | execution_time | [461.240µs; 461.311µs] or [-0.008%; +0.008%] | None | None | None |
| normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて | throughput | [2167738.015op/s; 2168067.122op/s] or [-0.008%; +0.008%] | None | None | None |
| normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters | execution_time | [179.223µs; 179.445µs] or [-0.062%; +0.062%] | None | None | None |
| normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters | throughput | [5572922.121op/s; 5579669.012op/s] or [-0.060%; +0.060%] | None | None | None |
| normalization/normalize_service/normalize_service/[empty string] | execution_time | [46.086µs; 46.101µs] or [-0.016%; +0.016%] | None | None | None |
| normalization/normalize_service/normalize_service/[empty string] | throughput | [21691385.779op/s; 21698509.624op/s] or [-0.016%; +0.016%] | None | None | None |
| normalization/normalize_service/normalize_service/test_ASCII | execution_time | [48.947µs; 48.976µs] or [-0.029%; +0.029%] | None | None | None |
| normalization/normalize_service/normalize_service/test_ASCII | throughput | [20418504.159op/s; 20430162.784op/s] or [-0.029%; +0.029%] | None | None | None |
Group 4
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 73a93c7 | 1727198761 | andrew.glaude/macroTest |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| sql/obfuscate_sql_string | execution_time | 75.450µs | 75.644µs ± 0.175µs | 75.625µs ± 0.054µs | 75.680µs | 75.745µs | 76.538µs | 77.310µs | 2.23% | 6.356 | 50.767 | 0.23% | 0.012µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| sql/obfuscate_sql_string | execution_time | [75.620µs; 75.668µs] or [-0.032%; +0.032%] | None | None | None |
Group 5
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 73a93c7 | 1727198761 | andrew.glaude/macroTest |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... | execution_time | 252.717µs | 257.263µs ± 2.093µs | 257.138µs ± 1.388µs | 258.722µs | 260.609µs | 261.496µs | 262.428µs | 2.06% | -0.002 | -0.557 | 0.81% | 0.148µs | 1 | 200 |
| normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... | throughput | 3810569.463op/s | 3887335.862op/s ± 31635.395op/s | 3888968.954op/s ± 20877.365op/s | 3907542.021op/s | 3944459.944op/s | 3949149.277op/s | 3956995.374op/s | 1.75% | 0.037 | -0.555 | 0.81% | 2236.960op/s | 1 | 200 |
| normalization/normalize_name/normalize_name/bad-name | execution_time | 23.363µs | 23.522µs ± 0.066µs | 23.516µs ± 0.040µs | 23.562µs | 23.642µs | 23.659µs | 23.713µs | 0.84% | 0.139 | -0.024 | 0.28% | 0.005µs | 1 | 200 |
| normalization/normalize_name/normalize_name/bad-name | throughput | 42170330.566op/s | 42513662.269op/s ± 120020.748op/s | 42523844.286op/s ± 73056.427op/s | 42590674.584op/s | 42706284.867op/s | 42793530.562op/s | 42801856.200op/s | 0.65% | -0.123 | -0.025 | 0.28% | 8486.748op/s | 1 | 200 |
| normalization/normalize_name/normalize_name/good | execution_time | 13.944µs | 14.043µs ± 0.069µs | 14.031µs ± 0.035µs | 14.072µs | 14.134µs | 14.206µs | 14.680µs | 4.62% | 4.288 | 35.039 | 0.49% | 0.005µs | 1 | 200 |
| normalization/normalize_name/normalize_name/good | throughput | 68120283.653op/s | 71211830.737op/s ± 342735.978op/s | 71268706.324op/s ± 176068.693op/s | 71417672.389op/s | 71573494.051op/s | 71694190.544op/s | 71717688.285op/s | 0.63% | -4.025 | 31.788 | 0.48% | 24235.093op/s | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... | execution_time | [256.972µs; 257.553µs] or [-0.113%; +0.113%] | None | None | None |
| normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... | throughput | [3882951.500op/s; 3891720.223op/s] or [-0.113%; +0.113%] | None | None | None |
| normalization/normalize_name/normalize_name/bad-name | execution_time | [23.513µs; 23.531µs] or [-0.039%; +0.039%] | None | None | None |
| normalization/normalize_name/normalize_name/bad-name | throughput | [42497028.547op/s; 42530295.990op/s] or [-0.039%; +0.039%] | None | None | None |
| normalization/normalize_name/normalize_name/good | execution_time | [14.033µs; 14.052µs] or [-0.068%; +0.068%] | None | None | None |
| normalization/normalize_name/normalize_name/good | throughput | [71164330.827op/s; 71259330.647op/s] or [-0.067%; +0.067%] | None | None | None |
Group 6
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 73a93c7 | 1727198761 | andrew.glaude/macroTest |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| concentrator/add_spans_to_concentrator | execution_time | 9.132ms | 9.170ms ± 0.017ms | 9.169ms ± 0.008ms | 9.177ms | 9.190ms | 9.197ms | 9.334ms | 1.80% | 4.770 | 46.497 | 0.18% | 0.001ms | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| concentrator/add_spans_to_concentrator | execution_time | [9.167ms; 9.172ms] or [-0.025%; +0.025%] | None | None | None |
Group 7
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 73a93c7 | 1727198761 | andrew.glaude/macroTest |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| tags/replace_trace_tags | execution_time | 2.656µs | 2.709µs ± 0.016µs | 2.710µs ± 0.006µs | 2.715µs | 2.737µs | 2.742µs | 2.745µs | 1.32% | -0.863 | 2.281 | 0.59% | 0.001µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| tags/replace_trace_tags | execution_time | [2.707µs; 2.711µs] or [-0.083%; +0.083%] | None | None | None |
Group 8
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 73a93c7 | 1727198761 | andrew.glaude/macroTest |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| benching deserializing traces from msgpack to their internal representation | execution_time | 1.124µs | 1.183µs ± 0.021µs | 1.188µs ± 0.013µs | 1.200µs | 1.203µs | 1.204µs | 1.204µs | 1.38% | -1.239 | 0.805 | 1.78% | 0.001µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| benching deserializing traces from msgpack to their internal representation | execution_time | [1.180µs; 1.185µs] or [-0.247%; +0.247%] | None | None | None |
Group 9
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 73a93c7 | 1727198761 | andrew.glaude/macroTest |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| two way interface | execution_time | 17.219µs | 26.248µs ± 10.618µs | 18.605µs ± 0.824µs | 34.803µs | 41.989µs | 45.282µs | 91.282µs | 390.63% | 1.857 | 7.282 | 40.35% | 0.751µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| two way interface | execution_time | [24.777µs; 27.720µs] or [-5.606%; +5.606%] | None | None | None |
Group 10
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 73a93c7 | 1727198761 | andrew.glaude/macroTest |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| normalization/normalize_trace/test_trace | execution_time | 273.015ns | 285.049ns ± 13.850ns | 280.480ns ± 5.718ns | 287.477ns | 314.911ns | 331.017ns | 333.619ns | 18.95% | 1.806 | 2.874 | 4.85% | 0.979ns | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| normalization/normalize_trace/test_trace | execution_time | [283.130ns; 286.969ns] or [-0.673%; +0.673%] | None | None | None |
Group 11
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 73a93c7 | 1727198761 | andrew.glaude/macroTest |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| write only interface | execution_time | 1.352µs | 3.186µs ± 1.538µs | 3.033µs ± 0.022µs | 3.053µs | 3.143µs | 13.772µs | 17.585µs | 479.88% | 7.945 | 63.755 | 48.15% | 0.109µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| write only interface | execution_time | [2.973µs; 3.400µs] or [-6.690%; +6.690%] | None | None | None |
Group 12
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 73a93c7 | 1727198761 | andrew.glaude/macroTest |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| redis/obfuscate_redis_string | execution_time | 39.314µs | 39.879µs ± 0.901µs | 39.475µs ± 0.065µs | 39.568µs | 41.792µs | 41.815µs | 42.949µs | 8.80% | 1.716 | 1.124 | 2.25% | 0.064µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| redis/obfuscate_redis_string | execution_time | [39.754µs; 40.004µs] or [-0.313%; +0.313%] | None | None | None |
Baseline
Omitted due to size.
This pull request has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. To override this behavior, add the keep-open label or update the PR.