libdatadog icon indicating copy to clipboard operation
libdatadog copied to clipboard

Published 20 hours ago • verified publisher icon DataDog

Update blazesym to v0.2.0-rc.3.

Open hoolioh opened this issue 6 months ago • 3 comments
trafficstars

What does this PR do?

A brief description of the change being made with this pull request.

Motivation

What inspired you to submit this pull request?

Additional Notes

Anything else we should know when reviewing?

How to test the change?

Describe here in detail how the change can be validated.

hoolioh avatar Apr 30 '25 11:04 hoolioh

Benchmarks

Comparison

Benchmark execution time: 2025-05-30 15:23:41

Comparing candidate commit 5908d9f3 in PR branch julio/update-blazesym-dependency with baseline commit 35cf8db7 in branch main.

Found 0 performance improvements and 12 performance regressions! Performance is the same for 40 metrics, 2 unstable metrics.

scenario:credit_card/is_card_number/ 3782-8224-6310-005

  • 🟥 execution_time [+5.619µs; +5.808µs] or [+7.244%; +7.488%]
  • 🟥 throughput [-898919.153op/s; -869899.430op/s] or [-6.973%; -6.748%]

scenario:credit_card/is_card_number/ 378282246310005

  • 🟥 execution_time [+8.876µs; +8.977µs] or [+12.436%; +12.578%]
  • 🟥 throughput [-1566560.430op/s; -1548620.787op/s] or [-11.181%; -11.053%]

scenario:credit_card/is_card_number/378282246310005

  • 🟥 execution_time [+9.165µs; +9.292µs] or [+13.517%; +13.705%]
  • 🟥 throughput [-1780283.524op/s; -1754346.215op/s] or [-12.070%; -11.894%]

scenario:normalization/normalize_name/normalize_name/bad-name

  • 🟥 execution_time [+2.138µs; +2.167µs] or [+12.108%; +12.268%]
  • 🟥 throughput [-6186972.258op/s; -6113685.364op/s] or [-10.927%; -10.798%]

scenario:normalization/normalize_name/normalize_name/good

  • 🟥 execution_time [+1.831µs; +1.869µs] or [+17.730%; +18.101%]
  • 🟥 throughput [-14838274.390op/s; -14577892.085op/s] or [-15.322%; -15.054%]

scenario:normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000...

  • 🟥 execution_time [+96.921µs; +97.120µs] or [+22.114%; +22.160%]
  • 🟥 throughput [-413951.311op/s; -413149.642op/s] or [-18.142%; -18.107%]

Candidate

Candidate benchmark details

Group 1

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 5908d9f3 1748617906 julio/update-blazesym-dependency
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time 534.396µs 535.292µs ± 0.607µs 535.196µs ± 0.276µs 535.509µs 536.070µs 536.362µs 539.983µs 0.89% 4.015 26.809 0.11% 0.043µs 1 200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput 1851910.153op/s 1868140.295op/s ± 2109.337op/s 1868475.483op/s ± 961.536op/s 1869176.604op/s 1870360.897op/s 1870725.344op/s 1871272.521op/s 0.15% -3.973 26.390 0.11% 149.153op/s 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time 449.871µs 450.650µs ± 0.804µs 450.556µs ± 0.212µs 450.806µs 451.217µs 451.671µs 460.927µs 2.30% 10.549 132.136 0.18% 0.057µs 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput 2169543.300op/s 2219023.546op/s ± 3884.662op/s 2219480.178op/s ± 1044.577op/s 2220407.286op/s 2221575.275op/s 2222363.076op/s 2222860.183op/s 0.15% -10.427 130.039 0.17% 274.687op/s 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time 183.915µs 184.853µs ± 0.339µs 184.917µs ± 0.200µs 185.054µs 185.285µs 185.565µs 185.800µs 0.48% -0.448 0.056 0.18% 0.024µs 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput 5382129.151op/s 5409735.957op/s ± 9926.347op/s 5407817.731op/s ± 5846.126op/s 5415967.824op/s 5428869.198op/s 5433685.799op/s 5437308.445op/s 0.55% 0.458 0.059 0.18% 701.899op/s 1 200
normalization/normalize_service/normalize_service/[empty string] execution_time 39.916µs 40.038µs ± 0.058µs 40.041µs ± 0.046µs 40.080µs 40.134µs 40.165µs 40.211µs 0.42% 0.191 -0.561 0.14% 0.004µs 1 200
normalization/normalize_service/normalize_service/[empty string] throughput 24868967.137op/s 24976303.022op/s ± 36257.981op/s 24974399.437op/s ± 28832.573op/s 25006882.315op/s 25032373.334op/s 25039929.895op/s 25052407.319op/s 0.31% -0.185 -0.568 0.14% 2563.826op/s 1 200
normalization/normalize_service/normalize_service/test_ASCII execution_time 45.313µs 45.488µs ± 0.103µs 45.492µs ± 0.087µs 45.575µs 45.650µs 45.730µs 45.742µs 0.55% 0.120 -0.906 0.23% 0.007µs 1 200
normalization/normalize_service/normalize_service/test_ASCII throughput 21861751.627op/s 21984120.346op/s ± 49770.246op/s 21981903.033op/s ± 41892.959op/s 22027004.496op/s 22061950.054op/s 22067660.221op/s 22068554.247op/s 0.39% -0.113 -0.913 0.23% 3519.288op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time [535.208µs; 535.377µs] or [-0.016%; +0.016%] None None None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput [1867847.962op/s; 1868432.629op/s] or [-0.016%; +0.016%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time [450.539µs; 450.761µs] or [-0.025%; +0.025%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput [2218485.169op/s; 2219561.922op/s] or [-0.024%; +0.024%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time [184.806µs; 184.899µs] or [-0.025%; +0.025%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput [5408360.261op/s; 5411111.654op/s] or [-0.025%; +0.025%] None None None
normalization/normalize_service/normalize_service/[empty string] execution_time [40.030µs; 40.046µs] or [-0.020%; +0.020%] None None None
normalization/normalize_service/normalize_service/[empty string] throughput [24971278.015op/s; 24981328.029op/s] or [-0.020%; +0.020%] None None None
normalization/normalize_service/normalize_service/test_ASCII execution_time [45.473µs; 45.502µs] or [-0.031%; +0.031%] None None None
normalization/normalize_service/normalize_service/test_ASCII throughput [21977222.669op/s; 21991018.024op/s] or [-0.031%; +0.031%] None None None

Group 2

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 5908d9f3 1748617906 julio/update-blazesym-dependency
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sql/obfuscate_sql_string execution_time 65.461µs 65.712µs ± 0.289µs 65.690µs ± 0.054µs 65.747µs 65.828µs 66.225µs 69.538µs 5.86% 11.692 151.653 0.44% 0.020µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sql/obfuscate_sql_string execution_time [65.671µs; 65.752µs] or [-0.061%; +0.061%] None None None

Group 3

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 5908d9f3 1748617906 julio/update-blazesym-dependency
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
write only interface execution_time 1.218µs 3.155µs ± 1.430µs 2.991µs ± 0.021µs 3.009µs 3.155µs 13.963µs 14.946µs 399.75% 7.513 56.849 45.23% 0.101µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
write only interface execution_time [2.957µs; 3.353µs] or [-6.283%; +6.283%] None None None

Group 4

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 5908d9f3 1748617906 julio/update-blazesym-dependency
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
concentrator/add_spans_to_concentrator execution_time 5.965ms 5.978ms ± 0.011ms 5.976ms ± 0.003ms 5.980ms 5.991ms 6.027ms 6.073ms 1.63% 4.592 28.898 0.19% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
concentrator/add_spans_to_concentrator execution_time [5.977ms; 5.980ms] or [-0.026%; +0.026%] None None None

Group 5

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 5908d9f3 1748617906 julio/update-blazesym-dependency
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_trace/test_trace execution_time 251.652ns 260.456ns ± 12.059ns 255.042ns ± 2.045ns 261.072ns 294.496ns 299.135ns 300.007ns 17.63% 2.057 3.134 4.62% 0.853ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_trace/test_trace execution_time [258.785ns; 262.128ns] or [-0.642%; +0.642%] None None None

Group 6

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 5908d9f3 1748617906 julio/update-blazesym-dependency
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time 215.981µs 216.787µs ± 0.421µs 216.731µs ± 0.277µs 217.044µs 217.539µs 217.707µs 218.297µs 0.72% 0.573 -0.095 0.19% 0.030µs 1 200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput 4580917.324op/s 4612834.805op/s ± 8953.610op/s 4614009.581op/s ± 5905.809op/s 4619570.954op/s 4625648.098op/s 4626973.071op/s 4630036.901op/s 0.35% -0.564 -0.115 0.19% 633.116op/s 1 200
normalization/normalize_name/normalize_name/bad-name execution_time 19.700µs 19.814µs ± 0.094µs 19.786µs ± 0.043µs 19.873µs 19.931µs 19.958µs 20.696µs 4.60% 4.244 35.941 0.48% 0.007µs 1 200
normalization/normalize_name/normalize_name/bad-name throughput 48318934.704op/s 50470851.849op/s ± 236006.170op/s 50541124.919op/s ± 111273.646op/s 50637951.631op/s 50683934.208op/s 50709851.908op/s 50762192.146op/s 0.44% -3.970 32.506 0.47% 16688.156op/s 1 200
normalization/normalize_name/normalize_name/good execution_time 11.961µs 12.177µs ± 0.125µs 12.172µs ± 0.016µs 12.187µs 12.219µs 12.252µs 13.524µs 11.10% 8.472 83.062 1.02% 0.009µs 1 200
normalization/normalize_name/normalize_name/good throughput 73944201.013op/s 82131998.816op/s ± 775106.563op/s 82152788.158op/s ± 106482.607op/s 82274279.633op/s 82759330.769op/s 83290073.315op/s 83607780.226op/s 1.77% -8.064 77.562 0.94% 54808.311op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time [216.729µs; 216.846µs] or [-0.027%; +0.027%] None None None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput [4611593.921op/s; 4614075.689op/s] or [-0.027%; +0.027%] None None None
normalization/normalize_name/normalize_name/bad-name execution_time [19.801µs; 19.827µs] or [-0.066%; +0.066%] None None None
normalization/normalize_name/normalize_name/bad-name throughput [50438143.664op/s; 50503560.035op/s] or [-0.065%; +0.065%] None None None
normalization/normalize_name/normalize_name/good execution_time [12.159µs; 12.194µs] or [-0.142%; +0.142%] None None None
normalization/normalize_name/normalize_name/good throughput [82024576.501op/s; 82239421.131op/s] or [-0.131%; +0.131%] None None None

Group 7

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 5908d9f3 1748617906 julio/update-blazesym-dependency
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
two way interface execution_time 18.003µs 25.765µs ± 10.982µs 18.175µs ± 0.129µs 34.673µs 44.781µs 46.183µs 93.408µs 413.94% 2.001 7.449 42.52% 0.777µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
two way interface execution_time [24.243µs; 27.287µs] or [-5.907%; +5.907%] None None None

Group 8

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 5908d9f3 1748617906 julio/update-blazesym-dependency
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
tags/replace_trace_tags execution_time 2.379µs 2.412µs ± 0.025µs 2.404µs ± 0.010µs 2.414µs 2.472µs 2.483µs 2.489µs 3.56% 1.493 1.277 1.05% 0.002µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
tags/replace_trace_tags execution_time [2.408µs; 2.415µs] or [-0.146%; +0.146%] None None None

Group 9

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 5908d9f3 1748617906 julio/update-blazesym-dependency
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
credit_card/is_card_number/ execution_time 3.891µs 3.913µs ± 0.003µs 3.913µs ± 0.002µs 3.914µs 3.917µs 3.920µs 3.921µs 0.21% -1.622 14.844 0.07% 0.000µs 1 200
credit_card/is_card_number/ throughput 255053134.241op/s 255589782.478op/s ± 185692.216op/s 255589789.683op/s ± 98793.710op/s 255694010.369op/s 255821954.163op/s 255869553.791op/s 256984330.589op/s 0.55% 1.653 15.091 0.07% 13130.423op/s 1 200
credit_card/is_card_number/ 3782-8224-6310-005 execution_time 81.718µs 83.283µs ± 0.520µs 83.292µs ± 0.352µs 83.674µs 84.062µs 84.300µs 84.345µs 1.26% -0.276 -0.401 0.62% 0.037µs 1 200
credit_card/is_card_number/ 3782-8224-6310-005 throughput 11856032.491op/s 12007652.863op/s ± 75178.121op/s 12005997.495op/s ± 50915.319op/s 12053627.613op/s 12135748.350op/s 12159974.246op/s 12237189.912op/s 1.93% 0.305 -0.370 0.62% 5315.896op/s 1 200
credit_card/is_card_number/ 378282246310005 execution_time 79.412µs 80.301µs ± 0.249µs 80.343µs ± 0.170µs 80.489µs 80.609µs 80.718µs 81.047µs 0.88% -0.588 0.466 0.31% 0.018µs 1 200
credit_card/is_card_number/ 378282246310005 throughput 12338571.995op/s 12453264.509op/s ± 38609.493op/s 12446674.092op/s ± 26329.646op/s 12476867.936op/s 12523038.575op/s 12542898.369op/s 12592528.641op/s 1.17% 0.607 0.494 0.31% 2730.103op/s 1 200
credit_card/is_card_number/37828224631 execution_time 3.891µs 3.912µs ± 0.003µs 3.912µs ± 0.002µs 3.914µs 3.918µs 3.920µs 3.923µs 0.30% -0.576 8.859 0.08% 0.000µs 1 200
credit_card/is_card_number/37828224631 throughput 254894507.866op/s 255627180.818op/s ± 213004.895op/s 255654851.355op/s ± 117404.312op/s 255760915.860op/s 255850812.547op/s 255912817.950op/s 257023336.050op/s 0.54% 0.603 9.014 0.08% 15061.721op/s 1 200
credit_card/is_card_number/378282246310005 execution_time 76.363µs 77.029µs ± 0.248µs 77.064µs ± 0.155µs 77.214µs 77.370µs 77.470µs 77.518µs 0.59% -0.643 0.071 0.32% 0.018µs 1 200
credit_card/is_card_number/378282246310005 throughput 12900193.781op/s 12982209.076op/s ± 41900.522op/s 12976205.537op/s ± 26217.464op/s 13002420.726op/s 13067733.224op/s 13089189.925op/s 13095389.436op/s 0.92% 0.659 0.096 0.32% 2962.814op/s 1 200
credit_card/is_card_number/37828224631000521389798 execution_time 51.334µs 51.390µs ± 0.027µs 51.389µs ± 0.018µs 51.407µs 51.438µs 51.457µs 51.492µs 0.20% 0.472 0.459 0.05% 0.002µs 1 200
credit_card/is_card_number/37828224631000521389798 throughput 19420680.116op/s 19458862.438op/s ± 10040.988op/s 19459532.928op/s ± 6881.654op/s 19466393.219op/s 19473997.151op/s 19479312.172op/s 19480118.591op/s 0.11% -0.469 0.451 0.05% 710.005op/s 1 200
credit_card/is_card_number/x371413321323331 execution_time 6.027µs 6.034µs ± 0.004µs 6.034µs ± 0.003µs 6.037µs 6.041µs 6.044µs 6.047µs 0.22% 0.632 0.217 0.06% 0.000µs 1 200
credit_card/is_card_number/x371413321323331 throughput 165364034.260op/s 165714867.263op/s ± 103337.682op/s 165733433.167op/s ± 69836.319op/s 165788241.469op/s 165861330.548op/s 165907738.498op/s 165927764.379op/s 0.12% -0.629 0.210 0.06% 7307.078op/s 1 200
credit_card/is_card_number_no_luhn/ execution_time 3.892µs 3.911µs ± 0.003µs 3.910µs ± 0.001µs 3.912µs 3.914µs 3.916µs 3.925µs 0.36% -0.876 14.381 0.07% 0.000µs 1 200
credit_card/is_card_number_no_luhn/ throughput 254804210.318op/s 255715324.156op/s ± 175270.164op/s 255727132.651op/s ± 98119.393op/s 255814841.678op/s 255925976.240op/s 255980645.919op/s 256959047.943op/s 0.48% 0.908 14.527 0.07% 12393.472op/s 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time 65.864µs 66.137µs ± 0.126µs 66.128µs ± 0.077µs 66.199µs 66.373µs 66.528µs 66.623µs 0.75% 0.887 1.177 0.19% 0.009µs 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput 15009788.456op/s 15120229.945op/s ± 28686.876op/s 15122270.787op/s ± 17721.787op/s 15141464.238op/s 15158963.929op/s 15168595.222op/s 15182873.718op/s 0.40% -0.874 1.140 0.19% 2028.468op/s 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time 59.374µs 59.666µs ± 0.106µs 59.683µs ± 0.074µs 59.743µs 59.821µs 59.875µs 59.914µs 0.39% -0.352 -0.304 0.18% 0.008µs 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 throughput 16690452.217op/s 16760110.190op/s ± 29907.607op/s 16755306.060op/s ± 20716.810op/s 16780056.077op/s 16814854.833op/s 16832586.469op/s 16842481.792op/s 0.52% 0.361 -0.297 0.18% 2114.787op/s 1 200
credit_card/is_card_number_no_luhn/37828224631 execution_time 3.891µs 3.910µs ± 0.003µs 3.910µs ± 0.001µs 3.912µs 3.914µs 3.916µs 3.925µs 0.38% -1.160 21.387 0.07% 0.000µs 1 200
credit_card/is_card_number_no_luhn/37828224631 throughput 254758768.255op/s 255733130.869op/s ± 168292.507op/s 255737043.513op/s ± 85186.150op/s 255820229.123op/s 255934195.152op/s 255966489.784op/s 257034549.082op/s 0.51% 1.203 21.582 0.07% 11900.077op/s 1 200
credit_card/is_card_number_no_luhn/378282246310005 execution_time 56.483µs 56.943µs ± 0.147µs 56.975µs ± 0.087µs 57.041µs 57.131µs 57.213µs 57.240µs 0.46% -0.648 0.051 0.26% 0.010µs 1 200
credit_card/is_card_number_no_luhn/378282246310005 throughput 17470257.135op/s 17561439.256op/s ± 45347.321op/s 17551476.314op/s ± 26955.829op/s 17584174.690op/s 17651991.027op/s 17680452.330op/s 17704554.245op/s 0.87% 0.661 0.071 0.26% 3206.540op/s 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time 51.338µs 51.398µs ± 0.033µs 51.393µs ± 0.022µs 51.418µs 51.461µs 51.470µs 51.582µs 0.37% 1.180 3.728 0.06% 0.002µs 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput 19386661.698op/s 19455908.300op/s ± 12515.034op/s 19457900.892op/s ± 8180.905op/s 19464551.645op/s 19472043.209op/s 19477007.976op/s 19478569.678op/s 0.11% -1.172 3.678 0.06% 884.947op/s 1 200
credit_card/is_card_number_no_luhn/x371413321323331 execution_time 6.028µs 6.035µs ± 0.005µs 6.034µs ± 0.003µs 6.037µs 6.043µs 6.049µs 6.065µs 0.51% 2.009 7.951 0.08% 0.000µs 1 200
credit_card/is_card_number_no_luhn/x371413321323331 throughput 164878936.795op/s 165705929.591op/s ± 130412.470op/s 165727982.905op/s ± 69824.497op/s 165793297.813op/s 165857006.712op/s 165880213.700op/s 165892684.243op/s 0.10% -1.995 7.843 0.08% 9221.554op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
credit_card/is_card_number/ execution_time [3.912µs; 3.913µs] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/ throughput [255564047.323op/s; 255615517.634op/s] or [-0.010%; +0.010%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 execution_time [83.211µs; 83.356µs] or [-0.087%; +0.087%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 throughput [11997233.898op/s; 12018071.828op/s] or [-0.087%; +0.087%] None None None
credit_card/is_card_number/ 378282246310005 execution_time [80.267µs; 80.335µs] or [-0.043%; +0.043%] None None None
credit_card/is_card_number/ 378282246310005 throughput [12447913.604op/s; 12458615.413op/s] or [-0.043%; +0.043%] None None None
credit_card/is_card_number/37828224631 execution_time [3.911µs; 3.912µs] or [-0.012%; +0.012%] None None None
credit_card/is_card_number/37828224631 throughput [255597660.388op/s; 255656701.247op/s] or [-0.012%; +0.012%] None None None
credit_card/is_card_number/378282246310005 execution_time [76.995µs; 77.064µs] or [-0.045%; +0.045%] None None None
credit_card/is_card_number/378282246310005 throughput [12976402.066op/s; 12988016.085op/s] or [-0.045%; +0.045%] None None None
credit_card/is_card_number/37828224631000521389798 execution_time [51.387µs; 51.394µs] or [-0.007%; +0.007%] None None None
credit_card/is_card_number/37828224631000521389798 throughput [19457470.854op/s; 19460254.023op/s] or [-0.007%; +0.007%] None None None
credit_card/is_card_number/x371413321323331 execution_time [6.034µs; 6.035µs] or [-0.009%; +0.009%] None None None
credit_card/is_card_number/x371413321323331 throughput [165700545.654op/s; 165729188.872op/s] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/ execution_time [3.910µs; 3.911µs] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/ throughput [255691033.397op/s; 255739614.915op/s] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time [66.119µs; 66.154µs] or [-0.026%; +0.026%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput [15116254.220op/s; 15124205.670op/s] or [-0.026%; +0.026%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time [59.651µs; 59.680µs] or [-0.025%; +0.025%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 throughput [16755965.283op/s; 16764255.097op/s] or [-0.025%; +0.025%] None None None
credit_card/is_card_number_no_luhn/37828224631 execution_time [3.910µs; 3.911µs] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/37828224631 throughput [255709807.146op/s; 255756454.592op/s] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/378282246310005 execution_time [56.923µs; 56.964µs] or [-0.036%; +0.036%] None None None
credit_card/is_card_number_no_luhn/378282246310005 throughput [17555154.554op/s; 17567723.959op/s] or [-0.036%; +0.036%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time [51.394µs; 51.403µs] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput [19454173.836op/s; 19457642.763op/s] or [-0.009%; +0.009%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 execution_time [6.034µs; 6.035µs] or [-0.011%; +0.011%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 throughput [165687855.676op/s; 165724003.505op/s] or [-0.011%; +0.011%] None None None

Group 10

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 5908d9f3 1748617906 julio/update-blazesym-dependency
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
redis/obfuscate_redis_string execution_time 32.700µs 33.522µs ± 1.034µs 32.919µs ± 0.134µs 34.678µs 35.383µs 35.490µs 35.975µs 9.28% 0.968 -0.889 3.08% 0.073µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
redis/obfuscate_redis_string execution_time [33.379µs; 33.666µs] or [-0.427%; +0.427%] None None None

Group 11

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 5908d9f3 1748617906 julio/update-blazesym-dependency
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching string interning on wordpress profile execution_time 148.695µs 149.563µs ± 0.420µs 149.499µs ± 0.214µs 149.743µs 150.185µs 150.850µs 152.739µs 2.17% 2.700 15.886 0.28% 0.030µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching string interning on wordpress profile execution_time [149.505µs; 149.621µs] or [-0.039%; +0.039%] None None None

Group 12

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 5908d9f3 1748617906 julio/update-blazesym-dependency
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching deserializing traces from msgpack to their internal representation execution_time 72.702ms 72.915ms ± 0.168ms 72.870ms ± 0.061ms 72.952ms 73.249ms 73.575ms 73.785ms 1.26% 2.463 7.479 0.23% 0.012ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching deserializing traces from msgpack to their internal representation execution_time [72.892ms; 72.939ms] or [-0.032%; +0.032%] None None None

Group 13

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 5908d9f3 1748617906 julio/update-blazesym-dependency
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
ip_address/quantize_peer_ip_address_benchmark execution_time 4.951µs 5.020µs ± 0.057µs 5.016µs ± 0.049µs 5.045µs 5.112µs 5.116µs 5.119µs 2.07% 0.520 -1.140 1.12% 0.004µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
ip_address/quantize_peer_ip_address_benchmark execution_time [5.013µs; 5.028µs] or [-0.156%; +0.156%] None None None

Baseline

Omitted due to size.

pr-commenter[bot] avatar Apr 30 '25 11:04 pr-commenter[bot]

Codecov Report

Attention: Patch coverage is 0% with 2 lines in your changes missing coverage. Please review.

Project coverage is 71.00%. Comparing base (35cf8db) to head (5908d9f).

Additional details and impacted files 
@@            Coverage Diff             @@
##             main    #1046      +/-   ##
==========================================
+ Coverage   70.98%   71.00%   +0.01%     
==========================================
  Files         329      329              
  Lines       49895    49888       -7     
==========================================
+ Hits        35419    35421       +2     
+ Misses      14476    14467       -9
Components Coverage Δ
datadog-crashtracker 42.55% <0.00%> (+0.02%) :arrow_up:
datadog-crashtracker-ffi 6.03% <ø> (ø)
datadog-alloc 98.73% <ø> (ø)
data-pipeline 90.61% <ø> (-0.15%) :arrow_down:
data-pipeline-ffi 89.26% <ø> (ø)
ddcommon 80.07% <ø> (ø)
ddcommon-ffi 68.64% <ø> (ø)
ddtelemetry 60.56% <ø> (ø)
ddtelemetry-ffi 21.32% <ø> (ø)
dogstatsd-client 83.26% <ø> (ø)
datadog-ipc 82.58% <ø> (ø)
datadog-profiling 77.17% <ø> (ø)
datadog-profiling-ffi 62.12% <ø> (ø)
datadog-sidecar 42.37% <ø> (+0.01%) :arrow_up:
datdog-sidecar-ffi 10.80% <ø> (+0.14%) :arrow_up:
spawn-worker 55.35% <ø> (ø)
tinybytes 90.96% <ø> (ø)
datadog-trace-normalization 98.24% <ø> (ø)
datadog-trace-obfuscation 94.16% <ø> (ø)
datadog-trace-protobuf 77.10% <ø> (ø)
datadog-trace-utils 89.28% <ø> (ø)
:rocket: New features to boost your workflow:
  • :snowflake: Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

codecov-commenter avatar Apr 30 '25 11:04 codecov-commenter

Artifact Size Benchmark Report

aarch64-alpine-linux-musl
Artifact Baseline Commit Change
/aarch64-alpine-linux-musl/lib/libdatadog_profiling.a 65.98 MB 68.04 MB +3.13% (+2.06 MB) ⚠️
/aarch64-alpine-linux-musl/lib/libdatadog_profiling.so.debug 20.28 MB 21.15 MB +4.27% (+888.62 KB) ⚠️
/aarch64-alpine-linux-musl/lib/libdatadog_profiling.so 7.97 MB 8.26 MB +3.72% (+304.01 KB) ⚠️
aarch64-unknown-linux-gnu
Artifact Baseline Commit Change
/aarch64-unknown-linux-gnu/lib/libdatadog_profiling.a 72.53 MB 74.96 MB +3.35% (+2.43 MB) ⚠️
/aarch64-unknown-linux-gnu/lib/libdatadog_profiling.so.debug 22.66 MB 23.69 MB +4.55% (+1.03 MB) ⚠️
/aarch64-unknown-linux-gnu/lib/libdatadog_profiling.so 7.94 MB 8.30 MB +4.59% (+373.32 KB) ⚠️
libdatadog-x64-windows
Artifact Baseline Commit Change
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.dll 16.69 MB 16.70 MB +.02% (+3.50 KB) 🔍
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.lib 62.62 KB 62.62 KB 0% (0 B) 👌
/libdatadog-x64-windows/debug/dynamic/datadog_profiling_ffi.pdb 112.66 MB 112.69 MB +.02% (+32.00 KB) 🔍
/libdatadog-x64-windows/debug/static/datadog_profiling_ffi.lib 632.48 MB 632.41 MB --.01% (-72.92 KB) 💪
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.dll 4.98 MB 4.98 MB +0% (+512 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.lib 62.62 KB 62.62 KB 0% (0 B) 👌
/libdatadog-x64-windows/release/dynamic/datadog_profiling_ffi.pdb 15.85 MB 15.85 MB 0% (0 B) 👌
/libdatadog-x64-windows/release/static/datadog_profiling_ffi.lib 26.38 MB 26.38 MB --.01% (-3.59 KB) 💪
libdatadog-x86-windows
Artifact Baseline Commit Change
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.dll 14.15 MB 14.15 MB 0% (0 B) 👌
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.lib 63.58 KB 63.58 KB 0% (0 B) 👌
/libdatadog-x86-windows/debug/dynamic/datadog_profiling_ffi.pdb 114.54 MB 114.56 MB +.02% (+24.00 KB) 🔍
/libdatadog-x86-windows/debug/static/datadog_profiling_ffi.lib 625.07 MB 624.68 MB --.06% (-401.90 KB) 💪
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.dll 3.77 MB 3.77 MB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.lib 63.58 KB 63.58 KB 0% (0 B) 👌
/libdatadog-x86-windows/release/dynamic/datadog_profiling_ffi.pdb 16.48 MB 16.48 MB 0% (0 B) 👌
/libdatadog-x86-windows/release/static/datadog_profiling_ffi.lib 24.30 MB 24.30 MB +0% (+1.23 KB) 👌
x86_64-alpine-linux-musl
Artifact Baseline Commit Change
/x86_64-alpine-linux-musl/lib/libdatadog_profiling.a 57.45 MB 59.31 MB +3.23% (+1.85 MB) ⚠️
/x86_64-alpine-linux-musl/lib/libdatadog_profiling.so 8.42 MB 8.69 MB +3.19% (+275.32 KB) ⚠️
/x86_64-alpine-linux-musl/lib/libdatadog_profiling.so.debug 18.68 MB 19.47 MB +4.22% (+808.67 KB) ⚠️
x86_64-unknown-linux-gnu
Artifact Baseline Commit Change
/x86_64-unknown-linux-gnu/lib/libdatadog_profiling.a 68.54 MB 70.65 MB +3.08% (+2.11 MB) ⚠️
/x86_64-unknown-linux-gnu/lib/libdatadog_profiling.so 8.42 MB 8.70 MB +3.37% (+290.95 KB) ⚠️
/x86_64-unknown-linux-gnu/lib/libdatadog_profiling.so.debug 20.86 MB 21.77 MB +4.37% (+935.59 KB) ⚠️

r1viollet avatar Apr 30 '25 12:04 r1viollet

@hoolioh do you need help to push this ? It would be interesting to have this for everyone.

r1viollet avatar May 19 '25 09:05 r1viollet

@hoolioh do you need help to push this ? It would be interesting to have this for everyone.

Probably, I won't be able to debug why the example failed until next week. If you have some time available feel free to take over the PR. Otherwise we can talk next week.

hoolioh avatar May 19 '25 20:05 hoolioh

Hey @hoolioh I took the liberty to fix the PR and make it ready to review.

gleocadie avatar May 28 '25 15:05 gleocadie