libdatadog icon indicating copy to clipboard operation
libdatadog copied to clipboard

APMSP-1542 ci: setup building nuget packages in CI

Open ganeshnj opened this issue 1 year ago • 4 comments

What does this PR do?

  • [ ] Build nuget packages on changes
  • [ ] Include data pipeline artifacts

Motivation

  • Prerequisite for data pipeline integration in .NET tracer
  • Currently, we are not testing the building nuget packages in CI

Additional Notes

Anything else we should know when reviewing?

How to test the change?

The libdatadog nuget version attached in artifacts can be used directly in .NET tracer.

ganeshnj avatar Oct 29 '24 12:10 ganeshnj

Benchmarks

Comparison

Benchmark execution time: 2024-11-19 09:40:59

Comparing candidate commit 88f6c10e in PR branch ganeshnj/feat/datapipeline-nuget with baseline commit ce9ae282 in branch main.

Found 2 performance improvements and 0 performance regressions! Performance is the same for 49 metrics, 2 unstable metrics.

scenario:credit_card/is_card_number_no_luhn/378282246310005

  • 🟩 execution_time [-9.198µs; -9.127µs] or [-12.827%; -12.728%]
  • 🟩 throughput [+2035386.827op/s; +2050370.448op/s] or [+14.595%; +14.702%]

Candidate

Candidate benchmark details

Group 1

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 88f6c10e 1732008589 ganeshnj/feat/datapipeline-nuget
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
two way interface execution_time 18.713µs 25.252µs ± 11.070µs 19.473µs ± 0.237µs 35.011µs 44.391µs 46.931µs 97.032µs 398.30% 2.825 12.479 43.73% 0.783µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
two way interface execution_time [23.717µs; 26.786µs] or [-6.075%; +6.075%] None None None

Group 2

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 88f6c10e 1732008589 ganeshnj/feat/datapipeline-nuget
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_trace/test_trace execution_time 296.093ns 313.341ns ± 19.890ns 305.035ns ± 6.133ns 318.706ns 357.882ns 370.360ns 370.556ns 21.48% 1.623 1.556 6.33% 1.406ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_trace/test_trace execution_time [310.584ns; 316.098ns] or [-0.880%; +0.880%] None None None

Group 3

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 88f6c10e 1732008589 ganeshnj/feat/datapipeline-nuget
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
tags/replace_trace_tags execution_time 2.615µs 2.692µs ± 0.022µs 2.694µs ± 0.007µs 2.704µs 2.716µs 2.720µs 2.721µs 1.01% -2.075 4.424 0.82% 0.002µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
tags/replace_trace_tags execution_time [2.688µs; 2.695µs] or [-0.114%; +0.114%] None None None

Group 4

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 88f6c10e 1732008589 ganeshnj/feat/datapipeline-nuget
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
write only interface execution_time 1.389µs 3.291µs ± 1.421µs 3.146µs ± 0.029µs 3.168µs 3.202µs 14.150µs 15.115µs 380.43% 7.528 56.993 43.06% 0.100µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
write only interface execution_time [3.094µs; 3.488µs] or [-5.983%; +5.983%] None None None

Group 5

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 88f6c10e 1732008589 ganeshnj/feat/datapipeline-nuget
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
credit_card/is_card_number/ execution_time 4.599µs 4.612µs ± 0.009µs 4.613µs ± 0.007µs 4.618µs 4.629µs 4.631µs 4.633µs 0.45% 0.366 -0.701 0.19% 0.001µs 1 200
credit_card/is_card_number/ throughput 215826729.364op/s 216805162.102op/s ± 405842.961op/s 216797593.811op/s ± 312134.993op/s 217210359.325op/s 217378802.589op/s 217400321.857op/s 217419471.558op/s 0.29% -0.359 -0.709 0.19% 28697.431op/s 1 200
credit_card/is_card_number/ 3782-8224-6310-005 execution_time 93.109µs 93.495µs ± 0.317µs 93.437µs ± 0.097µs 93.566µs 93.761µs 94.295µs 97.094µs 3.91% 7.692 81.521 0.34% 0.022µs 1 200
credit_card/is_card_number/ 3782-8224-6310-005 throughput 10299345.173op/s 10695897.113op/s ± 35403.148op/s 10702404.831op/s ± 11120.899op/s 10711882.155op/s 10718183.882op/s 10734310.779op/s 10740049.645op/s 0.35% -7.449 77.639 0.33% 2503.381op/s 1 200
credit_card/is_card_number/ 378282246310005 execution_time 85.202µs 85.408µs ± 0.349µs 85.332µs ± 0.029µs 85.363µs 85.958µs 86.695µs 89.263µs 4.61% 7.667 75.136 0.41% 0.025µs 1 200
credit_card/is_card_number/ 378282246310005 throughput 11202803.880op/s 11708747.325op/s ± 46373.624op/s 11718980.647op/s ± 4019.880op/s 11722472.860op/s 11726100.894op/s 11730992.932op/s 11736864.317op/s 0.15% -7.449 71.370 0.40% 3279.110op/s 1 200
credit_card/is_card_number/37828224631 execution_time 4.591µs 4.611µs ± 0.009µs 4.611µs ± 0.007µs 4.617µs 4.628µs 4.629µs 4.633µs 0.48% 0.386 -0.614 0.19% 0.001µs 1 200
credit_card/is_card_number/37828224631 throughput 215824473.380op/s 216855955.805op/s ± 405557.022op/s 216870764.932op/s ± 313579.675op/s 217254403.920op/s 217385762.240op/s 217399519.237op/s 217819088.387op/s 0.44% -0.379 -0.620 0.19% 28677.212op/s 1 200
credit_card/is_card_number/378282246310005 execution_time 81.611µs 82.060µs ± 0.231µs 82.036µs ± 0.101µs 82.143µs 82.342µs 83.072µs 83.239µs 1.47% 1.945 7.570 0.28% 0.016µs 1 200
credit_card/is_card_number/378282246310005 throughput 12013643.166op/s 12186342.158op/s ± 34096.991op/s 12189764.866op/s ± 15079.243op/s 12204330.402op/s 12231633.580op/s 12249614.947op/s 12253287.095op/s 0.52% -1.896 7.315 0.28% 2411.021op/s 1 200
credit_card/is_card_number/37828224631000521389798 execution_time 58.858µs 58.896µs ± 0.022µs 58.898µs ± 0.016µs 58.907µs 58.932µs 58.956µs 59.029µs 0.22% 1.419 5.438 0.04% 0.002µs 1 200
credit_card/is_card_number/37828224631000521389798 throughput 16940952.311op/s 16979138.587op/s ± 6405.134op/s 16978645.957op/s ± 4725.193op/s 16984245.838op/s 16987061.465op/s 16989363.418op/s 16989921.579op/s 0.07% -1.413 5.396 0.04% 452.911op/s 1 200
credit_card/is_card_number/x371413321323331 execution_time 6.819µs 6.838µs ± 0.034µs 6.824µs ± 0.003µs 6.831µs 6.903µs 6.935µs 7.110µs 4.19% 3.666 20.405 0.50% 0.002µs 1 200
credit_card/is_card_number/x371413321323331 throughput 140653665.044op/s 146247265.993op/s ± 719687.404op/s 146541529.631op/s ± 66099.285op/s 146605712.745op/s 146627808.060op/s 146644258.581op/s 146654147.361op/s 0.08% -3.537 18.880 0.49% 50889.584op/s 1 200
credit_card/is_card_number_no_luhn/ execution_time 4.588µs 4.613µs ± 0.008µs 4.613µs ± 0.006µs 4.619µs 4.626µs 4.630µs 4.631µs 0.39% -0.003 -0.627 0.18% 0.001µs 1 200
credit_card/is_card_number_no_luhn/ throughput 215931138.574op/s 216798924.073op/s ± 391177.132op/s 216781930.103op/s ± 285461.416op/s 217075972.785op/s 217379676.524op/s 217426101.593op/s 217967320.579op/s 0.55% 0.010 -0.626 0.18% 27660.400op/s 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time 73.353µs 73.672µs ± 0.189µs 73.673µs ± 0.102µs 73.772µs 73.884µs 74.028µs 75.032µs 1.84% 2.588 16.403 0.26% 0.013µs 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput 13327667.768op/s 13573736.481op/s ± 34571.573op/s 13573442.881op/s ± 18811.128op/s 13596872.722op/s 13620425.190op/s 13627864.159op/s 13632624.233op/s 0.44% -2.500 15.673 0.25% 2444.579op/s 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time 65.271µs 65.519µs ± 0.134µs 65.529µs ± 0.110µs 65.638µs 65.715µs 65.735µs 65.768µs 0.36% -0.129 -1.059 0.20% 0.009µs 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 throughput 15205011.254op/s 15262834.718op/s ± 31285.715op/s 15260304.911op/s ± 25682.767op/s 15290396.108op/s 15314730.553op/s 15319226.119op/s 15320854.747op/s 0.40% 0.135 -1.058 0.20% 2212.234op/s 1 200
credit_card/is_card_number_no_luhn/37828224631 execution_time 4.600µs 4.614µs ± 0.009µs 4.614µs ± 0.006µs 4.619µs 4.629µs 4.632µs 4.632µs 0.39% 0.203 -0.775 0.19% 0.001µs 1 200
credit_card/is_card_number_no_luhn/37828224631 throughput 215885725.684op/s 216723356.503op/s ± 404867.059op/s 216723662.837op/s ± 282290.335op/s 217022047.780op/s 217363236.924op/s 217393814.833op/s 217400172.577op/s 0.31% -0.196 -0.778 0.19% 28628.424op/s 1 200
credit_card/is_card_number_no_luhn/378282246310005 execution_time 62.160µs 62.545µs ± 0.133µs 62.519µs ± 0.050µs 62.630µs 62.766µs 62.914µs 63.082µs 0.90% 0.490 1.422 0.21% 0.009µs 1 200
credit_card/is_card_number_no_luhn/378282246310005 throughput 15852351.201op/s 15988632.001op/s ± 33915.728op/s 15995188.647op/s ± 12793.733op/s 16005027.181op/s 16045617.611op/s 16064165.875op/s 16087438.445op/s 0.58% -0.470 1.389 0.21% 2398.204op/s 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time 58.861µs 58.894µs ± 0.021µs 58.894µs ± 0.016µs 58.907µs 58.932µs 58.945µs 58.982µs 0.15% 0.947 1.602 0.04% 0.001µs 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput 16954254.032op/s 16979678.749op/s ± 6102.157op/s 16979521.848op/s ± 4732.433op/s 16984985.273op/s 16987270.928op/s 16988215.699op/s 16989237.318op/s 0.06% -0.944 1.589 0.04% 431.488op/s 1 200
credit_card/is_card_number_no_luhn/x371413321323331 execution_time 6.819µs 6.834µs ± 0.027µs 6.824µs ± 0.003µs 6.828µs 6.899µs 6.915µs 6.986µs 2.38% 2.653 7.806 0.39% 0.002µs 1 200
credit_card/is_card_number_no_luhn/x371413321323331 throughput 143141396.168op/s 146325651.675op/s ± 568445.720op/s 146551414.996op/s ± 64438.223op/s 146615209.512op/s 146639878.175op/s 146648571.834op/s 146659520.738op/s 0.07% -2.621 7.539 0.39% 40195.182op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
credit_card/is_card_number/ execution_time [4.611µs; 4.614µs] or [-0.026%; +0.026%] None None None
credit_card/is_card_number/ throughput [216748916.170op/s; 216861408.033op/s] or [-0.026%; +0.026%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 execution_time [93.451µs; 93.539µs] or [-0.047%; +0.047%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 throughput [10690990.577op/s; 10700803.649op/s] or [-0.046%; +0.046%] None None None
credit_card/is_card_number/ 378282246310005 execution_time [85.359µs; 85.456µs] or [-0.057%; +0.057%] None None None
credit_card/is_card_number/ 378282246310005 throughput [11702320.387op/s; 11715174.263op/s] or [-0.055%; +0.055%] None None None
credit_card/is_card_number/37828224631 execution_time [4.610µs; 4.613µs] or [-0.026%; +0.026%] None None None
credit_card/is_card_number/37828224631 throughput [216799749.502op/s; 216912162.107op/s] or [-0.026%; +0.026%] None None None
credit_card/is_card_number/378282246310005 execution_time [82.028µs; 82.092µs] or [-0.039%; +0.039%] None None None
credit_card/is_card_number/378282246310005 throughput [12181616.643op/s; 12191067.673op/s] or [-0.039%; +0.039%] None None None
credit_card/is_card_number/37828224631000521389798 execution_time [58.893µs; 58.899µs] or [-0.005%; +0.005%] None None None
credit_card/is_card_number/37828224631000521389798 throughput [16978250.897op/s; 16980026.277op/s] or [-0.005%; +0.005%] None None None
credit_card/is_card_number/x371413321323331 execution_time [6.833µs; 6.843µs] or [-0.069%; +0.069%] None None None
credit_card/is_card_number/x371413321323331 throughput [146147524.241op/s; 146347007.746op/s] or [-0.068%; +0.068%] None None None
credit_card/is_card_number_no_luhn/ execution_time [4.611µs; 4.614µs] or [-0.025%; +0.025%] None None None
credit_card/is_card_number_no_luhn/ throughput [216744710.684op/s; 216853137.461op/s] or [-0.025%; +0.025%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time [73.646µs; 73.698µs] or [-0.036%; +0.036%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput [13568945.193op/s; 13578527.768op/s] or [-0.035%; +0.035%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time [65.500µs; 65.538µs] or [-0.028%; +0.028%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 throughput [15258498.819op/s; 15267170.618op/s] or [-0.028%; +0.028%] None None None
credit_card/is_card_number_no_luhn/37828224631 execution_time [4.613µs; 4.615µs] or [-0.026%; +0.026%] None None None
credit_card/is_card_number_no_luhn/37828224631 throughput [216667245.823op/s; 216779467.184op/s] or [-0.026%; +0.026%] None None None
credit_card/is_card_number_no_luhn/378282246310005 execution_time [62.526µs; 62.563µs] or [-0.029%; +0.029%] None None None
credit_card/is_card_number_no_luhn/378282246310005 throughput [15983931.607op/s; 15993332.395op/s] or [-0.029%; +0.029%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time [58.891µs; 58.897µs] or [-0.005%; +0.005%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput [16978833.049op/s; 16980524.450op/s] or [-0.005%; +0.005%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 execution_time [6.830µs; 6.838µs] or [-0.054%; +0.054%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 throughput [146246870.565op/s; 146404432.784op/s] or [-0.054%; +0.054%] None None None

Group 6

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 88f6c10e 1732008589 ganeshnj/feat/datapipeline-nuget
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time 271.455µs 272.960µs ± 0.641µs 272.826µs ± 0.376µs 273.312µs 274.061µs 274.856µs 275.321µs 0.91% 0.930 1.067 0.23% 0.045µs 1 200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput 3632117.801op/s 3663562.533op/s ± 8587.026op/s 3665341.157op/s ± 5052.846op/s 3669565.756op/s 3674331.911op/s 3678824.644op/s 3683852.288op/s 0.51% -0.914 1.028 0.23% 607.194op/s 1 200
normalization/normalize_name/normalize_name/bad-name execution_time 25.797µs 25.908µs ± 0.067µs 25.892µs ± 0.040µs 25.946µs 26.032µs 26.096µs 26.111µs 0.85% 0.894 0.157 0.26% 0.005µs 1 200
normalization/normalize_name/normalize_name/bad-name throughput 38298528.800op/s 38598516.434op/s ± 99306.643op/s 38622205.172op/s ± 59038.637op/s 38674435.531op/s 38713846.428op/s 38732732.889op/s 38764871.491op/s 0.37% -0.884 0.132 0.26% 7022.040op/s 1 200
normalization/normalize_name/normalize_name/good execution_time 15.447µs 15.496µs ± 0.044µs 15.478µs ± 0.018µs 15.516µs 15.589µs 15.621µs 15.674µs 1.26% 1.455 1.746 0.28% 0.003µs 1 200
normalization/normalize_name/normalize_name/good throughput 63800737.537op/s 64532192.469op/s ± 182622.177op/s 64605934.759op/s ± 74852.086op/s 64666443.748op/s 64705170.756op/s 64719995.323op/s 64737908.577op/s 0.20% -1.442 1.686 0.28% 12913.338op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time [272.871µs; 273.049µs] or [-0.033%; +0.033%] None None None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput [3662372.454op/s; 3664752.612op/s] or [-0.032%; +0.032%] None None None
normalization/normalize_name/normalize_name/bad-name execution_time [25.899µs; 25.917µs] or [-0.036%; +0.036%] None None None
normalization/normalize_name/normalize_name/bad-name throughput [38584753.489op/s; 38612279.380op/s] or [-0.036%; +0.036%] None None None
normalization/normalize_name/normalize_name/good execution_time [15.490µs; 15.502µs] or [-0.039%; +0.039%] None None None
normalization/normalize_name/normalize_name/good throughput [64506882.791op/s; 64557502.146op/s] or [-0.039%; +0.039%] None None None

Group 7

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 88f6c10e 1732008589 ganeshnj/feat/datapipeline-nuget
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
redis/obfuscate_redis_string execution_time 36.614µs 37.210µs ± 1.034µs 36.761µs ± 0.100µs 36.860µs 39.425µs 39.446µs 40.377µs 9.84% 1.703 1.001 2.77% 0.073µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
redis/obfuscate_redis_string execution_time [37.067µs; 37.354µs] or [-0.385%; +0.385%] None None None

Group 8

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 88f6c10e 1732008589 ganeshnj/feat/datapipeline-nuget
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching string interning on wordpress profile execution_time 141.294µs 142.042µs ± 0.381µs 142.001µs ± 0.174µs 142.180µs 142.480µs 143.147µs 145.024µs 2.13% 3.101 19.836 0.27% 0.027µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching string interning on wordpress profile execution_time [141.990µs; 142.095µs] or [-0.037%; +0.037%] None None None

Group 9

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 88f6c10e 1732008589 ganeshnj/feat/datapipeline-nuget
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sql/obfuscate_sql_string execution_time 69.496µs 69.781µs ± 0.124µs 69.777µs ± 0.032µs 69.805µs 69.839µs 69.967µs 71.334µs 2.23% 9.987 123.667 0.18% 0.009µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sql/obfuscate_sql_string execution_time [69.763µs; 69.798µs] or [-0.025%; +0.025%] None None None

Group 10

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 88f6c10e 1732008589 ganeshnj/feat/datapipeline-nuget
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time 506.830µs 507.685µs ± 0.623µs 507.605µs ± 0.308µs 507.939µs 508.607µs 508.903µs 513.190µs 1.10% 3.672 28.767 0.12% 0.044µs 1 200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput 1948596.483op/s 1969728.648op/s ± 2406.781op/s 1970034.158op/s ± 1195.114op/s 1971145.732op/s 1972590.690op/s 1972906.285op/s 1973047.933op/s 0.15% -3.609 28.028 0.12% 170.185op/s 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time 467.690µs 468.647µs ± 0.311µs 468.658µs ± 0.208µs 468.852µs 469.144µs 469.251µs 469.406µs 0.16% -0.171 0.036 0.07% 0.022µs 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput 2130352.216op/s 2133804.480op/s ± 1415.355op/s 2133750.081op/s ± 948.678op/s 2134765.199op/s 2136056.549op/s 2137168.143op/s 2138166.520op/s 0.21% 0.175 0.040 0.07% 100.081op/s 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time 179.854µs 180.241µs ± 0.173µs 180.213µs ± 0.119µs 180.345µs 180.561µs 180.660µs 180.697µs 0.27% 0.385 -0.274 0.10% 0.012µs 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput 5534120.960op/s 5548136.100op/s ± 5311.040op/s 5548975.361op/s ± 3653.854op/s 5552125.163op/s 5555220.662op/s 5558123.655op/s 5560055.584op/s 0.20% -0.381 -0.279 0.10% 375.547op/s 1 200
normalization/normalize_service/normalize_service/[empty string] execution_time 44.687µs 45.081µs ± 0.124µs 45.099µs ± 0.069µs 45.165µs 45.228µs 45.326µs 45.336µs 0.53% -0.919 1.049 0.27% 0.009µs 1 200
normalization/normalize_service/normalize_service/[empty string] throughput 22057400.920op/s 22182678.253op/s ± 61057.581op/s 22173275.601op/s ± 34075.370op/s 22212780.071op/s 22312009.589op/s 22369816.470op/s 22377676.030op/s 0.92% 0.937 1.090 0.27% 4317.423op/s 1 200
normalization/normalize_service/normalize_service/test_ASCII execution_time 49.042µs 49.165µs ± 0.096µs 49.153µs ± 0.019µs 49.180µs 49.227µs 49.270µs 50.399µs 2.53% 10.572 132.989 0.20% 0.007µs 1 200
normalization/normalize_service/normalize_service/test_ASCII throughput 19841477.740op/s 20339808.893op/s ± 39078.006op/s 20344459.124op/s ± 7851.711op/s 20349922.637op/s 20369926.331op/s 20378983.571op/s 20390881.748op/s 0.23% -10.436 130.672 0.19% 2763.232op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time [507.599µs; 507.771µs] or [-0.017%; +0.017%] None None None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput [1969395.091op/s; 1970062.204op/s] or [-0.017%; +0.017%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time [468.604µs; 468.690µs] or [-0.009%; +0.009%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput [2133608.326op/s; 2134000.635op/s] or [-0.009%; +0.009%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time [180.217µs; 180.265µs] or [-0.013%; +0.013%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput [5547400.041op/s; 5548872.159op/s] or [-0.013%; +0.013%] None None None
normalization/normalize_service/normalize_service/[empty string] execution_time [45.063µs; 45.098µs] or [-0.038%; +0.038%] None None None
normalization/normalize_service/normalize_service/[empty string] throughput [22174216.260op/s; 22191140.247op/s] or [-0.038%; +0.038%] None None None
normalization/normalize_service/normalize_service/test_ASCII execution_time [49.151µs; 49.178µs] or [-0.027%; +0.027%] None None None
normalization/normalize_service/normalize_service/test_ASCII throughput [20334393.057op/s; 20345224.728op/s] or [-0.027%; +0.027%] None None None

Group 11

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 88f6c10e 1732008589 ganeshnj/feat/datapipeline-nuget
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
concentrator/add_spans_to_concentrator execution_time 9.001ms 9.037ms ± 0.021ms 9.035ms ± 0.011ms 9.046ms 9.064ms 9.139ms 9.182ms 1.62% 2.914 15.350 0.24% 0.002ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
concentrator/add_spans_to_concentrator execution_time [9.034ms; 9.040ms] or [-0.033%; +0.033%] None None None

Group 12

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 88f6c10e 1732008589 ganeshnj/feat/datapipeline-nuget
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching deserializing traces from msgpack to their internal representation execution_time 58.724ms 58.947ms ± 0.235ms 58.892ms ± 0.062ms 58.979ms 59.257ms 59.775ms 61.213ms 3.94% 5.480 44.128 0.40% 0.017ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching deserializing traces from msgpack to their internal representation execution_time [58.914ms; 58.979ms] or [-0.055%; +0.055%] None None None

Baseline

Omitted due to size.

pr-commenter[bot] avatar Oct 29 '24 12:10 pr-commenter[bot]

Codecov Report

All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 70.57%. Comparing base (d04fad9) to head (88f6c10). Report is 4 commits behind head on main.

Additional details and impacted files
@@            Coverage Diff             @@
##             main     #697      +/-   ##
==========================================
- Coverage   70.58%   70.57%   -0.02%     
==========================================
  Files         295      296       +1     
  Lines       43096    43281     +185     
==========================================
+ Hits        30420    30544     +124     
- Misses      12676    12737      +61     
Components Coverage Δ
crashtracker 37.14% <ø> (+0.03%) :arrow_up:
crashtracker-ffi 8.67% <ø> (ø)
datadog-alloc 98.73% <ø> (ø)
data-pipeline 91.95% <ø> (ø)
data-pipeline-ffi 0.00% <ø> (ø)
ddcommon 83.46% <ø> (ø)
ddcommon-ffi 69.12% <ø> (ø)
ddtelemetry 59.10% <ø> (ø)
ddtelemetry-ffi 22.13% <ø> (ø)
dogstatsd 89.45% <ø> (ø)
dogstatsd-client 79.77% <ø> (ø)
ipc 82.86% <ø> (+0.10%) :arrow_up:
profiling 84.30% <ø> (ø)
profiling-ffi 77.46% <ø> (ø)
serverless 0.00% <ø> (ø)
sidecar 38.00% <ø> (+0.64%) :arrow_up:
sidecar-ffi 0.00% <ø> (ø)
spawn-worker 50.36% <ø> (ø)
tinybytes 94.77% <ø> (ø)
trace-mini-agent 72.18% <ø> (ø)
trace-normalization 98.25% <ø> (ø)
trace-obfuscation 95.77% <ø> (ø)
trace-protobuf 77.67% <ø> (ø)
trace-utils 93.15% <ø> (+<0.01%) :arrow_up:
---- 🚨 Try these New Features:

codecov-commenter avatar Oct 29 '24 12:10 codecov-commenter

This pull request has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. To override this behavior, add the keep-open label or update the PR.

github-actions[bot] avatar Mar 10 '25 00:03 github-actions[bot]

Is this PR still relevant?

ivoanjo avatar Mar 20 '25 09:03 ivoanjo