libdatadog icon indicating copy to clipboard operation
libdatadog copied to clipboard

[Serverless Mini Agent] Add Zipping of Serverless Binaries with Proper Github Permissions

Open duncanpharvey opened this issue 1 year ago • 2 comments

What does this PR do?

Zip Serverless binaries and create a Github release with the proper permissions.

Motivation

Revert changes made in the below PR to only upload the binaries to Github. By adding the proper Github job permissions we can create a Github release and automatically attach the binaries to the release.

https://github.com/DataDog/libdatadog/pull/634

Additional Notes

How to test the change?

Pushed a test tag and confirmed that the generated binaries in the zip file worked successfully.

duncanpharvey avatar Oct 02 '24 18:10 duncanpharvey

Benchmarks

Comparison

Benchmark execution time: 2024-10-11 19:53:05

Comparing candidate commit 5f9c93e in PR branch duncan-harvey/serverless-release-github-permissions with baseline commit 356f76a in branch main.

Found 0 performance improvements and 1 performance regressions! Performance is the same for 50 metrics, 2 unstable metrics.

scenario:benching deserializing traces from msgpack to their internal representation

  • 🟥 execution_time [+80.565ns; +89.914ns] or [+6.865%; +7.662%]

Candidate

Candidate benchmark details

Group 1

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 5f9c93e 1728675756 duncan-harvey/serverless-release-github-permissions
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
concentrator/add_spans_to_concentrator execution_time 9.294ms 9.320ms ± 0.013ms 9.319ms ± 0.009ms 9.329ms 9.341ms 9.350ms 9.372ms 0.56% 0.494 0.564 0.13% 0.001ms 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
concentrator/add_spans_to_concentrator execution_time [9.319ms; 9.322ms] or [-0.019%; +0.019%] None None None

Group 2

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 5f9c93e 1728675756 duncan-harvey/serverless-release-github-permissions
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
two way interface execution_time 18.800µs 25.370µs ± 11.819µs 19.923µs ± 0.397µs 26.729µs 43.168µs 50.399µs 103.948µs 421.74% 3.445 17.630 46.47% 0.836µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
two way interface execution_time [23.732µs; 27.008µs] or [-6.456%; +6.456%] None None None

Group 3

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 5f9c93e 1728675756 duncan-harvey/serverless-release-github-permissions
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time 623.132µs 624.572µs ± 0.459µs 624.576µs ± 0.279µs 624.864µs 625.278µs 625.491µs 625.818µs 0.20% -0.340 0.517 0.07% 0.032µs 1 200
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput 1597909.387op/s 1601096.752op/s ± 1176.104op/s 1601085.353op/s ± 714.341op/s 1601772.063op/s 1603332.431op/s 1603932.654op/s 1604796.599op/s 0.23% 0.345 0.522 0.07% 83.163op/s 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time 460.955µs 461.903µs ± 0.378µs 461.856µs ± 0.264µs 462.172µs 462.550µs 462.748µs 462.885µs 0.22% 0.237 -0.490 0.08% 0.027µs 1 200
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput 2160366.016op/s 2164959.218op/s ± 1769.049op/s 2165178.012op/s ± 1235.938op/s 2166221.841op/s 2167539.028op/s 2168076.777op/s 2169409.905op/s 0.20% -0.234 -0.492 0.08% 125.091op/s 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time 178.081µs 178.377µs ± 0.133µs 178.366µs ± 0.069µs 178.426µs 178.606µs 178.703µs 179.197µs 0.47% 1.650 7.043 0.07% 0.009µs 1 200
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput 5580460.440op/s 5606102.070op/s ± 4176.623op/s 5606461.160op/s ± 2160.029op/s 5609168.336op/s 5611178.722op/s 5613790.394op/s 5615416.043op/s 0.16% -1.636 6.950 0.07% 295.332op/s 1 200
normalization/normalize_service/normalize_service/[empty string] execution_time 46.670µs 46.850µs ± 0.083µs 46.848µs ± 0.045µs 46.883µs 46.989µs 47.063µs 47.306µs 0.98% 1.030 3.911 0.18% 0.006µs 1 200
normalization/normalize_service/normalize_service/[empty string] throughput 21138844.845op/s 21344992.230op/s ± 37822.034op/s 21345456.751op/s ± 20355.840op/s 21369125.919op/s 21399905.407op/s 21417660.829op/s 21426882.499op/s 0.38% -1.004 3.780 0.18% 2674.422op/s 1 200
normalization/normalize_service/normalize_service/test_ASCII execution_time 48.768µs 49.283µs ± 0.221µs 49.270µs ± 0.159µs 49.435µs 49.675µs 49.723µs 49.961µs 1.40% 0.200 -0.391 0.45% 0.016µs 1 200
normalization/normalize_service/normalize_service/test_ASCII throughput 20015696.030op/s 20291359.337op/s ± 91033.929op/s 20296434.159op/s ± 65524.063op/s 20360833.042op/s 20430161.185op/s 20467594.992op/s 20505273.790op/s 1.03% -0.179 -0.407 0.45% 6437.071op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... execution_time [624.509µs; 624.636µs] or [-0.010%; +0.010%] None None None
normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... throughput [1600933.755op/s; 1601259.749op/s] or [-0.010%; +0.010%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて execution_time [461.850µs; 461.955µs] or [-0.011%; +0.011%] None None None
normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて throughput [2164714.045op/s; 2165204.392op/s] or [-0.011%; +0.011%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters execution_time [178.359µs; 178.396µs] or [-0.010%; +0.010%] None None None
normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters throughput [5605523.230op/s; 5606680.910op/s] or [-0.010%; +0.010%] None None None
normalization/normalize_service/normalize_service/[empty string] execution_time [46.838µs; 46.861µs] or [-0.025%; +0.025%] None None None
normalization/normalize_service/normalize_service/[empty string] throughput [21339750.460op/s; 21350234.001op/s] or [-0.025%; +0.025%] None None None
normalization/normalize_service/normalize_service/test_ASCII execution_time [49.252µs; 49.314µs] or [-0.062%; +0.062%] None None None
normalization/normalize_service/normalize_service/test_ASCII throughput [20278742.910op/s; 20303975.764op/s] or [-0.062%; +0.062%] None None None

Group 4

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 5f9c93e 1728675756 duncan-harvey/serverless-release-github-permissions
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
write only interface execution_time 1.678µs 3.182µs ± 1.367µs 3.040µs ± 0.022µs 3.058µs 3.098µs 13.704µs 14.668µs 382.56% 7.611 57.969 42.85% 0.097µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
write only interface execution_time [2.993µs; 3.371µs] or [-5.953%; +5.953%] None None None

Group 5

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 5f9c93e 1728675756 duncan-harvey/serverless-release-github-permissions
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
sql/obfuscate_sql_string execution_time 66.987µs 67.113µs ± 0.174µs 67.089µs ± 0.022µs 67.113µs 67.183µs 67.568µs 68.885µs 2.68% 8.573 78.672 0.26% 0.012µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
sql/obfuscate_sql_string execution_time [67.089µs; 67.137µs] or [-0.036%; +0.036%] None None None

Group 6

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 5f9c93e 1728675756 duncan-harvey/serverless-release-github-permissions
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
credit_card/is_card_number/ execution_time 1.613µs 1.614µs ± 0.001µs 1.614µs ± 0.000µs 1.614µs 1.615µs 1.616µs 1.623µs 0.54% 5.577 52.673 0.05% 0.000µs 1 200
credit_card/is_card_number/ throughput 616220106.859op/s 619519569.952op/s ± 323696.542op/s 619577540.147op/s ± 160676.656op/s 619724526.196op/s 619790939.165op/s 619813823.518op/s 619836509.241op/s 0.04% -5.540 52.156 0.05% 22888.802op/s 1 200
credit_card/is_card_number/ 3782-8224-6310-005 execution_time 110.473µs 111.916µs ± 0.650µs 111.868µs ± 0.376µs 112.308µs 113.003µs 113.700µs 115.034µs 2.83% 0.886 2.484 0.58% 0.046µs 1 200
credit_card/is_card_number/ 3782-8224-6310-005 throughput 8693052.657op/s 8935551.491op/s ± 51602.317op/s 8939144.547op/s ± 30097.232op/s 8967526.793op/s 9018848.040op/s 9037974.154op/s 9052004.672op/s 1.26% -0.823 2.258 0.58% 3648.835op/s 1 200
credit_card/is_card_number/ 378282246310005 execution_time 106.750µs 107.894µs ± 0.759µs 107.669µs ± 0.463µs 108.342µs 109.417µs 109.829µs 110.088µs 2.25% 0.833 -0.120 0.70% 0.054µs 1 200
credit_card/is_card_number/ 378282246310005 throughput 9083641.290op/s 9268836.555op/s ± 64800.763op/s 9287721.752op/s ± 40127.094op/s 9315985.974op/s 9347613.474op/s 9363148.199op/s 9367664.514op/s 0.86% -0.808 -0.170 0.70% 4582.106op/s 1 200
credit_card/is_card_number/37828224631 execution_time 1.613µs 1.614µs ± 0.002µs 1.614µs ± 0.000µs 1.614µs 1.615µs 1.621µs 1.630µs 0.97% 7.186 63.039 0.09% 0.000µs 1 200
credit_card/is_card_number/37828224631 throughput 613544317.585op/s 619443742.700op/s ± 577150.610op/s 619479201.556op/s ± 168015.566op/s 619700732.372op/s 619797303.176op/s 619815969.916op/s 619847629.128op/s 0.06% -7.149 62.473 0.09% 40810.711op/s 1 200
credit_card/is_card_number/378282246310005 execution_time 102.351µs 103.542µs ± 0.563µs 103.410µs ± 0.313µs 103.858µs 104.569µs 105.269µs 105.605µs 2.12% 0.939 1.013 0.54% 0.040µs 1 200
credit_card/is_card_number/378282246310005 throughput 9469275.423op/s 9658207.221op/s ± 52261.784op/s 9670208.505op/s ± 29207.963op/s 9694366.858op/s 9728186.304op/s 9752634.445op/s 9770317.955op/s 1.04% -0.905 0.926 0.54% 3695.466op/s 1 200
credit_card/is_card_number/37828224631000521389798 execution_time 106.594µs 108.298µs ± 0.589µs 108.445µs ± 0.359µs 108.746µs 109.032µs 109.148µs 109.251µs 0.74% -0.923 0.317 0.54% 0.042µs 1 200
credit_card/is_card_number/37828224631000521389798 throughput 9153237.899op/s 9234076.456op/s ± 50473.160op/s 9221247.321op/s ± 30500.520op/s 9267440.644op/s 9338758.638op/s 9371700.963op/s 9381400.536op/s 1.74% 0.947 0.373 0.55% 3568.991op/s 1 200
credit_card/is_card_number/x371413321323331 execution_time 23.369µs 25.080µs ± 0.557µs 25.110µs ± 0.389µs 25.480µs 26.085µs 26.276µs 26.438µs 5.29% 0.019 -0.258 2.21% 0.039µs 1 200
credit_card/is_card_number/x371413321323331 throughput 37824207.833op/s 39892091.336op/s ± 886597.243op/s 39824346.269op/s ± 616732.911op/s 40486283.386op/s 41290802.090op/s 41760163.214op/s 42792199.581op/s 7.45% 0.099 -0.193 2.22% 62691.892op/s 1 200
credit_card/is_card_number_no_luhn/ execution_time 1.613µs 1.614µs ± 0.001µs 1.614µs ± 0.000µs 1.614µs 1.615µs 1.616µs 1.620µs 0.38% 3.122 20.569 0.05% 0.000µs 1 200
credit_card/is_card_number_no_luhn/ throughput 617246623.797op/s 619531442.729op/s ± 281082.195op/s 619596871.039op/s ± 157491.670op/s 619739317.399op/s 619798493.567op/s 619817396.625op/s 619865550.402op/s 0.04% -3.104 20.376 0.05% 19875.513op/s 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time 89.210µs 90.544µs ± 0.234µs 90.550µs ± 0.074µs 90.641µs 90.819µs 91.034µs 91.593µs 1.15% -1.306 8.537 0.26% 0.017µs 1 200
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput 10917874.567op/s 11044372.081op/s ± 28673.551op/s 11043645.382op/s ± 9078.893op/s 11051658.664op/s 11101697.385op/s 11118151.659op/s 11209464.909op/s 1.50% 1.375 8.720 0.26% 2027.526op/s 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time 83.985µs 85.241µs ± 0.767µs 84.941µs ± 0.358µs 85.881µs 86.581µs 87.239µs 87.827µs 3.40% 0.895 -0.004 0.90% 0.054µs 1 200
credit_card/is_card_number_no_luhn/ 378282246310005 throughput 11386002.666op/s 11732428.749op/s ± 104782.503op/s 11772850.751op/s ± 49853.575op/s 11795484.725op/s 11851180.229op/s 11894217.422op/s 11906919.373op/s 1.14% -0.863 -0.078 0.89% 7409.242op/s 1 200
credit_card/is_card_number_no_luhn/37828224631 execution_time 1.613µs 1.614µs ± 0.000µs 1.614µs ± 0.000µs 1.614µs 1.615µs 1.615µs 1.616µs 0.10% 0.415 0.419 0.03% 0.000µs 1 200
credit_card/is_card_number_no_luhn/37828224631 throughput 618893409.394op/s 619565027.693op/s ± 178876.348op/s 619538665.689op/s ± 134521.279op/s 619722317.693op/s 619835766.931op/s 619853039.508op/s 619955854.661op/s 0.07% -0.413 0.413 0.03% 12648.468op/s 1 200
credit_card/is_card_number_no_luhn/378282246310005 execution_time 79.198µs 80.182µs ± 0.626µs 80.028µs ± 0.216µs 80.268µs 81.405µs 82.806µs 83.347µs 4.15% 2.297 7.254 0.78% 0.044µs 1 200
credit_card/is_card_number_no_luhn/378282246310005 throughput 11998071.478op/s 12472320.956op/s ± 95757.167op/s 12495590.307op/s ± 33747.613op/s 12526002.738op/s 12569941.645op/s 12620211.583op/s 12626555.970op/s 1.05% -2.206 6.734 0.77% 6771.054op/s 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time 106.232µs 108.169µs ± 0.652µs 108.263µs ± 0.464µs 108.689µs 108.969µs 109.362µs 109.518µs 1.16% -0.719 0.166 0.60% 0.046µs 1 200
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput 9130929.876op/s 9245148.507op/s ± 55986.095op/s 9236737.126op/s ± 39546.517op/s 9279030.320op/s 9357118.633op/s 9405504.582op/s 9413373.732op/s 1.91% 0.749 0.228 0.60% 3958.815op/s 1 200
credit_card/is_card_number_no_luhn/x371413321323331 execution_time 23.013µs 24.980µs ± 0.507µs 25.010µs ± 0.330µs 25.336µs 25.707µs 26.010µs 26.245µs 4.94% -0.435 0.792 2.02% 0.036µs 1 200
credit_card/is_card_number_no_luhn/x371413321323331 throughput 38101835.156op/s 40048119.253op/s ± 820849.062op/s 39984292.512op/s ± 524567.179op/s 40540126.245op/s 41410700.405op/s 42177875.223op/s 43454006.921op/s 8.68% 0.600 1.165 2.04% 58042.794op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
credit_card/is_card_number/ execution_time [1.614µs; 1.614µs] or [-0.007%; +0.007%] None None None
credit_card/is_card_number/ throughput [619474708.725op/s; 619564431.180op/s] or [-0.007%; +0.007%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 execution_time [111.826µs; 112.006µs] or [-0.080%; +0.080%] None None None
credit_card/is_card_number/ 3782-8224-6310-005 throughput [8928399.906op/s; 8942703.076op/s] or [-0.080%; +0.080%] None None None
credit_card/is_card_number/ 378282246310005 execution_time [107.789µs; 107.999µs] or [-0.097%; +0.097%] None None None
credit_card/is_card_number/ 378282246310005 throughput [9259855.792op/s; 9277817.317op/s] or [-0.097%; +0.097%] None None None
credit_card/is_card_number/37828224631 execution_time [1.614µs; 1.615µs] or [-0.013%; +0.013%] None None None
credit_card/is_card_number/37828224631 throughput [619363755.176op/s; 619523730.223op/s] or [-0.013%; +0.013%] None None None
credit_card/is_card_number/378282246310005 execution_time [103.464µs; 103.620µs] or [-0.075%; +0.075%] None None None
credit_card/is_card_number/378282246310005 throughput [9650964.240op/s; 9665450.201op/s] or [-0.075%; +0.075%] None None None
credit_card/is_card_number/37828224631000521389798 execution_time [108.216µs; 108.379µs] or [-0.075%; +0.075%] None None None
credit_card/is_card_number/37828224631000521389798 throughput [9227081.361op/s; 9241071.550op/s] or [-0.076%; +0.076%] None None None
credit_card/is_card_number/x371413321323331 execution_time [25.003µs; 25.157µs] or [-0.308%; +0.308%] None None None
credit_card/is_card_number/x371413321323331 throughput [39769217.485op/s; 40014965.187op/s] or [-0.308%; +0.308%] None None None
credit_card/is_card_number_no_luhn/ execution_time [1.614µs; 1.614µs] or [-0.006%; +0.006%] None None None
credit_card/is_card_number_no_luhn/ throughput [619492487.440op/s; 619570398.018op/s] or [-0.006%; +0.006%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 execution_time [90.512µs; 90.577µs] or [-0.036%; +0.036%] None None None
credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 throughput [11040398.203op/s; 11048345.960op/s] or [-0.036%; +0.036%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 execution_time [85.134µs; 85.347µs] or [-0.125%; +0.125%] None None None
credit_card/is_card_number_no_luhn/ 378282246310005 throughput [11717906.901op/s; 11746950.596op/s] or [-0.124%; +0.124%] None None None
credit_card/is_card_number_no_luhn/37828224631 execution_time [1.614µs; 1.614µs] or [-0.004%; +0.004%] None None None
credit_card/is_card_number_no_luhn/37828224631 throughput [619540237.152op/s; 619589818.235op/s] or [-0.004%; +0.004%] None None None
credit_card/is_card_number_no_luhn/378282246310005 execution_time [80.096µs; 80.269µs] or [-0.108%; +0.108%] None None None
credit_card/is_card_number_no_luhn/378282246310005 throughput [12459049.934op/s; 12485591.979op/s] or [-0.106%; +0.106%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 execution_time [108.078µs; 108.259µs] or [-0.084%; +0.084%] None None None
credit_card/is_card_number_no_luhn/37828224631000521389798 throughput [9237389.373op/s; 9252907.642op/s] or [-0.084%; +0.084%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 execution_time [24.910µs; 25.051µs] or [-0.281%; +0.281%] None None None
credit_card/is_card_number_no_luhn/x371413321323331 throughput [39934357.467op/s; 40161881.038op/s] or [-0.284%; +0.284%] None None None

Group 7

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 5f9c93e 1728675756 duncan-harvey/serverless-release-github-permissions
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching string interning on wordpress profile execution_time 142.165µs 143.081µs ± 0.332µs 143.066µs ± 0.176µs 143.266µs 143.597µs 144.118µs 144.348µs 0.90% 0.307 1.770 0.23% 0.023µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching string interning on wordpress profile execution_time [143.035µs; 143.126µs] or [-0.032%; +0.032%] None None None

Group 8

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 5f9c93e 1728675756 duncan-harvey/serverless-release-github-permissions
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
benching deserializing traces from msgpack to their internal representation execution_time 1.204µs 1.259µs ± 0.024µs 1.259µs ± 0.020µs 1.280µs 1.284µs 1.285µs 1.285µs 2.09% -0.799 -0.260 1.89% 0.002µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
benching deserializing traces from msgpack to their internal representation execution_time [1.255µs; 1.262µs] or [-0.263%; +0.263%] None None None

Group 9

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 5f9c93e 1728675756 duncan-harvey/serverless-release-github-permissions
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
redis/obfuscate_redis_string execution_time 36.939µs 37.463µs ± 0.906µs 37.051µs ± 0.041µs 37.114µs 39.399µs 39.429µs 40.374µs 8.97% 1.727 1.082 2.41% 0.064µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
redis/obfuscate_redis_string execution_time [37.338µs; 37.589µs] or [-0.335%; +0.335%] None None None

Group 10

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 5f9c93e 1728675756 duncan-harvey/serverless-release-github-permissions
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
tags/replace_trace_tags execution_time 2.687µs 2.718µs ± 0.017µs 2.714µs ± 0.007µs 2.721µs 2.758µs 2.762µs 2.763µs 1.80% 1.045 0.570 0.64% 0.001µs 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
tags/replace_trace_tags execution_time [2.716µs; 2.720µs] or [-0.089%; +0.089%] None None None

Group 11

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 5f9c93e 1728675756 duncan-harvey/serverless-release-github-permissions
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time 187.196µs 192.188µs ± 1.231µs 192.433µs ± 0.711µs 193.074µs 193.885µs 194.227µs 194.295µs 0.97% -0.869 0.817 0.64% 0.087µs 1 200
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput 5146800.986op/s 5203464.536op/s ± 33532.243op/s 5196602.526op/s ± 19136.710op/s 5221905.391op/s 5267487.120op/s 5283251.380op/s 5341989.230op/s 2.80% 0.909 0.938 0.64% 2371.088op/s 1 200
normalization/normalize_name/normalize_name/bad-name execution_time 18.197µs 18.231µs ± 0.025µs 18.238µs ± 0.022µs 18.250µs 18.259µs 18.297µs 18.319µs 0.44% 0.517 -0.148 0.14% 0.002µs 1 200
normalization/normalize_name/normalize_name/bad-name throughput 54588486.085op/s 54853214.688op/s ± 74509.869op/s 54829758.270op/s ± 64584.834op/s 54924761.223op/s 54939810.645op/s 54948081.748op/s 54954010.944op/s 0.23% -0.510 -0.171 0.14% 5268.643op/s 1 200
normalization/normalize_name/normalize_name/good execution_time 11.302µs 11.358µs ± 0.027µs 11.351µs ± 0.015µs 11.376µs 11.402µs 11.422µs 11.491µs 1.23% 0.991 2.572 0.24% 0.002µs 1 200
normalization/normalize_name/normalize_name/good throughput 87026698.839op/s 88046911.289op/s ± 207153.962op/s 88097328.335op/s ± 117361.410op/s 88183831.663op/s 88316399.313op/s 88446742.477op/s 88479853.898op/s 0.43% -0.966 2.463 0.23% 14647.997op/s 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... execution_time [192.017µs; 192.358µs] or [-0.089%; +0.089%] None None None
normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... throughput [5198817.289op/s; 5208111.782op/s] or [-0.089%; +0.089%] None None None
normalization/normalize_name/normalize_name/bad-name execution_time [18.227µs; 18.234µs] or [-0.019%; +0.019%] None None None
normalization/normalize_name/normalize_name/bad-name throughput [54842888.336op/s; 54863541.039op/s] or [-0.019%; +0.019%] None None None
normalization/normalize_name/normalize_name/good execution_time [11.354µs; 11.361µs] or [-0.033%; +0.033%] None None None
normalization/normalize_name/normalize_name/good throughput [88018201.742op/s; 88075620.836op/s] or [-0.033%; +0.033%] None None None

Group 12

cpu_model git_commit_sha git_commit_date git_branch
Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz 5f9c93e 1728675756 duncan-harvey/serverless-release-github-permissions
scenario metric min mean ± sd median ± mad p75 p95 p99 max peak_to_median_ratio skewness kurtosis cv sem runs sample_size
normalization/normalize_trace/test_trace execution_time 258.496ns 269.587ns ± 15.011ns 262.975ns ± 2.825ns 270.904ns 305.098ns 319.250ns 320.648ns 21.93% 2.060 3.417 5.55% 1.061ns 1 200
scenario metric 95% CI mean Shapiro-Wilk pvalue Ljung-Box pvalue (lag=1) Dip test pvalue
normalization/normalize_trace/test_trace execution_time [267.507ns; 271.668ns] or [-0.772%; +0.772%] None None None

Baseline

Omitted due to size.

pr-commenter[bot] avatar Oct 02 '24 18:10 pr-commenter[bot]

Codecov Report

All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 71.87%. Comparing base (b8a7d2d) to head (94d4f9a).

Additional details and impacted files
@@            Coverage Diff             @@
##             main     #660      +/-   ##
==========================================
+ Coverage   71.86%   71.87%   +0.01%     
==========================================
  Files         271      271              
  Lines       40654    40654              
==========================================
+ Hits        29215    29222       +7     
+ Misses      11439    11432       -7     
Components Coverage Δ
crashtracker 20.41% <ø> (ø)
crashtracker-ffi 9.07% <ø> (ø)
datadog-alloc 98.73% <ø> (ø)
data-pipeline 92.71% <ø> (ø)
data-pipeline-ffi 0.00% <ø> (ø)
ddcommon 82.73% <ø> (ø)
ddcommon-ffi 69.12% <ø> (ø)
ddtelemetry 59.10% <ø> (ø)
ddtelemetry-ffi 22.13% <ø> (ø)
dogstatsd 90.42% <ø> (ø)
dogstatsd-client 79.77% <ø> (ø)
ipc 82.69% <ø> (ø)
profiling 84.26% <ø> (ø)
profiling-ffi 77.42% <ø> (ø)
serverless 0.00% <ø> (ø)
sidecar 36.35% <ø> (ø)
sidecar-ffi 0.00% <ø> (ø)
spawn-worker 50.36% <ø> (ø)
tinybytes 94.77% <ø> (ø)
trace-mini-agent 72.47% <ø> (ø)
trace-normalization 98.25% <ø> (ø)
trace-obfuscation 95.73% <ø> (ø)
trace-protobuf 77.67% <ø> (ø)
trace-utils 93.46% <ø> (ø)

codecov-commenter avatar Oct 02 '24 18:10 codecov-commenter