libdatadog
libdatadog copied to clipboard
[Serverless Mini Agent] Add Zipping of Serverless Binaries with Proper Github Permissions
What does this PR do?
Zip Serverless binaries and create a Github release with the proper permissions.
Motivation
Revert changes made in the below PR to only upload the binaries to Github. By adding the proper Github job permissions we can create a Github release and automatically attach the binaries to the release.
https://github.com/DataDog/libdatadog/pull/634
Additional Notes
How to test the change?
Pushed a test tag and confirmed that the generated binaries in the zip file worked successfully.
Benchmarks
Comparison
Benchmark execution time: 2024-10-11 19:53:05
Comparing candidate commit 5f9c93e in PR branch duncan-harvey/serverless-release-github-permissions with baseline commit 356f76a in branch main.
Found 0 performance improvements and 1 performance regressions! Performance is the same for 50 metrics, 2 unstable metrics.
scenario:benching deserializing traces from msgpack to their internal representation
- 🟥
execution_time[+80.565ns; +89.914ns] or [+6.865%; +7.662%]
Candidate
Candidate benchmark details
Group 1
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 5f9c93e | 1728675756 | duncan-harvey/serverless-release-github-permissions |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| concentrator/add_spans_to_concentrator | execution_time | 9.294ms | 9.320ms ± 0.013ms | 9.319ms ± 0.009ms | 9.329ms | 9.341ms | 9.350ms | 9.372ms | 0.56% | 0.494 | 0.564 | 0.13% | 0.001ms | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| concentrator/add_spans_to_concentrator | execution_time | [9.319ms; 9.322ms] or [-0.019%; +0.019%] | None | None | None |
Group 2
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 5f9c93e | 1728675756 | duncan-harvey/serverless-release-github-permissions |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| two way interface | execution_time | 18.800µs | 25.370µs ± 11.819µs | 19.923µs ± 0.397µs | 26.729µs | 43.168µs | 50.399µs | 103.948µs | 421.74% | 3.445 | 17.630 | 46.47% | 0.836µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| two way interface | execution_time | [23.732µs; 27.008µs] or [-6.456%; +6.456%] | None | None | None |
Group 3
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 5f9c93e | 1728675756 | duncan-harvey/serverless-release-github-permissions |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... | execution_time | 623.132µs | 624.572µs ± 0.459µs | 624.576µs ± 0.279µs | 624.864µs | 625.278µs | 625.491µs | 625.818µs | 0.20% | -0.340 | 0.517 | 0.07% | 0.032µs | 1 | 200 |
| normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... | throughput | 1597909.387op/s | 1601096.752op/s ± 1176.104op/s | 1601085.353op/s ± 714.341op/s | 1601772.063op/s | 1603332.431op/s | 1603932.654op/s | 1604796.599op/s | 0.23% | 0.345 | 0.522 | 0.07% | 83.163op/s | 1 | 200 |
| normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて | execution_time | 460.955µs | 461.903µs ± 0.378µs | 461.856µs ± 0.264µs | 462.172µs | 462.550µs | 462.748µs | 462.885µs | 0.22% | 0.237 | -0.490 | 0.08% | 0.027µs | 1 | 200 |
| normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて | throughput | 2160366.016op/s | 2164959.218op/s ± 1769.049op/s | 2165178.012op/s ± 1235.938op/s | 2166221.841op/s | 2167539.028op/s | 2168076.777op/s | 2169409.905op/s | 0.20% | -0.234 | -0.492 | 0.08% | 125.091op/s | 1 | 200 |
| normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters | execution_time | 178.081µs | 178.377µs ± 0.133µs | 178.366µs ± 0.069µs | 178.426µs | 178.606µs | 178.703µs | 179.197µs | 0.47% | 1.650 | 7.043 | 0.07% | 0.009µs | 1 | 200 |
| normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters | throughput | 5580460.440op/s | 5606102.070op/s ± 4176.623op/s | 5606461.160op/s ± 2160.029op/s | 5609168.336op/s | 5611178.722op/s | 5613790.394op/s | 5615416.043op/s | 0.16% | -1.636 | 6.950 | 0.07% | 295.332op/s | 1 | 200 |
| normalization/normalize_service/normalize_service/[empty string] | execution_time | 46.670µs | 46.850µs ± 0.083µs | 46.848µs ± 0.045µs | 46.883µs | 46.989µs | 47.063µs | 47.306µs | 0.98% | 1.030 | 3.911 | 0.18% | 0.006µs | 1 | 200 |
| normalization/normalize_service/normalize_service/[empty string] | throughput | 21138844.845op/s | 21344992.230op/s ± 37822.034op/s | 21345456.751op/s ± 20355.840op/s | 21369125.919op/s | 21399905.407op/s | 21417660.829op/s | 21426882.499op/s | 0.38% | -1.004 | 3.780 | 0.18% | 2674.422op/s | 1 | 200 |
| normalization/normalize_service/normalize_service/test_ASCII | execution_time | 48.768µs | 49.283µs ± 0.221µs | 49.270µs ± 0.159µs | 49.435µs | 49.675µs | 49.723µs | 49.961µs | 1.40% | 0.200 | -0.391 | 0.45% | 0.016µs | 1 | 200 |
| normalization/normalize_service/normalize_service/test_ASCII | throughput | 20015696.030op/s | 20291359.337op/s ± 91033.929op/s | 20296434.159op/s ± 65524.063op/s | 20360833.042op/s | 20430161.185op/s | 20467594.992op/s | 20505273.790op/s | 1.03% | -0.179 | -0.407 | 0.45% | 6437.071op/s | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... | execution_time | [624.509µs; 624.636µs] or [-0.010%; +0.010%] | None | None | None |
| normalization/normalize_service/normalize_service/A0000000000000000000000000000000000000000000000000... | throughput | [1600933.755op/s; 1601259.749op/s] or [-0.010%; +0.010%] | None | None | None |
| normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて | execution_time | [461.850µs; 461.955µs] or [-0.011%; +0.011%] | None | None | None |
| normalization/normalize_service/normalize_service/Data🐨dog🐶 繋がっ⛰てて | throughput | [2164714.045op/s; 2165204.392op/s] or [-0.011%; +0.011%] | None | None | None |
| normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters | execution_time | [178.359µs; 178.396µs] or [-0.010%; +0.010%] | None | None | None |
| normalization/normalize_service/normalize_service/Test Conversion 0f Weird !@#$%^&**() Characters | throughput | [5605523.230op/s; 5606680.910op/s] or [-0.010%; +0.010%] | None | None | None |
| normalization/normalize_service/normalize_service/[empty string] | execution_time | [46.838µs; 46.861µs] or [-0.025%; +0.025%] | None | None | None |
| normalization/normalize_service/normalize_service/[empty string] | throughput | [21339750.460op/s; 21350234.001op/s] or [-0.025%; +0.025%] | None | None | None |
| normalization/normalize_service/normalize_service/test_ASCII | execution_time | [49.252µs; 49.314µs] or [-0.062%; +0.062%] | None | None | None |
| normalization/normalize_service/normalize_service/test_ASCII | throughput | [20278742.910op/s; 20303975.764op/s] or [-0.062%; +0.062%] | None | None | None |
Group 4
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 5f9c93e | 1728675756 | duncan-harvey/serverless-release-github-permissions |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| write only interface | execution_time | 1.678µs | 3.182µs ± 1.367µs | 3.040µs ± 0.022µs | 3.058µs | 3.098µs | 13.704µs | 14.668µs | 382.56% | 7.611 | 57.969 | 42.85% | 0.097µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| write only interface | execution_time | [2.993µs; 3.371µs] or [-5.953%; +5.953%] | None | None | None |
Group 5
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 5f9c93e | 1728675756 | duncan-harvey/serverless-release-github-permissions |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| sql/obfuscate_sql_string | execution_time | 66.987µs | 67.113µs ± 0.174µs | 67.089µs ± 0.022µs | 67.113µs | 67.183µs | 67.568µs | 68.885µs | 2.68% | 8.573 | 78.672 | 0.26% | 0.012µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| sql/obfuscate_sql_string | execution_time | [67.089µs; 67.137µs] or [-0.036%; +0.036%] | None | None | None |
Group 6
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 5f9c93e | 1728675756 | duncan-harvey/serverless-release-github-permissions |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| credit_card/is_card_number/ | execution_time | 1.613µs | 1.614µs ± 0.001µs | 1.614µs ± 0.000µs | 1.614µs | 1.615µs | 1.616µs | 1.623µs | 0.54% | 5.577 | 52.673 | 0.05% | 0.000µs | 1 | 200 |
| credit_card/is_card_number/ | throughput | 616220106.859op/s | 619519569.952op/s ± 323696.542op/s | 619577540.147op/s ± 160676.656op/s | 619724526.196op/s | 619790939.165op/s | 619813823.518op/s | 619836509.241op/s | 0.04% | -5.540 | 52.156 | 0.05% | 22888.802op/s | 1 | 200 |
| credit_card/is_card_number/ 3782-8224-6310-005 | execution_time | 110.473µs | 111.916µs ± 0.650µs | 111.868µs ± 0.376µs | 112.308µs | 113.003µs | 113.700µs | 115.034µs | 2.83% | 0.886 | 2.484 | 0.58% | 0.046µs | 1 | 200 |
| credit_card/is_card_number/ 3782-8224-6310-005 | throughput | 8693052.657op/s | 8935551.491op/s ± 51602.317op/s | 8939144.547op/s ± 30097.232op/s | 8967526.793op/s | 9018848.040op/s | 9037974.154op/s | 9052004.672op/s | 1.26% | -0.823 | 2.258 | 0.58% | 3648.835op/s | 1 | 200 |
| credit_card/is_card_number/ 378282246310005 | execution_time | 106.750µs | 107.894µs ± 0.759µs | 107.669µs ± 0.463µs | 108.342µs | 109.417µs | 109.829µs | 110.088µs | 2.25% | 0.833 | -0.120 | 0.70% | 0.054µs | 1 | 200 |
| credit_card/is_card_number/ 378282246310005 | throughput | 9083641.290op/s | 9268836.555op/s ± 64800.763op/s | 9287721.752op/s ± 40127.094op/s | 9315985.974op/s | 9347613.474op/s | 9363148.199op/s | 9367664.514op/s | 0.86% | -0.808 | -0.170 | 0.70% | 4582.106op/s | 1 | 200 |
| credit_card/is_card_number/37828224631 | execution_time | 1.613µs | 1.614µs ± 0.002µs | 1.614µs ± 0.000µs | 1.614µs | 1.615µs | 1.621µs | 1.630µs | 0.97% | 7.186 | 63.039 | 0.09% | 0.000µs | 1 | 200 |
| credit_card/is_card_number/37828224631 | throughput | 613544317.585op/s | 619443742.700op/s ± 577150.610op/s | 619479201.556op/s ± 168015.566op/s | 619700732.372op/s | 619797303.176op/s | 619815969.916op/s | 619847629.128op/s | 0.06% | -7.149 | 62.473 | 0.09% | 40810.711op/s | 1 | 200 |
| credit_card/is_card_number/378282246310005 | execution_time | 102.351µs | 103.542µs ± 0.563µs | 103.410µs ± 0.313µs | 103.858µs | 104.569µs | 105.269µs | 105.605µs | 2.12% | 0.939 | 1.013 | 0.54% | 0.040µs | 1 | 200 |
| credit_card/is_card_number/378282246310005 | throughput | 9469275.423op/s | 9658207.221op/s ± 52261.784op/s | 9670208.505op/s ± 29207.963op/s | 9694366.858op/s | 9728186.304op/s | 9752634.445op/s | 9770317.955op/s | 1.04% | -0.905 | 0.926 | 0.54% | 3695.466op/s | 1 | 200 |
| credit_card/is_card_number/37828224631000521389798 | execution_time | 106.594µs | 108.298µs ± 0.589µs | 108.445µs ± 0.359µs | 108.746µs | 109.032µs | 109.148µs | 109.251µs | 0.74% | -0.923 | 0.317 | 0.54% | 0.042µs | 1 | 200 |
| credit_card/is_card_number/37828224631000521389798 | throughput | 9153237.899op/s | 9234076.456op/s ± 50473.160op/s | 9221247.321op/s ± 30500.520op/s | 9267440.644op/s | 9338758.638op/s | 9371700.963op/s | 9381400.536op/s | 1.74% | 0.947 | 0.373 | 0.55% | 3568.991op/s | 1 | 200 |
| credit_card/is_card_number/x371413321323331 | execution_time | 23.369µs | 25.080µs ± 0.557µs | 25.110µs ± 0.389µs | 25.480µs | 26.085µs | 26.276µs | 26.438µs | 5.29% | 0.019 | -0.258 | 2.21% | 0.039µs | 1 | 200 |
| credit_card/is_card_number/x371413321323331 | throughput | 37824207.833op/s | 39892091.336op/s ± 886597.243op/s | 39824346.269op/s ± 616732.911op/s | 40486283.386op/s | 41290802.090op/s | 41760163.214op/s | 42792199.581op/s | 7.45% | 0.099 | -0.193 | 2.22% | 62691.892op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/ | execution_time | 1.613µs | 1.614µs ± 0.001µs | 1.614µs ± 0.000µs | 1.614µs | 1.615µs | 1.616µs | 1.620µs | 0.38% | 3.122 | 20.569 | 0.05% | 0.000µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/ | throughput | 617246623.797op/s | 619531442.729op/s ± 281082.195op/s | 619596871.039op/s ± 157491.670op/s | 619739317.399op/s | 619798493.567op/s | 619817396.625op/s | 619865550.402op/s | 0.04% | -3.104 | 20.376 | 0.05% | 19875.513op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 | execution_time | 89.210µs | 90.544µs ± 0.234µs | 90.550µs ± 0.074µs | 90.641µs | 90.819µs | 91.034µs | 91.593µs | 1.15% | -1.306 | 8.537 | 0.26% | 0.017µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 | throughput | 10917874.567op/s | 11044372.081op/s ± 28673.551op/s | 11043645.382op/s ± 9078.893op/s | 11051658.664op/s | 11101697.385op/s | 11118151.659op/s | 11209464.909op/s | 1.50% | 1.375 | 8.720 | 0.26% | 2027.526op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/ 378282246310005 | execution_time | 83.985µs | 85.241µs ± 0.767µs | 84.941µs ± 0.358µs | 85.881µs | 86.581µs | 87.239µs | 87.827µs | 3.40% | 0.895 | -0.004 | 0.90% | 0.054µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/ 378282246310005 | throughput | 11386002.666op/s | 11732428.749op/s ± 104782.503op/s | 11772850.751op/s ± 49853.575op/s | 11795484.725op/s | 11851180.229op/s | 11894217.422op/s | 11906919.373op/s | 1.14% | -0.863 | -0.078 | 0.89% | 7409.242op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/37828224631 | execution_time | 1.613µs | 1.614µs ± 0.000µs | 1.614µs ± 0.000µs | 1.614µs | 1.615µs | 1.615µs | 1.616µs | 0.10% | 0.415 | 0.419 | 0.03% | 0.000µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/37828224631 | throughput | 618893409.394op/s | 619565027.693op/s ± 178876.348op/s | 619538665.689op/s ± 134521.279op/s | 619722317.693op/s | 619835766.931op/s | 619853039.508op/s | 619955854.661op/s | 0.07% | -0.413 | 0.413 | 0.03% | 12648.468op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/378282246310005 | execution_time | 79.198µs | 80.182µs ± 0.626µs | 80.028µs ± 0.216µs | 80.268µs | 81.405µs | 82.806µs | 83.347µs | 4.15% | 2.297 | 7.254 | 0.78% | 0.044µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/378282246310005 | throughput | 11998071.478op/s | 12472320.956op/s ± 95757.167op/s | 12495590.307op/s ± 33747.613op/s | 12526002.738op/s | 12569941.645op/s | 12620211.583op/s | 12626555.970op/s | 1.05% | -2.206 | 6.734 | 0.77% | 6771.054op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/37828224631000521389798 | execution_time | 106.232µs | 108.169µs ± 0.652µs | 108.263µs ± 0.464µs | 108.689µs | 108.969µs | 109.362µs | 109.518µs | 1.16% | -0.719 | 0.166 | 0.60% | 0.046µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/37828224631000521389798 | throughput | 9130929.876op/s | 9245148.507op/s ± 55986.095op/s | 9236737.126op/s ± 39546.517op/s | 9279030.320op/s | 9357118.633op/s | 9405504.582op/s | 9413373.732op/s | 1.91% | 0.749 | 0.228 | 0.60% | 3958.815op/s | 1 | 200 |
| credit_card/is_card_number_no_luhn/x371413321323331 | execution_time | 23.013µs | 24.980µs ± 0.507µs | 25.010µs ± 0.330µs | 25.336µs | 25.707µs | 26.010µs | 26.245µs | 4.94% | -0.435 | 0.792 | 2.02% | 0.036µs | 1 | 200 |
| credit_card/is_card_number_no_luhn/x371413321323331 | throughput | 38101835.156op/s | 40048119.253op/s ± 820849.062op/s | 39984292.512op/s ± 524567.179op/s | 40540126.245op/s | 41410700.405op/s | 42177875.223op/s | 43454006.921op/s | 8.68% | 0.600 | 1.165 | 2.04% | 58042.794op/s | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| credit_card/is_card_number/ | execution_time | [1.614µs; 1.614µs] or [-0.007%; +0.007%] | None | None | None |
| credit_card/is_card_number/ | throughput | [619474708.725op/s; 619564431.180op/s] or [-0.007%; +0.007%] | None | None | None |
| credit_card/is_card_number/ 3782-8224-6310-005 | execution_time | [111.826µs; 112.006µs] or [-0.080%; +0.080%] | None | None | None |
| credit_card/is_card_number/ 3782-8224-6310-005 | throughput | [8928399.906op/s; 8942703.076op/s] or [-0.080%; +0.080%] | None | None | None |
| credit_card/is_card_number/ 378282246310005 | execution_time | [107.789µs; 107.999µs] or [-0.097%; +0.097%] | None | None | None |
| credit_card/is_card_number/ 378282246310005 | throughput | [9259855.792op/s; 9277817.317op/s] or [-0.097%; +0.097%] | None | None | None |
| credit_card/is_card_number/37828224631 | execution_time | [1.614µs; 1.615µs] or [-0.013%; +0.013%] | None | None | None |
| credit_card/is_card_number/37828224631 | throughput | [619363755.176op/s; 619523730.223op/s] or [-0.013%; +0.013%] | None | None | None |
| credit_card/is_card_number/378282246310005 | execution_time | [103.464µs; 103.620µs] or [-0.075%; +0.075%] | None | None | None |
| credit_card/is_card_number/378282246310005 | throughput | [9650964.240op/s; 9665450.201op/s] or [-0.075%; +0.075%] | None | None | None |
| credit_card/is_card_number/37828224631000521389798 | execution_time | [108.216µs; 108.379µs] or [-0.075%; +0.075%] | None | None | None |
| credit_card/is_card_number/37828224631000521389798 | throughput | [9227081.361op/s; 9241071.550op/s] or [-0.076%; +0.076%] | None | None | None |
| credit_card/is_card_number/x371413321323331 | execution_time | [25.003µs; 25.157µs] or [-0.308%; +0.308%] | None | None | None |
| credit_card/is_card_number/x371413321323331 | throughput | [39769217.485op/s; 40014965.187op/s] or [-0.308%; +0.308%] | None | None | None |
| credit_card/is_card_number_no_luhn/ | execution_time | [1.614µs; 1.614µs] or [-0.006%; +0.006%] | None | None | None |
| credit_card/is_card_number_no_luhn/ | throughput | [619492487.440op/s; 619570398.018op/s] or [-0.006%; +0.006%] | None | None | None |
| credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 | execution_time | [90.512µs; 90.577µs] or [-0.036%; +0.036%] | None | None | None |
| credit_card/is_card_number_no_luhn/ 3782-8224-6310-005 | throughput | [11040398.203op/s; 11048345.960op/s] or [-0.036%; +0.036%] | None | None | None |
| credit_card/is_card_number_no_luhn/ 378282246310005 | execution_time | [85.134µs; 85.347µs] or [-0.125%; +0.125%] | None | None | None |
| credit_card/is_card_number_no_luhn/ 378282246310005 | throughput | [11717906.901op/s; 11746950.596op/s] or [-0.124%; +0.124%] | None | None | None |
| credit_card/is_card_number_no_luhn/37828224631 | execution_time | [1.614µs; 1.614µs] or [-0.004%; +0.004%] | None | None | None |
| credit_card/is_card_number_no_luhn/37828224631 | throughput | [619540237.152op/s; 619589818.235op/s] or [-0.004%; +0.004%] | None | None | None |
| credit_card/is_card_number_no_luhn/378282246310005 | execution_time | [80.096µs; 80.269µs] or [-0.108%; +0.108%] | None | None | None |
| credit_card/is_card_number_no_luhn/378282246310005 | throughput | [12459049.934op/s; 12485591.979op/s] or [-0.106%; +0.106%] | None | None | None |
| credit_card/is_card_number_no_luhn/37828224631000521389798 | execution_time | [108.078µs; 108.259µs] or [-0.084%; +0.084%] | None | None | None |
| credit_card/is_card_number_no_luhn/37828224631000521389798 | throughput | [9237389.373op/s; 9252907.642op/s] or [-0.084%; +0.084%] | None | None | None |
| credit_card/is_card_number_no_luhn/x371413321323331 | execution_time | [24.910µs; 25.051µs] or [-0.281%; +0.281%] | None | None | None |
| credit_card/is_card_number_no_luhn/x371413321323331 | throughput | [39934357.467op/s; 40161881.038op/s] or [-0.284%; +0.284%] | None | None | None |
Group 7
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 5f9c93e | 1728675756 | duncan-harvey/serverless-release-github-permissions |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| benching string interning on wordpress profile | execution_time | 142.165µs | 143.081µs ± 0.332µs | 143.066µs ± 0.176µs | 143.266µs | 143.597µs | 144.118µs | 144.348µs | 0.90% | 0.307 | 1.770 | 0.23% | 0.023µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| benching string interning on wordpress profile | execution_time | [143.035µs; 143.126µs] or [-0.032%; +0.032%] | None | None | None |
Group 8
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 5f9c93e | 1728675756 | duncan-harvey/serverless-release-github-permissions |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| benching deserializing traces from msgpack to their internal representation | execution_time | 1.204µs | 1.259µs ± 0.024µs | 1.259µs ± 0.020µs | 1.280µs | 1.284µs | 1.285µs | 1.285µs | 2.09% | -0.799 | -0.260 | 1.89% | 0.002µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| benching deserializing traces from msgpack to their internal representation | execution_time | [1.255µs; 1.262µs] or [-0.263%; +0.263%] | None | None | None |
Group 9
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 5f9c93e | 1728675756 | duncan-harvey/serverless-release-github-permissions |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| redis/obfuscate_redis_string | execution_time | 36.939µs | 37.463µs ± 0.906µs | 37.051µs ± 0.041µs | 37.114µs | 39.399µs | 39.429µs | 40.374µs | 8.97% | 1.727 | 1.082 | 2.41% | 0.064µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| redis/obfuscate_redis_string | execution_time | [37.338µs; 37.589µs] or [-0.335%; +0.335%] | None | None | None |
Group 10
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 5f9c93e | 1728675756 | duncan-harvey/serverless-release-github-permissions |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| tags/replace_trace_tags | execution_time | 2.687µs | 2.718µs ± 0.017µs | 2.714µs ± 0.007µs | 2.721µs | 2.758µs | 2.762µs | 2.763µs | 1.80% | 1.045 | 0.570 | 0.64% | 0.001µs | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| tags/replace_trace_tags | execution_time | [2.716µs; 2.720µs] or [-0.089%; +0.089%] | None | None | None |
Group 11
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 5f9c93e | 1728675756 | duncan-harvey/serverless-release-github-permissions |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... | execution_time | 187.196µs | 192.188µs ± 1.231µs | 192.433µs ± 0.711µs | 193.074µs | 193.885µs | 194.227µs | 194.295µs | 0.97% | -0.869 | 0.817 | 0.64% | 0.087µs | 1 | 200 |
| normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... | throughput | 5146800.986op/s | 5203464.536op/s ± 33532.243op/s | 5196602.526op/s ± 19136.710op/s | 5221905.391op/s | 5267487.120op/s | 5283251.380op/s | 5341989.230op/s | 2.80% | 0.909 | 0.938 | 0.64% | 2371.088op/s | 1 | 200 |
| normalization/normalize_name/normalize_name/bad-name | execution_time | 18.197µs | 18.231µs ± 0.025µs | 18.238µs ± 0.022µs | 18.250µs | 18.259µs | 18.297µs | 18.319µs | 0.44% | 0.517 | -0.148 | 0.14% | 0.002µs | 1 | 200 |
| normalization/normalize_name/normalize_name/bad-name | throughput | 54588486.085op/s | 54853214.688op/s ± 74509.869op/s | 54829758.270op/s ± 64584.834op/s | 54924761.223op/s | 54939810.645op/s | 54948081.748op/s | 54954010.944op/s | 0.23% | -0.510 | -0.171 | 0.14% | 5268.643op/s | 1 | 200 |
| normalization/normalize_name/normalize_name/good | execution_time | 11.302µs | 11.358µs ± 0.027µs | 11.351µs ± 0.015µs | 11.376µs | 11.402µs | 11.422µs | 11.491µs | 1.23% | 0.991 | 2.572 | 0.24% | 0.002µs | 1 | 200 |
| normalization/normalize_name/normalize_name/good | throughput | 87026698.839op/s | 88046911.289op/s ± 207153.962op/s | 88097328.335op/s ± 117361.410op/s | 88183831.663op/s | 88316399.313op/s | 88446742.477op/s | 88479853.898op/s | 0.43% | -0.966 | 2.463 | 0.23% | 14647.997op/s | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... | execution_time | [192.017µs; 192.358µs] or [-0.089%; +0.089%] | None | None | None |
| normalization/normalize_name/normalize_name/Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Long-.Too-Lo... | throughput | [5198817.289op/s; 5208111.782op/s] or [-0.089%; +0.089%] | None | None | None |
| normalization/normalize_name/normalize_name/bad-name | execution_time | [18.227µs; 18.234µs] or [-0.019%; +0.019%] | None | None | None |
| normalization/normalize_name/normalize_name/bad-name | throughput | [54842888.336op/s; 54863541.039op/s] or [-0.019%; +0.019%] | None | None | None |
| normalization/normalize_name/normalize_name/good | execution_time | [11.354µs; 11.361µs] or [-0.033%; +0.033%] | None | None | None |
| normalization/normalize_name/normalize_name/good | throughput | [88018201.742op/s; 88075620.836op/s] or [-0.033%; +0.033%] | None | None | None |
Group 12
| cpu_model | git_commit_sha | git_commit_date | git_branch |
|---|---|---|---|
| Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | 5f9c93e | 1728675756 | duncan-harvey/serverless-release-github-permissions |
| scenario | metric | min | mean ± sd | median ± mad | p75 | p95 | p99 | max | peak_to_median_ratio | skewness | kurtosis | cv | sem | runs | sample_size |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| normalization/normalize_trace/test_trace | execution_time | 258.496ns | 269.587ns ± 15.011ns | 262.975ns ± 2.825ns | 270.904ns | 305.098ns | 319.250ns | 320.648ns | 21.93% | 2.060 | 3.417 | 5.55% | 1.061ns | 1 | 200 |
| scenario | metric | 95% CI mean | Shapiro-Wilk pvalue | Ljung-Box pvalue (lag=1) | Dip test pvalue |
|---|---|---|---|---|---|
| normalization/normalize_trace/test_trace | execution_time | [267.507ns; 271.668ns] or [-0.772%; +0.772%] | None | None | None |
Baseline
Omitted due to size.
Codecov Report
All modified and coverable lines are covered by tests :white_check_mark:
Project coverage is 71.87%. Comparing base (
b8a7d2d) to head (94d4f9a).
Additional details and impacted files
@@ Coverage Diff @@
## main #660 +/- ##
==========================================
+ Coverage 71.86% 71.87% +0.01%
==========================================
Files 271 271
Lines 40654 40654
==========================================
+ Hits 29215 29222 +7
+ Misses 11439 11432 -7
| Components | Coverage Δ | |
|---|---|---|
| crashtracker | 20.41% <ø> (ø) |
|
| crashtracker-ffi | 9.07% <ø> (ø) |
|
| datadog-alloc | 98.73% <ø> (ø) |
|
| data-pipeline | 92.71% <ø> (ø) |
|
| data-pipeline-ffi | 0.00% <ø> (ø) |
|
| ddcommon | 82.73% <ø> (ø) |
|
| ddcommon-ffi | 69.12% <ø> (ø) |
|
| ddtelemetry | 59.10% <ø> (ø) |
|
| ddtelemetry-ffi | 22.13% <ø> (ø) |
|
| dogstatsd | 90.42% <ø> (ø) |
|
| dogstatsd-client | 79.77% <ø> (ø) |
|
| ipc | 82.69% <ø> (ø) |
|
| profiling | 84.26% <ø> (ø) |
|
| profiling-ffi | 77.42% <ø> (ø) |
|
| serverless | 0.00% <ø> (ø) |
|
| sidecar | 36.35% <ø> (ø) |
|
| sidecar-ffi | 0.00% <ø> (ø) |
|
| spawn-worker | 50.36% <ø> (ø) |
|
| tinybytes | 94.77% <ø> (ø) |
|
| trace-mini-agent | 72.47% <ø> (ø) |
|
| trace-normalization | 98.25% <ø> (ø) |
|
| trace-obfuscation | 95.73% <ø> (ø) |
|
| trace-protobuf | 77.67% <ø> (ø) |
|
| trace-utils | 93.46% <ø> (ø) |