vectordotdev
docs(nats source): Use generated docs for configuration
Deploy Preview for vrl-playground canceled.
| Name | Link |
|---|---|
| Latest commit | fb7589fc1555718ce7bfdd60328f1d972118974b |
| Latest deploy log | https://app.netlify.com/sites/vrl-playground/deploys/63cfad7cdf25410009579b35 |
![netlify[bot] avatar](https://avatars.githubusercontent.com/in/13473?v=4 "Published by a pub.dev verified publisher"){kind=small}
Deploy Preview for vector-project ready!
| Name | Link |
|---|---|
| Latest commit | fb7589fc1555718ce7bfdd60328f1d972118974b |
| Latest deploy log | https://app.netlify.com/sites/vector-project/deploys/63cfad7cc2ddad0008b021c1 |
| Deploy Preview | https://deploy-preview-15983--vector-project.netlify.app |
| Preview on mobile | Toggle QR Code...Use your smartphone camera to open QR code link. |
To edit notification comments on pull requests, go to your Netlify site settings.
Regression Test Results
Run ID: 16ac0c69-62cf-4ca2-9a15-c42ff63b7b08
Baseline: e12a08ca7bd2d6f1e0cadecad7616cd4adf587ee
Comparison: 4e7782edfedbc232a434fc7a40710e8b1d114fa8
Total vector CPUs: 7
Explanation
A regression test is an integrated performance test for vector in
a repeatable rig, with varying configuration for vector. What
follows is a statistical summary of a brief vector run for each
configuration across SHAs given above. The goal of these tests are to determine,
quickly, if vector performance is changed and to what degree by a
pull request. Where appropriate units are scaled per-core.
The table below, if present, lists those experiments that have experienced a
statistically significant change in their bytes_written_per_cpu_second performance
between baseline and comparison SHAs, with 90.0%
confidence OR have been detected as newly erratic. Negative values mean that
baseline is faster, positive comparison. Results that do not exhibit more than a
±5% change in mean bytes_written_per_cpu_second are
discarded. An experiment is erratic if its coefficient of variation is greater
than 0.1. The abbreviated table will be
omitted if no interesting changes are observed.
No interesting changes in bytes_written_per_cpu_second with confidence ≥ 90.00% and absolute Δ mean >= ±5%.
Fine details of change detection per experiment.
| experiment | Δ mean | Δ mean % | confidence | baseline mean | baseline stdev | baseline stderr | baseline outlier % | baseline CoV | comparison mean | comparison stdev | comparison stderr | comparison outlier % | comparison CoV | erratic | declared erratic |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| otlp_http_to_blackhole | 45.91KiB/CPU-s | 3.04 | 100.00% | 1.48MiB/CPU-s | 135.4KiB/CPU-s | 1.75KiB/CPU-s | 0.0 | 0.089621 | 1.52MiB/CPU-s | 121.28KiB/CPU-s | 1.57KiB/CPU-s | 0.0 | 0.077906 | False | False |
| socket_to_socket_blackhole | 313.43KiB/CPU-s | 2.35 | 100.00% | 13.02MiB/CPU-s | 404.39KiB/CPU-s | 5.22KiB/CPU-s | 0.0 | 0.030322 | 13.33MiB/CPU-s | 153.24KiB/CPU-s | 1.98KiB/CPU-s | 0.0 | 0.011226 | False | False |
| http_text_to_http_json | 438.72KiB/CPU-s | 1.81 | 100.00% | 23.62MiB/CPU-s | 794.75KiB/CPU-s | 10.26KiB/CPU-s | 0.0 | 0.032861 | 24.04MiB/CPU-s | 772.77KiB/CPU-s | 9.97KiB/CPU-s | 0.0 | 0.031383 | False | False |
| datadog_agent_remap_datadog_logs_acks | 608.23KiB/CPU-s | 1.79 | 100.00% | 33.26MiB/CPU-s | 1.29MiB/CPU-s | 17.03KiB/CPU-s | 0.0 | 0.038745 | 33.86MiB/CPU-s | 1.04MiB/CPU-s | 13.8KiB/CPU-s | 0.0 | 0.030836 | False | False |
| syslog_humio_logs | 111.07KiB/CPU-s | 1.21 | 100.00% | 8.93MiB/CPU-s | 267.04KiB/CPU-s | 3.45KiB/CPU-s | 0.0 | 0.0292 | 9.04MiB/CPU-s | 336.18KiB/CPU-s | 4.34KiB/CPU-s | 0.0 | 0.03632 | False | False |
| otlp_grpc_to_blackhole | 10.16KiB/CPU-s | 0.98 | 100.00% | 1.02MiB/CPU-s | 49.5KiB/CPU-s | 654.26B/CPU-s | 0.0 | 0.047504 | 1.03MiB/CPU-s | 64.34KiB/CPU-s | 850.04B/CPU-s | 0.0 | 0.061148 | False | False |
| syslog_loki | 67.18KiB/CPU-s | 0.75 | 100.00% | 8.74MiB/CPU-s | 374.58KiB/CPU-s | 4.83KiB/CPU-s | 0.0 | 0.041845 | 8.81MiB/CPU-s | 272.15KiB/CPU-s | 3.51KiB/CPU-s | 0.0 | 0.030175 | False | False |
| http_to_http_json | 75.4KiB/CPU-s | 0.54 | 100.00% | 13.55MiB/CPU-s | 320.93KiB/CPU-s | 4.14KiB/CPU-s | 0.0 | 0.023132 | 13.62MiB/CPU-s | 217.05KiB/CPU-s | 2.8KiB/CPU-s | 0.0 | 0.01556 | False | False |
| splunk_hec_to_splunk_hec_logs_noack | 2.24KiB/CPU-s | 0.02 | 45.67% | 13.62MiB/CPU-s | 212.35KiB/CPU-s | 2.74KiB/CPU-s | 0.0 | 0.015221 | 13.63MiB/CPU-s | 191.3KiB/CPU-s | 2.47KiB/CPU-s | 0.0 | 0.01371 | False | False |
| enterprise_http_to_http | 2.06KiB/CPU-s | 0.01 | 40.71% | 13.62MiB/CPU-s | 228.68KiB/CPU-s | 2.95KiB/CPU-s | 0.0 | 0.016395 | 13.62MiB/CPU-s | 191.88KiB/CPU-s | 2.48KiB/CPU-s | 0.0 | 0.013755 | False | False |
| splunk_hec_to_splunk_hec_logs_acks | 147.0B/CPU-s | 0.0 | 1.71% | 13.61MiB/CPU-s | 355.46KiB/CPU-s | 4.59KiB/CPU-s | 0.0 | 0.025497 | 13.61MiB/CPU-s | 377.79KiB/CPU-s | 4.87KiB/CPU-s | 0.0 | 0.027098 | False | False |
| file_to_blackhole | 886.87B/CPU-s | 0.0 | 3.27% | 54.5MiB/CPU-s | 1.15MiB/CPU-s | 15.2KiB/CPU-s | 0.0 | 0.021119 | 54.5MiB/CPU-s | 1.11MiB/CPU-s | 14.63KiB/CPU-s | 0.0 | 0.020324 | False | False |
| fluent_elasticsearch | -78.0B/CPU-s | -0.0 | 11.32% | 45.41MiB/CPU-s | 29.43KiB/CPU-s | 384.85B/CPU-s | 0.0 | 0.000633 | 45.41MiB/CPU-s | 29.83KiB/CPU-s | 390.16B/CPU-s | 0.0 | 0.000641 | False | False |
| splunk_hec_indexer_ack_blackhole | 25.32B/CPU-s | 0.0 | 0.44% | 13.62MiB/CPU-s | 247.44KiB/CPU-s | 3.19KiB/CPU-s | 0.0 | 0.017743 | 13.62MiB/CPU-s | 246.79KiB/CPU-s | 3.18KiB/CPU-s | 0.0 | 0.017696 | False | False |
| http_to_http_noack | -2.22KiB/CPU-s | -0.02 | 29.79% | 13.61MiB/CPU-s | 301.77KiB/CPU-s | 3.89KiB/CPU-s | 0.0 | 0.021645 | 13.61MiB/CPU-s | 333.8KiB/CPU-s | 4.31KiB/CPU-s | 0.0 | 0.023946 | False | False |
| syslog_splunk_hec_logs | -8.6KiB/CPU-s | -0.09 | 99.98% | 9.2MiB/CPU-s | 72.72KiB/CPU-s | 961.4B/CPU-s | 0.0 | 0.007721 | 9.19MiB/CPU-s | 162.31KiB/CPU-s | 2.09KiB/CPU-s | 0.0 | 0.017248 | False | False |
| datadog_agent_remap_datadog_logs | -83.74KiB/CPU-s | -0.24 | 99.90% | 33.9MiB/CPU-s | 1.33MiB/CPU-s | 17.56KiB/CPU-s | 0.0 | 0.039206 | 33.81MiB/CPU-s | 1.39MiB/CPU-s | 18.34KiB/CPU-s | 0.0 | 0.041064 | False | False |
| splunk_hec_route_s3 | -38.58KiB/CPU-s | -0.32 | 99.92% | 11.64MiB/CPU-s | 686.26KiB/CPU-s | 8.85KiB/CPU-s | 0.0 | 0.057558 | 11.6MiB/CPU-s | 565.5KiB/CPU-s | 7.3KiB/CPU-s | 0.0 | 0.047584 | False | False |
| syslog_log2metric_humio_metrics | -47.64KiB/CPU-s | -0.75 | 100.00% | 6.24MiB/CPU-s | 86.72KiB/CPU-s | 1.12KiB/CPU-s | 0.0 | 0.01357 | 6.19MiB/CPU-s | 236.01KiB/CPU-s | 3.05KiB/CPU-s | 0.0 | 0.037208 | False | False |
| datadog_agent_remap_blackhole_acks | -341.57KiB/CPU-s | -1.06 | 100.00% | 31.34MiB/CPU-s | 793.13KiB/CPU-s | 10.24KiB/CPU-s | 0.0 | 0.024712 | 31.01MiB/CPU-s | 1.47MiB/CPU-s | 19.4KiB/CPU-s | 0.0 | 0.047323 | False | False |
| syslog_log2metric_splunk_hec_metrics | -168.19KiB/CPU-s | -1.77 | 100.00% | 9.27MiB/CPU-s | 247.9KiB/CPU-s | 3.2KiB/CPU-s | 0.0 | 0.026117 | 9.1MiB/CPU-s | 609.59KiB/CPU-s | 7.87KiB/CPU-s | 0.0 | 0.065381 | False | False |
| datadog_agent_remap_blackhole | -621.63KiB/CPU-s | -2.01 | 100.00% | 30.25MiB/CPU-s | 1.78MiB/CPU-s | 23.52KiB/CPU-s | 0.0 | 0.058813 | 29.64MiB/CPU-s | 1.75MiB/CPU-s | 23.16KiB/CPU-s | 0.0 | 0.059113 | False | False |
| http_to_http_acks | -155.02KiB/CPU-s | -2.86 | 99.76% | 5.29MiB/CPU-s | 2.78MiB/CPU-s | 36.77KiB/CPU-s | 0.0 | 0.526151 | 5.14MiB/CPU-s | 2.68MiB/CPU-s | 35.37KiB/CPU-s | 0.0 | 0.521106 | True | False |
| syslog_regex_logs2metric_ddmetrics | -161.35KiB/CPU-s | -4.22 | 100.00% | 3.73MiB/CPU-s | 494.69KiB/CPU-s | 6.39KiB/CPU-s | 0.0 | 0.129492 | 3.57MiB/CPU-s | 608.19KiB/CPU-s | 7.85KiB/CPU-s | 0.0 | 0.166222 | True | False |
![github-actions[bot] avatar](https://avatars.githubusercontent.com/in/15368?v=4 "Published by a pub.dev verified publisher"){kind=small}
Regression Test Results
Run ID: 969e19f0-4346-4721-80ca-92807eb70b47
Baseline: 964919a17e57e0b57d446826425ce03144dad5e1
Comparison: 9c3a33e9c1cbc40ffb343f5efc6923d45334078f
Total vector CPUs: 7
Explanation
A regression test is an integrated performance test for vector in
a repeatable rig, with varying configuration for vector. What
follows is a statistical summary of a brief vector run for each
configuration across SHAs given above. The goal of these tests are to determine,
quickly, if vector performance is changed and to what degree by a
pull request. Where appropriate units are scaled per-core.
The table below, if present, lists those experiments that have experienced a
statistically significant change in their bytes_written_per_cpu_second performance
between baseline and comparison SHAs, with 90.0%
confidence OR have been detected as newly erratic. Negative values mean that
baseline is faster, positive comparison. Results that do not exhibit more than a
±5% change in mean bytes_written_per_cpu_second are
discarded. An experiment is erratic if its coefficient of variation is greater
than 0.1. The abbreviated table will be
omitted if no interesting changes are observed.
No interesting changes in bytes_written_per_cpu_second with confidence ≥ 90.00% and absolute Δ mean >= ±5%.
Fine details of change detection per experiment.
| experiment | Δ mean | Δ mean % | confidence | baseline mean | baseline stdev | baseline stderr | baseline outlier % | baseline CoV | comparison mean | comparison stdev | comparison stderr | comparison outlier % | comparison CoV | erratic | declared erratic |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| syslog_log2metric_humio_metrics | 250.31KiB/CPU-s | 4.11 | 100.00% | 5.95MiB/CPU-s | 292.74KiB/CPU-s | 3.78KiB/CPU-s | 0.0 | 0.048017 | 6.2MiB/CPU-s | 160.13KiB/CPU-s | 2.07KiB/CPU-s | 0.0 | 0.025229 | False | False |
| http_to_http_acks | 116.64KiB/CPU-s | 2.19 | 97.41% | 5.2MiB/CPU-s | 2.79MiB/CPU-s | 36.85KiB/CPU-s | 0.0 | 0.536341 | 5.31MiB/CPU-s | 2.81MiB/CPU-s | 37.21KiB/CPU-s | 0.0 | 0.529916 | True | False |
| http_text_to_http_json | 72.18KiB/CPU-s | 0.29 | 100.00% | 24.12MiB/CPU-s | 684.0KiB/CPU-s | 8.83KiB/CPU-s | 0.0 | 0.027691 | 24.19MiB/CPU-s | 672.67KiB/CPU-s | 8.68KiB/CPU-s | 0.0 | 0.027154 | False | False |
| syslog_log2metric_splunk_hec_metrics | 12.69KiB/CPU-s | 0.13 | 98.75% | 9.38MiB/CPU-s | 210.49KiB/CPU-s | 2.72KiB/CPU-s | 0.0 | 0.021918 | 9.39MiB/CPU-s | 332.08KiB/CPU-s | 4.29KiB/CPU-s | 0.0 | 0.034535 | False | False |
| enterprise_http_to_http | 8.21KiB/CPU-s | 0.06 | 92.06% | 13.61MiB/CPU-s | 307.87KiB/CPU-s | 3.97KiB/CPU-s | 0.0 | 0.022082 | 13.62MiB/CPU-s | 191.9KiB/CPU-s | 2.48KiB/CPU-s | 0.0 | 0.013756 | False | False |
| syslog_humio_logs | 2.84KiB/CPU-s | 0.03 | 55.69% | 9.17MiB/CPU-s | 241.62KiB/CPU-s | 3.12KiB/CPU-s | 0.0 | 0.025724 | 9.17MiB/CPU-s | 155.05KiB/CPU-s | 2.0KiB/CPU-s | 0.0 | 0.016502 | False | False |
| splunk_hec_to_splunk_hec_logs_noack | 3.81KiB/CPU-s | 0.03 | 69.19% | 13.62MiB/CPU-s | 218.09KiB/CPU-s | 2.81KiB/CPU-s | 0.0 | 0.015634 | 13.63MiB/CPU-s | 190.8KiB/CPU-s | 2.46KiB/CPU-s | 0.0 | 0.013674 | False | False |
| http_to_http_json | 149.71B/CPU-s | 0.0 | 3.04% | 13.62MiB/CPU-s | 210.29KiB/CPU-s | 2.71KiB/CPU-s | 0.0 | 0.015074 | 13.62MiB/CPU-s | 210.85KiB/CPU-s | 2.72KiB/CPU-s | 0.0 | 0.015114 | False | False |
| splunk_hec_to_splunk_hec_logs_acks | -646.14B/CPU-s | -0.0 | 7.97% | 13.62MiB/CPU-s | 349.46KiB/CPU-s | 4.51KiB/CPU-s | 0.0 | 0.025056 | 13.62MiB/CPU-s | 341.46KiB/CPU-s | 4.41KiB/CPU-s | 0.0 | 0.024484 | False | False |
| http_to_http_noack | -150.2B/CPU-s | -0.0 | 2.25% | 13.62MiB/CPU-s | 284.62KiB/CPU-s | 3.67KiB/CPU-s | 0.0 | 0.020412 | 13.62MiB/CPU-s | 285.28KiB/CPU-s | 3.68KiB/CPU-s | 0.0 | 0.020459 | False | False |
| fluent_elasticsearch | 227.09B/CPU-s | 0.0 | 31.62% | 45.41MiB/CPU-s | 30.14KiB/CPU-s | 394.0B/CPU-s | 0.0 | 0.000648 | 45.41MiB/CPU-s | 30.19KiB/CPU-s | 394.62B/CPU-s | 0.0 | 0.000649 | False | False |
| file_to_blackhole | 1.12KiB/CPU-s | 0.0 | 4.39% | 54.49MiB/CPU-s | 1.1MiB/CPU-s | 14.48KiB/CPU-s | 0.0 | 0.020118 | 54.49MiB/CPU-s | 1.09MiB/CPU-s | 14.33KiB/CPU-s | 0.0 | 0.019928 | False | False |
| splunk_hec_indexer_ack_blackhole | -777.11B/CPU-s | -0.01 | 13.21% | 13.62MiB/CPU-s | 246.32KiB/CPU-s | 3.18KiB/CPU-s | 0.0 | 0.017662 | 13.62MiB/CPU-s | 253.83KiB/CPU-s | 3.27KiB/CPU-s | 0.0 | 0.018202 | False | False |
| syslog_loki | -1.74KiB/CPU-s | -0.02 | 50.14% | 8.9MiB/CPU-s | 154.83KiB/CPU-s | 2.0KiB/CPU-s | 0.0 | 0.016978 | 8.9MiB/CPU-s | 125.41KiB/CPU-s | 1.62KiB/CPU-s | 0.0 | 0.013754 | False | False |
| syslog_regex_logs2metric_ddmetrics | -2.06KiB/CPU-s | -0.05 | 20.89% | 3.69MiB/CPU-s | 397.08KiB/CPU-s | 5.13KiB/CPU-s | 0.0 | 0.105171 | 3.68MiB/CPU-s | 453.28KiB/CPU-s | 5.85KiB/CPU-s | 0.0 | 0.120122 | True | False |
| datadog_agent_remap_datadog_logs | -16.44KiB/CPU-s | -0.05 | 53.58% | 34.14MiB/CPU-s | 1.19MiB/CPU-s | 15.71KiB/CPU-s | 0.0 | 0.034832 | 34.13MiB/CPU-s | 1.22MiB/CPU-s | 16.05KiB/CPU-s | 0.0 | 0.035605 | False | False |
| otlp_grpc_to_blackhole | -3.65KiB/CPU-s | -0.34 | 100.00% | 1.05MiB/CPU-s | 37.45KiB/CPU-s | 495.1B/CPU-s | 0.0 | 0.034713 | 1.05MiB/CPU-s | 46.02KiB/CPU-s | 608.18B/CPU-s | 0.0 | 0.042797 | False | False |
| datadog_agent_remap_blackhole_acks | -210.76KiB/CPU-s | -0.66 | 100.00% | 30.97MiB/CPU-s | 1.35MiB/CPU-s | 17.86KiB/CPU-s | 0.0 | 0.043613 | 30.76MiB/CPU-s | 1.72MiB/CPU-s | 22.72KiB/CPU-s | 0.0 | 0.055878 | False | False |
| syslog_splunk_hec_logs | -72.09KiB/CPU-s | -0.77 | 100.00% | 9.11MiB/CPU-s | 87.89KiB/CPU-s | 1.13KiB/CPU-s | 0.0 | 0.009419 | 9.04MiB/CPU-s | 215.57KiB/CPU-s | 2.78KiB/CPU-s | 0.0 | 0.023282 | False | False |
| socket_to_socket_blackhole | -144.52KiB/CPU-s | -1.06 | 100.00% | 13.34MiB/CPU-s | 202.14KiB/CPU-s | 2.61KiB/CPU-s | 0.0 | 0.014796 | 13.2MiB/CPU-s | 373.62KiB/CPU-s | 4.82KiB/CPU-s | 0.0 | 0.027639 | False | False |
| datadog_agent_remap_blackhole | -374.93KiB/CPU-s | -1.17 | 100.00% | 31.34MiB/CPU-s | 918.4KiB/CPU-s | 11.85KiB/CPU-s | 0.0 | 0.028615 | 30.97MiB/CPU-s | 1.17MiB/CPU-s | 15.51KiB/CPU-s | 0.0 | 0.037897 | False | False |
| datadog_agent_remap_datadog_logs_acks | -476.82KiB/CPU-s | -1.37 | 100.00% | 34.1MiB/CPU-s | 885.68KiB/CPU-s | 11.43KiB/CPU-s | 0.0 | 0.025364 | 33.63MiB/CPU-s | 1.2MiB/CPU-s | 15.85KiB/CPU-s | 0.0 | 0.035656 | False | False |
| otlp_http_to_blackhole | -22.71KiB/CPU-s | -1.43 | 100.00% | 1.55MiB/CPU-s | 107.35KiB/CPU-s | 1.39KiB/CPU-s | 0.0 | 0.067438 | 1.53MiB/CPU-s | 120.19KiB/CPU-s | 1.55KiB/CPU-s | 0.0 | 0.076595 | False | False |
| splunk_hec_route_s3 | -314.44KiB/CPU-s | -2.61 | 100.00% | 11.75MiB/CPU-s | 526.92KiB/CPU-s | 6.8KiB/CPU-s | 0.0 | 0.043772 | 11.45MiB/CPU-s | 676.11KiB/CPU-s | 8.73KiB/CPU-s | 0.0 | 0.057673 | False | False |
Regression Test Results
Run ID: a275d136-dd86-49b3-b446-9c81393412fd
Baseline: 964919a17e57e0b57d446826425ce03144dad5e1
Comparison: 5a4901b662824552a537579cc91f448756aa5bb5
Total vector CPUs: 7
Explanation
A regression test is an integrated performance test for vector in
a repeatable rig, with varying configuration for vector. What
follows is a statistical summary of a brief vector run for each
configuration across SHAs given above. The goal of these tests are to determine,
quickly, if vector performance is changed and to what degree by a
pull request. Where appropriate units are scaled per-core.
The table below, if present, lists those experiments that have experienced a
statistically significant change in their bytes_written_per_cpu_second performance
between baseline and comparison SHAs, with 90.0%
confidence OR have been detected as newly erratic. Negative values mean that
baseline is faster, positive comparison. Results that do not exhibit more than a
±5% change in mean bytes_written_per_cpu_second are
discarded. An experiment is erratic if its coefficient of variation is greater
than 0.1. The abbreviated table will be
omitted if no interesting changes are observed.
No interesting changes in bytes_written_per_cpu_second with confidence ≥ 90.00% and absolute Δ mean >= ±5%.
Fine details of change detection per experiment.
| experiment | Δ mean | Δ mean % | confidence | baseline mean | baseline stdev | baseline stderr | baseline outlier % | baseline CoV | comparison mean | comparison stdev | comparison stderr | comparison outlier % | comparison CoV | erratic | declared erratic |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| syslog_humio_logs | 166.92KiB/CPU-s | 1.81 | 100.00% | 9.03MiB/CPU-s | 263.21KiB/CPU-s | 3.4KiB/CPU-s | 0.0 | 0.028474 | 9.19MiB/CPU-s | 156.39KiB/CPU-s | 2.02KiB/CPU-s | 0.0 | 0.016618 | False | False |
| otlp_http_to_blackhole | 18.24KiB/CPU-s | 1.17 | 100.00% | 1.52MiB/CPU-s | 124.96KiB/CPU-s | 1.61KiB/CPU-s | 0.0 | 0.080068 | 1.54MiB/CPU-s | 114.56KiB/CPU-s | 1.48KiB/CPU-s | 0.0 | 0.072558 | False | False |
| syslog_log2metric_humio_metrics | 63.49KiB/CPU-s | 1.04 | 100.00% | 5.94MiB/CPU-s | 242.45KiB/CPU-s | 3.13KiB/CPU-s | 0.0 | 0.039853 | 6.0MiB/CPU-s | 296.28KiB/CPU-s | 3.82KiB/CPU-s | 0.0 | 0.048198 | False | False |
| datadog_agent_remap_blackhole_acks | 157.31KiB/CPU-s | 0.51 | 100.00% | 30.26MiB/CPU-s | 1.51MiB/CPU-s | 20.02KiB/CPU-s | 0.0 | 0.050024 | 30.41MiB/CPU-s | 1.62MiB/CPU-s | 21.39KiB/CPU-s | 0.0 | 0.053198 | False | False |
| http_to_http_json | 35.86KiB/CPU-s | 0.26 | 100.00% | 13.59MiB/CPU-s | 262.51KiB/CPU-s | 3.39KiB/CPU-s | 0.0 | 0.018866 | 13.62MiB/CPU-s | 209.85KiB/CPU-s | 2.71KiB/CPU-s | 0.0 | 0.015043 | False | False |
| datadog_agent_remap_blackhole | 62.4KiB/CPU-s | 0.2 | 99.74% | 31.14MiB/CPU-s | 1.28MiB/CPU-s | 16.88KiB/CPU-s | 0.0 | 0.04101 | 31.2MiB/CPU-s | 932.58KiB/CPU-s | 12.04KiB/CPU-s | 0.0 | 0.029186 | False | False |
| splunk_hec_to_splunk_hec_logs_noack | 5.38KiB/CPU-s | 0.04 | 83.45% | 13.62MiB/CPU-s | 233.52KiB/CPU-s | 3.01KiB/CPU-s | 0.0 | 0.016742 | 13.63MiB/CPU-s | 189.67KiB/CPU-s | 2.45KiB/CPU-s | 0.0 | 0.013593 | False | False |
| http_to_http_noack | 3.92KiB/CPU-s | 0.03 | 51.36% | 13.61MiB/CPU-s | 331.66KiB/CPU-s | 4.28KiB/CPU-s | 0.0 | 0.023792 | 13.62MiB/CPU-s | 283.43KiB/CPU-s | 3.66KiB/CPU-s | 0.0 | 0.020327 | False | False |
| enterprise_http_to_http | 4.33KiB/CPU-s | 0.03 | 70.41% | 13.62MiB/CPU-s | 259.01KiB/CPU-s | 3.34KiB/CPU-s | 0.0 | 0.018572 | 13.62MiB/CPU-s | 189.5KiB/CPU-s | 2.45KiB/CPU-s | 0.0 | 0.013584 | False | False |
| splunk_hec_to_splunk_hec_logs_acks | 2.61KiB/CPU-s | 0.02 | 29.66% | 13.61MiB/CPU-s | 376.82KiB/CPU-s | 4.86KiB/CPU-s | 0.0 | 0.027028 | 13.62MiB/CPU-s | 374.36KiB/CPU-s | 4.83KiB/CPU-s | 0.0 | 0.026847 | False | False |
| file_to_blackhole | 5.45KiB/CPU-s | 0.01 | 21.26% | 54.49MiB/CPU-s | 1.08MiB/CPU-s | 14.25KiB/CPU-s | 0.0 | 0.01979 | 54.5MiB/CPU-s | 1.08MiB/CPU-s | 14.31KiB/CPU-s | 0.0 | 0.0199 | False | False |
| fluent_elasticsearch | 46.44B/CPU-s | 0.0 | 6.73% | 45.41MiB/CPU-s | 30.02KiB/CPU-s | 392.36B/CPU-s | 0.0 | 0.000646 | 45.41MiB/CPU-s | 29.53KiB/CPU-s | 385.87B/CPU-s | 0.0 | 0.000635 | False | False |
| splunk_hec_indexer_ack_blackhole | 273.38B/CPU-s | 0.0 | 4.63% | 13.62MiB/CPU-s | 251.18KiB/CPU-s | 3.24KiB/CPU-s | 0.0 | 0.018012 | 13.62MiB/CPU-s | 253.13KiB/CPU-s | 3.27KiB/CPU-s | 0.0 | 0.018151 | False | False |
| datadog_agent_remap_datadog_logs_acks | -104.34KiB/CPU-s | -0.31 | 100.00% | 33.21MiB/CPU-s | 1.29MiB/CPU-s | 17.0KiB/CPU-s | 0.0 | 0.03874 | 33.11MiB/CPU-s | 1.3MiB/CPU-s | 17.23KiB/CPU-s | 0.0 | 0.039374 | False | False |
| otlp_grpc_to_blackhole | -4.13KiB/CPU-s | -0.39 | 100.00% | 1.04MiB/CPU-s | 39.41KiB/CPU-s | 520.91B/CPU-s | 0.0 | 0.037124 | 1.03MiB/CPU-s | 53.41KiB/CPU-s | 705.66B/CPU-s | 0.0 | 0.050513 | False | False |
| http_to_http_acks | -22.16KiB/CPU-s | -0.41 | 33.02% | 5.23MiB/CPU-s | 2.81MiB/CPU-s | 37.15KiB/CPU-s | 0.0 | 0.537128 | 5.21MiB/CPU-s | 2.75MiB/CPU-s | 36.33KiB/CPU-s | 0.0 | 0.527236 | True | False |
| splunk_hec_route_s3 | -61.13KiB/CPU-s | -0.52 | 100.00% | 11.55MiB/CPU-s | 612.21KiB/CPU-s | 7.9KiB/CPU-s | 0.0 | 0.05177 | 11.49MiB/CPU-s | 604.4KiB/CPU-s | 7.8KiB/CPU-s | 0.0 | 0.051375 | False | False |
| syslog_splunk_hec_logs | -52.89KiB/CPU-s | -0.57 | 100.00% | 9.11MiB/CPU-s | 187.13KiB/CPU-s | 2.42KiB/CPU-s | 0.0 | 0.020053 | 9.06MiB/CPU-s | 199.59KiB/CPU-s | 2.58KiB/CPU-s | 0.0 | 0.021511 | False | False |
| http_text_to_http_json | -166.15KiB/CPU-s | -0.68 | 100.00% | 24.0MiB/CPU-s | 675.55KiB/CPU-s | 8.72KiB/CPU-s | 0.0 | 0.027483 | 23.84MiB/CPU-s | 745.42KiB/CPU-s | 9.62KiB/CPU-s | 0.0 | 0.030532 | False | False |
| syslog_log2metric_splunk_hec_metrics | -98.25KiB/CPU-s | -1.02 | 100.00% | 9.36MiB/CPU-s | 268.74KiB/CPU-s | 3.47KiB/CPU-s | 0.0 | 0.028028 | 9.27MiB/CPU-s | 324.62KiB/CPU-s | 4.19KiB/CPU-s | 0.0 | 0.034207 | False | False |
| syslog_loki | -98.92KiB/CPU-s | -1.1 | 100.00% | 8.77MiB/CPU-s | 274.53KiB/CPU-s | 3.54KiB/CPU-s | 0.0 | 0.030585 | 8.67MiB/CPU-s | 259.69KiB/CPU-s | 3.35KiB/CPU-s | 0.0 | 0.029254 | False | False |
| datadog_agent_remap_datadog_logs | -475.36KiB/CPU-s | -1.37 | 100.00% | 33.9MiB/CPU-s | 1.17MiB/CPU-s | 15.5KiB/CPU-s | 0.0 | 0.034607 | 33.44MiB/CPU-s | 1.45MiB/CPU-s | 19.17KiB/CPU-s | 0.0 | 0.043395 | False | False |
| syslog_regex_logs2metric_ddmetrics | -66.25KiB/CPU-s | -1.76 | 100.00% | 3.67MiB/CPU-s | 416.6KiB/CPU-s | 5.38KiB/CPU-s | 0.0 | 0.11077 | 3.61MiB/CPU-s | 495.12KiB/CPU-s | 6.39KiB/CPU-s | 0.0 | 0.134009 | True | False |
| socket_to_socket_blackhole | -304.97KiB/CPU-s | -2.23 | 100.00% | 13.36MiB/CPU-s | 207.68KiB/CPU-s | 2.68KiB/CPU-s | 0.0 | 0.015181 | 13.06MiB/CPU-s | 438.07KiB/CPU-s | 5.66KiB/CPU-s | 0.0 | 0.032751 | False | False |
Also noting all of the underlying
authoptions got marked required with this change? Which seems... not right
So I see it as the auth section is optional, but when strategy = "credentials_file" the auth.credentials_file is mandatory. Which is correct.
Regression Test Results
Run ID: e6c8110b-72cc-422c-9beb-d0f341953109
Baseline: 9c5b0a137967986ccb11ee2675a7cbf4941398ad
Comparison: fb7589fc1555718ce7bfdd60328f1d972118974b
Total vector CPUs: 7
Explanation
A regression test is an integrated performance test for vector in
a repeatable rig, with varying configuration for vector. What
follows is a statistical summary of a brief vector run for each
configuration across SHAs given above. The goal of these tests are to determine,
quickly, if vector performance is changed and to what degree by a
pull request. Where appropriate units are scaled per-core.
The table below, if present, lists those experiments that have experienced a
statistically significant change in their bytes_written_per_cpu_second performance
between baseline and comparison SHAs, with 90.0%
confidence OR have been detected as newly erratic. Negative values mean that
baseline is faster, positive comparison. Results that do not exhibit more than a
±5% change in mean bytes_written_per_cpu_second are
discarded. An experiment is erratic if its coefficient of variation is greater
than 0.1. The abbreviated table will be
omitted if no interesting changes are observed.
No interesting changes in bytes_written_per_cpu_second with confidence ≥ 90.00% and absolute Δ mean >= ±5%.
Fine details of change detection per experiment.
| experiment | Δ mean | Δ mean % | confidence | baseline mean | baseline stdev | baseline stderr | baseline outlier % | baseline CoV | comparison mean | comparison stdev | comparison stderr | comparison outlier % | comparison CoV | erratic | declared erratic |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| syslog_log2metric_splunk_hec_metrics | 130.82KiB/CPU-s | 1.37 | 100.00% | 9.33MiB/CPU-s | 234.77KiB/CPU-s | 3.03KiB/CPU-s | 0.0 | 0.024568 | 9.46MiB/CPU-s | 213.56KiB/CPU-s | 2.76KiB/CPU-s | 0.0 | 0.022047 | False | False |
| syslog_regex_logs2metric_ddmetrics | 33.55KiB/CPU-s | 0.87 | 99.99% | 3.79MiB/CPU-s | 449.05KiB/CPU-s | 5.8KiB/CPU-s | 0.0 | 0.115833 | 3.82MiB/CPU-s | 468.94KiB/CPU-s | 6.05KiB/CPU-s | 0.0 | 0.119927 | True | False |
| datadog_agent_remap_blackhole_acks | 277.17KiB/CPU-s | 0.86 | 100.00% | 31.62MiB/CPU-s | 1.92MiB/CPU-s | 25.44KiB/CPU-s | 0.0 | 0.060847 | 31.89MiB/CPU-s | 970.32KiB/CPU-s | 12.53KiB/CPU-s | 0.0 | 0.029712 | False | False |
| otlp_grpc_to_blackhole | 7.41KiB/CPU-s | 0.7 | 100.00% | 1.04MiB/CPU-s | 42.2KiB/CPU-s | 557.73B/CPU-s | 0.0 | 0.039698 | 1.05MiB/CPU-s | 47.11KiB/CPU-s | 622.54B/CPU-s | 0.0 | 0.044014 | False | False |
| http_to_http_acks | 31.73KiB/CPU-s | 0.59 | 45.42% | 5.25MiB/CPU-s | 2.76MiB/CPU-s | 36.46KiB/CPU-s | 0.0 | 0.525507 | 5.28MiB/CPU-s | 2.86MiB/CPU-s | 37.82KiB/CPU-s | 0.0 | 0.541883 | True | False |
| syslog_loki | 49.83KiB/CPU-s | 0.56 | 100.00% | 8.75MiB/CPU-s | 302.06KiB/CPU-s | 3.9KiB/CPU-s | 0.0 | 0.033717 | 8.8MiB/CPU-s | 184.71KiB/CPU-s | 2.38KiB/CPU-s | 0.0 | 0.020504 | False | False |
| otlp_http_to_blackhole | 7.28KiB/CPU-s | 0.47 | 99.93% | 1.52MiB/CPU-s | 110.55KiB/CPU-s | 1.43KiB/CPU-s | 0.0 | 0.071045 | 1.53MiB/CPU-s | 123.88KiB/CPU-s | 1.6KiB/CPU-s | 0.0 | 0.079238 | False | False |
| http_to_http_json | 61.18KiB/CPU-s | 0.44 | 100.00% | 13.56MiB/CPU-s | 304.14KiB/CPU-s | 3.92KiB/CPU-s | 0.0 | 0.021898 | 13.62MiB/CPU-s | 210.12KiB/CPU-s | 2.71KiB/CPU-s | 0.0 | 0.015062 | False | False |
| socket_to_socket_blackhole | 54.29KiB/CPU-s | 0.4 | 100.00% | 13.29MiB/CPU-s | 149.26KiB/CPU-s | 1.93KiB/CPU-s | 0.0 | 0.010968 | 13.34MiB/CPU-s | 96.0KiB/CPU-s | 1.24KiB/CPU-s | 0.0 | 0.007026 | False | False |
| syslog_humio_logs | 24.85KiB/CPU-s | 0.27 | 100.00% | 9.07MiB/CPU-s | 182.64KiB/CPU-s | 2.36KiB/CPU-s | 0.0 | 0.019657 | 9.1MiB/CPU-s | 166.31KiB/CPU-s | 2.15KiB/CPU-s | 0.0 | 0.017852 | False | False |
| enterprise_http_to_http | 8.09KiB/CPU-s | 0.06 | 91.82% | 13.61MiB/CPU-s | 306.4KiB/CPU-s | 3.95KiB/CPU-s | 0.0 | 0.021977 | 13.62MiB/CPU-s | 189.26KiB/CPU-s | 2.44KiB/CPU-s | 0.0 | 0.013567 | False | False |
| splunk_hec_to_splunk_hec_logs_noack | 5.72KiB/CPU-s | 0.04 | 85.48% | 13.62MiB/CPU-s | 236.83KiB/CPU-s | 3.06KiB/CPU-s | 0.0 | 0.01698 | 13.63MiB/CPU-s | 191.38KiB/CPU-s | 2.47KiB/CPU-s | 0.0 | 0.013716 | False | False |
| http_to_http_noack | 2.19KiB/CPU-s | 0.02 | 34.14% | 13.62MiB/CPU-s | 285.76KiB/CPU-s | 3.69KiB/CPU-s | 0.0 | 0.020494 | 13.62MiB/CPU-s | 257.87KiB/CPU-s | 3.33KiB/CPU-s | 0.0 | 0.018491 | False | False |
| fluent_elasticsearch | -175.88B/CPU-s | -0.0 | 24.80% | 45.41MiB/CPU-s | 29.9KiB/CPU-s | 391.01B/CPU-s | 0.0 | 0.000643 | 45.41MiB/CPU-s | 30.3KiB/CPU-s | 396.12B/CPU-s | 0.0 | 0.000652 | False | False |
| splunk_hec_indexer_ack_blackhole | -644.93B/CPU-s | -0.0 | 11.11% | 13.62MiB/CPU-s | 242.27KiB/CPU-s | 3.13KiB/CPU-s | 0.0 | 0.017372 | 13.62MiB/CPU-s | 251.8KiB/CPU-s | 3.25KiB/CPU-s | 0.0 | 0.018057 | False | False |
| splunk_hec_to_splunk_hec_logs_acks | 600.13B/CPU-s | 0.0 | 7.16% | 13.61MiB/CPU-s | 358.36KiB/CPU-s | 4.62KiB/CPU-s | 0.0 | 0.025704 | 13.61MiB/CPU-s | 356.77KiB/CPU-s | 4.6KiB/CPU-s | 0.0 | 0.025589 | False | False |
| file_to_blackhole | -17.13KiB/CPU-s | -0.03 | 57.93% | 54.5MiB/CPU-s | 1.09MiB/CPU-s | 14.43KiB/CPU-s | 0.0 | 0.020045 | 54.48MiB/CPU-s | 1.18MiB/CPU-s | 15.64KiB/CPU-s | 0.0 | 0.021746 | False | False |
| splunk_hec_route_s3 | -122.96KiB/CPU-s | -1.01 | 100.00% | 11.85MiB/CPU-s | 536.87KiB/CPU-s | 6.93KiB/CPU-s | 0.0 | 0.044238 | 11.73MiB/CPU-s | 528.16KiB/CPU-s | 6.82KiB/CPU-s | 0.0 | 0.043966 | False | False |
| syslog_log2metric_humio_metrics | -68.3KiB/CPU-s | -1.07 | 100.00% | 6.25MiB/CPU-s | 114.98KiB/CPU-s | 1.48KiB/CPU-s | 0.0 | 0.017961 | 6.18MiB/CPU-s | 213.92KiB/CPU-s | 2.76KiB/CPU-s | 0.0 | 0.033776 | False | False |
| datadog_agent_remap_datadog_logs | -433.47KiB/CPU-s | -1.22 | 100.00% | 34.77MiB/CPU-s | 1.12MiB/CPU-s | 14.8KiB/CPU-s | 0.0 | 0.032227 | 34.34MiB/CPU-s | 1.08MiB/CPU-s | 14.31KiB/CPU-s | 0.0 | 0.031544 | False | False |
| datadog_agent_remap_datadog_logs_acks | -446.4KiB/CPU-s | -1.27 | 100.00% | 34.31MiB/CPU-s | 917.59KiB/CPU-s | 11.84KiB/CPU-s | 0.0 | 0.026118 | 33.87MiB/CPU-s | 852.22KiB/CPU-s | 11.0KiB/CPU-s | 0.0 | 0.02457 | False | False |
| datadog_agent_remap_blackhole | -430.91KiB/CPU-s | -1.32 | 100.00% | 31.87MiB/CPU-s | 909.56KiB/CPU-s | 11.74KiB/CPU-s | 0.0 | 0.027869 | 31.45MiB/CPU-s | 854.79KiB/CPU-s | 11.03KiB/CPU-s | 0.0 | 0.026541 | False | False |
| syslog_splunk_hec_logs | -173.16KiB/CPU-s | -1.86 | 100.00% | 9.08MiB/CPU-s | 86.26KiB/CPU-s | 1.11KiB/CPU-s | 0.0 | 0.009279 | 8.91MiB/CPU-s | 290.87KiB/CPU-s | 3.75KiB/CPU-s | 0.0 | 0.031882 | False | False |
| http_text_to_http_json | -1003.01KiB/CPU-s | -3.92 | 100.00% | 24.99MiB/CPU-s | 571.76KiB/CPU-s | 7.38KiB/CPU-s | 0.0 | 0.022342 | 24.01MiB/CPU-s | 558.56KiB/CPU-s | 7.21KiB/CPU-s | 0.0 | 0.022716 | False | False |