vector icon indicating copy to clipboard operation
vector copied to clipboard

Published 20 hours ago • verified publisher icon vectordotdev

chore: Move TLS library to `vector-core`

Open bruceg opened this issue 1 year ago • 2 comments

This reduces the knot of feature flag dependencies for a relatively small but core library.

Basically, I was trying to run one of the unit tests with minimal flags, but gave up trying to figure out all of the needed "utils" flags I needed to run the test. This is the fruit of that frustration as it removes a number of those flags. Feel free to NAK if this is not the desired direction to take this.

bruceg avatar Aug 10 '22 00:08 bruceg

Deploy Preview for vector-project canceled.

Name Link
Latest commit 55b141c859918e388112f695c5f5a7fd01e4b1ed
Latest deploy log https://app.netlify.com/sites/vector-project/deploys/6307f1ee9a688a0008369684

netlify[bot] avatar Aug 10 '22 00:08 netlify[bot]

Soak Test Results

Baseline: 20d69b7a06bd2d76594ea4564743a35a24c5614b Comparison: e274c8f1d1ca461cd4d15345426ed9c120ad6b06 Total Vector CPUs: 4

Explanation

A soak test is an integrated performance test for vector in a repeatable rig, with varying configuration for vector. What follows is a statistical summary of a brief vector run for each configuration across SHAs given above. The goal of these tests are to determine, quickly, if vector performance is changed and to what degree by a pull request. Where appropriate units are scaled per-core.

The table below, if present, lists those experiments that have experienced a statistically significant change in their throughput performance between baseline and comparision SHAs, with 90.0% confidence OR have been detected as newly erratic. Negative values mean that baseline is faster, positive comparison. Results that do not exhibit more than a ±8.87% change in mean throughput are discarded. An experiment is erratic if its coefficient of variation is greater than 0.3. The abbreviated table will be omitted if no interesting changes are observed.

No interesting changes in throughput with confidence ≥ 90.00% and absolute Δ mean >= ±8.87%:

Fine details of change detection per experiment.
experiment Δ mean Δ mean % confidence baseline mean baseline stdev baseline stderr baseline outlier % baseline CoV comparison mean comparison stdev comparison stderr comparison outlier % comparison CoV erratic declared erratic
socket_to_socket_blackhole 906.08KiB 3.9 100.00% 22.7MiB 315.5KiB 6.44KiB 0 0.01357 23.59MiB 233.78KiB 4.77KiB 0 0.00967779 False False
http_text_to_http_json 1.07MiB 2.8 100.00% 38.35MiB 938.48KiB 19.16KiB 0 0.0238917 39.43MiB 840.5KiB 17.16KiB 0 0.0208143 False False
http_to_http_acks 295.01KiB 1.69 78.53% 17.05MiB 8.1MiB 169.37KiB 0 0.475056 17.33MiB 8.0MiB 166.85KiB 0 0.461571 True True
datadog_agent_remap_blackhole_acks 883.56KiB 1.34 100.00% 64.3MiB 4.48MiB 93.3KiB 0 0.0696818 65.16MiB 2.2MiB 46.04KiB 0 0.0337245 False False
syslog_log2metric_humio_metrics 146.89KiB 1.1 100.00% 13.06MiB 230.49KiB 4.7KiB 0 0.0172296 13.2MiB 491.09KiB 10.0KiB 0 0.0363112 False False
datadog_agent_remap_datadog_logs 563.19KiB 0.9 100.00% 61.21MiB 3.12MiB 65.48KiB 0 0.0510139 61.76MiB 5.0MiB 104.12KiB 0 0.0809377 False False
syslog_loki 130.02KiB 0.87 100.00% 14.62MiB 394.35KiB 8.07KiB 0 0.0263424 14.74MiB 740.58KiB 15.05KiB 0 0.0490438 False False
splunk_hec_route_s3 132.25KiB 0.7 95.27% 18.41MiB 2.3MiB 47.84KiB 0 0.124633 18.54MiB 2.22MiB 46.42KiB 0 0.119604 False False
http_pipelines_blackhole 8.64KiB 0.54 99.26% 1.55MiB 85.67KiB 1.75KiB 0 0.0539917 1.56MiB 132.98KiB 2.71KiB 0 0.0833518 False False
datadog_agent_remap_datadog_logs_acks 297.93KiB 0.47 99.35% 62.36MiB 2.97MiB 62.02KiB 0 0.0475528 62.65MiB 4.33MiB 90.22KiB 0 0.0691513 False False
splunk_hec_to_splunk_hec_logs_noack 18.19KiB 0.07 87.24% 23.82MiB 479.04KiB 9.78KiB 0 0.0196353 23.84MiB 335.37KiB 6.85KiB 0 0.0137362 False False
splunk_hec_indexer_ack_blackhole 12.87KiB 0.05 36.78% 23.74MiB 967.18KiB 19.66KiB 0 0.0397856 23.75MiB 901.68KiB 18.34KiB 0 0.0370714 False False
enterprise_http_to_http -3.52KiB -0.01 35.30% 23.85MiB 261.61KiB 5.34KiB 0 0.0107109 23.84MiB 270.5KiB 5.53KiB 0 0.0110767 False False
http_pipelines_blackhole_acks -582.97B -0.05 14.95% 1.16MiB 114.81KiB 2.34KiB 0 0.096748 1.16MiB 93.79KiB 1.91KiB 0 0.0790707 False False
file_to_blackhole -49.91KiB -0.05 35.28% 95.33MiB 3.51MiB 72.69KiB 0 0.0367835 95.28MiB 3.91MiB 81.26KiB 0 0.0409897 False False
splunk_hec_to_splunk_hec_logs_acks -11.8KiB -0.05 38.14% 23.76MiB 796.99KiB 16.22KiB 0 0.0327484 23.75MiB 849.81KiB 17.29KiB 0 0.0349356 False False
http_to_http_json -37.56KiB -0.15 99.60% 23.85MiB 346.68KiB 7.08KiB 0 0.0141943 23.81MiB 537.59KiB 10.98KiB 0 0.0220448 False False
fluent_elasticsearch -157.81KiB -0.19 100.00% 79.47MiB 51.83KiB 1.05KiB 0 0.000636797 79.32MiB 1.44MiB 29.56KiB 0 0.018108 False False
http_to_http_noack -96.3KiB -0.39 100.00% 23.85MiB 250.73KiB 5.13KiB 0 0.0102662 23.75MiB 1.06MiB 22.21KiB 0 0.044822 False False
syslog_splunk_hec_logs -240.23KiB -1.46 100.00% 16.07MiB 712.37KiB 14.5KiB 0 0.0432899 15.83MiB 645.81KiB 13.16KiB 0 0.039827 False False
syslog_humio_logs -291.76KiB -1.75 100.00% 16.31MiB 503.05KiB 10.27KiB 0 0.030108 16.03MiB 492.77KiB 10.09KiB 0 0.0300169 False False
syslog_log2metric_splunk_hec_metrics -333.81KiB -1.85 100.00% 17.63MiB 705.28KiB 14.36KiB 0 0.0390639 17.3MiB 660.87KiB 13.46KiB 0 0.0372937 False False
http_pipelines_no_grok_blackhole -231.76KiB -2.04 100.00% 11.1MiB 137.17KiB 2.8KiB 0 0.0120691 10.87MiB 1.12MiB 23.23KiB 0 0.102629 False False
syslog_regex_logs2metric_ddmetrics -305.65KiB -2.39 100.00% 12.48MiB 501.94KiB 10.24KiB 0 0.0392747 12.18MiB 500.76KiB 10.2KiB 0 0.0401422 False False
datadog_agent_remap_blackhole -1.84MiB -2.92 100.00% 63.03MiB 4.93MiB 102.73KiB 0 0.0782213 61.19MiB 4.93MiB 102.96KiB 0 0.0806169 False False

github-actions[bot] avatar Aug 10 '22 01:08 github-actions[bot]

Soak Test Results

Baseline: c5a94ffcb18da11f8471ce07d23377c641ef8de3 Comparison: a2f8c68036ca5230e9751d72d92ea3a6b139500c Total Vector CPUs: 4

Explanation

A soak test is an integrated performance test for vector in a repeatable rig, with varying configuration for vector. What follows is a statistical summary of a brief vector run for each configuration across SHAs given above. The goal of these tests are to determine, quickly, if vector performance is changed and to what degree by a pull request. Where appropriate units are scaled per-core.

The table below, if present, lists those experiments that have experienced a statistically significant change in their throughput performance between baseline and comparision SHAs, with 90.0% confidence OR have been detected as newly erratic. Negative values mean that baseline is faster, positive comparison. Results that do not exhibit more than a ±8.87% change in mean throughput are discarded. An experiment is erratic if its coefficient of variation is greater than 0.3. The abbreviated table will be omitted if no interesting changes are observed.

No interesting changes in throughput with confidence ≥ 90.00% and absolute Δ mean >= ±8.87%:

Fine details of change detection per experiment.
experiment Δ mean Δ mean % confidence baseline mean baseline stdev baseline stderr baseline outlier % baseline CoV comparison mean comparison stdev comparison stderr comparison outlier % comparison CoV erratic declared erratic
syslog_loki 325.81KiB 2.25 100.00% 14.15MiB 753.93KiB 15.43KiB 0 0.0520172 14.47MiB 943.21KiB 19.17KiB 0 0.0636458 False False
socket_to_socket_blackhole 475.39KiB 2 100.00% 23.24MiB 449.08KiB 9.17KiB 0 0.0188681 23.7MiB 143.51KiB 2.93KiB 0 0.0059113 False False
syslog_regex_logs2metric_ddmetrics 204.88KiB 1.65 100.00% 12.13MiB 563.34KiB 11.47KiB 0 0.0453544 12.33MiB 572.22KiB 11.66KiB 0 0.0453213 False False
http_to_http_acks 198.76KiB 1.13 59.37% 17.23MiB 8.11MiB 169.59KiB 0 0.470815 17.42MiB 8.09MiB 168.85KiB 0 0.464214 True True
http_text_to_http_json 440.61KiB 1.1 100.00% 39.29MiB 771.54KiB 15.75KiB 0 0.0191729 39.72MiB 742.9KiB 15.16KiB 0 0.0182612 False False
splunk_hec_route_s3 150.45KiB 0.79 97.93% 18.64MiB 2.23MiB 46.48KiB 0 0.119742 18.78MiB 2.17MiB 45.42KiB 0 0.115522 False False
syslog_humio_logs 85.46KiB 0.52 100.00% 16.0MiB 672.83KiB 13.73KiB 0 0.0410601 16.08MiB 713.23KiB 14.6KiB 0 0.0432995 False False
http_pipelines_blackhole_acks 4.35KiB 0.39 89.10% 1.1MiB 110.37KiB 2.25KiB 0 0.0980749 1.1MiB 74.9KiB 1.53KiB 0 0.0662971 False False
splunk_hec_to_splunk_hec_logs_noack 21.82KiB 0.09 92.46% 23.82MiB 496.42KiB 10.13KiB 0 0.0203505 23.84MiB 338.76KiB 6.92KiB 0 0.0138749 False False
splunk_hec_to_splunk_hec_logs_acks 9.23KiB 0.04 31.01% 23.76MiB 820.56KiB 16.69KiB 0 0.0337232 23.77MiB 786.64KiB 16.01KiB 0 0.032317 False False
datadog_agent_remap_blackhole 4.26KiB 0.01 3.22% 59.7MiB 4.11MiB 85.53KiB 0 0.0687566 59.7MiB 2.94MiB 61.43KiB 0 0.0493016 False False
splunk_hec_indexer_ack_blackhole -1.97KiB -0.01 6.86% 23.77MiB 779.12KiB 15.86KiB 0 0.032004 23.77MiB 806.46KiB 16.41KiB 0 0.0331298 False False
enterprise_http_to_http -5.09KiB -0.02 49.77% 23.85MiB 261.03KiB 5.33KiB 0 0.0106871 23.84MiB 264.25KiB 5.41KiB 0 0.0108209 False False
file_to_blackhole -47.12KiB -0.05 41.48% 95.34MiB 2.76MiB 57.12KiB 0 0.0288937 95.3MiB 3.11MiB 64.71KiB 0 0.0326483 False False
syslog_splunk_hec_logs -20.23KiB -0.13 58.25% 15.75MiB 928.54KiB 18.89KiB 0 0.0575454 15.73MiB 799.63KiB 16.31KiB 0 0.0496185 False False
http_to_http_json -31.34KiB -0.13 98.47% 23.84MiB 357.09KiB 7.29KiB 0 0.0146227 23.81MiB 522.41KiB 10.67KiB 0 0.0214199 False False
datadog_agent_remap_blackhole_acks -137.34KiB -0.21 76.63% 63.83MiB 4.46MiB 92.87KiB 0 0.0698647 63.7MiB 3.27MiB 68.35KiB 0 0.0513331 False False
syslog_log2metric_splunk_hec_metrics -36.92KiB -0.21 76.63% 17.14MiB 952.66KiB 19.41KiB 0 0.0542674 17.1MiB 1.16MiB 24.18KiB 0 0.0678361 False False
http_pipelines_blackhole -5.22KiB -0.32 98.05% 1.62MiB 32.88KiB 688.01B 0 0.0198766 1.61MiB 104.62KiB 2.13KiB 0 0.0634443 False False
syslog_log2metric_humio_metrics -51.68KiB -0.4 99.56% 12.56MiB 487.21KiB 9.95KiB 0 0.0378725 12.51MiB 746.09KiB 15.19KiB 0 0.058231 False False
http_to_http_noack -122.89KiB -0.5 100.00% 23.84MiB 404.76KiB 8.27KiB 0 0.0165783 23.72MiB 1.23MiB 25.65KiB 0 0.0518879 False False
fluent_elasticsearch -469.27KiB -0.58 100.00% 79.47MiB 53.08KiB 1.07KiB 0 0.000652096 79.01MiB 4.64MiB 95.35KiB 0 0.0587342 False False
datadog_agent_remap_datadog_logs_acks -706.5KiB -1.08 100.00% 63.59MiB 3.36MiB 70.15KiB 0 0.0527879 62.9MiB 4.46MiB 92.84KiB 0 0.0708879 False False
datadog_agent_remap_datadog_logs -940.61KiB -1.44 100.00% 63.92MiB 435.54KiB 8.91KiB 0 0.00665257 63.0MiB 3.88MiB 80.83KiB 0 0.0615559 False False
http_pipelines_no_grok_blackhole -250.5KiB -2.16 100.00% 11.31MiB 51.69KiB 1.06KiB 0 0.00446423 11.06MiB 1.13MiB 23.46KiB 0 0.101876 False False

github-actions[bot] avatar Aug 10 '22 23:08 github-actions[bot]

Soak Test Results

Baseline: d8fd8b891abd29682c54314f329a57638095e8ff Comparison: 55b141c859918e388112f695c5f5a7fd01e4b1ed Total Vector CPUs: 4

Explanation

A soak test is an integrated performance test for vector in a repeatable rig, with varying configuration for vector. What follows is a statistical summary of a brief vector run for each configuration across SHAs given above. The goal of these tests are to determine, quickly, if vector performance is changed and to what degree by a pull request. Where appropriate units are scaled per-core.

The table below, if present, lists those experiments that have experienced a statistically significant change in their throughput performance between baseline and comparision SHAs, with 90.0% confidence OR have been detected as newly erratic. Negative values mean that baseline is faster, positive comparison. Results that do not exhibit more than a ±8.87% change in mean throughput are discarded. An experiment is erratic if its coefficient of variation is greater than 0.3. The abbreviated table will be omitted if no interesting changes are observed.

No interesting changes in throughput with confidence ≥ 90.00% and absolute Δ mean >= ±8.87%:

Fine details of change detection per experiment.
experiment Δ mean Δ mean % confidence baseline mean baseline stdev baseline stderr baseline outlier % baseline CoV comparison mean comparison stdev comparison stderr comparison outlier % comparison CoV erratic declared erratic
http_text_to_http_json 1.28MiB 3.2 100.00% 40.04MiB 695.59KiB 14.2KiB 0 0.0169612 41.32MiB 760.4KiB 15.52KiB 0 0.0179675 False False
http_pipelines_no_grok_blackhole 206.84KiB 1.96 100.00% 10.3MiB 889.62KiB 18.16KiB 0 0.0843699 10.5MiB 1.21MiB 25.25KiB 0 0.1155 False False
socket_to_socket_blackhole 460.95KiB 1.92 100.00% 23.42MiB 447.09KiB 9.13KiB 0 0.0186384 23.87MiB 464.86KiB 9.49KiB 0 0.0190138 False False
splunk_hec_route_s3 206.67KiB 1.08 99.84% 18.7MiB 2.26MiB 47.14KiB 0 0.120996 18.91MiB 2.18MiB 45.52KiB 0 0.115096 False False
syslog_regex_logs2metric_ddmetrics 65.93KiB 0.51 100.00% 12.56MiB 530.96KiB 10.82KiB 0 0.0412607 12.63MiB 507.95KiB 10.36KiB 0 0.0392719 False False
syslog_humio_logs 77.73KiB 0.46 100.00% 16.4MiB 313.08KiB 6.39KiB 0 0.0186418 16.47MiB 297.76KiB 6.1KiB 0 0.0176481 False False
syslog_splunk_hec_logs 46.73KiB 0.28 99.11% 16.46MiB 697.61KiB 14.2KiB 0 0.041384 16.5MiB 529.42KiB 10.81KiB 0 0.0313196 False False
syslog_log2metric_splunk_hec_metrics 46.69KiB 0.26 98.82% 17.72MiB 529.09KiB 10.78KiB 0 0.0291485 17.77MiB 739.99KiB 15.07KiB 0 0.0406629 False False
splunk_hec_to_splunk_hec_logs_noack 16.05KiB 0.07 84.02% 23.82MiB 448.95KiB 9.17KiB 0 0.0184005 23.84MiB 333.11KiB 6.8KiB 0 0.0136437 False False
splunk_hec_to_splunk_hec_logs_acks 51.46B 0 0.18% 23.77MiB 781.19KiB 15.9KiB 0 0.0320911 23.77MiB 777.43KiB 15.82KiB 0 0.0319367 False False
splunk_hec_indexer_ack_blackhole 375.48B 0 1.24% 23.76MiB 815.26KiB 16.59KiB 0 0.0334977 23.76MiB 828.6KiB 16.86KiB 0 0.0340452 False False
enterprise_http_to_http -1.84KiB -0.01 20.19% 23.85MiB 246.54KiB 5.03KiB 0 0.0100941 23.85MiB 250.66KiB 5.13KiB 0 0.0102635 False False
file_to_blackhole -40.23KiB -0.04 38.99% 95.36MiB 2.48MiB 51.39KiB 0 0.0259882 95.33MiB 2.88MiB 59.86KiB 0 0.0301773 False False
http_to_http_json -34.38KiB -0.14 99.45% 23.85MiB 324.97KiB 6.63KiB 0 0.0133049 23.81MiB 512.05KiB 10.46KiB 0 0.0209943 False False
datadog_agent_remap_blackhole -131.72KiB -0.2 83.96% 63.2MiB 3.56MiB 74.32KiB 0 0.0563377 63.07MiB 2.74MiB 57.26KiB 0 0.043491 False False
syslog_log2metric_humio_metrics -25.62KiB -0.2 91.34% 12.71MiB 370.55KiB 7.56KiB 0 0.0284611 12.69MiB 633.37KiB 12.89KiB 0 0.0487441 False False
fluent_elasticsearch -200.7KiB -0.25 100.00% 79.47MiB 53.63KiB 1.09KiB 0 0.000658822 79.28MiB 1.77MiB 36.44KiB 0 0.022328 False False
datadog_agent_remap_blackhole_acks -253.61KiB -0.41 87.83% 61.01MiB 6.0MiB 124.95KiB 0 0.0983061 60.76MiB 5.06MiB 105.95KiB 0 0.0832942 False False
http_pipelines_blackhole_acks -5.07KiB -0.43 88.70% 1.16MiB 119.81KiB 2.44KiB 0 0.100595 1.16MiB 101.47KiB 2.07KiB 0 0.0855623 False False
http_to_http_noack -116.16KiB -0.48 100.00% 23.84MiB 330.6KiB 6.77KiB 0 0.0135398 23.73MiB 1.19MiB 24.8KiB 0 0.0501333 False False
datadog_agent_remap_datadog_logs -402.54KiB -0.64 100.00% 61.79MiB 1.44MiB 30.23KiB 0 0.0233331 61.4MiB 4.37MiB 91.02KiB 0 0.0711831 False False
http_pipelines_blackhole -16.37KiB -0.94 100.00% 1.69MiB 10.37KiB 217.21B 0 0.00597687 1.68MiB 106.85KiB 2.18KiB 0 0.0621434 False False
syslog_loki -148.72KiB -0.97 100.00% 14.98MiB 278.59KiB 5.71KiB 0 0.0181523 14.84MiB 736.77KiB 14.98KiB 0 0.0484769 False False
datadog_agent_remap_datadog_logs_acks -861.19KiB -1.41 100.00% 59.85MiB 3.08MiB 64.47KiB 0 0.051506 59.01MiB 4.39MiB 91.47KiB 0 0.0744492 False False
http_to_http_acks -313.98KiB -1.77 81.75% 17.37MiB 7.92MiB 165.54KiB 0 0.455852 17.06MiB 8.02MiB 167.47KiB 0 0.470033 True True

github-actions[bot] avatar Aug 25 '22 23:08 github-actions[bot]