vector icon indicating copy to clipboard operation
vector copied to clipboard

chore(metric_to_log transform): Audit metric_to_log transform

Open fuchsnj opened this issue 2 years ago • 1 comments

closes https://github.com/vectordotdev/vector/issues/14069

fuchsnj avatar Sep 20 '22 19:09 fuchsnj

Deploy Preview for vector-project ready!

Name Link
Latest commit b8b3fb5c78d5e4acb7679706563cf776eca749d5
Latest deploy log https://app.netlify.com/sites/vector-project/deploys/632a1af033ce170009b25c5d
Deploy Preview https://deploy-preview-14486--vector-project.netlify.app
Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify site settings.

netlify[bot] avatar Sep 20 '22 19:09 netlify[bot]

Soak Test Results

Baseline: 9cf1ea9b08ed745e3872c1cc81757f6078c82419 Comparison: b8b3fb5c78d5e4acb7679706563cf776eca749d5 Total Vector CPUs: 4

Explanation

A soak test is an integrated performance test for vector in a repeatable rig, with varying configuration for vector. What follows is a statistical summary of a brief vector run for each configuration across SHAs given above. The goal of these tests are to determine, quickly, if vector performance is changed and to what degree by a pull request. Where appropriate units are scaled per-core.

The table below, if present, lists those experiments that have experienced a statistically significant change in their throughput performance between baseline and comparision SHAs, with 90.0% confidence OR have been detected as newly erratic. Negative values mean that baseline is faster, positive comparison. Results that do not exhibit more than a ±8.87% change in mean throughput are discarded. An experiment is erratic if its coefficient of variation is greater than 0.3. The abbreviated table will be omitted if no interesting changes are observed.

No interesting changes in throughput with confidence ≥ 90.00% and absolute Δ mean >= ±8.87%:

Fine details of change detection per experiment.
experiment Δ mean Δ mean % confidence baseline mean baseline stdev baseline stderr baseline outlier % baseline CoV comparison mean comparison stdev comparison stderr comparison outlier % comparison CoV erratic declared erratic
syslog_loki 362.9KiB 2.5 100.00% 14.18MiB 455.48KiB 9.32KiB 0 0.031373 14.53MiB 772.52KiB 15.7KiB 0 0.0519128 False False
http_pipelines_blackhole_acks 14.72KiB 1.24 100.00% 1.16MiB 124.76KiB 2.54KiB 0 0.10544 1.17MiB 91.4KiB 1.86KiB 0 0.0763007 False False
http_text_to_http_json 491.36KiB 1.21 100.00% 39.52MiB 764.8KiB 15.61KiB 0 0.0188941 40.0MiB 730.88KiB 14.92KiB 0 0.0178393 False False
socket_to_socket_blackhole 244.28KiB 1.03 100.00% 23.14MiB 187.67KiB 3.83KiB 0 0.00791864 23.38MiB 131.9KiB 2.69KiB 0 0.00550886 False False
http_to_http_acks 148.4KiB 0.85 46.43% 17.06MiB 8.22MiB 171.93KiB 0 0.481819 17.21MiB 8.0MiB 166.88KiB 0 0.464876 True True
http_pipelines_no_grok_blackhole 50.4KiB 0.46 98.52% 10.69MiB 130.35KiB 2.66KiB 0 0.0119032 10.74MiB 1007.15KiB 20.49KiB 0 0.091547 False False
datadog_agent_remap_datadog_logs_acks 201.45KiB 0.32 90.75% 61.03MiB 3.63MiB 75.74KiB 0 0.0594313 61.23MiB 4.46MiB 92.74KiB 0 0.0727502 False False
syslog_regex_logs2metric_ddmetrics 38.83KiB 0.3 97.90% 12.53MiB 598.77KiB 12.2KiB 0 0.0466483 12.57MiB 568.11KiB 11.57KiB 0 0.0441263 False False
splunk_hec_to_splunk_hec_logs_noack 15.34KiB 0.06 81.11% 23.82MiB 466.65KiB 9.52KiB 0 0.0191261 23.84MiB 330.61KiB 6.75KiB 0 0.0135419 False False
enterprise_http_to_http 261.71B 0 2.79% 23.84MiB 252.29KiB 5.15KiB 0 0.0103304 23.84MiB 253.56KiB 5.19KiB 0 0.0103822 False False
datadog_agent_remap_blackhole_acks -6.76KiB -0.01 4.34% 60.69MiB 4.64MiB 96.71KiB 0 0.0765064 60.68MiB 3.74MiB 78.26KiB 0 0.0616887 False False
splunk_hec_to_splunk_hec_logs_acks -6.82KiB -0.03 22.67% 23.76MiB 805.93KiB 16.4KiB 0 0.0331156 23.75MiB 838.78KiB 17.06KiB 0 0.0344751 False False
splunk_hec_indexer_ack_blackhole -7.09KiB -0.03 24.04% 23.77MiB 773.87KiB 15.75KiB 0 0.03179 23.76MiB 835.1KiB 16.99KiB 0 0.0343153 False False
splunk_hec_route_s3 -9.88KiB -0.05 11.86% 18.78MiB 2.29MiB 47.73KiB 0 0.121981 18.78MiB 2.19MiB 45.91KiB 0 0.116874 False False
file_to_blackhole -62.19KiB -0.06 50.73% 95.34MiB 2.89MiB 59.9KiB 0 0.0303013 95.28MiB 3.27MiB 68.04KiB 0 0.0343361 False False
http_to_http_json -21.61KiB -0.09 94.62% 23.85MiB 343.41KiB 7.01KiB 0 0.0140609 23.82MiB 427.7KiB 8.74KiB 0 0.0175275 False False
fluent_elasticsearch -141.48KiB -0.17 100.00% 79.47MiB 52.19KiB 1.06KiB 0 0.000641137 79.33MiB 1.24MiB 25.47KiB 0 0.0156037 False False
datadog_agent_remap_blackhole -166.29KiB -0.27 90.28% 59.96MiB 3.93MiB 81.81KiB 0 0.0654588 59.8MiB 2.77MiB 57.9KiB 0 0.046392 False False
http_to_http_noack -78.05KiB -0.32 99.98% 23.85MiB 253.33KiB 5.18KiB 0 0.0103726 23.77MiB 984.23KiB 20.05KiB 0 0.040429 False False
syslog_humio_logs -58.42KiB -0.34 100.00% 16.59MiB 117.25KiB 2.39KiB 0 0.0069003 16.53MiB 117.76KiB 2.41KiB 0 0.00695398 False False
syslog_log2metric_humio_metrics -45.82KiB -0.36 99.16% 12.43MiB 541.72KiB 11.06KiB 0 0.0425365 12.39MiB 658.71KiB 13.42KiB 0 0.0519098 False False
datadog_agent_remap_datadog_logs -231.11KiB -0.36 99.29% 62.26MiB 560.47KiB 11.47KiB 0 0.00878927 62.03MiB 4.08MiB 85.03KiB 0 0.0657932 False False
http_pipelines_blackhole -8.04KiB -0.46 99.96% 1.7MiB 22.55KiB 471.99B 0 0.012948 1.69MiB 108.0KiB 2.2KiB 0 0.0622954 False False
syslog_log2metric_splunk_hec_metrics -151.03KiB -0.84 100.00% 17.51MiB 547.92KiB 11.17KiB 0 0.0305462 17.37MiB 764.7KiB 15.56KiB 0 0.0429939 False False
syslog_splunk_hec_logs -357.61KiB -2.29 100.00% 15.26MiB 1.58MiB 32.83KiB 0 0.103267 14.91MiB 1.67MiB 34.77KiB 0 0.111747 False False

github-actions[bot] avatar Sep 21 '22 21:09 github-actions[bot]