vector icon indicating copy to clipboard operation
vector copied to clipboard

chore(log_to_metric transform): Audit log_to_metric transform

Open fuchsnj opened this issue 1 year ago • 1 comments

closes https://github.com/vectordotdev/vector/issues/14067

There were some minor changes to when an event is considered "dropped" with this transform. A single event can generate multiple metrics. If a single metric fails, the event is dropped and no metrics are published.

fuchsnj avatar Sep 20 '22 20:09 fuchsnj

Deploy Preview for vector-project canceled.

Name Link
Latest commit 4f6ea43f0ce7f9acda0ca0cf2896af0020b4bc79
Latest deploy log https://app.netlify.com/sites/vector-project/deploys/63403c53073b0c0009f2e62c

netlify[bot] avatar Sep 20 '22 20:09 netlify[bot]

Soak Test Results

Baseline: 7b26f65c6bde9fe824ea15948fa0147cf026db5e Comparison: d58f3dc7183205a084f98f2748656a088ffe5d83 Total Vector CPUs: 4

Explanation

A soak test is an integrated performance test for vector in a repeatable rig, with varying configuration for vector. What follows is a statistical summary of a brief vector run for each configuration across SHAs given above. The goal of these tests are to determine, quickly, if vector performance is changed and to what degree by a pull request. Where appropriate units are scaled per-core.

The table below, if present, lists those experiments that have experienced a statistically significant change in their throughput performance between baseline and comparision SHAs, with 90.0% confidence OR have been detected as newly erratic. Negative values mean that baseline is faster, positive comparison. Results that do not exhibit more than a ±8.87% change in mean throughput are discarded. An experiment is erratic if its coefficient of variation is greater than 0.3. The abbreviated table will be omitted if no interesting changes are observed.

No interesting changes in throughput with confidence ≥ 90.00% and absolute Δ mean >= ±8.87%:

Fine details of change detection per experiment.
experiment Δ mean Δ mean % confidence baseline mean baseline stdev baseline stderr baseline outlier % baseline CoV comparison mean comparison stdev comparison stderr comparison outlier % comparison CoV erratic declared erratic
syslog_log2metric_splunk_hec_metrics 432.36KiB 2.57 100.00% 16.45MiB 843.12KiB 17.19KiB 0 0.0500354 16.87MiB 1.09MiB 22.71KiB 0 0.0646003 False False
http_pipelines_blackhole_acks 24.96KiB 2.15 100.00% 1.13MiB 110.78KiB 2.26KiB 0 0.0954338 1.16MiB 83.78KiB 1.71KiB 0 0.0706492 False False
syslog_log2metric_humio_metrics 274.43KiB 2.13 100.00% 12.57MiB 435.7KiB 8.9KiB 0 0.0338497 12.84MiB 531.5KiB 10.82KiB 0 0.0404309 False False
syslog_humio_logs 262.87KiB 1.6 100.00% 16.01MiB 813.1KiB 16.6KiB 0 0.0495761 16.27MiB 772.86KiB 15.83KiB 0 0.0463793 False False
splunk_hec_route_s3 223.58KiB 1.2 99.82% 18.25MiB 2.43MiB 50.65KiB 0 0.133258 18.47MiB 2.42MiB 50.71KiB 0 0.131197 False False
syslog_splunk_hec_logs 127.1KiB 0.78 100.00% 15.93MiB 854.62KiB 17.39KiB 0 0.0523964 16.05MiB 785.67KiB 16.03KiB 0 0.0477965 False False
http_text_to_http_json 61.17KiB 0.15 97.27% 39.24MiB 984.47KiB 20.1KiB 0 0.0244941 39.3MiB 934.77KiB 19.08KiB 0 0.0232223 False False
syslog_regex_logs2metric_ddmetrics 12.09KiB 0.1 52.87% 12.38MiB 578.25KiB 11.78KiB 0 0.0456159 12.39MiB 587.24KiB 11.96KiB 0 0.0462815 False False
splunk_hec_to_splunk_hec_logs_noack 13.57KiB 0.06 76.23% 23.82MiB 454.75KiB 9.28KiB 0 0.0186363 23.84MiB 332.38KiB 6.78KiB 0 0.0136138 False False
splunk_hec_to_splunk_hec_logs_acks 9.82KiB 0.04 31.14% 23.75MiB 867.43KiB 17.64KiB 0 0.0356632 23.76MiB 835.48KiB 17.0KiB 0 0.0343354 False False
enterprise_http_to_http -1.21KiB -0 12.61% 23.85MiB 263.51KiB 5.38KiB 0 0.0107892 23.84MiB 262.4KiB 5.37KiB 0 0.0107443 False False
file_to_blackhole -55.64KiB -0.06 48.87% 95.34MiB 2.81MiB 58.24KiB 0 0.0294622 95.29MiB 2.96MiB 61.52KiB 0 0.0310418 False False
splunk_hec_indexer_ack_blackhole -16.14KiB -0.07 46.74% 23.76MiB 858.55KiB 17.47KiB 0 0.03528 23.74MiB 937.29KiB 19.07KiB 0 0.0385414 False False
datadog_agent_remap_blackhole -44.91KiB -0.07 26.34% 58.91MiB 4.84MiB 100.86KiB 0 0.0821873 58.86MiB 4.19MiB 87.46KiB 0 0.0712447 False False
http_to_http_json -26.97KiB -0.11 97.78% 23.85MiB 333.27KiB 6.8KiB 0 0.0136447 23.82MiB 470.94KiB 9.63KiB 0 0.0193027 False False
datadog_agent_remap_blackhole_acks -83.38KiB -0.14 58.71% 60.24MiB 4.16MiB 86.61KiB 0 0.06905 60.15MiB 2.56MiB 53.51KiB 0 0.0425021 False False
fluent_elasticsearch -285.29KiB -0.35 100.00% 79.47MiB 53.45KiB 1.08KiB 0 0.000656603 79.19MiB 3.05MiB 62.65KiB 0 0.0384972 False False
http_to_http_noack -92.48KiB -0.38 99.99% 23.84MiB 403.25KiB 8.24KiB 0 0.0165176 23.75MiB 1.09MiB 22.64KiB 0 0.0457212 False False
http_pipelines_no_grok_blackhole -53.89KiB -0.51 98.97% 10.37MiB 109.16KiB 2.23KiB 0 0.010281 10.31MiB 1.0MiB 20.87KiB 0 0.0971372 False False
http_to_http_acks -114.39KiB -0.65 38.01% 17.28MiB 7.67MiB 160.41KiB 0 0.443955 17.17MiB 7.94MiB 165.68KiB 0 0.462393 True True
socket_to_socket_blackhole -251.75KiB -1.12 100.00% 21.94MiB 1.32MiB 27.67KiB 0 0.0603258 21.69MiB 1.11MiB 23.22KiB 0 0.051195 False False
syslog_loki -176.55KiB -1.21 100.00% 14.23MiB 689.85KiB 14.13KiB 0 0.0473291 14.06MiB 827.12KiB 16.81KiB 0 0.0574432 False False
datadog_agent_remap_datadog_logs -856.78KiB -1.38 100.00% 60.64MiB 912.56KiB 18.68KiB 0 0.0146933 59.8MiB 4.23MiB 88.04KiB 0 0.0707093 False False
http_pipelines_blackhole -27.42KiB -1.7 100.00% 1.57MiB 149.06KiB 3.05KiB 0 0.09255 1.55MiB 190.58KiB 3.88KiB 0 0.120378 False False
datadog_agent_remap_datadog_logs_acks -1.08MiB -1.77 100.00% 60.93MiB 4.41MiB 92.18KiB 0 0.072333 59.85MiB 5.34MiB 111.06KiB 0 0.0891247 False False

github-actions[bot] avatar Sep 21 '22 22:09 github-actions[bot]