Closes #3649

Adds multiple endpoints feature for elasticsearch sink using distributed service added in #13918.

#13236 was the original PR which got split into two, #13918 and this one.

Aug 23 '22 22:08 ktff

Deploy Preview for vector-project ready!

Name	Link
Latest commit	0e302e6e4f6101bce5109688c21b3c7ed3505b22
Latest deploy log	https://app.netlify.com/sites/vector-project/deploys/6334aef480fa1800096f1353
Deploy Preview	https://deploy-preview-14088--vector-project.netlify.app
Preview on mobile	Toggle QR Code... Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify site settings.

Aug 23 '22 22:08 netlify[bot]

Soak Test Results

Baseline: 92dfb84a47eff94a85e49f8eea8278d35b550c04 Comparison: f01f4d8e5202cc44f82168a6ae1e8a5745be4e94 Total Vector CPUs: 4

Explanation

A soak test is an integrated performance test for vector in a repeatable rig, with varying configuration for vector. What follows is a statistical summary of a brief vector run for each configuration across SHAs given above. The goal of these tests are to determine, quickly, if vector performance is changed and to what degree by a pull request. Where appropriate units are scaled per-core.

The table below, if present, lists those experiments that have experienced a statistically significant change in their throughput performance between baseline and comparision SHAs, with 90.0% confidence OR have been detected as newly erratic. Negative values mean that baseline is faster, positive comparison. Results that do not exhibit more than a ±8.87% change in mean throughput are discarded. An experiment is erratic if its coefficient of variation is greater than 0.3. The abbreviated table will be omitted if no interesting changes are observed.

No interesting changes in throughput with confidence ≥ 90.00% and absolute Δ mean >= ±8.87%:

Fine details of change detection per experiment.

experiment	Δ mean	Δ mean %	confidence	baseline mean	baseline stdev	baseline stderr	baseline CoV	comparison mean	comparison stdev	comparison stderr	comparison CoV	erratic	declared erratic
splunk_hec_route_s3	48.94KiB	0.28	43.44%	17.19MiB	2.88MiB	60.01KiB	0.167586	17.24MiB	2.89MiB	60.47KiB	0.167752	False	False
syslog_log2metric_humio_metrics	26.55KiB	0.21	88.71%	12.51MiB	483.88KiB	9.88KiB	0.037752	12.54MiB	664.04KiB	13.52KiB	0.0517002	False	False
splunk_hec_to_splunk_hec_logs_noack	15.17KiB	0.06	80.24%	23.82MiB	464.52KiB	9.49KiB	0.0190378	23.84MiB	341.26KiB	6.97KiB	0.0139773	False	False
splunk_hec_indexer_ack_blackhole	691.66B	0	2.17%	23.76MiB	870.08KiB	17.7KiB	0.0357607	23.76MiB	852.57KiB	17.35KiB	0.03504	False	False
enterprise_http_to_http	-1001.69B	-0	10.91%	23.85MiB	246.97KiB	5.04KiB	0.0101119	23.85MiB	246.28KiB	5.04KiB	0.0100837	False	False
splunk_hec_to_splunk_hec_logs_acks	-5.21KiB	-0.02	16.02%	23.76MiB	887.1KiB	18.04KiB	0.0364563	23.75MiB	904.41KiB	18.39KiB	0.0371756	False	False
file_to_blackhole	-45.77KiB	-0.05	35.68%	95.34MiB	3.09MiB	63.96KiB	0.0323537	95.3MiB	3.62MiB	75.3KiB	0.0379547	False	False
http_to_http_json	-28.55KiB	-0.12	98.10%	23.85MiB	333.86KiB	6.82KiB	0.0136702	23.82MiB	493.23KiB	10.08KiB	0.0202194	False	False
http_pipelines_blackhole_acks	-1.51KiB	-0.12	39.94%	1.22MiB	111.44KiB	2.27KiB	0.0889014	1.22MiB	87.38KiB	1.78KiB	0.0697953	False	False
fluent_elasticsearch	-195.25KiB	-0.24	100.00%	79.47MiB	53.25KiB	1.08KiB	0.000654234	79.28MiB	1.67MiB	34.32KiB	0.0210383	False	False
http_to_http_noack	-58.55KiB	-0.24	99.55%	23.84MiB	404.28KiB	8.26KiB	0.0165598	23.78MiB	925.95KiB	18.87KiB	0.0380191	False	False
datadog_agent_remap_blackhole_acks	-222.34KiB	-0.37	97.01%	58.15MiB	3.99MiB	83.1KiB	0.0686248	57.93MiB	2.86MiB	59.71KiB	0.0493031	False	False
syslog_humio_logs	-75.26KiB	-0.45	99.99%	16.32MiB	681.91KiB	13.92KiB	0.0407989	16.25MiB	612.85KiB	12.55KiB	0.0368326	False	False
syslog_regex_logs2metric_ddmetrics	-80.78KiB	-0.63	100.00%	12.47MiB	680.72KiB	13.87KiB	0.053288	12.39MiB	679.26KiB	13.85KiB	0.0535123	False	False
http_pipelines_no_grok_blackhole	-79.93KiB	-0.71	99.92%	11.0MiB	265.05KiB	5.41KiB	0.0235281	10.92MiB	1.11MiB	23.18KiB	0.101923	False	False
datadog_agent_remap_datadog_logs_acks	-578.68KiB	-0.92	100.00%	61.68MiB	3.14MiB	65.64KiB	0.0509006	61.11MiB	4.33MiB	90.1KiB	0.0708111	False	False
datadog_agent_remap_datadog_logs	-763.15KiB	-1.19	100.00%	62.45MiB	574.63KiB	11.77KiB	0.00898372	61.71MiB	4.29MiB	89.25KiB	0.0694572	False	False
syslog_splunk_hec_logs	-205.29KiB	-1.24	100.00%	16.17MiB	1.07MiB	22.39KiB	0.06647	15.96MiB	998.04KiB	20.37KiB	0.0610372	False	False
http_pipelines_blackhole	-24.48KiB	-1.4	100.00%	1.71MiB	12.81KiB	268.17B	0.00733521	1.68MiB	131.49KiB	2.68KiB	0.0763578	False	False
datadog_agent_remap_blackhole	-919.79KiB	-1.49	100.00%	60.41MiB	4.66MiB	97.02KiB	0.077068	59.52MiB	3.95MiB	82.4KiB	0.0663303	False	False
http_to_http_acks	-321.62KiB	-1.81	82.96%	17.33MiB	7.74MiB	161.86KiB	0.446862	17.01MiB	8.13MiB	169.8KiB	0.477927	True	True
syslog_log2metric_splunk_hec_metrics	-370.09KiB	-2.06	100.00%	17.57MiB	1007.59KiB	20.52KiB	0.0560037	17.2MiB	1.21MiB	25.19KiB	0.070277	False	False
socket_to_socket_blackhole	-695.76KiB	-2.85	100.00%	23.88MiB	247.95KiB	5.06KiB	0.0101367	23.2MiB	194.59KiB	3.97KiB	0.00818834	False	False
syslog_loki	-538.11KiB	-3.63	100.00%	14.48MiB	578.79KiB	11.85KiB	0.0390133	13.96MiB	846.67KiB	17.21KiB	0.0592182	False	False
http_text_to_http_json	-1.44MiB	-3.9	100.00%	36.95MiB	2.74MiB	57.28KiB	0.0741794	35.51MiB	2.47MiB	51.68KiB	0.0696324	False	False

Aug 24 '22 00:08 github-actions[bot]

Soak Test Results

Baseline: 92dfb84a47eff94a85e49f8eea8278d35b550c04 Comparison: 9c7eb82d75bb0e90337196c1d5b0602e9a1fcb57 Total Vector CPUs: 4

Explanation

A soak test is an integrated performance test for vector in a repeatable rig, with varying configuration for vector. What follows is a statistical summary of a brief vector run for each configuration across SHAs given above. The goal of these tests are to determine, quickly, if vector performance is changed and to what degree by a pull request. Where appropriate units are scaled per-core.

The table below, if present, lists those experiments that have experienced a statistically significant change in their throughput performance between baseline and comparision SHAs, with 90.0% confidence OR have been detected as newly erratic. Negative values mean that baseline is faster, positive comparison. Results that do not exhibit more than a ±8.87% change in mean throughput are discarded. An experiment is erratic if its coefficient of variation is greater than 0.3. The abbreviated table will be omitted if no interesting changes are observed.

No interesting changes in throughput with confidence ≥ 90.00% and absolute Δ mean >= ±8.87%:

Fine details of change detection per experiment.

experiment	Δ mean	Δ mean %	confidence	baseline mean	baseline stdev	baseline stderr	baseline CoV	comparison mean	comparison stdev	comparison stderr	comparison CoV	erratic	declared erratic
datadog_agent_remap_blackhole	622.8KiB	1	100.00%	60.55MiB	4.38MiB	91.22KiB	0.0722655	61.16MiB	3.43MiB	71.69KiB	0.0561459	False	False
syslog_log2metric_humio_metrics	65.27KiB	0.5	100.00%	12.75MiB	322.43KiB	6.58KiB	0.024683	12.82MiB	570.08KiB	11.6KiB	0.0434248	False	False
splunk_hec_route_s3	85.9KiB	0.45	81.53%	18.83MiB	2.22MiB	46.15KiB	0.117743	18.91MiB	2.17MiB	45.43KiB	0.114877	False	False
syslog_regex_logs2metric_ddmetrics	23.01KiB	0.18	84.47%	12.4MiB	573.25KiB	11.68KiB	0.0451209	12.43MiB	550.22KiB	11.22KiB	0.0432298	False	False
splunk_hec_to_splunk_hec_logs_noack	9.83KiB	0.04	62.75%	23.83MiB	424.02KiB	8.66KiB	0.0173752	23.84MiB	334.0KiB	6.82KiB	0.0136809	False	False
splunk_hec_to_splunk_hec_logs_acks	10.13KiB	0.04	33.26%	23.75MiB	841.06KiB	17.11KiB	0.0345689	23.76MiB	797.38KiB	16.23KiB	0.0327597	False	False
splunk_hec_indexer_ack_blackhole	10.14KiB	0.04	31.98%	23.76MiB	872.23KiB	17.75KiB	0.035844	23.77MiB	837.32KiB	17.05KiB	0.0343951	False	False
enterprise_http_to_http	-4.47KiB	-0.02	45.22%	23.85MiB	256.16KiB	5.23KiB	0.0104871	23.84MiB	258.37KiB	5.29KiB	0.0105798	False	False
file_to_blackhole	-79.74KiB	-0.08	61.71%	95.36MiB	2.89MiB	59.96KiB	0.0303226	95.28MiB	3.32MiB	68.95KiB	0.0348162	False	False
syslog_splunk_hec_logs	-22.71KiB	-0.13	75.55%	16.45MiB	786.96KiB	16.02KiB	0.0467027	16.43MiB	545.11KiB	11.14KiB	0.0323936	False	False
http_to_http_json	-41.57KiB	-0.17	99.85%	23.85MiB	328.85KiB	6.71KiB	0.0134644	23.81MiB	549.96KiB	11.23KiB	0.0225558	False	False
fluent_elasticsearch	-168.24KiB	-0.21	100.00%	79.47MiB	52.98KiB	1.07KiB	0.000650833	79.31MiB	1.58MiB	32.62KiB	0.0199652	False	False
http_to_http_acks	-67.81KiB	-0.38	22.48%	17.59MiB	8.1MiB	169.34KiB	0.460397	17.52MiB	7.97MiB	166.41KiB	0.454539	True	True
http_to_http_noack	-96.63KiB	-0.4	99.99%	23.84MiB	404.9KiB	8.28KiB	0.0165841	23.74MiB	1.11MiB	23.12KiB	0.0466873	False	False
syslog_log2metric_splunk_hec_metrics	-78.24KiB	-0.43	99.99%	17.76MiB	616.14KiB	12.55KiB	0.033877	17.68MiB	751.76KiB	15.3KiB	0.041512	False	False
datadog_agent_remap_blackhole_acks	-308.31KiB	-0.47	99.66%	63.42MiB	4.2MiB	87.45KiB	0.0661869	63.12MiB	2.8MiB	58.55KiB	0.0443426	False	False
syslog_humio_logs	-80.47KiB	-0.47	100.00%	16.68MiB	163.05KiB	3.33KiB	0.00954693	16.6MiB	174.39KiB	3.57KiB	0.0102589	False	False
http_pipelines_blackhole_acks	-5.97KiB	-0.47	97.78%	1.23MiB	112.36KiB	2.29KiB	0.0891779	1.22MiB	61.53KiB	1.25KiB	0.0490655	False	False
datadog_agent_remap_datadog_logs_acks	-511.9KiB	-0.8	100.00%	62.23MiB	3.14MiB	65.56KiB	0.0503889	61.73MiB	4.39MiB	91.35KiB	0.0710763	False	False
http_pipelines_no_grok_blackhole	-89.43KiB	-0.8	99.99%	10.97MiB	74.54KiB	1.52KiB	0.00663407	10.88MiB	1.08MiB	22.53KiB	0.0994175	False	False
datadog_agent_remap_datadog_logs	-698.62KiB	-1.1	100.00%	62.28MiB	825.62KiB	16.9KiB	0.0129422	61.6MiB	4.19MiB	87.28KiB	0.0680223	False	False
http_pipelines_blackhole	-23.16KiB	-1.32	100.00%	1.71MiB	18.76KiB	392.86B	0.0107041	1.69MiB	110.44KiB	2.25KiB	0.063845	False	False
syslog_loki	-298.96KiB	-1.99	100.00%	14.7MiB	553.33KiB	11.34KiB	0.0367584	14.41MiB	721.38KiB	14.66KiB	0.0488936	False	False
socket_to_socket_blackhole	-663.84KiB	-2.71	100.00%	23.9MiB	157.63KiB	3.22KiB	0.00643891	23.25MiB	180.87KiB	3.69KiB	0.0075942	False	False
http_text_to_http_json	-1.73MiB	-4.39	100.00%	39.4MiB	807.86KiB	16.49KiB	0.0200192	37.67MiB	806.49KiB	16.47KiB	0.0209035	False	False

Aug 24 '22 00:08 github-actions[bot]

@tobz @bruceg this is ready for review.

Aug 31 '22 13:08 ktff

This possibly could close https://github.com/vectordotdev/vector/issues/13057

Sep 12 '22 14:09 spencergilbert

Soak Test Results

Baseline: bcbcb2eb9d419acfb2483ec8c731d307b448d39a Comparison: f50c7d767303232250ac248a16f5c555da69dd27 Total Vector CPUs: 4

Explanation

A soak test is an integrated performance test for vector in a repeatable rig, with varying configuration for vector. What follows is a statistical summary of a brief vector run for each configuration across SHAs given above. The goal of these tests are to determine, quickly, if vector performance is changed and to what degree by a pull request. Where appropriate units are scaled per-core.

The table below, if present, lists those experiments that have experienced a statistically significant change in their throughput performance between baseline and comparision SHAs, with 90.0% confidence OR have been detected as newly erratic. Negative values mean that baseline is faster, positive comparison. Results that do not exhibit more than a ±8.87% change in mean throughput are discarded. An experiment is erratic if its coefficient of variation is greater than 0.3. The abbreviated table will be omitted if no interesting changes are observed.

No interesting changes in throughput with confidence ≥ 90.00% and absolute Δ mean >= ±8.87%:

Fine details of change detection per experiment.

experiment	Δ mean	Δ mean %	confidence	baseline mean	baseline stdev	baseline stderr	baseline CoV	comparison mean	comparison stdev	comparison stderr	comparison CoV	erratic	declared erratic
syslog_loki	772.46KiB	5.49	100.00%	13.74MiB	696.42KiB	14.22KiB	0.049471	14.5MiB	798.94KiB	16.24KiB	0.0538006	False	False
datadog_agent_remap_blackhole_acks	1.27MiB	2.16	100.00%	58.75MiB	5.05MiB	105.15KiB	0.0859671	60.02MiB	3.7MiB	77.32KiB	0.0616717	False	False
datadog_agent_remap_blackhole	291.65KiB	0.49	99.65%	58.69MiB	4.1MiB	85.26KiB	0.069764	58.97MiB	2.49MiB	51.93KiB	0.0421634	False	False
splunk_hec_to_splunk_hec_logs_noack	21.78KiB	0.09	92.04%	23.82MiB	507.16KiB	10.35KiB	0.0207902	23.84MiB	336.66KiB	6.87KiB	0.0137884	False	False
syslog_log2metric_humio_metrics	11.86KiB	0.09	75.92%	12.47MiB	157.0KiB	3.21KiB	0.012294	12.48MiB	470.4KiB	9.59KiB	0.0368007	False	False
splunk_hec_indexer_ack_blackhole	16.3KiB	0.07	46.38%	23.74MiB	945.29KiB	19.22KiB	0.0388808	23.75MiB	886.44KiB	18.03KiB	0.0364357	False	False
enterprise_http_to_http	1.5KiB	0.01	16.19%	23.84MiB	253.68KiB	5.18KiB	0.0103878	23.84MiB	255.22KiB	5.22KiB	0.0104504	False	False
splunk_hec_to_splunk_hec_logs_acks	-7.03KiB	-0.03	21.18%	23.75MiB	880.42KiB	17.9KiB	0.0362009	23.74MiB	938.13KiB	19.07KiB	0.0385848	False	False
file_to_blackhole	-89.84KiB	-0.09	66.01%	95.37MiB	3.07MiB	63.57KiB	0.0321558	95.28MiB	3.34MiB	69.41KiB	0.0350452	False	False
syslog_regex_logs2metric_ddmetrics	-15.28KiB	-0.12	59.71%	12.23MiB	650.7KiB	13.25KiB	0.0519563	12.21MiB	617.03KiB	12.57KiB	0.0493277	False	False
http_to_http_json	-44.22KiB	-0.18	99.90%	23.85MiB	343.42KiB	7.01KiB	0.0140613	23.8MiB	563.71KiB	11.5KiB	0.0231228	False	False
http_to_http_noack	-51.25KiB	-0.21	98.23%	23.83MiB	513.69KiB	10.49KiB	0.0210475	23.78MiB	925.88KiB	18.87KiB	0.0380165	False	False
fluent_elasticsearch	-186.11KiB	-0.23	100.00%	79.47MiB	53.97KiB	1.09KiB	0.000663069	79.29MiB	1.9MiB	39.13KiB	0.023992	False	False
syslog_humio_logs	-135.27KiB	-0.8	100.00%	16.49MiB	169.84KiB	3.47KiB	0.0100563	16.36MiB	169.88KiB	3.48KiB	0.0101395	False	False
syslog_log2metric_splunk_hec_metrics	-191.48KiB	-1.09	100.00%	17.21MiB	618.43KiB	12.6KiB	0.0350848	17.02MiB	797.52KiB	16.23KiB	0.0457423	False	False
http_to_http_acks	-251.11KiB	-1.42	70.85%	17.27MiB	8.0MiB	167.2KiB	0.462845	17.03MiB	8.12MiB	169.45KiB	0.476938	True	True
http_pipelines_blackhole	-26.77KiB	-1.52	100.00%	1.72MiB	15.38KiB	321.82B	0.00875387	1.69MiB	122.77KiB	2.5KiB	0.0709418	False	False
datadog_agent_remap_datadog_logs	-979.52KiB	-1.54	100.00%	61.93MiB	631.22KiB	12.93KiB	0.0099514	60.97MiB	4.02MiB	83.71KiB	0.0659021	False	False
datadog_agent_remap_datadog_logs_acks	-1.03MiB	-1.68	100.00%	61.74MiB	2.5MiB	52.32KiB	0.0404724	60.7MiB	4.33MiB	90.19KiB	0.0713647	False	False
http_pipelines_no_grok_blackhole	-197.13KiB	-1.8	100.00%	10.67MiB	179.08KiB	3.66KiB	0.0163853	10.48MiB	1.0MiB	20.85KiB	0.095499	False	False
http_text_to_http_json	-769.1KiB	-1.96	100.00%	38.22MiB	838.68KiB	17.12KiB	0.021423	37.47MiB	818.4KiB	16.71KiB	0.021324	False	False
http_pipelines_blackhole_acks	-25.35KiB	-2.07	100.00%	1.2MiB	121.92KiB	2.48KiB	0.099362	1.17MiB	105.57KiB	2.15KiB	0.0878529	False	False
syslog_splunk_hec_logs	-512.29KiB	-3.11	100.00%	16.11MiB	804.43KiB	16.38KiB	0.0487492	15.61MiB	802.77KiB	16.36KiB	0.0502075	False	False
splunk_hec_route_s3	-610.11KiB	-3.2	100.00%	18.6MiB	2.34MiB	48.66KiB	0.125561	18.0MiB	2.41MiB	50.41KiB	0.133682	False	False
socket_to_socket_blackhole	-815.06KiB	-3.45	100.00%	23.05MiB	1.42MiB	29.6KiB	0.0614328	22.25MiB	792.16KiB	16.17KiB	0.0347587	False	False

Sep 15 '22 01:09 github-actions[bot]

Soak Test Results

Baseline: bcbcb2eb9d419acfb2483ec8c731d307b448d39a Comparison: 8c94096c579d59c8f1c472fea49ebd195fb5e8aa Total Vector CPUs: 4

Explanation

A soak test is an integrated performance test for vector in a repeatable rig, with varying configuration for vector. What follows is a statistical summary of a brief vector run for each configuration across SHAs given above. The goal of these tests are to determine, quickly, if vector performance is changed and to what degree by a pull request. Where appropriate units are scaled per-core.

The table below, if present, lists those experiments that have experienced a statistically significant change in their throughput performance between baseline and comparision SHAs, with 90.0% confidence OR have been detected as newly erratic. Negative values mean that baseline is faster, positive comparison. Results that do not exhibit more than a ±8.87% change in mean throughput are discarded. An experiment is erratic if its coefficient of variation is greater than 0.3. The abbreviated table will be omitted if no interesting changes are observed.

No interesting changes in throughput with confidence ≥ 90.00% and absolute Δ mean >= ±8.87%:

Fine details of change detection per experiment.

experiment	Δ mean	Δ mean %	confidence	baseline mean	baseline stdev	baseline stderr	baseline CoV	comparison mean	comparison stdev	comparison stderr	comparison CoV	erratic	declared erratic
syslog_loki	139.48KiB	0.95	100.00%	14.28MiB	621.08KiB	12.71KiB	0.0424587	14.42MiB	874.59KiB	17.78KiB	0.059224	False	False
http_pipelines_blackhole_acks	5.14KiB	0.43	94.59%	1.16MiB	111.28KiB	2.26KiB	0.0937741	1.16MiB	68.98KiB	1.41KiB	0.0578779	False	False
http_to_http_acks	52.34KiB	0.3	17.35%	17.23MiB	8.07MiB	168.84KiB	0.468495	17.28MiB	8.09MiB	168.88KiB	0.46829	True	True
splunk_hec_route_s3	33.97KiB	0.18	38.37%	18.59MiB	2.34MiB	48.8KiB	0.125994	18.62MiB	2.25MiB	47.05KiB	0.120866	False	False
splunk_hec_to_splunk_hec_logs_noack	17.09KiB	0.07	85.43%	23.82MiB	469.75KiB	9.59KiB	0.0192534	23.84MiB	331.99KiB	6.78KiB	0.0135974	False	False
splunk_hec_indexer_ack_blackhole	13.31KiB	0.05	37.89%	23.74MiB	968.49KiB	19.7KiB	0.0398327	23.75MiB	902.45KiB	18.36KiB	0.0370963	False	False
enterprise_http_to_http	-5.06KiB	-0.02	49.81%	23.85MiB	259.56KiB	5.3KiB	0.0106267	23.84MiB	261.47KiB	5.35KiB	0.0107073	False	False
datadog_agent_remap_blackhole	-12.82KiB	-0.02	9.19%	59.34MiB	4.32MiB	90.07KiB	0.0728275	59.33MiB	3.11MiB	64.99KiB	0.052465	False	False
splunk_hec_to_splunk_hec_logs_acks	-6.61KiB	-0.03	21.65%	23.76MiB	818.72KiB	16.66KiB	0.0336395	23.76MiB	853.23KiB	17.36KiB	0.0350668	False	False
syslog_regex_logs2metric_ddmetrics	-14.12KiB	-0.11	64.50%	12.53MiB	528.5KiB	10.77KiB	0.041168	12.52MiB	530.19KiB	10.81KiB	0.0413448	False	False
http_to_http_json	-40.56KiB	-0.17	99.78%	23.84MiB	343.14KiB	7.0KiB	0.0140502	23.81MiB	550.77KiB	11.23KiB	0.0225896	False	False
fluent_elasticsearch	-155.45KiB	-0.19	99.98%	79.47MiB	53.75KiB	1.09KiB	0.000660344	79.32MiB	2.04MiB	42.08KiB	0.0257719	False	False
file_to_blackhole	-183.95KiB	-0.19	83.21%	95.35MiB	3.69MiB	76.33KiB	0.0386712	95.17MiB	5.28MiB	109.36KiB	0.0554337	False	False
http_to_http_noack	-122.73KiB	-0.5	100.00%	23.84MiB	409.72KiB	8.38KiB	0.0167815	23.72MiB	1.23MiB	25.62KiB	0.0518315	False	False
syslog_splunk_hec_logs	-125.47KiB	-0.76	100.00%	16.16MiB	816.65KiB	16.6KiB	0.0493515	16.03MiB	683.48KiB	13.93KiB	0.0416193	False	False
syslog_humio_logs	-136.11KiB	-0.81	100.00%	16.46MiB	271.21KiB	5.54KiB	0.0160866	16.33MiB	349.2KiB	7.14KiB	0.0208817	False	False
syslog_log2metric_humio_metrics	-108.97KiB	-0.83	100.00%	12.88MiB	328.58KiB	6.71KiB	0.0249	12.78MiB	569.28KiB	11.59KiB	0.0434996	False	False
datadog_agent_remap_datadog_logs_acks	-676.0KiB	-1.09	100.00%	60.69MiB	3.85MiB	80.43KiB	0.0633956	60.03MiB	4.81MiB	100.13KiB	0.0801161	False	False
datadog_agent_remap_blackhole_acks	-833.3KiB	-1.35	100.00%	60.27MiB	4.42MiB	91.99KiB	0.0732805	59.45MiB	3.44MiB	72.03KiB	0.0578745	False	False
http_text_to_http_json	-824.52KiB	-2.13	100.00%	37.89MiB	808.89KiB	16.51KiB	0.0208436	37.08MiB	776.43KiB	15.86KiB	0.0204416	False	False
datadog_agent_remap_datadog_logs	-1.39MiB	-2.36	100.00%	58.86MiB	1014.17KiB	20.77KiB	0.0168232	57.47MiB	3.57MiB	74.34KiB	0.0620763	False	False
syslog_log2metric_splunk_hec_metrics	-444.47KiB	-2.47	100.00%	17.54MiB	796.5KiB	16.23KiB	0.0443379	17.11MiB	1015.38KiB	20.67KiB	0.0579561	False	False
http_pipelines_no_grok_blackhole	-287.44KiB	-2.6	100.00%	10.81MiB	349.93KiB	7.14KiB	0.0316107	10.53MiB	1.03MiB	21.52KiB	0.0981108	False	False
http_pipelines_blackhole	-86.67KiB	-4.93	100.00%	1.72MiB	10.67KiB	223.3B	0.00606535	1.63MiB	151.21KiB	3.08KiB	0.0903711	False	False
socket_to_socket_blackhole	-1.39MiB	-5.88	100.00%	23.7MiB	390.88KiB	7.98KiB	0.0161015	22.31MiB	276.05KiB	5.63KiB	0.0120824	False	False

Sep 15 '22 01:09 github-actions[bot]

This

ktff requested review from StephenWakely and removed request for tobz and bruceg 2 minutes ago

seams like a github bug, since I don't even have the permission to change reviewers.

Sep 15 '22 22:09 ktff

Soak Test Results

Baseline: a22d8590b9a3b45c85f3d6051f70eed2b3d10c5e Comparison: ff46d5d7b60766a3c8c6f68b295bb12eab4edd72 Total Vector CPUs: 4

Explanation

A soak test is an integrated performance test for vector in a repeatable rig, with varying configuration for vector. What follows is a statistical summary of a brief vector run for each configuration across SHAs given above. The goal of these tests are to determine, quickly, if vector performance is changed and to what degree by a pull request. Where appropriate units are scaled per-core.

The table below, if present, lists those experiments that have experienced a statistically significant change in their throughput performance between baseline and comparision SHAs, with 90.0% confidence OR have been detected as newly erratic. Negative values mean that baseline is faster, positive comparison. Results that do not exhibit more than a ±8.87% change in mean throughput are discarded. An experiment is erratic if its coefficient of variation is greater than 0.3. The abbreviated table will be omitted if no interesting changes are observed.

No interesting changes in throughput with confidence ≥ 90.00% and absolute Δ mean >= ±8.87%:

Fine details of change detection per experiment.

experiment	Δ mean	Δ mean %	confidence	baseline mean	baseline stdev	baseline stderr	baseline CoV	comparison mean	comparison stdev	comparison stderr	comparison CoV	erratic	declared erratic
http_to_http_acks	167.41KiB	0.95	52.17%	17.17MiB	7.84MiB	163.85KiB	0.45634	17.34MiB	8.12MiB	169.95KiB	0.468178	True	True
syslog_humio_logs	44.29KiB	0.27	100.00%	16.25MiB	228.66KiB	4.67KiB	0.0137391	16.29MiB	199.61KiB	4.09KiB	0.0119615	False	False
splunk_hec_to_splunk_hec_logs_noack	5.28KiB	0.02	38.76%	23.83MiB	384.71KiB	7.86KiB	0.0157599	23.84MiB	335.39KiB	6.85KiB	0.0137364	False	False
datadog_agent_remap_blackhole_acks	7.13KiB	0.01	5.47%	59.8MiB	4.2MiB	87.5KiB	0.0702512	59.81MiB	2.68MiB	56.02KiB	0.0447285	False	False
syslog_splunk_hec_logs	-355.75B	-0	1.14%	16.01MiB	891.32KiB	18.13KiB	0.0543691	16.01MiB	800.77KiB	16.33KiB	0.0488469	False	False
enterprise_http_to_http	-1.11KiB	-0	11.95%	23.85MiB	260.15KiB	5.31KiB	0.0106513	23.85MiB	252.04KiB	5.15KiB	0.0103198	False	False
splunk_hec_indexer_ack_blackhole	-8.18KiB	-0.03	24.44%	23.75MiB	891.34KiB	18.13KiB	0.0366428	23.74MiB	936.23KiB	19.04KiB	0.0385011	False	False
file_to_blackhole	-57.8KiB	-0.06	43.04%	95.34MiB	3.12MiB	64.63KiB	0.0326927	95.28MiB	3.77MiB	78.43KiB	0.0395685	False	False
splunk_hec_to_splunk_hec_logs_acks	-24.49KiB	-0.1	71.20%	23.78MiB	748.4KiB	15.24KiB	0.0307304	23.75MiB	849.72KiB	17.29KiB	0.0349256	False	False
http_to_http_json	-30.08KiB	-0.12	98.63%	23.85MiB	334.66KiB	6.83KiB	0.0137023	23.82MiB	494.65KiB	10.11KiB	0.0202777	False	False
http_pipelines_blackhole_acks	-2.12KiB	-0.17	53.63%	1.23MiB	108.76KiB	2.21KiB	0.0863196	1.23MiB	91.72KiB	1.87KiB	0.0729184	False	False
syslog_regex_logs2metric_ddmetrics	-26.8KiB	-0.21	88.19%	12.36MiB	631.43KiB	12.86KiB	0.0498722	12.34MiB	555.48KiB	11.33KiB	0.0439666	False	False
fluent_elasticsearch	-197.4KiB	-0.24	100.00%	79.47MiB	53.85KiB	1.09KiB	0.000661519	79.28MiB	1.77MiB	36.43KiB	0.0223263	False	False
http_to_http_noack	-112.93KiB	-0.46	100.00%	23.85MiB	256.99KiB	5.25KiB	0.010522	23.74MiB	1.13MiB	23.63KiB	0.047751	False	False
splunk_hec_route_s3	-94.9KiB	-0.49	83.96%	18.72MiB	2.32MiB	48.29KiB	0.12376	18.63MiB	2.26MiB	47.32KiB	0.121424	False	False
datadog_agent_remap_datadog_logs	-567.16KiB	-0.9	100.00%	61.59MiB	728.49KiB	14.91KiB	0.0115478	61.04MiB	4.04MiB	84.12KiB	0.0661519	False	False
http_text_to_http_json	-380.7KiB	-0.97	100.00%	38.14MiB	975.67KiB	19.92KiB	0.0249793	37.76MiB	922.71KiB	18.83KiB	0.0238559	False	False
http_pipelines_no_grok_blackhole	-108.49KiB	-1.01	100.00%	10.52MiB	591.5KiB	12.07KiB	0.0548734	10.42MiB	1.12MiB	23.38KiB	0.1077	False	False
syslog_log2metric_splunk_hec_metrics	-188.45KiB	-1.05	100.00%	17.48MiB	584.3KiB	11.91KiB	0.0326428	17.29MiB	827.39KiB	16.83KiB	0.0467155	False	False
datadog_agent_remap_datadog_logs_acks	-710.83KiB	-1.14	100.00%	61.01MiB	2.9MiB	60.57KiB	0.0474457	60.32MiB	4.35MiB	90.61KiB	0.0721487	False	False
datadog_agent_remap_blackhole	-705.73KiB	-1.17	100.00%	58.7MiB	3.96MiB	82.55KiB	0.0674973	58.01MiB	2.97MiB	61.92KiB	0.0511551	False	False
http_pipelines_blackhole	-30.54KiB	-1.73	100.00%	1.73MiB	11.05KiB	231.49B	0.00624457	1.7MiB	129.15KiB	2.63KiB	0.0742394	False	False
syslog_log2metric_humio_metrics	-248.8KiB	-1.89	100.00%	12.86MiB	224.66KiB	4.59KiB	0.0170545	12.62MiB	557.94KiB	11.35KiB	0.0431703	False	False
syslog_loki	-428.62KiB	-2.8	100.00%	14.97MiB	271.06KiB	5.55KiB	0.0176793	14.55MiB	729.84KiB	14.84KiB	0.0489719	False	False
socket_to_socket_blackhole	-943.11KiB	-3.84	100.00%	23.97MiB	365.19KiB	7.45KiB	0.0148756	23.05MiB	158.82KiB	3.24KiB	0.00672782	False	False

Sep 16 '22 00:09 github-actions[bot]

Soak Test Results

Baseline: a22d8590b9a3b45c85f3d6051f70eed2b3d10c5e Comparison: 3a044c021a6920b1b8272bd70b4a9eba9462b5f0 Total Vector CPUs: 4

Explanation

A soak test is an integrated performance test for vector in a repeatable rig, with varying configuration for vector. What follows is a statistical summary of a brief vector run for each configuration across SHAs given above. The goal of these tests are to determine, quickly, if vector performance is changed and to what degree by a pull request. Where appropriate units are scaled per-core.

The table below, if present, lists those experiments that have experienced a statistically significant change in their throughput performance between baseline and comparision SHAs, with 90.0% confidence OR have been detected as newly erratic. Negative values mean that baseline is faster, positive comparison. Results that do not exhibit more than a ±8.87% change in mean throughput are discarded. An experiment is erratic if its coefficient of variation is greater than 0.3. The abbreviated table will be omitted if no interesting changes are observed.

No interesting changes in throughput with confidence ≥ 90.00% and absolute Δ mean >= ±8.87%:

Fine details of change detection per experiment.

experiment	Δ mean	Δ mean %	confidence	baseline mean	baseline stdev	baseline stderr	baseline CoV	comparison mean	comparison stdev	comparison stderr	comparison CoV	erratic	declared erratic
syslog_regex_logs2metric_ddmetrics	108.23KiB	0.86	100.00%	12.33MiB	726.9KiB	14.8KiB	0.0575644	12.43MiB	581.32KiB	11.85KiB	0.0456439	False	False
http_pipelines_blackhole	2.07KiB	0.12	60.70%	1.65MiB	56.17KiB	1.15KiB	0.033153	1.66MiB	104.38KiB	2.13KiB	0.0615345	False	False
splunk_hec_indexer_ack_blackhole	29.92KiB	0.12	80.51%	23.75MiB	875.22KiB	17.8KiB	0.0359802	23.78MiB	721.6KiB	14.69KiB	0.0296287	False	False
splunk_hec_to_splunk_hec_logs_noack	16.51KiB	0.07	83.51%	23.82MiB	475.04KiB	9.7KiB	0.0194708	23.84MiB	336.66KiB	6.87KiB	0.0137896	False	False
splunk_hec_route_s3	6.81KiB	0.04	8.06%	18.44MiB	2.32MiB	48.26KiB	0.1256	18.45MiB	2.24MiB	46.86KiB	0.121502	False	False
splunk_hec_to_splunk_hec_logs_acks	-1.69KiB	-0.01	5.39%	23.75MiB	860.01KiB	17.49KiB	0.0353551	23.75MiB	873.26KiB	17.76KiB	0.0359022	False	False
enterprise_http_to_http	-20.97KiB	-0.09	92.18%	23.85MiB	251.38KiB	5.13KiB	0.010292	23.83MiB	524.97KiB	10.74KiB	0.0215118	False	False
file_to_blackhole	-86.98KiB	-0.09	59.32%	95.33MiB	3.25MiB	67.44KiB	0.0341317	95.25MiB	3.86MiB	80.29KiB	0.0405467	False	False
http_to_http_json	-28.59KiB	-0.12	98.05%	23.85MiB	344.31KiB	7.03KiB	0.0140979	23.82MiB	490.38KiB	10.02KiB	0.0201021	False	False
http_pipelines_blackhole_acks	-1.65KiB	-0.13	40.84%	1.21MiB	120.11KiB	2.44KiB	0.0965272	1.21MiB	91.3KiB	1.86KiB	0.0734708	False	False
http_to_http_acks	-44.28KiB	-0.25	14.96%	17.37MiB	7.99MiB	166.98KiB	0.459635	17.33MiB	7.91MiB	164.99KiB	0.456127	True	True
syslog_humio_logs	-50.36KiB	-0.3	100.00%	16.35MiB	337.05KiB	6.88KiB	0.0201226	16.3MiB	299.05KiB	6.12KiB	0.0179077	False	False
fluent_elasticsearch	-261.77KiB	-0.32	99.97%	79.47MiB	53.87KiB	1.09KiB	0.000661844	79.22MiB	3.51MiB	72.1KiB	0.044264	False	False
http_to_http_noack	-90.79KiB	-0.37	100.00%	23.85MiB	266.36KiB	5.45KiB	0.0109059	23.76MiB	1.03MiB	21.38KiB	0.0431485	False	False
syslog_log2metric_splunk_hec_metrics	-102.67KiB	-0.58	100.00%	17.25MiB	567.6KiB	11.57KiB	0.0321313	17.15MiB	775.73KiB	15.79KiB	0.0441699	False	False
syslog_splunk_hec_logs	-189.13KiB	-1.14	100.00%	16.27MiB	742.23KiB	15.12KiB	0.0445341	16.09MiB	666.44KiB	13.59KiB	0.0404461	False	False
http_text_to_http_json	-485.51KiB	-1.25	100.00%	38.0MiB	862.74KiB	17.61KiB	0.0221685	37.52MiB	815.52KiB	16.65KiB	0.02122	False	False
datadog_agent_remap_datadog_logs	-778.39KiB	-1.27	100.00%	59.91MiB	1.62MiB	33.89KiB	0.0269715	59.15MiB	4.21MiB	87.68KiB	0.0711719	False	False
datadog_agent_remap_datadog_logs_acks	-821.27KiB	-1.31	100.00%	61.14MiB	3.12MiB	65.29KiB	0.0510625	60.33MiB	4.46MiB	92.93KiB	0.0739815	False	False
datadog_agent_remap_blackhole_acks	-910.58KiB	-1.53	100.00%	58.26MiB	4.73MiB	98.53KiB	0.0811768	57.37MiB	3.69MiB	77.18KiB	0.06428	False	False
syslog_loki	-417.09KiB	-2.75	100.00%	14.82MiB	358.47KiB	7.34KiB	0.0236238	14.41MiB	771.56KiB	15.68KiB	0.0522843	False	False
syslog_log2metric_humio_metrics	-370.39KiB	-2.8	100.00%	12.93MiB	528.96KiB	10.8KiB	0.0399558	12.56MiB	749.5KiB	15.26KiB	0.0582446	False	False
datadog_agent_remap_blackhole	-2.75MiB	-4.7	100.00%	58.44MiB	4.76MiB	99.11KiB	0.0813679	55.69MiB	4.59MiB	95.68KiB	0.0823816	False	False
socket_to_socket_blackhole	-1.09MiB	-4.7	100.00%	23.26MiB	619.17KiB	12.64KiB	0.0259901	22.17MiB	596.99KiB	12.19KiB	0.0262963	False	False
http_pipelines_no_grok_blackhole	-558.08KiB	-4.99	100.00%	10.92MiB	37.61KiB	786.63B	0.00336221	10.38MiB	1.08MiB	22.59KiB	0.1045	False	False

Sep 16 '22 00:09 github-actions[bot]

Soak Test Results

Baseline: d498040a770ae2bb5c9d25efce62acadcb17ee57 Comparison: af27457a6d5934404a0c949ea4237cacdee8004a Total Vector CPUs: 4

Explanation

A soak test is an integrated performance test for vector in a repeatable rig, with varying configuration for vector. What follows is a statistical summary of a brief vector run for each configuration across SHAs given above. The goal of these tests are to determine, quickly, if vector performance is changed and to what degree by a pull request. Where appropriate units are scaled per-core.

The table below, if present, lists those experiments that have experienced a statistically significant change in their throughput performance between baseline and comparision SHAs, with 90.0% confidence OR have been detected as newly erratic. Negative values mean that baseline is faster, positive comparison. Results that do not exhibit more than a ±8.87% change in mean throughput are discarded. An experiment is erratic if its coefficient of variation is greater than 0.3. The abbreviated table will be omitted if no interesting changes are observed.

No interesting changes in throughput with confidence ≥ 90.00% and absolute Δ mean >= ±8.87%:

Fine details of change detection per experiment.

experiment	Δ mean	Δ mean %	confidence	baseline mean	baseline stdev	baseline stderr	baseline CoV	comparison mean	comparison stdev	comparison stderr	comparison CoV	erratic	declared erratic
datadog_agent_remap_blackhole_acks	1.15MiB	1.91	100.00%	60.04MiB	4.31MiB	89.72KiB	0.0717598	61.19MiB	2.94MiB	61.47KiB	0.048008	False	False
http_pipelines_blackhole_acks	21.03KiB	1.69	100.00%	1.22MiB	112.16KiB	2.28KiB	0.0900821	1.24MiB	41.78KiB	873.07B	0.0329953	False	False
splunk_hec_route_s3	307.79KiB	1.63	100.00%	18.47MiB	2.37MiB	49.32KiB	0.128119	18.77MiB	2.2MiB	45.93KiB	0.116961	False	False
syslog_log2metric_humio_metrics	157.27KiB	1.23	100.00%	12.49MiB	357.68KiB	7.3KiB	0.0279559	12.65MiB	534.97KiB	10.89KiB	0.0413043	False	False
splunk_hec_indexer_ack_blackhole	21.26KiB	0.09	62.78%	23.75MiB	860.98KiB	17.51KiB	0.035399	23.77MiB	793.4KiB	16.15KiB	0.032592	False	False
splunk_hec_to_splunk_hec_logs_acks	14.67KiB	0.06	45.83%	23.75MiB	865.13KiB	17.59KiB	0.0355667	23.76MiB	804.76KiB	16.38KiB	0.0330646	False	False
splunk_hec_to_splunk_hec_logs_noack	11.54KiB	0.05	69.97%	23.83MiB	428.19KiB	8.75KiB	0.0175458	23.84MiB	337.77KiB	6.89KiB	0.013834	False	False
enterprise_http_to_http	-1.5KiB	-0.01	16.61%	23.85MiB	246.34KiB	5.03KiB	0.0100859	23.85MiB	249.03KiB	5.1KiB	0.0101968	False	False
file_to_blackhole	-124.41KiB	-0.13	71.75%	95.32MiB	3.37MiB	69.9KiB	0.0353946	95.2MiB	4.44MiB	92.26KiB	0.0466733	False	False
http_to_http_json	-39.76KiB	-0.16	99.74%	23.85MiB	350.25KiB	7.15KiB	0.0143408	23.81MiB	543.64KiB	11.09KiB	0.0222954	False	False
http_to_http_noack	-43.52KiB	-0.18	94.95%	23.82MiB	584.89KiB	11.95KiB	0.0239723	23.78MiB	920.87KiB	18.77KiB	0.0378101	False	False
fluent_elasticsearch	-222.81KiB	-0.27	100.00%	79.47MiB	52.95KiB	1.07KiB	0.000650565	79.26MiB	2.07MiB	42.5KiB	0.0260736	False	False
http_pipelines_blackhole	-8.65KiB	-0.5	99.99%	1.69MiB	23.97KiB	501.64B	0.0138885	1.68MiB	107.74KiB	2.2KiB	0.0627309	False	False
datadog_agent_remap_datadog_logs	-563.33KiB	-0.89	100.00%	61.68MiB	471.28KiB	9.65KiB	0.00746022	61.13MiB	3.89MiB	81.06KiB	0.0636403	False	False
http_to_http_acks	-257.46KiB	-1.44	71.26%	17.44MiB	8.32MiB	173.93KiB	0.47684	17.19MiB	8.06MiB	168.27KiB	0.468961	True	True
syslog_splunk_hec_logs	-271.43KiB	-1.61	100.00%	16.45MiB	705.61KiB	14.36KiB	0.0418771	16.19MiB	673.44KiB	13.72KiB	0.0406225	False	False
syslog_loki	-254.78KiB	-1.78	100.00%	13.96MiB	580.5KiB	11.88KiB	0.0405907	13.71MiB	827.94KiB	16.83KiB	0.0589424	False	False
syslog_regex_logs2metric_ddmetrics	-231.28KiB	-1.78	100.00%	12.72MiB	644.41KiB	13.12KiB	0.04948	12.49MiB	534.37KiB	10.89KiB	0.041773	False	False
socket_to_socket_blackhole	-430.43KiB	-1.81	100.00%	23.26MiB	249.76KiB	5.1KiB	0.0104847	22.84MiB	352.0KiB	7.19KiB	0.0150486	False	False
datadog_agent_remap_blackhole	-1.37MiB	-2.33	100.00%	58.69MiB	4.73MiB	98.57KiB	0.0806247	57.32MiB	3.67MiB	76.6KiB	0.0639719	False	False
http_text_to_http_json	-942.58KiB	-2.41	100.00%	38.26MiB	871.68KiB	17.79KiB	0.0222455	37.34MiB	807.98KiB	16.5KiB	0.0211281	False	False
datadog_agent_remap_datadog_logs_acks	-1.74MiB	-2.79	100.00%	62.19MiB	2.95MiB	61.77KiB	0.0474876	60.45MiB	4.85MiB	100.97KiB	0.0802261	False	False
syslog_log2metric_splunk_hec_metrics	-497.33KiB	-2.81	100.00%	17.29MiB	950.75KiB	19.37KiB	0.0536821	16.81MiB	995.31KiB	20.25KiB	0.0578223	False	False
syslog_humio_logs	-506.06KiB	-2.94	100.00%	16.84MiB	124.14KiB	2.53KiB	0.00719905	16.34MiB	130.4KiB	2.67KiB	0.00779077	False	False
http_pipelines_no_grok_blackhole	-437.44KiB	-3.91	100.00%	10.94MiB	371.73KiB	7.58KiB	0.0331902	10.51MiB	1.05MiB	21.83KiB	0.0997344	False	False

Sep 17 '22 00:09 github-actions[bot]

Soak Test Results

Baseline: d498040a770ae2bb5c9d25efce62acadcb17ee57 Comparison: 6ae56aace2e86815f74e09b3bd31a217d729586f Total Vector CPUs: 4

Explanation

A soak test is an integrated performance test for vector in a repeatable rig, with varying configuration for vector. What follows is a statistical summary of a brief vector run for each configuration across SHAs given above. The goal of these tests are to determine, quickly, if vector performance is changed and to what degree by a pull request. Where appropriate units are scaled per-core.

The table below, if present, lists those experiments that have experienced a statistically significant change in their throughput performance between baseline and comparision SHAs, with 90.0% confidence OR have been detected as newly erratic. Negative values mean that baseline is faster, positive comparison. Results that do not exhibit more than a ±8.87% change in mean throughput are discarded. An experiment is erratic if its coefficient of variation is greater than 0.3. The abbreviated table will be omitted if no interesting changes are observed.

No interesting changes in throughput with confidence ≥ 90.00% and absolute Δ mean >= ±8.87%:

Fine details of change detection per experiment.

experiment	Δ mean	Δ mean %	confidence	baseline mean	baseline stdev	baseline stderr	baseline CoV	comparison mean	comparison stdev	comparison stderr	comparison CoV	erratic	declared erratic
splunk_hec_route_s3	196.52KiB	1.05	99.73%	18.33MiB	2.25MiB	46.94KiB	0.122963	18.52MiB	2.18MiB	45.73KiB	0.117913	False	False
http_pipelines_blackhole_acks	7.06KiB	0.58	99.31%	1.19MiB	104.06KiB	2.12KiB	0.0854715	1.2MiB	75.04KiB	1.53KiB	0.0612748	False	False
splunk_hec_to_splunk_hec_logs_noack	17.54KiB	0.07	84.84%	23.82MiB	494.23KiB	10.08KiB	0.0202584	23.84MiB	338.92KiB	6.92KiB	0.0138822	False	False
splunk_hec_indexer_ack_blackhole	14.46KiB	0.06	43.93%	23.75MiB	880.54KiB	17.91KiB	0.0361988	23.76MiB	846.64KiB	17.23KiB	0.0347844	False	False
enterprise_http_to_http	697.49B	0	7.49%	23.85MiB	248.41KiB	5.07KiB	0.0101713	23.85MiB	253.11KiB	5.18KiB	0.0103634	False	False
splunk_hec_to_splunk_hec_logs_acks	-2.43KiB	-0.01	8.48%	23.77MiB	789.6KiB	16.07KiB	0.0324357	23.77MiB	797.53KiB	16.23KiB	0.0327648	False	False
file_to_blackhole	-47.66KiB	-0.05	32.69%	95.34MiB	3.6MiB	74.6KiB	0.03774	95.29MiB	4.08MiB	84.82KiB	0.0427973	False	False
http_to_http_json	-33.49KiB	-0.14	99.19%	23.84MiB	342.48KiB	6.99KiB	0.0140241	23.81MiB	515.3KiB	10.52KiB	0.0211301	False	False
fluent_elasticsearch	-191.52KiB	-0.24	100.00%	79.47MiB	53.63KiB	1.08KiB	0.000658884	79.29MiB	1.68MiB	34.56KiB	0.0211751	False	False
http_to_http_noack	-100.15KiB	-0.41	99.99%	23.83MiB	509.34KiB	10.41KiB	0.0208692	23.73MiB	1.15MiB	23.93KiB	0.0483719	False	False
http_to_http_acks	-72.19KiB	-0.41	23.56%	17.37MiB	8.02MiB	167.67KiB	0.46167	17.3MiB	8.28MiB	172.88KiB	0.47847	True	True
datadog_agent_remap_blackhole_acks	-306.15KiB	-0.5	99.15%	59.93MiB	4.46MiB	92.94KiB	0.0744675	59.63MiB	3.35MiB	69.97KiB	0.0561519	False	False
http_pipelines_blackhole	-8.39KiB	-0.5	99.51%	1.64MiB	76.55KiB	1.56KiB	0.0455906	1.63MiB	124.2KiB	2.53KiB	0.074337	False	False
datadog_agent_remap_blackhole	-386.99KiB	-0.64	99.82%	59.34MiB	4.45MiB	92.73KiB	0.0749484	58.96MiB	3.93MiB	81.94KiB	0.0666707	False	False
http_pipelines_no_grok_blackhole	-98.88KiB	-0.9	100.00%	10.71MiB	493.5KiB	10.07KiB	0.0449746	10.62MiB	1.05MiB	21.82KiB	0.0986637	False	False
syslog_log2metric_humio_metrics	-148.09KiB	-1.13	100.00%	12.81MiB	314.76KiB	6.42KiB	0.0239939	12.66MiB	727.06KiB	14.8KiB	0.0560561	False	False
socket_to_socket_blackhole	-286.99KiB	-1.2	100.00%	23.42MiB	493.2KiB	10.07KiB	0.0205584	23.14MiB	488.57KiB	9.98KiB	0.0206121	False	False
syslog_loki	-214.96KiB	-1.48	100.00%	14.2MiB	408.29KiB	8.36KiB	0.0280698	13.99MiB	769.45KiB	15.64KiB	0.0536933	False	False
syslog_splunk_hec_logs	-263.95KiB	-1.58	100.00%	16.35MiB	765.14KiB	15.56KiB	0.0456854	16.09MiB	600.56KiB	12.25KiB	0.0364329	False	False
syslog_regex_logs2metric_ddmetrics	-231.09KiB	-1.77	100.00%	12.78MiB	611.56KiB	12.46KiB	0.0467103	12.56MiB	518.77KiB	10.58KiB	0.0403349	False	False
datadog_agent_remap_datadog_logs	-1.17MiB	-1.98	100.00%	59.07MiB	510.51KiB	10.45KiB	0.00843858	57.9MiB	3.36MiB	70.02KiB	0.0580152	False	False
syslog_humio_logs	-451.16KiB	-2.7	100.00%	16.31MiB	473.02KiB	9.66KiB	0.0283186	15.87MiB	431.98KiB	8.84KiB	0.0265799	False	False
syslog_log2metric_splunk_hec_metrics	-494.9KiB	-2.71	100.00%	17.85MiB	532.91KiB	10.86KiB	0.0291504	17.37MiB	682.14KiB	13.9KiB	0.0383513	False	False
http_text_to_http_json	-1.04MiB	-2.71	100.00%	38.29MiB	869.82KiB	17.76KiB	0.0221787	37.25MiB	797.56KiB	16.28KiB	0.0209029	False	False
datadog_agent_remap_datadog_logs_acks	-2.35MiB	-3.79	100.00%	61.94MiB	2.96MiB	61.8KiB	0.0477027	59.6MiB	4.92MiB	102.45KiB	0.0825621	False	False

Sep 17 '22 00:09 github-actions[bot]

Soak Test Results

Baseline: d498040a770ae2bb5c9d25efce62acadcb17ee57 Comparison: ec41c68ef667890e38707c0434b7924929872908 Total Vector CPUs: 4

Explanation

A soak test is an integrated performance test for vector in a repeatable rig, with varying configuration for vector. What follows is a statistical summary of a brief vector run for each configuration across SHAs given above. The goal of these tests are to determine, quickly, if vector performance is changed and to what degree by a pull request. Where appropriate units are scaled per-core.

The table below, if present, lists those experiments that have experienced a statistically significant change in their throughput performance between baseline and comparision SHAs, with 90.0% confidence OR have been detected as newly erratic. Negative values mean that baseline is faster, positive comparison. Results that do not exhibit more than a ±8.87% change in mean throughput are discarded. An experiment is erratic if its coefficient of variation is greater than 0.3. The abbreviated table will be omitted if no interesting changes are observed.

No interesting changes in throughput with confidence ≥ 90.00% and absolute Δ mean >= ±8.87%:

Fine details of change detection per experiment.

experiment	Δ mean	Δ mean %	confidence	baseline mean	baseline stdev	baseline stderr	baseline CoV	comparison mean	comparison stdev	comparison stderr	comparison CoV	erratic	declared erratic
syslog_log2metric_humio_metrics	126.61KiB	0.99	100.00%	12.43MiB	436.86KiB	8.92KiB	0.0343018	12.56MiB	554.58KiB	11.3KiB	0.0431157	False	False
http_pipelines_blackhole_acks	4.03KiB	0.33	83.68%	1.2MiB	112.71KiB	2.29KiB	0.0918989	1.2MiB	86.47KiB	1.76KiB	0.0702688	False	False
splunk_hec_route_s3	57.01KiB	0.31	59.18%	18.21MiB	2.37MiB	49.33KiB	0.130094	18.27MiB	2.3MiB	48.15KiB	0.126013	False	False
splunk_hec_indexer_ack_blackhole	22.29KiB	0.09	65.03%	23.75MiB	877.65KiB	17.85KiB	0.0360799	23.77MiB	775.73KiB	15.79KiB	0.031861	False	False
splunk_hec_to_splunk_hec_logs_noack	17.16KiB	0.07	85.17%	23.82MiB	476.53KiB	9.73KiB	0.0195323	23.84MiB	332.39KiB	6.79KiB	0.0136148	False	False
splunk_hec_to_splunk_hec_logs_acks	1.54KiB	0.01	5.03%	23.75MiB	852.62KiB	17.34KiB	0.0350457	23.76MiB	841.05KiB	17.11KiB	0.0345679	False	False
enterprise_http_to_http	-808.77B	-0	8.77%	23.85MiB	248.57KiB	5.07KiB	0.0101775	23.85MiB	247.82KiB	5.07KiB	0.0101471	False	False
file_to_blackhole	-34.27KiB	-0.04	26.77%	95.33MiB	3.31MiB	68.7KiB	0.0347644	95.3MiB	3.5MiB	72.91KiB	0.0367606	False	False
http_to_http_json	-43.36KiB	-0.18	99.88%	23.85MiB	339.66KiB	6.93KiB	0.0139072	23.8MiB	560.41KiB	11.43KiB	0.0229867	False	False
fluent_elasticsearch	-148.73KiB	-0.18	100.00%	79.47MiB	52.96KiB	1.07KiB	0.000650584	79.33MiB	1.39MiB	28.52KiB	0.0174593	False	False
http_to_http_noack	-61.9KiB	-0.25	99.72%	23.84MiB	402.91KiB	8.24KiB	0.0165028	23.78MiB	931.25KiB	18.98KiB	0.0382398	False	False
datadog_agent_remap_blackhole_acks	-441.72KiB	-0.71	99.99%	60.48MiB	4.45MiB	92.62KiB	0.0735545	60.05MiB	2.92MiB	60.97KiB	0.0485479	False	False
http_pipelines_blackhole	-14.04KiB	-0.82	100.00%	1.67MiB	51.77KiB	1.06KiB	0.0302622	1.66MiB	128.2KiB	2.61KiB	0.0755664	False	False
http_to_http_acks	-154.11KiB	-0.85	48.71%	17.61MiB	7.67MiB	160.39KiB	0.435596	17.46MiB	8.25MiB	172.47KiB	0.472518	True	True
datadog_agent_remap_blackhole	-564.26KiB	-0.91	100.00%	60.23MiB	3.99MiB	83.19KiB	0.0662898	59.68MiB	2.25MiB	46.95KiB	0.0376702	False	False
datadog_agent_remap_datadog_logs_acks	-744.87KiB	-1.17	100.00%	61.99MiB	3.56MiB	74.4KiB	0.0574803	61.26MiB	4.37MiB	91.02KiB	0.0713651	False	False
syslog_regex_logs2metric_ddmetrics	-172.55KiB	-1.34	100.00%	12.57MiB	578.45KiB	11.79KiB	0.0449396	12.4MiB	522.26KiB	10.64KiB	0.0411257	False	False
datadog_agent_remap_datadog_logs	-1.13MiB	-1.83	100.00%	61.84MiB	495.65KiB	10.14KiB	0.00782569	60.71MiB	3.97MiB	82.79KiB	0.0654597	False	False
socket_to_socket_blackhole	-441.63KiB	-1.85	100.00%	23.31MiB	505.23KiB	10.31KiB	0.0211663	22.87MiB	594.42KiB	12.14KiB	0.0253721	False	False
http_text_to_http_json	-872.09KiB	-2.22	100.00%	38.29MiB	847.09KiB	17.29KiB	0.0216014	37.44MiB	803.02KiB	16.39KiB	0.0209435	False	False
syslog_loki	-334.9KiB	-2.29	100.00%	14.29MiB	413.75KiB	8.47KiB	0.0282781	13.96MiB	798.05KiB	16.22KiB	0.0558219	False	False
syslog_splunk_hec_logs	-434.41KiB	-2.64	100.00%	16.06MiB	724.32KiB	14.74KiB	0.0440267	15.64MiB	656.41KiB	13.38KiB	0.0409815	False	False
syslog_humio_logs	-510.81KiB	-2.96	100.00%	16.84MiB	133.89KiB	2.73KiB	0.00776467	16.34MiB	130.83KiB	2.68KiB	0.0078186	False	False
http_pipelines_no_grok_blackhole	-352.34KiB	-3.14	100.00%	10.95MiB	67.99KiB	1.39KiB	0.00606026	10.61MiB	1022.14KiB	20.79KiB	0.0940563	False	False
syslog_log2metric_splunk_hec_metrics	-599.75KiB	-3.23	100.00%	18.12MiB	495.0KiB	10.09KiB	0.0266703	17.54MiB	691.86KiB	14.09KiB	0.038522	False	False

Sep 17 '22 00:09 github-actions[bot]

Soak Test Results

Baseline: d498040a770ae2bb5c9d25efce62acadcb17ee57 Comparison: 35e6f39c3fd438a595ea6f3f678f9971f8f9b194 Total Vector CPUs: 4

Explanation

A soak test is an integrated performance test for vector in a repeatable rig, with varying configuration for vector. What follows is a statistical summary of a brief vector run for each configuration across SHAs given above. The goal of these tests are to determine, quickly, if vector performance is changed and to what degree by a pull request. Where appropriate units are scaled per-core.

The table below, if present, lists those experiments that have experienced a statistically significant change in their throughput performance between baseline and comparision SHAs, with 90.0% confidence OR have been detected as newly erratic. Negative values mean that baseline is faster, positive comparison. Results that do not exhibit more than a ±8.87% change in mean throughput are discarded. An experiment is erratic if its coefficient of variation is greater than 0.3. The abbreviated table will be omitted if no interesting changes are observed.

No interesting changes in throughput with confidence ≥ 90.00% and absolute Δ mean >= ±8.87%:

Fine details of change detection per experiment.

experiment	Δ mean	Δ mean %	confidence	baseline mean	baseline stdev	baseline stderr	baseline CoV	comparison mean	comparison stdev	comparison stderr	comparison CoV	erratic	declared erratic
syslog_log2metric_humio_metrics	114.73KiB	0.88	100.00%	12.75MiB	296.14KiB	6.05KiB	0.022678	12.86MiB	501.21KiB	10.21KiB	0.0380484	False	False
splunk_hec_route_s3	39.0KiB	0.21	42.79%	18.17MiB	2.36MiB	49.22KiB	0.129961	18.21MiB	2.31MiB	48.38KiB	0.127083	False	False
http_pipelines_blackhole_acks	2.19KiB	0.17	54.96%	1.23MiB	117.7KiB	2.39KiB	0.0936277	1.23MiB	80.57KiB	1.64KiB	0.0639794	False	False
http_to_http_acks	29.89KiB	0.17	10.00%	17.25MiB	7.94MiB	166.04KiB	0.460478	17.28MiB	8.16MiB	170.34KiB	0.472296	True	True
splunk_hec_to_splunk_hec_logs_noack	10.05KiB	0.04	63.07%	23.83MiB	434.34KiB	8.87KiB	0.0177981	23.84MiB	334.23KiB	6.82KiB	0.0136902	False	False
splunk_hec_indexer_ack_blackhole	4.34KiB	0.02	13.89%	23.75MiB	874.56KiB	17.79KiB	0.0359487	23.76MiB	848.11KiB	17.25KiB	0.0348554	False	False
splunk_hec_to_splunk_hec_logs_acks	-775.51B	-0	2.36%	23.74MiB	893.27KiB	18.17KiB	0.0367309	23.74MiB	890.19KiB	18.1KiB	0.0366053	False	False
enterprise_http_to_http	-1.08KiB	-0	11.90%	23.85MiB	250.43KiB	5.11KiB	0.0102536	23.85MiB	250.3KiB	5.12KiB	0.0102489	False	False
file_to_blackhole	-53.64KiB	-0.05	45.75%	95.35MiB	2.79MiB	57.75KiB	0.0292124	95.29MiB	3.2MiB	66.49KiB	0.0335244	False	False
http_to_http_json	-30.16KiB	-0.12	98.66%	23.85MiB	340.57KiB	6.95KiB	0.0139442	23.82MiB	490.17KiB	10.02KiB	0.0200942	False	False
http_to_http_noack	-87.35KiB	-0.36	99.98%	23.84MiB	398.29KiB	8.14KiB	0.0163131	23.75MiB	1.05MiB	21.95KiB	0.0443124	False	False
fluent_elasticsearch	-312.14KiB	-0.38	100.00%	79.47MiB	52.21KiB	1.06KiB	0.000641409	79.17MiB	3.04MiB	62.52KiB	0.0384538	False	False
http_pipelines_blackhole	-6.93KiB	-0.41	99.82%	1.65MiB	32.39KiB	677.64B	0.0192035	1.64MiB	103.82KiB	2.12KiB	0.061802	False	False
datadog_agent_remap_blackhole	-295.04KiB	-0.5	95.93%	57.88MiB	5.12MiB	106.74KiB	0.0884236	57.6MiB	4.64MiB	96.83KiB	0.080568	False	False
datadog_agent_remap_blackhole_acks	-400.76KiB	-0.63	99.95%	62.14MiB	4.45MiB	92.68KiB	0.0716343	61.75MiB	3.29MiB	68.76KiB	0.0532508	False	False
syslog_loki	-111.13KiB	-0.76	100.00%	14.24MiB	397.23KiB	8.14KiB	0.0272391	14.13MiB	713.63KiB	14.51KiB	0.0493113	False	False
socket_to_socket_blackhole	-238.31KiB	-1.02	100.00%	22.77MiB	597.15KiB	12.19KiB	0.0256008	22.54MiB	604.8KiB	12.35KiB	0.0261964	False	False
datadog_agent_remap_datadog_logs_acks	-665.5KiB	-1.05	100.00%	62.09MiB	3.41MiB	71.2KiB	0.0548979	61.44MiB	4.35MiB	90.59KiB	0.0708187	False	False
syslog_splunk_hec_logs	-246.19KiB	-1.46	100.00%	16.46MiB	777.15KiB	15.81KiB	0.0460984	16.22MiB	628.44KiB	12.81KiB	0.03783	False	False
syslog_regex_logs2metric_ddmetrics	-246.99KiB	-1.94	100.00%	12.43MiB	581.17KiB	11.84KiB	0.0456558	12.19MiB	449.01KiB	9.15KiB	0.0359715	False	False
http_pipelines_no_grok_blackhole	-311.48KiB	-2.78	100.00%	10.94MiB	51.42KiB	1.05KiB	0.00458752	10.64MiB	1.06MiB	22.01KiB	0.0993441	False	False
syslog_humio_logs	-520.9KiB	-3.01	100.00%	16.91MiB	111.76KiB	2.28KiB	0.00645418	16.4MiB	131.6KiB	2.69KiB	0.00783593	False	False
syslog_log2metric_splunk_hec_metrics	-595.37KiB	-3.21	100.00%	18.1MiB	437.5KiB	8.92KiB	0.0235998	17.52MiB	786.65KiB	16.0KiB	0.0438424	False	False
http_text_to_http_json	-1.22MiB	-3.23	100.00%	37.94MiB	1.15MiB	24.09KiB	0.0303755	36.72MiB	1.16MiB	24.16KiB	0.0314692	False	False
datadog_agent_remap_datadog_logs	-1.98MiB	-3.25	100.00%	60.98MiB	1.58MiB	33.14KiB	0.0259274	59.0MiB	4.33MiB	90.24KiB	0.073405	False	False

Sep 17 '22 00:09 github-actions[bot]

Soak Test Results

Baseline: d498040a770ae2bb5c9d25efce62acadcb17ee57 Comparison: 6d9681e4c061df761a74c254816061e3952db0c4 Total Vector CPUs: 4

Explanation

A soak test is an integrated performance test for vector in a repeatable rig, with varying configuration for vector. What follows is a statistical summary of a brief vector run for each configuration across SHAs given above. The goal of these tests are to determine, quickly, if vector performance is changed and to what degree by a pull request. Where appropriate units are scaled per-core.

The table below, if present, lists those experiments that have experienced a statistically significant change in their throughput performance between baseline and comparision SHAs, with 90.0% confidence OR have been detected as newly erratic. Negative values mean that baseline is faster, positive comparison. Results that do not exhibit more than a ±8.87% change in mean throughput are discarded. An experiment is erratic if its coefficient of variation is greater than 0.3. The abbreviated table will be omitted if no interesting changes are observed.

No interesting changes in throughput with confidence ≥ 90.00% and absolute Δ mean >= ±8.87%:

Fine details of change detection per experiment.

experiment	Δ mean	Δ mean %	confidence	baseline mean	baseline stdev	baseline stderr	baseline CoV	comparison mean	comparison stdev	comparison stderr	comparison CoV	erratic	declared erratic
http_to_http_acks	139.28KiB	0.79	44.96%	17.13MiB	7.63MiB	159.5KiB	0.445213	17.27MiB	8.15MiB	170.17KiB	0.471834	True	True
splunk_hec_route_s3	23.15KiB	0.12	27.46%	18.72MiB	2.26MiB	46.99KiB	0.12051	18.74MiB	2.21MiB	46.2KiB	0.117955	False	False
splunk_hec_to_splunk_hec_logs_noack	15.58KiB	0.06	81.17%	23.82MiB	475.72KiB	9.7KiB	0.0194981	23.84MiB	332.16KiB	6.78KiB	0.0136057	False	False
splunk_hec_indexer_ack_blackhole	12.88KiB	0.05	38.90%	23.74MiB	908.05KiB	18.47KiB	0.0373393	23.76MiB	852.02KiB	17.33KiB	0.0350169	False	False
enterprise_http_to_http	-1.54KiB	-0.01	16.87%	23.85MiB	246.62KiB	5.03KiB	0.0100973	23.85MiB	253.43KiB	5.18KiB	0.0103765	False	False
splunk_hec_to_splunk_hec_logs_acks	-1.77KiB	-0.01	5.96%	23.76MiB	824.01KiB	16.77KiB	0.0338564	23.76MiB	818.97KiB	16.67KiB	0.0336517	False	False
file_to_blackhole	-67.27KiB	-0.07	48.07%	95.34MiB	3.35MiB	69.49KiB	0.0351532	95.27MiB	3.75MiB	77.88KiB	0.0393193	False	False
http_to_http_json	-36.82KiB	-0.15	99.67%	23.85MiB	331.16KiB	6.76KiB	0.0135574	23.81MiB	517.0KiB	10.56KiB	0.0211975	False	False
datadog_agent_remap_blackhole	-92.61KiB	-0.16	62.52%	57.35MiB	4.08MiB	84.88KiB	0.0710913	57.26MiB	2.91MiB	60.68KiB	0.0507879	False	False
fluent_elasticsearch	-148.53KiB	-0.18	100.00%	79.47MiB	52.74KiB	1.07KiB	0.000647893	79.33MiB	1.31MiB	26.88KiB	0.0164625	False	False
datadog_agent_remap_datadog_logs_acks	-116.77KiB	-0.19	69.80%	61.17MiB	3.26MiB	68.18KiB	0.0532515	61.05MiB	4.34MiB	90.26KiB	0.0710046	False	False
datadog_agent_remap_blackhole_acks	-203.69KiB	-0.34	95.53%	58.57MiB	4.24MiB	88.28KiB	0.0723889	58.38MiB	2.39MiB	49.98KiB	0.0408849	False	False
http_to_http_noack	-95.91KiB	-0.39	99.99%	23.84MiB	401.59KiB	8.21KiB	0.016448	23.74MiB	1.09MiB	22.76KiB	0.0459713	False	False
syslog_log2metric_humio_metrics	-75.32KiB	-0.58	99.99%	12.63MiB	529.77KiB	10.82KiB	0.0409627	12.55MiB	790.44KiB	16.1KiB	0.0614759	False	False
syslog_splunk_hec_logs	-224.04KiB	-1.35	100.00%	16.24MiB	815.84KiB	16.6KiB	0.04904	16.02MiB	645.09KiB	13.16KiB	0.0393053	False	False
syslog_regex_logs2metric_ddmetrics	-221.31KiB	-1.72	100.00%	12.56MiB	698.14KiB	14.22KiB	0.0542754	12.34MiB	640.06KiB	13.04KiB	0.0506314	False	False
socket_to_socket_blackhole	-413.81KiB	-1.73	100.00%	23.37MiB	453.88KiB	9.26KiB	0.0189646	22.96MiB	348.82KiB	7.13KiB	0.0148315	False	False
http_pipelines_blackhole	-30.4KiB	-1.76	100.00%	1.69MiB	22.75KiB	475.99B	0.0131829	1.66MiB	113.99KiB	2.32KiB	0.0672252	False	False
http_pipelines_blackhole_acks	-29.32KiB	-2.36	100.00%	1.21MiB	95.05KiB	1.94KiB	0.076532	1.18MiB	92.09KiB	1.88KiB	0.0759415	False	False
http_pipelines_no_grok_blackhole	-312.19KiB	-2.82	100.00%	10.81MiB	109.82KiB	2.24KiB	0.00992088	10.5MiB	1.02MiB	21.25KiB	0.0971355	False	False
syslog_loki	-416.37KiB	-2.82	100.00%	14.4MiB	381.52KiB	7.81KiB	0.0258615	14.0MiB	797.46KiB	16.21KiB	0.0556274	False	False
http_text_to_http_json	-1.18MiB	-3.08	100.00%	38.24MiB	851.43KiB	17.38KiB	0.0217382	37.07MiB	789.67KiB	16.13KiB	0.0208012	False	False
syslog_humio_logs	-549.55KiB	-3.22	100.00%	16.64MiB	405.62KiB	8.28KiB	0.0237961	16.11MiB	436.82KiB	8.94KiB	0.0264804	False	False
datadog_agent_remap_datadog_logs	-2.14MiB	-3.45	100.00%	61.93MiB	875.36KiB	17.92KiB	0.0138007	59.79MiB	3.97MiB	82.76KiB	0.0664521	False	False
syslog_log2metric_splunk_hec_metrics	-648.67KiB	-3.58	100.00%	17.67MiB	625.35KiB	12.75KiB	0.0345492	17.04MiB	909.58KiB	18.51KiB	0.0521209	False	False

Sep 17 '22 01:09 github-actions[bot]

Soak Test Results

Baseline: d498040a770ae2bb5c9d25efce62acadcb17ee57 Comparison: 57aac289cbc4a8de74c72c4f1918d94eb5cc2bc9 Total Vector CPUs: 4

Explanation

A soak test is an integrated performance test for vector in a repeatable rig, with varying configuration for vector. What follows is a statistical summary of a brief vector run for each configuration across SHAs given above. The goal of these tests are to determine, quickly, if vector performance is changed and to what degree by a pull request. Where appropriate units are scaled per-core.

The table below, if present, lists those experiments that have experienced a statistically significant change in their throughput performance between baseline and comparision SHAs, with 90.0% confidence OR have been detected as newly erratic. Negative values mean that baseline is faster, positive comparison. Results that do not exhibit more than a ±8.87% change in mean throughput are discarded. An experiment is erratic if its coefficient of variation is greater than 0.3. The abbreviated table will be omitted if no interesting changes are observed.

No interesting changes in throughput with confidence ≥ 90.00% and absolute Δ mean >= ±8.87%:

Fine details of change detection per experiment.

experiment	Δ mean	Δ mean %	confidence	baseline mean	baseline stdev	baseline stderr	baseline CoV	comparison mean	comparison stdev	comparison stderr	comparison CoV	erratic	declared erratic
datadog_agent_remap_blackhole	2.95MiB	5.1	100.00%	57.87MiB	6.31MiB	131.35KiB	0.108949	60.82MiB	3.37MiB	70.3KiB	0.0553769	False	False
http_text_to_http_json	830.07KiB	2.1	100.00%	38.52MiB	813.96KiB	16.61KiB	0.020631	39.33MiB	766.22KiB	15.64KiB	0.0190207	False	False
syslog_splunk_hec_logs	179.29KiB	1.08	100.00%	16.28MiB	877.13KiB	17.85KiB	0.0525913	16.46MiB	625.6KiB	12.76KiB	0.0371108	False	False
splunk_hec_route_s3	191.79KiB	1.02	99.57%	18.42MiB	2.33MiB	48.6KiB	0.126645	18.61MiB	2.22MiB	46.44KiB	0.119263	False	False
syslog_log2metric_humio_metrics	131.01KiB	1.01	100.00%	12.67MiB	157.64KiB	3.22KiB	0.012145	12.8MiB	512.54KiB	10.44KiB	0.0390915	False	False
datadog_agent_remap_blackhole_acks	482.0KiB	0.78	100.00%	60.24MiB	4.26MiB	88.67KiB	0.0706897	60.71MiB	2.45MiB	51.31KiB	0.0403759	False	False
http_pipelines_blackhole_acks	1.42KiB	0.11	37.06%	1.23MiB	115.07KiB	2.34KiB	0.091327	1.23MiB	87.33KiB	1.78KiB	0.0692365	False	False
splunk_hec_to_splunk_hec_logs_noack	17.72KiB	0.07	86.08%	23.82MiB	474.36KiB	9.68KiB	0.019443	23.84MiB	345.61KiB	7.05KiB	0.0141554	False	False
enterprise_http_to_http	-1.93KiB	-0.01	21.19%	23.85MiB	246.73KiB	5.04KiB	0.010102	23.84MiB	250.63KiB	5.13KiB	0.0102623	False	False
splunk_hec_indexer_ack_blackhole	-6.42KiB	-0.03	19.97%	23.75MiB	868.74KiB	17.67KiB	0.0357138	23.74MiB	895.1KiB	18.2KiB	0.0368068	False	False
file_to_blackhole	-40.69KiB	-0.04	28.22%	95.34MiB	3.57MiB	74.0KiB	0.0374352	95.3MiB	4.08MiB	84.81KiB	0.0427533	False	False
splunk_hec_to_splunk_hec_logs_acks	-17.76KiB	-0.07	55.02%	23.77MiB	774.38KiB	15.76KiB	0.0318026	23.76MiB	856.89KiB	17.43KiB	0.0352168	False	False
http_to_http_json	-35.74KiB	-0.15	99.41%	23.84MiB	347.59KiB	7.1KiB	0.0142329	23.81MiB	531.29KiB	10.85KiB	0.0217865	False	False
syslog_regex_logs2metric_ddmetrics	-44.92KiB	-0.35	99.33%	12.68MiB	580.43KiB	11.83KiB	0.0446771	12.64MiB	568.96KiB	11.6KiB	0.043946	False	False
datadog_agent_remap_datadog_logs_acks	-259.65KiB	-0.41	97.43%	62.18MiB	3.42MiB	71.44KiB	0.0550024	61.93MiB	4.41MiB	91.85KiB	0.071243	False	False
fluent_elasticsearch	-384.54KiB	-0.47	99.99%	79.47MiB	54.25KiB	1.1KiB	0.000666472	79.1MiB	4.63MiB	95.22KiB	0.0585688	False	False
http_to_http_noack	-121.18KiB	-0.5	100.00%	23.83MiB	514.34KiB	10.51KiB	0.0210743	23.71MiB	1.26MiB	26.15KiB	0.052925	False	False
syslog_log2metric_splunk_hec_metrics	-103.62KiB	-0.56	100.00%	18.14MiB	437.81KiB	8.93KiB	0.0235581	18.04MiB	824.44KiB	16.77KiB	0.0446109	False	False
syslog_loki	-91.86KiB	-0.61	100.00%	14.62MiB	245.45KiB	5.03KiB	0.0163925	14.53MiB	724.51KiB	14.73KiB	0.0486859	False	False
datadog_agent_remap_datadog_logs	-627.97KiB	-0.99	100.00%	62.1MiB	1.81MiB	38.04KiB	0.0292203	61.48MiB	4.22MiB	87.93KiB	0.0686304	False	False
syslog_humio_logs	-174.32KiB	-1.01	100.00%	16.81MiB	147.48KiB	3.01KiB	0.0085646	16.64MiB	166.56KiB	3.41KiB	0.00977188	False	False
http_pipelines_blackhole	-22.0KiB	-1.26	100.00%	1.7MiB	13.92KiB	291.48B	0.00797894	1.68MiB	111.69KiB	2.28KiB	0.0648159	False	False
socket_to_socket_blackhole	-317.95KiB	-1.32	100.00%	23.49MiB	436.88KiB	8.92KiB	0.018162	23.18MiB	346.14KiB	7.07KiB	0.0145825	False	False
http_to_http_acks	-368.06KiB	-2.06	88.13%	17.43MiB	7.86MiB	164.39KiB	0.450904	17.07MiB	8.1MiB	169.09KiB	0.474167	True	True
http_pipelines_no_grok_blackhole	-256.03KiB	-2.32	100.00%	10.77MiB	124.12KiB	2.53KiB	0.0112485	10.52MiB	1.08MiB	22.46KiB	0.102493	False	False

Sep 17 '22 01:09 github-actions[bot]

Soak Test Results

Baseline: 512da4076a67a229996f96e51e711dc2af37dcf2 Comparison: b14cbcf5ce041fbac2763379fbfbad72ec2bd9df Total Vector CPUs: 4

Explanation

A soak test is an integrated performance test for vector in a repeatable rig, with varying configuration for vector. What follows is a statistical summary of a brief vector run for each configuration across SHAs given above. The goal of these tests are to determine, quickly, if vector performance is changed and to what degree by a pull request. Where appropriate units are scaled per-core.

The table below, if present, lists those experiments that have experienced a statistically significant change in their throughput performance between baseline and comparision SHAs, with 90.0% confidence OR have been detected as newly erratic. Negative values mean that baseline is faster, positive comparison. Results that do not exhibit more than a ±8.87% change in mean throughput are discarded. An experiment is erratic if its coefficient of variation is greater than 0.3. The abbreviated table will be omitted if no interesting changes are observed.

No interesting changes in throughput with confidence ≥ 90.00% and absolute Δ mean >= ±8.87%:

Fine details of change detection per experiment.

experiment	Δ mean	Δ mean %	confidence	baseline mean	baseline stdev	baseline stderr	baseline CoV	comparison mean	comparison stdev	comparison stderr	comparison CoV	erratic	declared erratic
http_to_http_acks	452.55KiB	2.59	95.12%	17.09MiB	7.67MiB	160.31KiB	0.448561	17.53MiB	7.88MiB	164.47KiB	0.449158	True	True
http_pipelines_blackhole_acks	7.69KiB	0.61	98.67%	1.23MiB	125.64KiB	2.56KiB	0.0998232	1.24MiB	86.64KiB	1.77KiB	0.0684156	False	False
splunk_hec_indexer_ack_blackhole	18.91KiB	0.08	58.47%	23.75MiB	845.41KiB	17.19KiB	0.0347555	23.77MiB	765.79KiB	15.59KiB	0.0314578	False	False
splunk_hec_to_splunk_hec_logs_noack	10.97KiB	0.04	67.36%	23.83MiB	432.98KiB	8.84KiB	0.0177433	23.84MiB	335.25KiB	6.84KiB	0.0137323	False	False
splunk_hec_to_splunk_hec_logs_acks	2.59KiB	0.01	8.74%	23.76MiB	830.67KiB	16.9KiB	0.0341365	23.76MiB	811.8KiB	16.52KiB	0.0333576	False	False
enterprise_http_to_http	-737.17B	-0	7.81%	23.85MiB	251.29KiB	5.13KiB	0.0102891	23.85MiB	256.99KiB	5.26KiB	0.0105229	False	False
syslog_log2metric_humio_metrics	-877.62B	-0.01	4.26%	12.7MiB	428.28KiB	8.75KiB	0.0329157	12.7MiB	660.94KiB	13.45KiB	0.0508	False	False
syslog_loki	-10.45KiB	-0.07	48.86%	14.31MiB	306.78KiB	6.28KiB	0.020934	14.3MiB	719.1KiB	14.62KiB	0.0491054	False	False
file_to_blackhole	-66.46KiB	-0.07	48.79%	95.34MiB	3.16MiB	65.48KiB	0.0331229	95.27MiB	3.72MiB	77.38KiB	0.0390651	False	False
http_to_http_json	-40.61KiB	-0.17	99.81%	23.85MiB	343.24KiB	7.01KiB	0.0140521	23.81MiB	538.62KiB	11.0KiB	0.0220872	False	False
syslog_regex_logs2metric_ddmetrics	-38.28KiB	-0.3	98.22%	12.28MiB	602.2KiB	12.26KiB	0.047867	12.25MiB	515.23KiB	10.5KiB	0.0410792	False	False
datadog_agent_remap_blackhole	-234.4KiB	-0.41	94.16%	56.0MiB	4.63MiB	96.56KiB	0.0827443	55.78MiB	3.71MiB	77.47KiB	0.0665632	False	False
fluent_elasticsearch	-340.4KiB	-0.42	99.99%	79.47MiB	53.36KiB	1.08KiB	0.000655548	79.14MiB	4.23MiB	86.94KiB	0.0534125	False	False
http_to_http_noack	-128.82KiB	-0.53	100.00%	23.84MiB	403.17KiB	8.25KiB	0.0165134	23.71MiB	1.25MiB	26.05KiB	0.0527211	False	False
syslog_humio_logs	-126.45KiB	-0.74	100.00%	16.7MiB	153.99KiB	3.14KiB	0.00900543	16.57MiB	153.52KiB	3.14KiB	0.00904519	False	False
splunk_hec_route_s3	-143.03KiB	-0.76	95.41%	18.46MiB	2.43MiB	50.69KiB	0.131818	18.32MiB	2.42MiB	50.63KiB	0.132138	False	False
datadog_agent_remap_datadog_logs	-565.01KiB	-0.9	100.00%	61.6MiB	607.66KiB	12.44KiB	0.00963061	61.05MiB	4.17MiB	86.77KiB	0.0682364	False	False
datadog_agent_remap_blackhole_acks	-568.4KiB	-0.91	100.00%	60.89MiB	4.38MiB	91.16KiB	0.07187	60.34MiB	2.62MiB	54.92KiB	0.043457	False	False
http_pipelines_blackhole	-15.57KiB	-0.92	100.00%	1.65MiB	61.37KiB	1.25KiB	0.0362336	1.64MiB	133.35KiB	2.72KiB	0.0794605	False	False
syslog_log2metric_splunk_hec_metrics	-179.69KiB	-0.98	100.00%	17.92MiB	641.89KiB	13.08KiB	0.0349738	17.74MiB	769.05KiB	15.65KiB	0.0423162	False	False
syslog_splunk_hec_logs	-171.91KiB	-1.07	100.00%	15.65MiB	923.65KiB	18.8KiB	0.0576319	15.48MiB	769.74KiB	15.7KiB	0.0485498	False	False
http_text_to_http_json	-464.3KiB	-1.15	100.00%	39.55MiB	1.12MiB	23.38KiB	0.0282732	39.09MiB	1.14MiB	23.74KiB	0.0290439	False	False
http_pipelines_no_grok_blackhole	-138.36KiB	-1.26	100.00%	10.72MiB	131.93KiB	2.69KiB	0.0120156	10.59MiB	1.06MiB	22.02KiB	0.0998806	False	False
datadog_agent_remap_datadog_logs_acks	-862.44KiB	-1.39	100.00%	60.55MiB	3.54MiB	73.98KiB	0.0585132	59.7MiB	4.31MiB	89.75KiB	0.0721973	False	False
socket_to_socket_blackhole	-1018.29KiB	-4.07	100.00%	24.41MiB	319.64KiB	6.52KiB	0.012785	23.42MiB	135.63KiB	2.77KiB	0.0056555	False	False

Sep 20 '22 17:09 github-actions[bot]

Soak Test Results

Baseline: 512da4076a67a229996f96e51e711dc2af37dcf2 Comparison: a03fd554be7edd3e349d39d68b39cc6470708ea9 Total Vector CPUs: 4

Explanation

A soak test is an integrated performance test for vector in a repeatable rig, with varying configuration for vector. What follows is a statistical summary of a brief vector run for each configuration across SHAs given above. The goal of these tests are to determine, quickly, if vector performance is changed and to what degree by a pull request. Where appropriate units are scaled per-core.

The table below, if present, lists those experiments that have experienced a statistically significant change in their throughput performance between baseline and comparision SHAs, with 90.0% confidence OR have been detected as newly erratic. Negative values mean that baseline is faster, positive comparison. Results that do not exhibit more than a ±8.87% change in mean throughput are discarded. An experiment is erratic if its coefficient of variation is greater than 0.3. The abbreviated table will be omitted if no interesting changes are observed.

No interesting changes in throughput with confidence ≥ 90.00% and absolute Δ mean >= ±8.87%:

Fine details of change detection per experiment.

experiment	Δ mean	Δ mean %	confidence	baseline mean	baseline stdev	baseline stderr	baseline CoV	comparison mean	comparison stdev	comparison stderr	comparison CoV	erratic	declared erratic
syslog_loki	102.89KiB	0.71	100.00%	14.08MiB	348.54KiB	7.14KiB	0.0241693	14.18MiB	726.08KiB	14.76KiB	0.0499933	False	False
splunk_hec_route_s3	61.49KiB	0.32	64.67%	18.58MiB	2.28MiB	47.44KiB	0.122597	18.64MiB	2.21MiB	46.24KiB	0.118475	False	False
splunk_hec_to_splunk_hec_logs_noack	22.76KiB	0.09	92.93%	23.81MiB	514.8KiB	10.51KiB	0.0211058	23.84MiB	339.72KiB	6.93KiB	0.0139147	False	False
splunk_hec_to_splunk_hec_logs_acks	4.44KiB	0.02	13.98%	23.74MiB	884.55KiB	17.99KiB	0.0363714	23.75MiB	866.18KiB	17.62KiB	0.0356099	False	False
http_pipelines_blackhole_acks	244.37B	0.02	7.58%	1.19MiB	99.67KiB	2.03KiB	0.0814393	1.2MiB	72.32KiB	1.47KiB	0.0590777	False	False
enterprise_http_to_http	-1.4KiB	-0.01	15.31%	23.85MiB	245.65KiB	5.01KiB	0.0100574	23.85MiB	254.84KiB	5.21KiB	0.0104343	False	False
splunk_hec_indexer_ack_blackhole	-8.1KiB	-0.03	24.44%	23.75MiB	891.7KiB	18.14KiB	0.0366592	23.74MiB	917.23KiB	18.65KiB	0.0377216	False	False
file_to_blackhole	-46.09KiB	-0.05	44.02%	95.35MiB	2.57MiB	53.36KiB	0.026992	95.3MiB	2.8MiB	58.29KiB	0.0293965	False	False
http_to_http_json	-57.32KiB	-0.23	99.99%	23.85MiB	341.61KiB	6.97KiB	0.0139862	23.79MiB	616.86KiB	12.57KiB	0.0253148	False	False
syslog_regex_logs2metric_ddmetrics	-40.64KiB	-0.31	98.42%	12.63MiB	621.42KiB	12.66KiB	0.048029	12.59MiB	544.67KiB	11.1KiB	0.0422296	False	False
syslog_log2metric_humio_metrics	-44.26KiB	-0.34	99.24%	12.56MiB	450.26KiB	9.19KiB	0.0349985	12.52MiB	677.52KiB	13.8KiB	0.0528453	False	False
fluent_elasticsearch	-298.08KiB	-0.37	99.97%	79.47MiB	53.94KiB	1.09KiB	0.000662636	79.18MiB	3.97MiB	81.61KiB	0.0500826	False	False
http_to_http_noack	-104.41KiB	-0.43	100.00%	23.84MiB	411.2KiB	8.41KiB	0.0168424	23.74MiB	1.15MiB	23.89KiB	0.0482669	False	False
syslog_splunk_hec_logs	-81.03KiB	-0.49	100.00%	16.23MiB	747.49KiB	15.21KiB	0.0449602	16.15MiB	610.02KiB	12.44KiB	0.0368711	False	False
syslog_humio_logs	-83.82KiB	-0.5	100.00%	16.36MiB	220.57KiB	4.5KiB	0.0131649	16.28MiB	134.42KiB	2.75KiB	0.00806334	False	False
datadog_agent_remap_blackhole	-353.37KiB	-0.58	99.91%	59.87MiB	3.93MiB	81.94KiB	0.0656149	59.52MiB	3.29MiB	68.58KiB	0.0552236	False	False
http_text_to_http_json	-265.42KiB	-0.65	100.00%	39.8MiB	854.54KiB	17.44KiB	0.0209659	39.54MiB	799.94KiB	16.34KiB	0.0197549	False	False
http_pipelines_blackhole	-20.35KiB	-1.22	100.00%	1.62MiB	121.89KiB	2.49KiB	0.0732484	1.6MiB	155.94KiB	3.18KiB	0.0948751	False	False
http_to_http_acks	-240.36KiB	-1.35	70.18%	17.43MiB	7.78MiB	162.78KiB	0.446409	17.2MiB	7.86MiB	163.94KiB	0.457056	True	True
datadog_agent_remap_datadog_logs_acks	-929.59KiB	-1.44	100.00%	62.91MiB	3.6MiB	75.19KiB	0.0572384	62.0MiB	4.4MiB	91.53KiB	0.0709039	False	False
syslog_log2metric_splunk_hec_metrics	-320.28KiB	-1.81	100.00%	17.28MiB	1.03MiB	21.58KiB	0.0598304	16.96MiB	1.21MiB	25.15KiB	0.0711222	False	False
datadog_agent_remap_datadog_logs	-1.16MiB	-1.89	100.00%	61.05MiB	1.83MiB	38.39KiB	0.0299704	59.9MiB	4.3MiB	89.63KiB	0.0718409	False	False
http_pipelines_no_grok_blackhole	-224.24KiB	-2.03	100.00%	10.79MiB	101.85KiB	2.08KiB	0.00921678	10.57MiB	1.05MiB	21.92KiB	0.0996041	False	False
datadog_agent_remap_blackhole_acks	-1.81MiB	-3.04	100.00%	59.58MiB	5.24MiB	109.07KiB	0.0878494	57.77MiB	4.54MiB	95.19KiB	0.0786265	False	False
socket_to_socket_blackhole	-969.66KiB	-3.91	100.00%	24.25MiB	363.6KiB	7.42KiB	0.0146418	23.3MiB	209.36KiB	4.27KiB	0.0087733	False	False

Sep 20 '22 17:09 github-actions[bot]

Soak Test Results

Baseline: ab3ca33efecdc91eff89fb9c0bb3a1ab81cd2762 Comparison: 32f959b7dc15f7ede98a158144c6b04b9740786c Total Vector CPUs: 4

Explanation

A soak test is an integrated performance test for vector in a repeatable rig, with varying configuration for vector. What follows is a statistical summary of a brief vector run for each configuration across SHAs given above. The goal of these tests are to determine, quickly, if vector performance is changed and to what degree by a pull request. Where appropriate units are scaled per-core.

The table below, if present, lists those experiments that have experienced a statistically significant change in their throughput performance between baseline and comparision SHAs, with 90.0% confidence OR have been detected as newly erratic. Negative values mean that baseline is faster, positive comparison. Results that do not exhibit more than a ±8.87% change in mean throughput are discarded. An experiment is erratic if its coefficient of variation is greater than 0.3. The abbreviated table will be omitted if no interesting changes are observed.

No interesting changes in throughput with confidence ≥ 90.00% and absolute Δ mean >= ±8.87%:

Fine details of change detection per experiment.

experiment	Δ mean	Δ mean %	confidence	baseline mean	baseline stdev	baseline stderr	baseline CoV	comparison mean	comparison stdev	comparison stderr	comparison CoV	erratic	declared erratic
syslog_loki	343.67KiB	2.38	100.00%	14.08MiB	515.61KiB	10.56KiB	0.0357431	14.42MiB	714.99KiB	14.53KiB	0.0484112	False	False
splunk_hec_route_s3	275.69KiB	1.48	99.99%	18.24MiB	2.37MiB	49.36KiB	0.129891	18.51MiB	2.29MiB	47.79KiB	0.123502	False	False
syslog_log2metric_humio_metrics	180.05KiB	1.39	100.00%	12.64MiB	373.05KiB	7.61KiB	0.0288145	12.82MiB	496.38KiB	10.11KiB	0.0378152	False	False
http_text_to_http_json	455.33KiB	1.15	100.00%	38.83MiB	1.16MiB	24.27KiB	0.0298954	39.27MiB	1.07MiB	22.29KiB	0.0271428	False	False
syslog_regex_logs2metric_ddmetrics	98.43KiB	0.77	100.00%	12.41MiB	592.06KiB	12.06KiB	0.046598	12.5MiB	561.02KiB	11.43KiB	0.0438156	False	False
syslog_humio_logs	81.0KiB	0.49	100.00%	16.27MiB	200.31KiB	4.09KiB	0.0120225	16.35MiB	203.93KiB	4.18KiB	0.0121805	False	False
syslog_splunk_hec_logs	67.87KiB	0.41	99.93%	16.33MiB	702.65KiB	14.3KiB	0.0420127	16.4MiB	686.33KiB	13.98KiB	0.0408711	False	False
syslog_log2metric_splunk_hec_metrics	41.26KiB	0.24	97.45%	16.85MiB	470.31KiB	9.59KiB	0.0272449	16.89MiB	775.65KiB	15.78KiB	0.044826	False	False
splunk_hec_to_splunk_hec_logs_acks	17.2KiB	0.07	50.22%	23.75MiB	916.4KiB	18.63KiB	0.0376805	23.76MiB	846.38KiB	17.22KiB	0.0347766	False	False
splunk_hec_to_splunk_hec_logs_noack	15.78KiB	0.06	81.82%	23.82MiB	473.04KiB	9.66KiB	0.0193883	23.84MiB	333.67KiB	6.81KiB	0.0136672	False	False
splunk_hec_indexer_ack_blackhole	11.42KiB	0.05	34.28%	23.75MiB	912.3KiB	18.56KiB	0.0375078	23.76MiB	875.29KiB	17.81KiB	0.0359693	False	False
enterprise_http_to_http	1.13KiB	0	11.57%	23.84MiB	263.34KiB	5.38KiB	0.0107831	23.85MiB	274.65KiB	5.62KiB	0.0112457	False	False
file_to_blackhole	-30.95KiB	-0.03	31.38%	95.35MiB	2.47MiB	51.25KiB	0.025925	95.32MiB	2.74MiB	56.94KiB	0.0287036	False	False
http_to_http_acks	-15.57KiB	-0.09	5.33%	17.26MiB	7.97MiB	166.6KiB	0.461662	17.25MiB	7.8MiB	162.95KiB	0.452216	True	True
http_to_http_json	-38.16KiB	-0.16	99.71%	23.85MiB	334.62KiB	6.83KiB	0.0136996	23.81MiB	530.91KiB	10.84KiB	0.0217701	False	False
fluent_elasticsearch	-132.54KiB	-0.16	100.00%	79.47MiB	53.55KiB	1.08KiB	0.000657841	79.34MiB	1.26MiB	25.97KiB	0.0158887	False	False
datadog_agent_remap_blackhole	-214.76KiB	-0.35	93.69%	59.9MiB	4.58MiB	95.28KiB	0.0764054	59.69MiB	3.13MiB	65.31KiB	0.0524174	False	False
http_to_http_noack	-86.81KiB	-0.36	99.87%	23.82MiB	611.61KiB	12.51KiB	0.0250695	23.73MiB	1.15MiB	23.96KiB	0.0484134	False	False
http_pipelines_blackhole	-7.47KiB	-0.43	99.86%	1.69MiB	11.15KiB	233.35B	0.00642651	1.69MiB	114.05KiB	2.32KiB	0.0660236	False	False
datadog_agent_remap_blackhole_acks	-420.07KiB	-0.67	99.98%	61.27MiB	4.57MiB	95.24KiB	0.0746379	60.86MiB	2.83MiB	59.36KiB	0.046563	False	False
socket_to_socket_blackhole	-169.68KiB	-0.7	100.00%	23.79MiB	437.97KiB	8.94KiB	0.0179722	23.63MiB	137.06KiB	2.8KiB	0.00566392	False	False
http_pipelines_no_grok_blackhole	-105.99KiB	-0.98	100.00%	10.56MiB	340.68KiB	6.95KiB	0.0315035	10.45MiB	1.06MiB	22.05KiB	0.101274	False	False
datadog_agent_remap_datadog_logs_acks	-624.18KiB	-1.02	100.00%	59.87MiB	3.08MiB	64.49KiB	0.0514791	59.27MiB	4.41MiB	91.73KiB	0.0743391	False	False
datadog_agent_remap_datadog_logs	-684.79KiB	-1.08	100.00%	61.91MiB	1.22MiB	25.49KiB	0.019659	61.24MiB	4.21MiB	87.72KiB	0.0687838	False	False
http_pipelines_blackhole_acks	-53.23KiB	-4.58	100.00%	1.13MiB	142.04KiB	2.89KiB	0.122311	1.08MiB	123.53KiB	2.52KiB	0.111482	False	False

Sep 22 '22 00:09 github-actions[bot]

Soak Test Results

Baseline: 285baaeb721218c6fc8dc89344b8d22806259b77 Comparison: 6cbf22e61b7f6a6706e54e3ec064f3390a4becbb Total Vector CPUs: 4

Explanation

A soak test is an integrated performance test for vector in a repeatable rig, with varying configuration for vector. What follows is a statistical summary of a brief vector run for each configuration across SHAs given above. The goal of these tests are to determine, quickly, if vector performance is changed and to what degree by a pull request. Where appropriate units are scaled per-core.

The table below, if present, lists those experiments that have experienced a statistically significant change in their throughput performance between baseline and comparision SHAs, with 90.0% confidence OR have been detected as newly erratic. Negative values mean that baseline is faster, positive comparison. Results that do not exhibit more than a ±8.87% change in mean throughput are discarded. An experiment is erratic if its coefficient of variation is greater than 0.3. The abbreviated table will be omitted if no interesting changes are observed.

No interesting changes in throughput with confidence ≥ 90.00% and absolute Δ mean >= ±8.87%:

Fine details of change detection per experiment.

experiment	Δ mean	Δ mean %	confidence	baseline mean	baseline stdev	baseline stderr	baseline CoV	comparison mean	comparison stdev	comparison stderr	comparison CoV	erratic	declared erratic
syslog_splunk_hec_logs	167.41KiB	1	100.00%	16.27MiB	700.89KiB	14.27KiB	0.0420621	16.43MiB	640.04KiB	13.04KiB	0.0380284	False	False
syslog_regex_logs2metric_ddmetrics	121.8KiB	0.99	100.00%	12.07MiB	554.12KiB	11.29KiB	0.0448171	12.19MiB	598.55KiB	12.2KiB	0.0479387	False	False
syslog_log2metric_humio_metrics	129.31KiB	0.99	100.00%	12.76MiB	353.48KiB	7.21KiB	0.027056	12.88MiB	496.94KiB	10.12KiB	0.0376638	False	False
syslog_humio_logs	150.14KiB	0.9	100.00%	16.36MiB	245.15KiB	5.01KiB	0.0146275	16.51MiB	167.11KiB	3.42KiB	0.00988268	False	False
http_to_http_acks	128.8KiB	0.73	41.63%	17.21MiB	7.96MiB	166.3KiB	0.462281	17.33MiB	7.96MiB	166.03KiB	0.458962	True	True
syslog_log2metric_splunk_hec_metrics	119.91KiB	0.69	100.00%	16.94MiB	765.47KiB	15.61KiB	0.0441125	17.06MiB	982.56KiB	19.99KiB	0.0562341	False	False
datadog_agent_remap_blackhole_acks	375.35KiB	0.61	99.96%	59.77MiB	4.15MiB	86.3KiB	0.0693437	60.13MiB	2.97MiB	62.13KiB	0.0494214	False	False
syslog_loki	27.2KiB	0.18	89.71%	14.48MiB	356.64KiB	7.3KiB	0.0240499	14.51MiB	737.47KiB	14.99KiB	0.0496396	False	False
splunk_hec_to_splunk_hec_logs_noack	28.06KiB	0.12	96.86%	23.81MiB	541.27KiB	11.04KiB	0.0221945	23.84MiB	338.9KiB	6.92KiB	0.0138806	False	False
http_pipelines_blackhole_acks	1.31KiB	0.1	36.55%	1.23MiB	108.75KiB	2.21KiB	0.0861147	1.23MiB	80.27KiB	1.64KiB	0.0634925	False	False
datadog_agent_remap_blackhole	40.61KiB	0.07	30.35%	59.85MiB	3.85MiB	80.2KiB	0.064286	59.89MiB	3.18MiB	66.35KiB	0.0531169	False	False
splunk_hec_to_splunk_hec_logs_acks	14.24KiB	0.06	43.49%	23.74MiB	883.92KiB	17.98KiB	0.036347	23.76MiB	835.87KiB	17.01KiB	0.0343513	False	False
enterprise_http_to_http	127.35B	0	1.36%	23.85MiB	250.55KiB	5.11KiB	0.0102586	23.85MiB	255.69KiB	5.23KiB	0.0104691	False	False
splunk_hec_route_s3	-4.3KiB	-0.02	5.06%	17.65MiB	2.31MiB	48.04KiB	0.130768	17.64MiB	2.29MiB	47.88KiB	0.129736	False	False
splunk_hec_indexer_ack_blackhole	-9.61KiB	-0.04	28.11%	23.75MiB	906.83KiB	18.45KiB	0.0372781	23.74MiB	948.19KiB	19.28KiB	0.038994	False	False
file_to_blackhole	-69.9KiB	-0.07	50.13%	95.34MiB	3.19MiB	66.12KiB	0.033447	95.27MiB	3.82MiB	79.37KiB	0.0400893	False	False
http_to_http_json	-36.38KiB	-0.15	99.61%	23.85MiB	332.46KiB	6.79KiB	0.0136111	23.81MiB	520.05KiB	10.62KiB	0.0213226	False	False
fluent_elasticsearch	-219.46KiB	-0.27	100.00%	79.47MiB	54.02KiB	1.09KiB	0.000663689	79.26MiB	1.83MiB	37.68KiB	0.0231087	False	False
http_to_http_noack	-69.42KiB	-0.28	99.87%	23.84MiB	402.2KiB	8.21KiB	0.0164742	23.77MiB	981.49KiB	20.0KiB	0.0403164	False	False
http_pipelines_blackhole	-6.54KiB	-0.39	99.89%	1.66MiB	29.26KiB	612.18B	0.0172306	1.65MiB	93.35KiB	1.9KiB	0.0551912	False	False
datadog_agent_remap_datadog_logs	-705.92KiB	-1.1	100.00%	62.6MiB	632.73KiB	12.96KiB	0.00986906	61.91MiB	4.32MiB	89.9KiB	0.0697372	False	False
datadog_agent_remap_datadog_logs_acks	-714.46KiB	-1.12	100.00%	62.1MiB	2.72MiB	56.95KiB	0.0438124	61.4MiB	4.39MiB	91.32KiB	0.0714364	False	False
socket_to_socket_blackhole	-797.76KiB	-3.29	100.00%	23.69MiB	524.37KiB	10.7KiB	0.0216142	22.91MiB	267.64KiB	5.46KiB	0.0114071	False	False
http_text_to_http_json	-1.3MiB	-3.31	100.00%	39.27MiB	861.77KiB	17.59KiB	0.021426	37.97MiB	888.32KiB	18.13KiB	0.0228412	False	False
http_pipelines_no_grok_blackhole	-707.83KiB	-6.45	100.00%	10.71MiB	212.3KiB	4.33KiB	0.0193544	10.02MiB	1.22MiB	25.43KiB	0.121874	False	False

Sep 24 '22 06:09 github-actions[bot]

Soak Test Results

Baseline: 9b9e303f9ffdb6b70afcc5c3f39b58d1450d3ca2 Comparison: ba17191cb2607b2fcadaba1341377b53a95e5294 Total Vector CPUs: 4

Explanation

A soak test is an integrated performance test for vector in a repeatable rig, with varying configuration for vector. What follows is a statistical summary of a brief vector run for each configuration across SHAs given above. The goal of these tests are to determine, quickly, if vector performance is changed and to what degree by a pull request. Where appropriate units are scaled per-core.

The table below, if present, lists those experiments that have experienced a statistically significant change in their throughput performance between baseline and comparision SHAs, with 90.0% confidence OR have been detected as newly erratic. Negative values mean that baseline is faster, positive comparison. Results that do not exhibit more than a ±8.87% change in mean throughput are discarded. An experiment is erratic if its coefficient of variation is greater than 0.3. The abbreviated table will be omitted if no interesting changes are observed.

No interesting changes in throughput with confidence ≥ 90.00% and absolute Δ mean >= ±8.87%:

Fine details of change detection per experiment.

experiment	Δ mean	Δ mean %	confidence	baseline mean	baseline stdev	baseline stderr	baseline CoV	comparison mean	comparison stdev	comparison stderr	comparison CoV	erratic	declared erratic
splunk_hec_route_s3	276.99KiB	1.46	100.00%	18.55MiB	2.26MiB	47.02KiB	0.1217	18.82MiB	2.17MiB	45.35KiB	0.115168	False	False
syslog_humio_logs	186.73KiB	1.12	100.00%	16.32MiB	344.48KiB	7.03KiB	0.020608	16.5MiB	271.62KiB	5.56KiB	0.01607	False	False
http_to_http_acks	132.72KiB	0.75	42.64%	17.39MiB	7.87MiB	164.56KiB	0.452504	17.52MiB	8.1MiB	168.88KiB	0.462188	True	True
syslog_log2metric_splunk_hec_metrics	106.71KiB	0.6	100.00%	17.39MiB	683.71KiB	13.94KiB	0.0383837	17.5MiB	902.58KiB	18.37KiB	0.0503691	False	False
datadog_agent_remap_blackhole	341.26KiB	0.55	99.87%	60.46MiB	4.13MiB	85.97KiB	0.0682365	60.8MiB	2.96MiB	61.69KiB	0.0486267	False	False
syslog_splunk_hec_logs	79.49KiB	0.47	100.00%	16.35MiB	680.67KiB	13.86KiB	0.0406562	16.42MiB	531.71KiB	10.85KiB	0.0316086	False	False
datadog_agent_remap_blackhole_acks	278.79KiB	0.44	98.98%	62.31MiB	4.22MiB	87.79KiB	0.0676438	62.58MiB	3.05MiB	63.76KiB	0.0487088	False	False
syslog_regex_logs2metric_ddmetrics	53.9KiB	0.42	99.83%	12.46MiB	602.65KiB	12.27KiB	0.0472207	12.51MiB	591.38KiB	12.05KiB	0.0461421	False	False
datadog_agent_remap_datadog_logs_acks	132.64KiB	0.21	76.66%	61.55MiB	2.98MiB	62.32KiB	0.0484074	61.68MiB	4.43MiB	92.2KiB	0.0717941	False	False
splunk_hec_to_splunk_hec_logs_noack	17.08KiB	0.07	85.07%	23.82MiB	476.58KiB	9.73KiB	0.0195349	23.84MiB	330.09KiB	6.74KiB	0.0135206	False	False
splunk_hec_to_splunk_hec_logs_acks	17.84KiB	0.07	53.59%	23.75MiB	885.51KiB	18.01KiB	0.0364083	23.76MiB	807.01KiB	16.43KiB	0.0331566	False	False
enterprise_http_to_http	1.4KiB	0.01	14.99%	23.84MiB	255.62KiB	5.22KiB	0.0104672	23.85MiB	257.93KiB	5.28KiB	0.010561	False	False
splunk_hec_indexer_ack_blackhole	-3.29KiB	-0.01	9.83%	23.75MiB	908.54KiB	18.48KiB	0.0373524	23.75MiB	941.65KiB	19.15KiB	0.038719	False	False
file_to_blackhole	-79.07KiB	-0.08	59.17%	95.34MiB	3.03MiB	62.76KiB	0.0317489	95.26MiB	3.47MiB	72.13KiB	0.0364103	False	False
syslog_loki	-23.89KiB	-0.16	87.48%	14.52MiB	220.17KiB	4.51KiB	0.0148097	14.49MiB	733.46KiB	14.91KiB	0.0494156	False	False
http_to_http_json	-40.4KiB	-0.17	99.77%	23.85MiB	345.95KiB	7.06KiB	0.0141652	23.81MiB	548.61KiB	11.2KiB	0.0225003	False	False
datadog_agent_remap_datadog_logs	-105.37KiB	-0.17	75.97%	61.65MiB	1.04MiB	21.83KiB	0.0168954	61.55MiB	4.18MiB	87.01KiB	0.0678783	False	False
http_pipelines_blackhole_acks	-2.55KiB	-0.21	61.39%	1.21MiB	112.62KiB	2.29KiB	0.0909467	1.21MiB	90.68KiB	1.85KiB	0.0733788	False	False
http_to_http_noack	-113.1KiB	-0.46	100.00%	23.83MiB	522.11KiB	10.67KiB	0.0213927	23.72MiB	1.23MiB	25.54KiB	0.0516632	False	False
syslog_log2metric_humio_metrics	-77.91KiB	-0.58	100.00%	13.05MiB	280.97KiB	5.74KiB	0.0210133	12.98MiB	608.72KiB	12.38KiB	0.0457924	False	False
fluent_elasticsearch	-503.57KiB	-0.62	100.00%	79.47MiB	53.23KiB	1.07KiB	0.000653975	78.98MiB	4.69MiB	96.32KiB	0.0594186	False	False
http_pipelines_no_grok_blackhole	-69.28KiB	-0.63	99.90%	10.77MiB	100.65KiB	2.06KiB	0.00912622	10.7MiB	1.01MiB	21.0KiB	0.0942164	False	False
socket_to_socket_blackhole	-204.24KiB	-0.87	100.00%	23.0MiB	239.19KiB	4.88KiB	0.0101535	22.8MiB	314.52KiB	6.42KiB	0.0134683	False	False
http_pipelines_blackhole	-16.05KiB	-0.93	100.00%	1.69MiB	30.43KiB	637.27B	0.0175775	1.67MiB	137.79KiB	2.81KiB	0.0803346	False	False
http_text_to_http_json	-374.09KiB	-0.95	100.00%	38.31MiB	819.42KiB	16.73KiB	0.0208822	37.95MiB	1013.1KiB	20.68KiB	0.0260666	False	False

Sep 26 '22 00:09 github-actions[bot]

Soak Test Results

Baseline: b6ac5e789bd3bed9ac88700487f89441cb14d31f Comparison: 2ce5771e00e8c28a56e6c92bcfce3bc6866fb219 Total Vector CPUs: 4

Explanation

A soak test is an integrated performance test for vector in a repeatable rig, with varying configuration for vector. What follows is a statistical summary of a brief vector run for each configuration across SHAs given above. The goal of these tests are to determine, quickly, if vector performance is changed and to what degree by a pull request. Where appropriate units are scaled per-core.

The table below, if present, lists those experiments that have experienced a statistically significant change in their throughput performance between baseline and comparision SHAs, with 90.0% confidence OR have been detected as newly erratic. Negative values mean that baseline is faster, positive comparison. Results that do not exhibit more than a ±8.87% change in mean throughput are discarded. An experiment is erratic if its coefficient of variation is greater than 0.3. The abbreviated table will be omitted if no interesting changes are observed.

No interesting changes in throughput with confidence ≥ 90.00% and absolute Δ mean >= ±8.87%:

Fine details of change detection per experiment.

experiment	Δ mean	Δ mean %	confidence	baseline mean	baseline stdev	baseline stderr	baseline CoV	comparison mean	comparison stdev	comparison stderr	comparison CoV	erratic	declared erratic
datadog_agent_remap_blackhole_acks	813.85KiB	1.35	100.00%	58.87MiB	5.14MiB	107.08KiB	0.0873428	59.67MiB	3.86MiB	80.7KiB	0.0646402	False	False
http_to_http_acks	208.96KiB	1.19	62.04%	17.11MiB	8.1MiB	169.31KiB	0.473344	17.31MiB	8.0MiB	166.95KiB	0.461814	True	True
http_pipelines_blackhole_acks	8.78KiB	0.7	99.87%	1.23MiB	105.51KiB	2.15KiB	0.0840577	1.23MiB	82.81KiB	1.69KiB	0.0655126	False	False
syslog_log2metric_splunk_hec_metrics	125.61KiB	0.7	100.00%	17.59MiB	574.31KiB	11.7KiB	0.0318735	17.72MiB	731.15KiB	14.89KiB	0.0402968	False	False
syslog_humio_logs	103.24KiB	0.62	100.00%	16.25MiB	183.28KiB	3.74KiB	0.0110116	16.35MiB	213.46KiB	4.37KiB	0.0127461	False	False
splunk_hec_route_s3	111.39KiB	0.59	90.86%	18.55MiB	2.3MiB	47.93KiB	0.12397	18.66MiB	2.17MiB	45.35KiB	0.116143	False	False
syslog_regex_logs2metric_ddmetrics	33.3KiB	0.26	98.60%	12.45MiB	521.83KiB	10.64KiB	0.0409184	12.48MiB	410.66KiB	8.38KiB	0.0321177	False	False
enterprise_http_to_http	1.74KiB	0.01	18.86%	23.84MiB	251.81KiB	5.14KiB	0.0103112	23.85MiB	253.95KiB	5.19KiB	0.010398	False	False
splunk_hec_to_splunk_hec_logs_noack	-1.14KiB	-0	9.47%	23.84MiB	330.69KiB	6.75KiB	0.0135441	23.84MiB	332.85KiB	6.79KiB	0.0136333	False	False
splunk_hec_indexer_ack_blackhole	-956.81B	-0	3.22%	23.76MiB	797.65KiB	16.22KiB	0.0327838	23.75MiB	810.41KiB	16.48KiB	0.0333092	False	False
splunk_hec_to_splunk_hec_logs_acks	-2.73KiB	-0.01	8.93%	23.76MiB	840.12KiB	17.09KiB	0.0345276	23.75MiB	851.09KiB	17.32KiB	0.0349823	False	False
file_to_blackhole	-59.05KiB	-0.06	50.67%	95.34MiB	2.71MiB	56.22KiB	0.0284398	95.28MiB	3.14MiB	65.33KiB	0.0329595	False	False
http_to_http_json	-26.3KiB	-0.11	97.38%	23.85MiB	333.85KiB	6.81KiB	0.0136694	23.82MiB	472.65KiB	9.66KiB	0.0193732	False	False
http_text_to_http_json	-69.81KiB	-0.18	99.28%	38.11MiB	846.17KiB	17.27KiB	0.0216798	38.04MiB	948.88KiB	19.37KiB	0.0243549	False	False
syslog_log2metric_humio_metrics	-31.68KiB	-0.26	99.63%	12.07MiB	232.77KiB	4.75KiB	0.0188262	12.04MiB	482.19KiB	9.82KiB	0.0390996	False	False
http_pipelines_blackhole	-5.76KiB	-0.34	98.32%	1.67MiB	15.99KiB	334.53B	0.00932529	1.67MiB	117.12KiB	2.39KiB	0.0685434	False	False
http_to_http_noack	-101.83KiB	-0.42	100.00%	23.84MiB	259.69KiB	5.31KiB	0.0106333	23.75MiB	1.09MiB	22.74KiB	0.0459156	False	False
datadog_agent_remap_blackhole	-271.55KiB	-0.46	95.44%	58.22MiB	4.95MiB	103.03KiB	0.0849479	57.95MiB	4.24MiB	88.42KiB	0.0731194	False	False
http_pipelines_no_grok_blackhole	-61.34KiB	-0.57	99.41%	10.44MiB	277.58KiB	5.66KiB	0.0259677	10.38MiB	1.03MiB	21.54KiB	0.0996593	False	False
fluent_elasticsearch	-514.52KiB	-0.63	100.00%	79.47MiB	54.18KiB	1.09KiB	0.000665655	78.97MiB	5.14MiB	105.52KiB	0.0651004	False	False
syslog_splunk_hec_logs	-149.49KiB	-0.9	100.00%	16.14MiB	776.92KiB	15.81KiB	0.0470038	15.99MiB	664.66KiB	13.55KiB	0.0405794	False	False
datadog_agent_remap_datadog_logs	-1.26MiB	-2.08	100.00%	60.32MiB	2.91MiB	60.98KiB	0.0482611	59.07MiB	4.98MiB	103.8KiB	0.0843555	False	False
datadog_agent_remap_datadog_logs_acks	-1.33MiB	-2.25	100.00%	59.28MiB	3.53MiB	73.81KiB	0.059508	57.95MiB	4.57MiB	95.12KiB	0.0788392	False	False
syslog_loki	-345.68KiB	-2.34	100.00%	14.44MiB	438.21KiB	8.97KiB	0.0296273	14.1MiB	793.74KiB	16.13KiB	0.0549485	False	False
socket_to_socket_blackhole	-744.59KiB	-3.13	100.00%	23.21MiB	375.61KiB	7.67KiB	0.0157975	22.49MiB	566.3KiB	11.56KiB	0.0245883	False	False

Sep 26 '22 21:09 github-actions[bot]

Soak Test Results

Baseline: b6ac5e789bd3bed9ac88700487f89441cb14d31f Comparison: 6803988041f8d7d3fbb1f375e9ff8b161ee3e0b4 Total Vector CPUs: 4

Explanation

A soak test is an integrated performance test for vector in a repeatable rig, with varying configuration for vector. What follows is a statistical summary of a brief vector run for each configuration across SHAs given above. The goal of these tests are to determine, quickly, if vector performance is changed and to what degree by a pull request. Where appropriate units are scaled per-core.

The table below, if present, lists those experiments that have experienced a statistically significant change in their throughput performance between baseline and comparision SHAs, with 90.0% confidence OR have been detected as newly erratic. Negative values mean that baseline is faster, positive comparison. Results that do not exhibit more than a ±8.87% change in mean throughput are discarded. An experiment is erratic if its coefficient of variation is greater than 0.3. The abbreviated table will be omitted if no interesting changes are observed.

No interesting changes in throughput with confidence ≥ 90.00% and absolute Δ mean >= ±8.87%:

Fine details of change detection per experiment.

experiment	Δ mean	Δ mean %	confidence	baseline mean	baseline stdev	baseline stderr	baseline CoV	comparison mean	comparison stdev	comparison stderr	comparison CoV	erratic	declared erratic
http_to_http_acks	230.57KiB	1.31	67.02%	17.21MiB	8.0MiB	167.26KiB	0.464739	17.44MiB	8.01MiB	167.29KiB	0.459503	True	True
syslog_log2metric_splunk_hec_metrics	149.96KiB	0.84	100.00%	17.49MiB	602.25KiB	12.27KiB	0.0336236	17.63MiB	719.42KiB	14.65KiB	0.0398315	False	False
syslog_humio_logs	90.37KiB	0.53	100.00%	16.5MiB	194.94KiB	3.98KiB	0.0115335	16.59MiB	147.88KiB	3.03KiB	0.00870298	False	False
syslog_log2metric_humio_metrics	43.63KiB	0.37	83.26%	11.61MiB	1.01MiB	21.07KiB	0.0867535	11.65MiB	1.13MiB	23.55KiB	0.0969149	False	False
datadog_agent_remap_blackhole	160.15KiB	0.27	77.04%	57.27MiB	4.81MiB	100.14KiB	0.0839349	57.43MiB	4.22MiB	87.97KiB	0.07344	False	False
splunk_hec_indexer_ack_blackhole	23.16KiB	0.1	63.76%	23.75MiB	925.36KiB	18.82KiB	0.0380466	23.77MiB	840.05KiB	17.1KiB	0.0345061	False	False
syslog_regex_logs2metric_ddmetrics	8.29KiB	0.07	42.02%	12.37MiB	514.1KiB	10.48KiB	0.0405709	12.38MiB	523.93KiB	10.68KiB	0.0413194	False	False
splunk_hec_to_splunk_hec_logs_acks	9.93KiB	0.04	33.23%	23.76MiB	825.97KiB	16.81KiB	0.0339394	23.77MiB	780.53KiB	15.89KiB	0.0320592	False	False
splunk_hec_to_splunk_hec_logs_noack	4.53KiB	0.02	33.43%	23.83MiB	391.82KiB	8.0KiB	0.0160514	23.84MiB	332.58KiB	6.79KiB	0.0136221	False	False
datadog_agent_remap_blackhole_acks	15.12KiB	0.02	9.39%	59.96MiB	4.73MiB	98.51KiB	0.0788701	59.98MiB	3.92MiB	81.91KiB	0.0653714	False	False
enterprise_http_to_http	2.96KiB	0.01	30.89%	23.84MiB	257.38KiB	5.25KiB	0.0105393	23.85MiB	257.13KiB	5.26KiB	0.0105277	False	False
file_to_blackhole	-40.64KiB	-0.04	29.89%	95.34MiB	3.39MiB	70.29KiB	0.0355569	95.3MiB	3.81MiB	79.16KiB	0.0399293	False	False
http_to_http_json	-17.92KiB	-0.07	90.49%	23.85MiB	329.41KiB	6.72KiB	0.013486	23.83MiB	408.68KiB	8.37KiB	0.0167434	False	False
syslog_splunk_hec_logs	-36.62KiB	-0.22	91.85%	16.05MiB	803.02KiB	16.34KiB	0.0488531	16.01MiB	647.8KiB	13.22KiB	0.0394981	False	False
http_pipelines_no_grok_blackhole	-35.67KiB	-0.32	91.78%	10.79MiB	78.77KiB	1.61KiB	0.00712761	10.76MiB	1005.38KiB	20.45KiB	0.0912653	False	False
http_text_to_http_json	-136.61KiB	-0.36	99.99%	37.53MiB	1.06MiB	22.25KiB	0.0283585	37.4MiB	1.27MiB	26.46KiB	0.0338427	False	False
http_pipelines_blackhole	-7.11KiB	-0.41	99.61%	1.68MiB	40.81KiB	854.5B	0.0236633	1.68MiB	113.64KiB	2.32KiB	0.0661595	False	False
http_to_http_noack	-104.16KiB	-0.43	100.00%	23.85MiB	255.44KiB	5.23KiB	0.0104594	23.74MiB	1.1MiB	22.97KiB	0.0463932	False	False
splunk_hec_route_s3	-93.74KiB	-0.5	81.14%	18.35MiB	2.43MiB	50.57KiB	0.132344	18.25MiB	2.4MiB	50.24KiB	0.131554	False	False
fluent_elasticsearch	-446.29KiB	-0.55	100.00%	79.47MiB	52.79KiB	1.07KiB	0.000648526	79.04MiB	4.46MiB	91.59KiB	0.0564231	False	False
http_pipelines_blackhole_acks	-7.73KiB	-0.62	99.10%	1.22MiB	115.94KiB	2.36KiB	0.0924835	1.22MiB	87.78KiB	1.79KiB	0.0704599	False	False
datadog_agent_remap_datadog_logs_acks	-627.05KiB	-1.02	100.00%	60.24MiB	3.08MiB	64.35KiB	0.0510754	59.63MiB	4.38MiB	91.07KiB	0.0733611	False	False
datadog_agent_remap_datadog_logs	-791.6KiB	-1.27	100.00%	60.89MiB	1018.32KiB	20.83KiB	0.0163286	60.12MiB	4.21MiB	87.75KiB	0.0700762	False	False
socket_to_socket_blackhole	-688.17KiB	-2.88	100.00%	23.29MiB	292.3KiB	5.97KiB	0.0122515	22.62MiB	248.08KiB	5.06KiB	0.0107071	False	False
syslog_loki	-691.12KiB	-4.6	100.00%	14.68MiB	293.28KiB	6.01KiB	0.0195006	14.01MiB	882.41KiB	17.94KiB	0.0614996	False	False

Sep 26 '22 21:09 github-actions[bot]

Soak Test Results

Baseline: ab07ed583a1f7ddb4615dde0a9ca1474648c8b95 Comparison: 4399e7356e51200e2ad1d805366d9f6c23f7b8d5 Total Vector CPUs: 4

Explanation

A soak test is an integrated performance test for vector in a repeatable rig, with varying configuration for vector. What follows is a statistical summary of a brief vector run for each configuration across SHAs given above. The goal of these tests are to determine, quickly, if vector performance is changed and to what degree by a pull request. Where appropriate units are scaled per-core.

The table below, if present, lists those experiments that have experienced a statistically significant change in their throughput performance between baseline and comparision SHAs, with 90.0% confidence OR have been detected as newly erratic. Negative values mean that baseline is faster, positive comparison. Results that do not exhibit more than a ±8.87% change in mean throughput are discarded. An experiment is erratic if its coefficient of variation is greater than 0.3. The abbreviated table will be omitted if no interesting changes are observed.

No interesting changes in throughput with confidence ≥ 90.00% and absolute Δ mean >= ±8.87%:

Fine details of change detection per experiment.

experiment	Δ mean	Δ mean %	confidence	baseline mean	baseline stdev	baseline stderr	baseline CoV	comparison mean	comparison stdev	comparison stderr	comparison CoV	erratic	declared erratic
datadog_agent_remap_blackhole_acks	866.39KiB	1.42	100.00%	59.57MiB	5.05MiB	105.1KiB	0.0847295	60.41MiB	3.65MiB	76.28KiB	0.060353	False	False
datadog_agent_remap_blackhole	744.48KiB	1.22	100.00%	59.62MiB	4.2MiB	87.38KiB	0.0703712	60.34MiB	2.83MiB	59.12KiB	0.0469374	False	False
http_pipelines_blackhole_acks	7.91KiB	0.65	99.56%	1.2MiB	107.11KiB	2.18KiB	0.0874259	1.2MiB	84.2KiB	1.72KiB	0.068289	False	False
syslog_humio_logs	63.67KiB	0.38	100.00%	16.27MiB	126.03KiB	2.57KiB	0.00756466	16.33MiB	138.92KiB	2.84KiB	0.00830683	False	False
syslog_splunk_hec_logs	35.76KiB	0.22	84.43%	15.87MiB	938.21KiB	19.09KiB	0.0577229	15.9MiB	805.44KiB	16.42KiB	0.0494456	False	False
http_pipelines_no_grok_blackhole	20.6KiB	0.19	66.93%	10.66MiB	155.74KiB	3.18KiB	0.0142705	10.68MiB	1.01MiB	20.94KiB	0.0941306	False	False
splunk_hec_route_s3	22.8KiB	0.12	26.33%	17.95MiB	2.33MiB	48.59KiB	0.1299	17.97MiB	2.26MiB	47.3KiB	0.125764	False	False
splunk_hec_to_splunk_hec_logs_noack	13.5KiB	0.06	77.12%	23.82MiB	434.57KiB	8.88KiB	0.0178095	23.84MiB	335.79KiB	6.86KiB	0.0137537	False	False
http_pipelines_blackhole	607.9B	0.03	21.33%	1.69MiB	14.94KiB	312.83B	0.00862684	1.69MiB	106.56KiB	2.17KiB	0.061495	False	False
enterprise_http_to_http	-659.48B	-0	7.06%	23.85MiB	252.75KiB	5.16KiB	0.0103483	23.85MiB	250.13KiB	5.12KiB	0.0102412	False	False
splunk_hec_indexer_ack_blackhole	-11.75KiB	-0.05	34.05%	23.75MiB	904.55KiB	18.4KiB	0.037183	23.74MiB	949.01KiB	19.3KiB	0.0390296	False	False
splunk_hec_to_splunk_hec_logs_acks	-15.27KiB	-0.06	48.29%	23.77MiB	781.93KiB	15.91KiB	0.0321217	23.75MiB	854.31KiB	17.38KiB	0.0351169	False	False
file_to_blackhole	-57.24KiB	-0.06	51.17%	95.34MiB	2.62MiB	54.34KiB	0.0274891	95.29MiB	2.99MiB	62.18KiB	0.0313728	False	False
syslog_regex_logs2metric_ddmetrics	-10.46KiB	-0.08	52.82%	12.41MiB	554.1KiB	11.29KiB	0.0435831	12.4MiB	448.97KiB	9.16KiB	0.0353436	False	False
syslog_log2metric_splunk_hec_metrics	-16.24KiB	-0.09	57.72%	17.24MiB	602.76KiB	12.29KiB	0.0341398	17.22MiB	791.68KiB	16.11KiB	0.0448811	False	False
http_to_http_json	-30.98KiB	-0.13	98.92%	23.85MiB	329.9KiB	6.74KiB	0.0135071	23.82MiB	494.8KiB	10.11KiB	0.0202839	False	False
http_to_http_noack	-94.54KiB	-0.39	99.99%	23.84MiB	403.02KiB	8.24KiB	0.0165071	23.75MiB	1.08MiB	22.62KiB	0.0456692	False	False
fluent_elasticsearch	-374.61KiB	-0.46	100.00%	79.47MiB	53.76KiB	1.09KiB	0.000660497	79.11MiB	4.31MiB	88.55KiB	0.0544485	False	False
syslog_loki	-169.48KiB	-1.19	100.00%	13.92MiB	666.69KiB	13.64KiB	0.0467713	13.75MiB	909.3KiB	18.48KiB	0.0645596	False	False
datadog_agent_remap_datadog_logs	-1.04MiB	-1.68	100.00%	61.87MiB	633.27KiB	12.96KiB	0.00999435	60.83MiB	3.94MiB	82.09KiB	0.0647703	False	False
datadog_agent_remap_datadog_logs_acks	-1.16MiB	-1.88	100.00%	61.5MiB	3.32MiB	69.43KiB	0.0540184	60.35MiB	4.45MiB	92.53KiB	0.0736438	False	False
syslog_log2metric_humio_metrics	-264.99KiB	-2.08	100.00%	12.45MiB	381.19KiB	7.78KiB	0.0298873	12.19MiB	533.05KiB	10.85KiB	0.0426809	False	False
socket_to_socket_blackhole	-694.1KiB	-2.99	100.00%	22.68MiB	554.03KiB	11.31KiB	0.0238492	22.0MiB	488.08KiB	9.96KiB	0.0216576	False	False
http_to_http_acks	-606.99KiB	-3.35	98.77%	17.69MiB	8.4MiB	175.64KiB	0.474487	17.1MiB	7.99MiB	166.99KiB	0.467042	True	True
http_text_to_http_json	-1.75MiB	-4.38	100.00%	39.82MiB	732.2KiB	14.95KiB	0.0179551	38.07MiB	948.81KiB	19.37KiB	0.0243338	False	False

Sep 28 '22 19:09 github-actions[bot]

Soak Test Results

Baseline: ab07ed583a1f7ddb4615dde0a9ca1474648c8b95 Comparison: 7869f54dea0ed7d1062310eff0f2bf60f8071382 Total Vector CPUs: 4

Explanation

A soak test is an integrated performance test for vector in a repeatable rig, with varying configuration for vector. What follows is a statistical summary of a brief vector run for each configuration across SHAs given above. The goal of these tests are to determine, quickly, if vector performance is changed and to what degree by a pull request. Where appropriate units are scaled per-core.

The table below, if present, lists those experiments that have experienced a statistically significant change in their throughput performance between baseline and comparision SHAs, with 90.0% confidence OR have been detected as newly erratic. Negative values mean that baseline is faster, positive comparison. Results that do not exhibit more than a ±8.87% change in mean throughput are discarded. An experiment is erratic if its coefficient of variation is greater than 0.3. The abbreviated table will be omitted if no interesting changes are observed.

No interesting changes in throughput with confidence ≥ 90.00% and absolute Δ mean >= ±8.87%:

Fine details of change detection per experiment.

experiment	Δ mean	Δ mean %	confidence	baseline mean	baseline stdev	baseline stderr	baseline CoV	comparison mean	comparison stdev	comparison stderr	comparison CoV	erratic	declared erratic
datadog_agent_remap_blackhole	1.37MiB	2.5	100.00%	54.93MiB	7.23MiB	150.71KiB	0.131633	56.31MiB	6.37MiB	132.98KiB	0.11317	False	False
http_pipelines_blackhole_acks	16.07KiB	1.34	100.00%	1.17MiB	107.27KiB	2.18KiB	0.0894882	1.19MiB	79.91KiB	1.63KiB	0.0657857	False	False
datadog_agent_remap_blackhole_acks	384.94KiB	0.63	99.97%	60.07MiB	4.4MiB	91.49KiB	0.073161	60.44MiB	2.61MiB	54.56KiB	0.043116	False	False
syslog_humio_logs	87.1KiB	0.51	100.00%	16.54MiB	254.34KiB	5.19KiB	0.0150113	16.63MiB	165.88KiB	3.4KiB	0.00973998	False	False
syslog_log2metric_splunk_hec_metrics	80.23KiB	0.45	100.00%	17.58MiB	426.39KiB	8.7KiB	0.0236845	17.66MiB	748.38KiB	15.23KiB	0.0413853	False	False
http_pipelines_blackhole	2.42KiB	0.14	64.50%	1.68MiB	30.56KiB	639.57B	0.0177205	1.69MiB	124.53KiB	2.54KiB	0.072109	False	False
splunk_hec_to_splunk_hec_logs_noack	23.93KiB	0.1	94.71%	23.82MiB	503.12KiB	10.27KiB	0.0206253	23.84MiB	337.05KiB	6.88KiB	0.0138038	False	False
syslog_splunk_hec_logs	14.81KiB	0.09	49.75%	16.12MiB	777.66KiB	15.83KiB	0.0470924	16.14MiB	755.76KiB	15.4KiB	0.0457255	False	False
enterprise_http_to_http	-2.06KiB	-0.01	21.25%	23.85MiB	262.56KiB	5.36KiB	0.0107502	23.84MiB	266.2KiB	5.45KiB	0.0109001	False	False
splunk_hec_to_splunk_hec_logs_acks	-1.77KiB	-0.01	5.61%	23.75MiB	867.02KiB	17.63KiB	0.0356461	23.75MiB	883.53KiB	17.97KiB	0.0363278	False	False
splunk_hec_indexer_ack_blackhole	-13.59KiB	-0.06	38.91%	23.75MiB	899.29KiB	18.3KiB	0.0369648	23.74MiB	957.27KiB	19.47KiB	0.0393701	False	False
file_to_blackhole	-76.09KiB	-0.08	59.25%	95.34MiB	2.91MiB	60.43KiB	0.0305679	95.27MiB	3.33MiB	69.2KiB	0.0349292	False	False
http_to_http_json	-21.82KiB	-0.09	94.38%	23.85MiB	331.8KiB	6.77KiB	0.0135854	23.82MiB	449.95KiB	9.2KiB	0.0184393	False	False
syslog_regex_logs2metric_ddmetrics	-16.18KiB	-0.13	70.99%	12.36MiB	517.37KiB	10.54KiB	0.0408746	12.34MiB	543.91KiB	11.08KiB	0.0430261	False	False
splunk_hec_route_s3	-61.69KiB	-0.33	64.78%	18.51MiB	2.27MiB	47.26KiB	0.122598	18.45MiB	2.22MiB	46.5KiB	0.120494	False	False
http_to_http_noack	-83.23KiB	-0.34	99.93%	23.83MiB	505.44KiB	10.34KiB	0.02071	23.75MiB	1.07MiB	22.24KiB	0.0449056	False	False
http_to_http_acks	-98.05KiB	-0.55	31.74%	17.34MiB	8.12MiB	169.82KiB	0.468448	17.24MiB	8.11MiB	169.29KiB	0.470474	True	True
fluent_elasticsearch	-597.4KiB	-0.73	100.00%	79.47MiB	54.52KiB	1.1KiB	0.000669821	78.89MiB	5.99MiB	122.9KiB	0.0758551	False	False
http_pipelines_no_grok_blackhole	-97.14KiB	-0.9	100.00%	10.58MiB	64.01KiB	1.31KiB	0.00590534	10.49MiB	1011.63KiB	20.58KiB	0.094179	False	False
datadog_agent_remap_datadog_logs_acks	-655.63KiB	-1.04	100.00%	61.64MiB	3.28MiB	68.52KiB	0.0531455	61.0MiB	4.45MiB	92.72KiB	0.0730068	False	False
datadog_agent_remap_datadog_logs	-938.96KiB	-1.49	100.00%	61.69MiB	851.16KiB	17.42KiB	0.0134703	60.78MiB	4.26MiB	88.77KiB	0.0701357	False	False
syslog_loki	-270.24KiB	-1.84	100.00%	14.33MiB	271.13KiB	5.55KiB	0.0184762	14.06MiB	758.08KiB	15.41KiB	0.0526278	False	False
syslog_log2metric_humio_metrics	-286.34KiB	-2.18	100.00%	12.84MiB	277.15KiB	5.66KiB	0.0210821	12.56MiB	561.91KiB	11.43KiB	0.043695	False	False
socket_to_socket_blackhole	-876.2KiB	-3.66	100.00%	23.38MiB	281.67KiB	5.75KiB	0.011764	22.52MiB	202.98KiB	4.14KiB	0.00879952	False	False
http_text_to_http_json	-1.82MiB	-4.59	100.00%	39.77MiB	756.49KiB	15.44KiB	0.0185707	37.95MiB	910.47KiB	18.58KiB	0.0234251	False	False

Sep 28 '22 19:09 github-actions[bot]

Soak Test Results

Baseline: 1ef045608a75637f524902f18b70a0c178e4c693 Comparison: 0e302e6e4f6101bce5109688c21b3c7ed3505b22 Total Vector CPUs: 4

Explanation

A soak test is an integrated performance test for vector in a repeatable rig, with varying configuration for vector. What follows is a statistical summary of a brief vector run for each configuration across SHAs given above. The goal of these tests are to determine, quickly, if vector performance is changed and to what degree by a pull request. Where appropriate units are scaled per-core.

The table below, if present, lists those experiments that have experienced a statistically significant change in their throughput performance between baseline and comparision SHAs, with 90.0% confidence OR have been detected as newly erratic. Negative values mean that baseline is faster, positive comparison. Results that do not exhibit more than a ±8.87% change in mean throughput are discarded. An experiment is erratic if its coefficient of variation is greater than 0.3. The abbreviated table will be omitted if no interesting changes are observed.

No interesting changes in throughput with confidence ≥ 90.00% and absolute Δ mean >= ±8.87%:

Fine details of change detection per experiment.

experiment	Δ mean	Δ mean %	confidence	baseline mean	baseline stdev	baseline stderr	baseline CoV	comparison mean	comparison stdev	comparison stderr	comparison CoV	erratic	declared erratic
syslog_humio_logs	352.89KiB	2.15	100.00%	16.06MiB	215.35KiB	4.39KiB	0.0130905	16.41MiB	131.23KiB	2.69KiB	0.00780937	False	False
syslog_log2metric_splunk_hec_metrics	375.17KiB	2.11	100.00%	17.4MiB	539.98KiB	11.01KiB	0.0303032	17.76MiB	816.46KiB	16.61KiB	0.0448737	False	False
syslog_splunk_hec_logs	285.36KiB	1.78	100.00%	15.68MiB	710.77KiB	14.47KiB	0.0442606	15.96MiB	628.93KiB	12.82KiB	0.0384808	False	False
http_pipelines_blackhole_acks	11.74KiB	1.06	98.40%	1.08MiB	160.77KiB	3.27KiB	0.144675	1.1MiB	176.84KiB	3.61KiB	0.157477	False	False
syslog_regex_logs2metric_ddmetrics	115.96KiB	0.93	100.00%	12.15MiB	545.28KiB	11.1KiB	0.0438188	12.26MiB	493.71KiB	10.06KiB	0.0393086	False	False
syslog_log2metric_humio_metrics	98.62KiB	0.79	100.00%	12.13MiB	275.07KiB	5.61KiB	0.0221436	12.22MiB	488.0KiB	9.94KiB	0.0389759	False	False
splunk_hec_indexer_ack_blackhole	18.29KiB	0.08	49.71%	23.73MiB	987.0KiB	20.07KiB	0.0406049	23.75MiB	909.93KiB	18.51KiB	0.0374062	False	False
splunk_hec_to_splunk_hec_logs_noack	5.91KiB	0.02	42.72%	23.83MiB	389.94KiB	7.96KiB	0.0159758	23.84MiB	333.79KiB	6.81KiB	0.0136719	False	False
splunk_hec_to_splunk_hec_logs_acks	4.71KiB	0.02	14.89%	23.75MiB	878.56KiB	17.87KiB	0.0361242	23.75MiB	867.67KiB	17.65KiB	0.0356695	False	False
enterprise_http_to_http	2.99KiB	0.01	31.23%	23.84MiB	255.07KiB	5.21KiB	0.0104452	23.85MiB	259.22KiB	5.3KiB	0.0106138	False	False
file_to_blackhole	-42.86KiB	-0.04	36.50%	95.34MiB	2.93MiB	60.64KiB	0.0306747	95.3MiB	3.22MiB	66.9KiB	0.0337532	False	False
http_to_http_json	-22.98KiB	-0.09	95.37%	23.85MiB	330.65KiB	6.75KiB	0.0135378	23.82MiB	456.83KiB	9.34KiB	0.0187214	False	False
fluent_elasticsearch	-145.63KiB	-0.18	100.00%	79.47MiB	52.03KiB	1.05KiB	0.000639222	79.33MiB	1.4MiB	28.88KiB	0.0176715	False	False
datadog_agent_remap_blackhole_acks	-132.24KiB	-0.21	82.23%	60.32MiB	3.92MiB	81.72KiB	0.0650078	60.19MiB	2.59MiB	54.25KiB	0.0430535	False	False
http_to_http_noack	-57.44KiB	-0.24	98.37%	23.82MiB	609.85KiB	12.46KiB	0.0249965	23.76MiB	1001.27KiB	20.4KiB	0.0411371	False	False
http_pipelines_blackhole	-4.75KiB	-0.28	98.03%	1.68MiB	15.85KiB	331.8B	0.00919191	1.68MiB	98.61KiB	2.01KiB	0.0573419	False	False
http_pipelines_no_grok_blackhole	-70.31KiB	-0.64	99.84%	10.74MiB	82.64KiB	1.69KiB	0.00751221	10.67MiB	1.06MiB	22.13KiB	0.0995925	False	False
datadog_agent_remap_blackhole	-442.96KiB	-0.75	100.00%	57.74MiB	3.58MiB	74.6KiB	0.0619259	57.31MiB	3.02MiB	63.09KiB	0.0527545	False	False
splunk_hec_route_s3	-157.69KiB	-0.81	98.46%	18.97MiB	2.24MiB	46.72KiB	0.118205	18.81MiB	2.16MiB	45.27KiB	0.114942	False	False
http_to_http_acks	-162.17KiB	-0.91	49.47%	17.44MiB	8.28MiB	173.15KiB	0.474782	17.28MiB	8.2MiB	171.13KiB	0.474644	True	True
datadog_agent_remap_datadog_logs	-1.13MiB	-1.81	100.00%	62.54MiB	583.04KiB	11.93KiB	0.00910165	61.42MiB	3.67MiB	76.44KiB	0.0597074	False	False
datadog_agent_remap_datadog_logs_acks	-1.18MiB	-1.9	100.00%	62.28MiB	3.33MiB	69.5KiB	0.053404	61.09MiB	4.39MiB	91.38KiB	0.0718442	False	False
syslog_loki	-340.62KiB	-2.26	100.00%	14.73MiB	247.6KiB	5.07KiB	0.016413	14.4MiB	756.18KiB	15.37KiB	0.051285	False	False
http_text_to_http_json	-1.19MiB	-3.02	100.00%	39.23MiB	797.24KiB	16.27KiB	0.019843	38.04MiB	852.61KiB	17.41KiB	0.0218824	False	False
socket_to_socket_blackhole	-765.47KiB	-3.27	100.00%	22.89MiB	571.17KiB	11.66KiB	0.0243588	22.15MiB	602.4KiB	12.3KiB	0.0265577	False	False

Sep 28 '22 22:09 github-actions[bot]

Thanks for working through this contribution @ktff - really appreciate all the effort, it has been a long wanted feature.

Sep 29 '22 00:09 spencergilbert

vector
vector copied to clipboard

enhancement(elasticsearch sink): Multiple endpoints

Deploy Preview for vector-project ready!

Soak Test Results

Soak Test Results

Soak Test Results

Soak Test Results

Soak Test Results

Soak Test Results

Soak Test Results

Soak Test Results

Soak Test Results

Soak Test Results

Soak Test Results

Soak Test Results

Soak Test Results

Soak Test Results

Soak Test Results

Soak Test Results

Soak Test Results

Soak Test Results

Soak Test Results

Soak Test Results

Soak Test Results

Soak Test Results

vector vector copied to clipboard

enhancement(elasticsearch sink): Multiple endpoints

✅ Deploy Preview for vector-project ready!

Soak Test Results

Soak Test Results

Soak Test Results

Soak Test Results

Soak Test Results

Soak Test Results

Soak Test Results

Soak Test Results

Soak Test Results

Soak Test Results

Soak Test Results

Soak Test Results

Soak Test Results

Soak Test Results

Soak Test Results

Soak Test Results

Soak Test Results

Soak Test Results

Soak Test Results

Soak Test Results

Soak Test Results

Soak Test Results

vector
vector copied to clipboard

Deploy Preview for vector-project ready!