fix: #15727

need: https://github.com/datafuselabs/databend/issues/9569

Jan 11 '23 06:01 everpcpc

Deploy Preview for vector-project canceled.

Name	Link
Latest commit	a5fa9aa0fd31b4bc294cf484162e9c468f4c2b5d
Latest deploy log	https://app.netlify.com/sites/vector-project/deploys/63f6c019871600000748b3f3

Jan 11 '23 06:01 netlify[bot]

Deploy Preview for vrl-playground canceled.

Name	Link
Latest commit	a5fa9aa0fd31b4bc294cf484162e9c468f4c2b5d
Latest deploy log	https://app.netlify.com/sites/vrl-playground/deploys/63f6c0190a1f5500089ef539

Jan 11 '23 06:01 netlify[bot]

Regression Test Results

Run ID: a857467d-08c8-4dec-b895-cfec12a59c44
Baseline: 1727e729487c4075c29d1ca30cda5053def52085
Comparison: 182f30a7a16de3cbf549eada043a0b25d4944fd3
Total vector CPUs: 7

Explanation

A regression test is an integrated performance test for vector in a repeatable rig, with varying configuration for vector. What follows is a statistical summary of a brief vector run for each configuration across SHAs given above. The goal of these tests are to determine, quickly, if vector performance is changed and to what degree by a pull request. Where appropriate units are scaled per-core.

The table below, if present, lists those experiments that have experienced a statistically significant change in their bytes_written_per_cpu_second performance between baseline and comparison SHAs, with 90.0% confidence OR have been detected as newly erratic. Negative values mean that baseline is faster, positive comparison. Results that do not exhibit more than a ±5% change in mean bytes_written_per_cpu_second are discarded. An experiment is erratic if its coefficient of variation is greater than 0.1. The abbreviated table will be omitted if no interesting changes are observed.

No interesting changes in bytes_written_per_cpu_second with confidence ≥ 90.00% and absolute Δ mean >= ±5%.

Fine details of change detection per experiment.

experiment	Δ mean	Δ mean %	confidence	baseline mean	baseline stdev	baseline stderr	baseline CoV	comparison mean	comparison stdev	comparison stderr	comparison CoV	erratic	declared erratic
syslog_splunk_hec_logs	212.08KiB/CPU-s	2.35	100.00%	8.8MiB/CPU-s	297.44KiB/CPU-s	3.84KiB/CPU-s	0.033012	9.01MiB/CPU-s	249.06KiB/CPU-s	3.21KiB/CPU-s	0.027006	False	False
syslog_log2metric_humio_metrics	81.69KiB/CPU-s	1.32	100.00%	6.04MiB/CPU-s	332.44KiB/CPU-s	4.29KiB/CPU-s	0.053726	6.12MiB/CPU-s	195.78KiB/CPU-s	2.53KiB/CPU-s	0.031228	False	False
datadog_agent_remap_blackhole	190.51KiB/CPU-s	0.61	100.00%	30.57MiB/CPU-s	1.29MiB/CPU-s	17.05KiB/CPU-s	0.042199	30.76MiB/CPU-s	1.27MiB/CPU-s	16.8KiB/CPU-s	0.041311	False	False
syslog_log2metric_splunk_hec_metrics	51.84KiB/CPU-s	0.54	100.00%	9.3MiB/CPU-s	199.87KiB/CPU-s	2.58KiB/CPU-s	0.020988	9.35MiB/CPU-s	269.68KiB/CPU-s	3.48KiB/CPU-s	0.028164	False	False
http_to_http_acks	18.38KiB/CPU-s	0.34	27.55%	5.27MiB/CPU-s	2.78MiB/CPU-s	36.75KiB/CPU-s	0.528193	5.28MiB/CPU-s	2.8MiB/CPU-s	36.97KiB/CPU-s	0.529514	True	False
splunk_hec_route_s3	36.69KiB/CPU-s	0.31	99.96%	11.71MiB/CPU-s	583.35KiB/CPU-s	7.52KiB/CPU-s	0.048641	11.75MiB/CPU-s	555.54KiB/CPU-s	7.17KiB/CPU-s	0.04618	False	False
otlp_http_to_blackhole	1.33KiB/CPU-s	0.08	47.05%	1.54MiB/CPU-s	111.86KiB/CPU-s	1.44KiB/CPU-s	0.070941	1.54MiB/CPU-s	119.31KiB/CPU-s	1.54KiB/CPU-s	0.075604	False	False
splunk_hec_to_splunk_hec_logs_noack	4.44KiB/CPU-s	0.03	75.20%	13.62MiB/CPU-s	227.22KiB/CPU-s	2.93KiB/CPU-s	0.016289	13.63MiB/CPU-s	192.84KiB/CPU-s	2.49KiB/CPU-s	0.01382	False	False
enterprise_http_to_http	4.23KiB/CPU-s	0.03	63.04%	13.62MiB/CPU-s	284.65KiB/CPU-s	3.67KiB/CPU-s	0.020414	13.62MiB/CPU-s	228.65KiB/CPU-s	2.95KiB/CPU-s	0.016393	False	False
file_to_blackhole	-1.64KiB/CPU-s	-0.0	6.47%	54.5MiB/CPU-s	1.08MiB/CPU-s	14.22KiB/CPU-s	0.019748	54.49MiB/CPU-s	1.09MiB/CPU-s	14.38KiB/CPU-s	0.01999	False	False
fluent_elasticsearch	291.11B/CPU-s	0.0	39.92%	45.41MiB/CPU-s	30.26KiB/CPU-s	395.38B/CPU-s	0.000651	45.41MiB/CPU-s	29.95KiB/CPU-s	391.38B/CPU-s	0.000644	False	False
http_to_http_json	-89.15B/CPU-s	-0.0	1.79%	13.62MiB/CPU-s	213.65KiB/CPU-s	2.76KiB/CPU-s	0.015316	13.62MiB/CPU-s	210.7KiB/CPU-s	2.72KiB/CPU-s	0.015104	False	False
splunk_hec_indexer_ack_blackhole	-356.34B/CPU-s	-0.0	5.98%	13.62MiB/CPU-s	250.31KiB/CPU-s	3.23KiB/CPU-s	0.01795	13.62MiB/CPU-s	257.8KiB/CPU-s	3.33KiB/CPU-s	0.018488	False	False
splunk_hec_to_splunk_hec_logs_acks	-1.21KiB/CPU-s	-0.01	15.46%	13.62MiB/CPU-s	340.16KiB/CPU-s	4.39KiB/CPU-s	0.024391	13.62MiB/CPU-s	340.34KiB/CPU-s	4.39KiB/CPU-s	0.024406	False	False
http_to_http_noack	-1.84KiB/CPU-s	-0.01	22.65%	13.61MiB/CPU-s	350.21KiB/CPU-s	4.52KiB/CPU-s	0.025127	13.61MiB/CPU-s	351.59KiB/CPU-s	4.54KiB/CPU-s	0.025229	False	False
syslog_regex_logs2metric_ddmetrics	-11.86KiB/CPU-s	-0.32	88.92%	3.62MiB/CPU-s	380.5KiB/CPU-s	4.91KiB/CPU-s	0.102557	3.61MiB/CPU-s	432.41KiB/CPU-s	5.58KiB/CPU-s	0.116922	True	False
datadog_agent_remap_datadog_logs_acks	-127.7KiB/CPU-s	-0.37	100.00%	33.61MiB/CPU-s	1.66MiB/CPU-s	21.98KiB/CPU-s	0.049499	33.48MiB/CPU-s	1.18MiB/CPU-s	15.65KiB/CPU-s	0.035368	False	False
datadog_agent_remap_blackhole_acks	-137.71KiB/CPU-s	-0.43	100.00%	31.32MiB/CPU-s	887.29KiB/CPU-s	11.46KiB/CPU-s	0.027666	31.18MiB/CPU-s	1.25MiB/CPU-s	16.54KiB/CPU-s	0.040114	False	False
datadog_agent_remap_datadog_logs	-150.51KiB/CPU-s	-0.43	100.00%	33.87MiB/CPU-s	1.25MiB/CPU-s	16.53KiB/CPU-s	0.03694	33.72MiB/CPU-s	1.26MiB/CPU-s	16.61KiB/CPU-s	0.037298	False	False
http_text_to_http_json	-125.79KiB/CPU-s	-0.48	100.00%	25.49MiB/CPU-s	627.38KiB/CPU-s	8.1KiB/CPU-s	0.024034	25.37MiB/CPU-s	620.52KiB/CPU-s	8.01KiB/CPU-s	0.023886	False	False
otlp_grpc_to_blackhole	-6.43KiB/CPU-s	-0.6	100.00%	1.04MiB/CPU-s	40.48KiB/CPU-s	535.1B/CPU-s	0.037904	1.04MiB/CPU-s	49.2KiB/CPU-s	650.14B/CPU-s	0.046343	False	False
syslog_humio_logs	-64.39KiB/CPU-s	-0.69	100.00%	9.13MiB/CPU-s	170.42KiB/CPU-s	2.2KiB/CPU-s	0.018234	9.06MiB/CPU-s	236.81KiB/CPU-s	3.06KiB/CPU-s	0.025512	False	False
socket_to_socket_blackhole	-177.22KiB/CPU-s	-1.27	100.00%	13.68MiB/CPU-s	187.8KiB/CPU-s	2.42KiB/CPU-s	0.013405	13.51MiB/CPU-s	167.59KiB/CPU-s	2.16KiB/CPU-s	0.012115	False	False
syslog_loki	-119.94KiB/CPU-s	-1.36	100.00%	8.64MiB/CPU-s	357.83KiB/CPU-s	4.62KiB/CPU-s	0.040458	8.52MiB/CPU-s	219.07KiB/CPU-s	2.83KiB/CPU-s	0.025109	False	False

Jan 11 '23 07:01 github-actions[bot]

Regression Test Results

Run ID: 5f3dbd11-1668-4f4a-bcd2-a33cfd3279bb
Baseline: 4af6d78b88661d874547f336a740b845aacd9334
Comparison: 153e0630e204ab8085424bf203fa72fb2bc8e511
Total vector CPUs: 7

Explanation

A regression test is an integrated performance test for vector in a repeatable rig, with varying configuration for vector. What follows is a statistical summary of a brief vector run for each configuration across SHAs given above. The goal of these tests are to determine, quickly, if vector performance is changed and to what degree by a pull request. Where appropriate units are scaled per-core.

The table below, if present, lists those experiments that have experienced a statistically significant change in their bytes_written_per_cpu_second performance between baseline and comparison SHAs, with 90.0% confidence OR have been detected as newly erratic. Negative values mean that baseline is faster, positive comparison. Results that do not exhibit more than a ±5% change in mean bytes_written_per_cpu_second are discarded. An experiment is erratic if its coefficient of variation is greater than 0.1. The abbreviated table will be omitted if no interesting changes are observed.

No interesting changes in bytes_written_per_cpu_second with confidence ≥ 90.00% and absolute Δ mean >= ±5%.

Fine details of change detection per experiment.

experiment	Δ mean	Δ mean %	confidence	baseline mean	baseline stdev	baseline stderr	baseline CoV	comparison mean	comparison stdev	comparison stderr	comparison CoV	erratic	declared erratic
syslog_log2metric_humio_metrics	151.21KiB/CPU-s	2.48	100.00%	5.95MiB/CPU-s	304.32KiB/CPU-s	3.93KiB/CPU-s	0.049967	6.09MiB/CPU-s	195.74KiB/CPU-s	2.53KiB/CPU-s	0.03136	False	False
datadog_agent_remap_blackhole_acks	544.72KiB/CPU-s	1.72	100.00%	31.0MiB/CPU-s	1.14MiB/CPU-s	15.12KiB/CPU-s	0.036888	31.53MiB/CPU-s	1.02MiB/CPU-s	13.54KiB/CPU-s	0.032474	False	False
syslog_regex_logs2metric_ddmetrics	61.96KiB/CPU-s	1.67	100.00%	3.63MiB/CPU-s	466.57KiB/CPU-s	6.02KiB/CPU-s	0.1255	3.69MiB/CPU-s	407.96KiB/CPU-s	5.27KiB/CPU-s	0.107936	True	False
syslog_humio_logs	128.84KiB/CPU-s	1.4	100.00%	9.01MiB/CPU-s	264.02KiB/CPU-s	3.41KiB/CPU-s	0.028612	9.14MiB/CPU-s	137.08KiB/CPU-s	1.77KiB/CPU-s	0.014651	False	False
http_to_http_acks	40.88KiB/CPU-s	0.77	57.51%	5.2MiB/CPU-s	2.75MiB/CPU-s	36.36KiB/CPU-s	0.528715	5.24MiB/CPU-s	2.73MiB/CPU-s	36.08KiB/CPU-s	0.520579	True	False
otlp_grpc_to_blackhole	5.4KiB/CPU-s	0.51	100.00%	1.02MiB/CPU-s	45.17KiB/CPU-s	596.98B/CPU-s	0.043049	1.03MiB/CPU-s	52.32KiB/CPU-s	691.32B/CPU-s	0.049606	False	False
otlp_http_to_blackhole	6.75KiB/CPU-s	0.43	99.87%	1.54MiB/CPU-s	112.56KiB/CPU-s	1.45KiB/CPU-s	0.071349	1.55MiB/CPU-s	117.3KiB/CPU-s	1.51KiB/CPU-s	0.07404	False	False
socket_to_socket_blackhole	36.21KiB/CPU-s	0.26	100.00%	13.47MiB/CPU-s	296.38KiB/CPU-s	3.83KiB/CPU-s	0.021492	13.5MiB/CPU-s	262.61KiB/CPU-s	3.39KiB/CPU-s	0.018994	False	False
syslog_log2metric_splunk_hec_metrics	10.29KiB/CPU-s	0.11	99.23%	9.33MiB/CPU-s	231.01KiB/CPU-s	2.98KiB/CPU-s	0.024174	9.34MiB/CPU-s	190.04KiB/CPU-s	2.45KiB/CPU-s	0.019865	False	False
enterprise_http_to_http	12.39KiB/CPU-s	0.09	99.23%	13.61MiB/CPU-s	328.18KiB/CPU-s	4.23KiB/CPU-s	0.023543	13.62MiB/CPU-s	148.38KiB/CPU-s	1.92KiB/CPU-s	0.010635	False	False
splunk_hec_to_splunk_hec_logs_noack	4.6KiB/CPU-s	0.03	77.10%	13.62MiB/CPU-s	224.69KiB/CPU-s	2.9KiB/CPU-s	0.016108	13.63MiB/CPU-s	192.92KiB/CPU-s	2.49KiB/CPU-s	0.013826	False	False
http_to_http_noack	3.95KiB/CPU-s	0.03	51.86%	13.61MiB/CPU-s	329.77KiB/CPU-s	4.26KiB/CPU-s	0.023657	13.62MiB/CPU-s	283.09KiB/CPU-s	3.65KiB/CPU-s	0.020302	False	False
http_text_to_http_json	8.76KiB/CPU-s	0.03	48.01%	25.38MiB/CPU-s	724.43KiB/CPU-s	9.35KiB/CPU-s	0.02787	25.39MiB/CPU-s	767.1KiB/CPU-s	9.9KiB/CPU-s	0.029502	False	False
fluent_elasticsearch	-308.48B/CPU-s	-0.0	41.74%	45.41MiB/CPU-s	30.5KiB/CPU-s	398.71B/CPU-s	0.000656	45.41MiB/CPU-s	30.22KiB/CPU-s	395.05B/CPU-s	0.00065	False	False
splunk_hec_to_splunk_hec_logs_acks	445.78B/CPU-s	0.0	5.35%	13.62MiB/CPU-s	354.58KiB/CPU-s	4.57KiB/CPU-s	0.02543	13.62MiB/CPU-s	356.04KiB/CPU-s	4.59KiB/CPU-s	0.025534	False	False
http_to_http_json	-1.61B/CPU-s	-0.0	0.03%	13.62MiB/CPU-s	211.02KiB/CPU-s	2.72KiB/CPU-s	0.015127	13.62MiB/CPU-s	210.2KiB/CPU-s	2.71KiB/CPU-s	0.015068	False	False
splunk_hec_indexer_ack_blackhole	-2.02KiB/CPU-s	-0.01	34.01%	13.62MiB/CPU-s	247.71KiB/CPU-s	3.2KiB/CPU-s	0.017762	13.62MiB/CPU-s	255.87KiB/CPU-s	3.3KiB/CPU-s	0.01835	False	False
file_to_blackhole	-3.19KiB/CPU-s	-0.01	11.65%	54.5MiB/CPU-s	1.1MiB/CPU-s	14.52KiB/CPU-s	0.020173	54.49MiB/CPU-s	1.23MiB/CPU-s	16.25KiB/CPU-s	0.022595	False	False
syslog_splunk_hec_logs	-14.94KiB/CPU-s	-0.16	99.99%	9.06MiB/CPU-s	196.41KiB/CPU-s	2.54KiB/CPU-s	0.021163	9.05MiB/CPU-s	230.84KiB/CPU-s	2.98KiB/CPU-s	0.024913	False	False
datadog_agent_remap_datadog_logs	-61.63KiB/CPU-s	-0.18	99.33%	34.31MiB/CPU-s	1.2MiB/CPU-s	15.91KiB/CPU-s	0.03511	34.25MiB/CPU-s	1.23MiB/CPU-s	16.25KiB/CPU-s	0.03592	False	False
datadog_agent_remap_blackhole	-73.82KiB/CPU-s	-0.23	100.00%	31.29MiB/CPU-s	741.24KiB/CPU-s	9.57KiB/CPU-s	0.02313	31.22MiB/CPU-s	1.13MiB/CPU-s	14.91KiB/CPU-s	0.036128	False	False
datadog_agent_remap_datadog_logs_acks	-295.26KiB/CPU-s	-0.84	100.00%	34.43MiB/CPU-s	948.68KiB/CPU-s	12.24KiB/CPU-s	0.026903	34.14MiB/CPU-s	981.96KiB/CPU-s	12.67KiB/CPU-s	0.028082	False	False
splunk_hec_route_s3	-252.93KiB/CPU-s	-2.09	100.00%	11.84MiB/CPU-s	550.24KiB/CPU-s	7.1KiB/CPU-s	0.045373	11.59MiB/CPU-s	644.09KiB/CPU-s	8.31KiB/CPU-s	0.054243	False	False
syslog_loki	-277.87KiB/CPU-s	-3.05	100.00%	8.9MiB/CPU-s	175.13KiB/CPU-s	2.26KiB/CPU-s	0.019205	8.63MiB/CPU-s	130.03KiB/CPU-s	1.68KiB/CPU-s	0.014707	False	False

Jan 12 '23 04:01 github-actions[bot]

Regression Test Results

Run ID: 426a7f9c-d122-4aae-9d7a-8c670726d770
Baseline: 4af6d78b88661d874547f336a740b845aacd9334
Comparison: e688f4ed76b9480b3c1b1e6a21cfcca5e102f2c7
Total vector CPUs: 7

Explanation

A regression test is an integrated performance test for vector in a repeatable rig, with varying configuration for vector. What follows is a statistical summary of a brief vector run for each configuration across SHAs given above. The goal of these tests are to determine, quickly, if vector performance is changed and to what degree by a pull request. Where appropriate units are scaled per-core.

The table below, if present, lists those experiments that have experienced a statistically significant change in their bytes_written_per_cpu_second performance between baseline and comparison SHAs, with 90.0% confidence OR have been detected as newly erratic. Negative values mean that baseline is faster, positive comparison. Results that do not exhibit more than a ±5% change in mean bytes_written_per_cpu_second are discarded. An experiment is erratic if its coefficient of variation is greater than 0.1. The abbreviated table will be omitted if no interesting changes are observed.

No interesting changes in bytes_written_per_cpu_second with confidence ≥ 90.00% and absolute Δ mean >= ±5%.

Fine details of change detection per experiment.

experiment	Δ mean	Δ mean %	confidence	baseline mean	baseline stdev	baseline stderr	baseline CoV	comparison mean	comparison stdev	comparison stderr	comparison CoV	erratic	declared erratic
datadog_agent_remap_blackhole	457.05KiB/CPU-s	1.46	100.00%	30.49MiB/CPU-s	988.36KiB/CPU-s	12.76KiB/CPU-s	0.031658	30.93MiB/CPU-s	973.32KiB/CPU-s	12.57KiB/CPU-s	0.030726	False	False
syslog_log2metric_humio_metrics	88.13KiB/CPU-s	1.43	100.00%	6.03MiB/CPU-s	233.21KiB/CPU-s	3.01KiB/CPU-s	0.037756	6.12MiB/CPU-s	216.04KiB/CPU-s	2.79KiB/CPU-s	0.034484	False	False
otlp_grpc_to_blackhole	13.41KiB/CPU-s	1.27	100.00%	1.03MiB/CPU-s	40.1KiB/CPU-s	530.02B/CPU-s	0.038093	1.04MiB/CPU-s	47.98KiB/CPU-s	634.04B/CPU-s	0.045007	False	False
otlp_http_to_blackhole	16.52KiB/CPU-s	1.05	100.00%	1.54MiB/CPU-s	111.6KiB/CPU-s	1.44KiB/CPU-s	0.070975	1.55MiB/CPU-s	112.24KiB/CPU-s	1.45KiB/CPU-s	0.070641	False	False
socket_to_socket_blackhole	130.06KiB/CPU-s	0.95	100.00%	13.41MiB/CPU-s	231.4KiB/CPU-s	2.99KiB/CPU-s	0.016847	13.54MiB/CPU-s	215.42KiB/CPU-s	2.78KiB/CPU-s	0.015536	False	False
datadog_agent_remap_blackhole_acks	294.29KiB/CPU-s	0.94	100.00%	30.53MiB/CPU-s	1.32MiB/CPU-s	17.39KiB/CPU-s	0.043077	30.82MiB/CPU-s	932.54KiB/CPU-s	12.04KiB/CPU-s	0.02955	False	False
splunk_hec_route_s3	58.51KiB/CPU-s	0.49	100.00%	11.74MiB/CPU-s	579.85KiB/CPU-s	7.48KiB/CPU-s	0.048239	11.79MiB/CPU-s	530.32KiB/CPU-s	6.84KiB/CPU-s	0.043905	False	False
datadog_agent_remap_datadog_logs_acks	101.78KiB/CPU-s	0.29	100.00%	34.24MiB/CPU-s	1.03MiB/CPU-s	13.59KiB/CPU-s	0.030034	34.34MiB/CPU-s	1.03MiB/CPU-s	13.59KiB/CPU-s	0.029948	False	False
syslog_log2metric_splunk_hec_metrics	26.34KiB/CPU-s	0.27	100.00%	9.45MiB/CPU-s	276.58KiB/CPU-s	3.57KiB/CPU-s	0.028571	9.48MiB/CPU-s	141.44KiB/CPU-s	1.83KiB/CPU-s	0.014571	False	False
enterprise_http_to_http	8.25KiB/CPU-s	0.06	92.19%	13.61MiB/CPU-s	307.8KiB/CPU-s	3.97KiB/CPU-s	0.022078	13.62MiB/CPU-s	192.03KiB/CPU-s	2.48KiB/CPU-s	0.013766	False	False
syslog_splunk_hec_logs	5.87KiB/CPU-s	0.06	92.74%	9.08MiB/CPU-s	145.1KiB/CPU-s	1.87KiB/CPU-s	0.015598	9.09MiB/CPU-s	207.88KiB/CPU-s	2.68KiB/CPU-s	0.022333	False	False
splunk_hec_to_splunk_hec_logs_acks	2.63KiB/CPU-s	0.02	32.62%	13.62MiB/CPU-s	350.34KiB/CPU-s	4.52KiB/CPU-s	0.025126	13.62MiB/CPU-s	334.59KiB/CPU-s	4.32KiB/CPU-s	0.023992	False	False
splunk_hec_to_splunk_hec_logs_noack	1.32KiB/CPU-s	0.01	28.95%	13.62MiB/CPU-s	199.61KiB/CPU-s	2.58KiB/CPU-s	0.014307	13.63MiB/CPU-s	190.2KiB/CPU-s	2.46KiB/CPU-s	0.013632	False	False
splunk_hec_indexer_ack_blackhole	1.72KiB/CPU-s	0.01	29.44%	13.62MiB/CPU-s	253.37KiB/CPU-s	3.27KiB/CPU-s	0.018171	13.62MiB/CPU-s	246.97KiB/CPU-s	3.19KiB/CPU-s	0.017709	False	False
http_to_http_json	546.19B/CPU-s	0.0	11.08%	13.62MiB/CPU-s	211.53KiB/CPU-s	2.73KiB/CPU-s	0.015163	13.62MiB/CPU-s	207.95KiB/CPU-s	2.68KiB/CPU-s	0.014906	False	False
file_to_blackhole	-382.8B/CPU-s	-0.0	1.46%	54.49MiB/CPU-s	1.14MiB/CPU-s	14.99KiB/CPU-s	0.02083	54.49MiB/CPU-s	1.06MiB/CPU-s	13.94KiB/CPU-s	0.019379	False	False
datadog_agent_remap_datadog_logs	1.59KiB/CPU-s	0.0	5.88%	33.93MiB/CPU-s	1.16MiB/CPU-s	15.29KiB/CPU-s	0.034116	33.93MiB/CPU-s	1.15MiB/CPU-s	15.23KiB/CPU-s	0.033975	False	False
fluent_elasticsearch	-11.6B/CPU-s	-0.0	1.66%	45.41MiB/CPU-s	29.83KiB/CPU-s	389.89B/CPU-s	0.000641	45.41MiB/CPU-s	30.3KiB/CPU-s	396.07B/CPU-s	0.000652	False	False
syslog_regex_logs2metric_ddmetrics	60.66B/CPU-s	0.0	0.67%	3.55MiB/CPU-s	421.61KiB/CPU-s	5.44KiB/CPU-s	0.116063	3.55MiB/CPU-s	345.98KiB/CPU-s	4.47KiB/CPU-s	0.095242	True	False
http_to_http_noack	-4.22KiB/CPU-s	-0.03	48.98%	13.61MiB/CPU-s	329.85KiB/CPU-s	4.26KiB/CPU-s	0.023663	13.61MiB/CPU-s	370.97KiB/CPU-s	4.79KiB/CPU-s	0.02662	False	False
http_to_http_acks	-11.52KiB/CPU-s	-0.21	17.50%	5.27MiB/CPU-s	2.76MiB/CPU-s	36.47KiB/CPU-s	0.523428	5.26MiB/CPU-s	2.82MiB/CPU-s	37.23KiB/CPU-s	0.535389	True	False
http_text_to_http_json	-62.78KiB/CPU-s	-0.24	99.97%	25.22MiB/CPU-s	942.53KiB/CPU-s	12.17KiB/CPU-s	0.036489	25.16MiB/CPU-s	967.43KiB/CPU-s	12.49KiB/CPU-s	0.037544	False	False
syslog_humio_logs	-97.38KiB/CPU-s	-1.03	100.00%	9.21MiB/CPU-s	184.68KiB/CPU-s	2.38KiB/CPU-s	0.019588	9.11MiB/CPU-s	228.66KiB/CPU-s	2.95KiB/CPU-s	0.024506	False	False
syslog_loki	-428.67KiB/CPU-s	-4.71	100.00%	8.89MiB/CPU-s	225.82KiB/CPU-s	2.92KiB/CPU-s	0.024816	8.47MiB/CPU-s	308.97KiB/CPU-s	3.99KiB/CPU-s	0.035633	False	False

Jan 12 '23 05:01 github-actions[bot]

Regression Test Results

Run ID: 0ee594f6-a565-42c3-b451-b5634dec13ed
Baseline: 4af6d78b88661d874547f336a740b845aacd9334
Comparison: 3a07e1473b19fabf24aa8248ed70ffb070fdd3cc
Total vector CPUs: 7

Explanation

A regression test is an integrated performance test for vector in a repeatable rig, with varying configuration for vector. What follows is a statistical summary of a brief vector run for each configuration across SHAs given above. The goal of these tests are to determine, quickly, if vector performance is changed and to what degree by a pull request. Where appropriate units are scaled per-core.

The table below, if present, lists those experiments that have experienced a statistically significant change in their bytes_written_per_cpu_second performance between baseline and comparison SHAs, with 90.0% confidence OR have been detected as newly erratic. Negative values mean that baseline is faster, positive comparison. Results that do not exhibit more than a ±5% change in mean bytes_written_per_cpu_second are discarded. An experiment is erratic if its coefficient of variation is greater than 0.1. The abbreviated table will be omitted if no interesting changes are observed.

Changes in bytes_written_per_cpu_second with confidence ≥ 90.00% and absolute Δ mean >= ±5%:

experiment	Δ mean	Δ mean %	confidence
syslog_regex_logs2metric_ddmetrics	292.22KiB/CPU-s	8.42	100.00%

Fine details of change detection per experiment.

experiment	Δ mean	Δ mean %	confidence	baseline mean	baseline stdev	baseline stderr	baseline CoV	comparison mean	comparison stdev	comparison stderr	comparison CoV	erratic	declared erratic
syslog_regex_logs2metric_ddmetrics	292.22KiB/CPU-s	8.42	100.00%	3.39MiB/CPU-s	640.62KiB/CPU-s	8.54KiB/CPU-s	0.184638	3.67MiB/CPU-s	395.04KiB/CPU-s	5.1KiB/CPU-s	0.105014	True	False
datadog_agent_remap_blackhole	786.81KiB/CPU-s	2.54	100.00%	30.3MiB/CPU-s	1.23MiB/CPU-s	16.32KiB/CPU-s	0.040733	31.07MiB/CPU-s	905.55KiB/CPU-s	11.69KiB/CPU-s	0.028462	False	False
datadog_agent_remap_datadog_logs	541.56KiB/CPU-s	1.58	100.00%	33.41MiB/CPU-s	1.2MiB/CPU-s	15.9KiB/CPU-s	0.036033	33.94MiB/CPU-s	1.22MiB/CPU-s	16.09KiB/CPU-s	0.035896	False	False
http_text_to_http_json	396.6KiB/CPU-s	1.55	100.00%	25.02MiB/CPU-s	701.3KiB/CPU-s	9.05KiB/CPU-s	0.027366	25.41MiB/CPU-s	611.41KiB/CPU-s	7.89KiB/CPU-s	0.023494	False	False
socket_to_socket_blackhole	193.9KiB/CPU-s	1.41	100.00%	13.46MiB/CPU-s	250.3KiB/CPU-s	3.23KiB/CPU-s	0.018156	13.65MiB/CPU-s	118.4KiB/CPU-s	1.53KiB/CPU-s	0.008469	False	False
otlp_http_to_blackhole	16.93KiB/CPU-s	1.08	100.00%	1.53MiB/CPU-s	119.76KiB/CPU-s	1.55KiB/CPU-s	0.076668	1.54MiB/CPU-s	115.81KiB/CPU-s	1.49KiB/CPU-s	0.073344	False	False
datadog_agent_remap_blackhole_acks	44.57KiB/CPU-s	0.14	94.36%	31.23MiB/CPU-s	1.44MiB/CPU-s	19.09KiB/CPU-s	0.046218	31.28MiB/CPU-s	1.02MiB/CPU-s	13.46KiB/CPU-s	0.032554	False	False
syslog_splunk_hec_logs	9.97KiB/CPU-s	0.11	99.80%	8.94MiB/CPU-s	153.42KiB/CPU-s	1.98KiB/CPU-s	0.016759	8.95MiB/CPU-s	197.87KiB/CPU-s	2.55KiB/CPU-s	0.02159	False	False
enterprise_http_to_http	10.33KiB/CPU-s	0.07	96.27%	13.61MiB/CPU-s	332.71KiB/CPU-s	4.29KiB/CPU-s	0.023868	13.62MiB/CPU-s	192.55KiB/CPU-s	2.49KiB/CPU-s	0.013803	False	False
splunk_hec_to_splunk_hec_logs_noack	4.83KiB/CPU-s	0.03	79.38%	13.62MiB/CPU-s	225.53KiB/CPU-s	2.91KiB/CPU-s	0.016168	13.63MiB/CPU-s	191.92KiB/CPU-s	2.48KiB/CPU-s	0.013754	False	False
splunk_hec_to_splunk_hec_logs_acks	3.18KiB/CPU-s	0.02	37.81%	13.61MiB/CPU-s	366.83KiB/CPU-s	4.73KiB/CPU-s	0.026312	13.62MiB/CPU-s	339.75KiB/CPU-s	4.38KiB/CPU-s	0.024364	False	False
splunk_hec_indexer_ack_blackhole	-153.06B/CPU-s	-0.0	2.62%	13.62MiB/CPU-s	249.76KiB/CPU-s	3.22KiB/CPU-s	0.01791	13.62MiB/CPU-s	249.78KiB/CPU-s	3.22KiB/CPU-s	0.017912	False	False
fluent_elasticsearch	87.56B/CPU-s	0.0	12.68%	45.41MiB/CPU-s	29.71KiB/CPU-s	388.2B/CPU-s	0.000639	45.41MiB/CPU-s	29.65KiB/CPU-s	387.61B/CPU-s	0.000638	False	False
http_to_http_noack	-4.35KiB/CPU-s	-0.03	60.06%	13.62MiB/CPU-s	255.04KiB/CPU-s	3.29KiB/CPU-s	0.018288	13.61MiB/CPU-s	308.46KiB/CPU-s	3.98KiB/CPU-s	0.022125	False	False
file_to_blackhole	-16.81KiB/CPU-s	-0.03	55.32%	54.49MiB/CPU-s	1.09MiB/CPU-s	14.4KiB/CPU-s	0.02001	54.48MiB/CPU-s	1.27MiB/CPU-s	16.76KiB/CPU-s	0.023311	False	False
otlp_grpc_to_blackhole	-1.49KiB/CPU-s	-0.14	92.01%	1.03MiB/CPU-s	41.33KiB/CPU-s	546.34B/CPU-s	0.039085	1.03MiB/CPU-s	51.27KiB/CPU-s	677.57B/CPU-s	0.04855	False	False
datadog_agent_remap_datadog_logs_acks	-62.18KiB/CPU-s	-0.18	99.86%	34.04MiB/CPU-s	1.04MiB/CPU-s	13.71KiB/CPU-s	0.03049	33.98MiB/CPU-s	1.05MiB/CPU-s	13.82KiB/CPU-s	0.030775	False	False
http_to_http_json	-36.29KiB/CPU-s	-0.26	100.00%	13.62MiB/CPU-s	210.51KiB/CPU-s	2.72KiB/CPU-s	0.01509	13.59MiB/CPU-s	261.31KiB/CPU-s	3.37KiB/CPU-s	0.01878	False	False
syslog_log2metric_splunk_hec_metrics	-31.82KiB/CPU-s	-0.33	100.00%	9.33MiB/CPU-s	330.79KiB/CPU-s	4.27KiB/CPU-s	0.034628	9.3MiB/CPU-s	227.43KiB/CPU-s	2.94KiB/CPU-s	0.023888	False	False
http_to_http_acks	-24.5KiB/CPU-s	-0.46	36.51%	5.22MiB/CPU-s	2.78MiB/CPU-s	36.69KiB/CPU-s	0.531398	5.2MiB/CPU-s	2.74MiB/CPU-s	36.27KiB/CPU-s	0.527826	True	False
syslog_log2metric_humio_metrics	-42.57KiB/CPU-s	-0.68	100.00%	6.08MiB/CPU-s	230.63KiB/CPU-s	2.98KiB/CPU-s	0.037036	6.04MiB/CPU-s	252.11KiB/CPU-s	3.25KiB/CPU-s	0.040766	False	False
splunk_hec_route_s3	-176.8KiB/CPU-s	-1.46	100.00%	11.82MiB/CPU-s	551.98KiB/CPU-s	7.12KiB/CPU-s	0.045617	11.64MiB/CPU-s	554.07KiB/CPU-s	7.15KiB/CPU-s	0.046469	False	False
syslog_humio_logs	-143.47KiB/CPU-s	-1.53	100.00%	9.15MiB/CPU-s	210.51KiB/CPU-s	2.72KiB/CPU-s	0.022461	9.01MiB/CPU-s	146.97KiB/CPU-s	1.9KiB/CPU-s	0.015926	False	False
syslog_loki	-370.98KiB/CPU-s	-4.16	100.00%	8.71MiB/CPU-s	190.92KiB/CPU-s	2.46KiB/CPU-s	0.021394	8.35MiB/CPU-s	232.15KiB/CPU-s	3.0KiB/CPU-s	0.027142	False	False

Jan 12 '23 06:01 github-actions[bot]

Regression Test Results

Run ID: db769699-c15d-44fe-bdaf-015448db4445
Baseline: 4af6d78b88661d874547f336a740b845aacd9334
Comparison: ec91ce1edc24b63556eee99798b435fd21b69faf
Total vector CPUs: 7

Explanation

A regression test is an integrated performance test for vector in a repeatable rig, with varying configuration for vector. What follows is a statistical summary of a brief vector run for each configuration across SHAs given above. The goal of these tests are to determine, quickly, if vector performance is changed and to what degree by a pull request. Where appropriate units are scaled per-core.

The table below, if present, lists those experiments that have experienced a statistically significant change in their bytes_written_per_cpu_second performance between baseline and comparison SHAs, with 90.0% confidence OR have been detected as newly erratic. Negative values mean that baseline is faster, positive comparison. Results that do not exhibit more than a ±5% change in mean bytes_written_per_cpu_second are discarded. An experiment is erratic if its coefficient of variation is greater than 0.1. The abbreviated table will be omitted if no interesting changes are observed.

No interesting changes in bytes_written_per_cpu_second with confidence ≥ 90.00% and absolute Δ mean >= ±5%.

Fine details of change detection per experiment.

experiment	Δ mean	Δ mean %	confidence	baseline mean	baseline stdev	baseline stderr	baseline CoV	comparison mean	comparison stdev	comparison stderr	comparison CoV	erratic	declared erratic
datadog_agent_remap_blackhole	1.08MiB/CPU-s	3.6	100.00%	30.08MiB/CPU-s	1.2MiB/CPU-s	15.91KiB/CPU-s	0.039991	31.17MiB/CPU-s	928.18KiB/CPU-s	11.98KiB/CPU-s	0.02908	False	False
syslog_regex_logs2metric_ddmetrics	113.19KiB/CPU-s	3.18	100.00%	3.48MiB/CPU-s	282.11KiB/CPU-s	3.64KiB/CPU-s	0.079211	3.59MiB/CPU-s	364.93KiB/CPU-s	4.71KiB/CPU-s	0.099309	False	False
datadog_agent_remap_blackhole_acks	971.93KiB/CPU-s	3.16	100.00%	30.08MiB/CPU-s	1.08MiB/CPU-s	14.26KiB/CPU-s	0.035854	31.03MiB/CPU-s	1.28MiB/CPU-s	16.91KiB/CPU-s	0.041233	False	False
datadog_agent_remap_datadog_logs_acks	706.94KiB/CPU-s	2.06	100.00%	33.49MiB/CPU-s	1.32MiB/CPU-s	17.43KiB/CPU-s	0.03939	34.18MiB/CPU-s	789.15KiB/CPU-s	10.19KiB/CPU-s	0.022542	False	False
http_to_http_acks	88.37KiB/CPU-s	1.64	91.12%	5.25MiB/CPU-s	2.78MiB/CPU-s	36.75KiB/CPU-s	0.529868	5.33MiB/CPU-s	2.78MiB/CPU-s	36.68KiB/CPU-s	0.520183	True	False
syslog_log2metric_humio_metrics	54.73KiB/CPU-s	0.88	100.00%	6.09MiB/CPU-s	225.51KiB/CPU-s	2.91KiB/CPU-s	0.036161	6.14MiB/CPU-s	194.22KiB/CPU-s	2.51KiB/CPU-s	0.030872	False	False
syslog_splunk_hec_logs	58.11KiB/CPU-s	0.63	100.00%	9.02MiB/CPU-s	111.16KiB/CPU-s	1.44KiB/CPU-s	0.012031	9.08MiB/CPU-s	198.72KiB/CPU-s	2.56KiB/CPU-s	0.021373	False	False
datadog_agent_remap_datadog_logs	98.3KiB/CPU-s	0.28	99.98%	33.75MiB/CPU-s	1.54MiB/CPU-s	20.29KiB/CPU-s	0.045514	33.85MiB/CPU-s	1.29MiB/CPU-s	17.09KiB/CPU-s	0.038214	False	False
enterprise_http_to_http	12.57KiB/CPU-s	0.09	99.24%	13.61MiB/CPU-s	333.0KiB/CPU-s	4.3KiB/CPU-s	0.023888	13.62MiB/CPU-s	149.25KiB/CPU-s	1.93KiB/CPU-s	0.010697	False	False
syslog_loki	7.16KiB/CPU-s	0.08	95.03%	8.78MiB/CPU-s	195.32KiB/CPU-s	2.52KiB/CPU-s	0.021735	8.78MiB/CPU-s	204.18KiB/CPU-s	2.64KiB/CPU-s	0.022703	False	False
splunk_hec_to_splunk_hec_logs_noack	3.57KiB/CPU-s	0.03	65.73%	13.62MiB/CPU-s	218.38KiB/CPU-s	2.82KiB/CPU-s	0.015654	13.63MiB/CPU-s	192.52KiB/CPU-s	2.49KiB/CPU-s	0.013797	False	False
http_to_http_json	121.49B/CPU-s	0.0	2.45%	13.62MiB/CPU-s	211.34KiB/CPU-s	2.73KiB/CPU-s	0.015149	13.62MiB/CPU-s	211.95KiB/CPU-s	2.73KiB/CPU-s	0.015193	False	False
splunk_hec_indexer_ack_blackhole	-524.13B/CPU-s	-0.0	8.92%	13.62MiB/CPU-s	250.81KiB/CPU-s	3.24KiB/CPU-s	0.017986	13.62MiB/CPU-s	249.94KiB/CPU-s	3.22KiB/CPU-s	0.017924	False	False
splunk_hec_to_splunk_hec_logs_acks	-1.37B/CPU-s	-0.0	0.02%	13.62MiB/CPU-s	350.36KiB/CPU-s	4.52KiB/CPU-s	0.025125	13.62MiB/CPU-s	348.06KiB/CPU-s	4.49KiB/CPU-s	0.02496	False	False
fluent_elasticsearch	-5.8KiB/CPU-s	-0.01	100.00%	45.41MiB/CPU-s	30.47KiB/CPU-s	398.24B/CPU-s	0.000655	45.41MiB/CPU-s	34.49KiB/CPU-s	450.68B/CPU-s	0.000742	False	False
file_to_blackhole	-10.3KiB/CPU-s	-0.02	37.27%	54.5MiB/CPU-s	1.13MiB/CPU-s	14.96KiB/CPU-s	0.020775	54.49MiB/CPU-s	1.14MiB/CPU-s	15.03KiB/CPU-s	0.020903	False	False
http_to_http_noack	-4.04KiB/CPU-s	-0.03	56.07%	13.62MiB/CPU-s	258.88KiB/CPU-s	3.34KiB/CPU-s	0.018563	13.61MiB/CPU-s	310.65KiB/CPU-s	4.01KiB/CPU-s	0.022282	False	False
http_text_to_http_json	-89.59KiB/CPU-s	-0.35	100.00%	25.11MiB/CPU-s	792.07KiB/CPU-s	10.23KiB/CPU-s	0.030804	25.02MiB/CPU-s	577.92KiB/CPU-s	7.46KiB/CPU-s	0.022554	False	False
splunk_hec_route_s3	-58.42KiB/CPU-s	-0.49	100.00%	11.7MiB/CPU-s	585.99KiB/CPU-s	7.56KiB/CPU-s	0.048927	11.64MiB/CPU-s	570.52KiB/CPU-s	7.36KiB/CPU-s	0.047869	False	False
syslog_log2metric_splunk_hec_metrics	-69.78KiB/CPU-s	-0.73	100.00%	9.31MiB/CPU-s	320.85KiB/CPU-s	4.14KiB/CPU-s	0.033649	9.24MiB/CPU-s	258.9KiB/CPU-s	3.34KiB/CPU-s	0.027352	False	False
otlp_grpc_to_blackhole	-11.21KiB/CPU-s	-1.06	100.00%	1.03MiB/CPU-s	38.97KiB/CPU-s	515.15B/CPU-s	0.036872	1.02MiB/CPU-s	47.7KiB/CPU-s	630.43B/CPU-s	0.045615	False	False
syslog_humio_logs	-125.81KiB/CPU-s	-1.34	100.00%	9.14MiB/CPU-s	201.78KiB/CPU-s	2.61KiB/CPU-s	0.021556	9.02MiB/CPU-s	235.24KiB/CPU-s	3.04KiB/CPU-s	0.025473	False	False
otlp_http_to_blackhole	-32.04KiB/CPU-s	-2.06	100.00%	1.52MiB/CPU-s	116.26KiB/CPU-s	1.5KiB/CPU-s	0.074605	1.49MiB/CPU-s	124.75KiB/CPU-s	1.61KiB/CPU-s	0.081732	False	False
socket_to_socket_blackhole	-477.99KiB/CPU-s	-3.47	100.00%	13.45MiB/CPU-s	185.12KiB/CPU-s	2.39KiB/CPU-s	0.013438	12.99MiB/CPU-s	384.66KiB/CPU-s	4.97KiB/CPU-s	0.028926	False	False

Jan 12 '23 07:01 github-actions[bot]

Regression Test Results

Run ID: 9201f2c5-a3eb-44d2-95ea-80ff31262bdb
Baseline: 94fcd43bbe562e290ba277b1e78d324cd6000f31
Comparison: fa1347790cbd8d8e5ed184fd3ad67e3c4041121c
Total vector CPUs: 7

Explanation

A regression test is an integrated performance test for vector in a repeatable rig, with varying configuration for vector. What follows is a statistical summary of a brief vector run for each configuration across SHAs given above. The goal of these tests are to determine, quickly, if vector performance is changed and to what degree by a pull request. Where appropriate units are scaled per-core.

The table below, if present, lists those experiments that have experienced a statistically significant change in their bytes_written_per_cpu_second performance between baseline and comparison SHAs, with 90.0% confidence OR have been detected as newly erratic. Negative values mean that baseline is faster, positive comparison. Results that do not exhibit more than a ±5% change in mean bytes_written_per_cpu_second are discarded. An experiment is erratic if its coefficient of variation is greater than 0.1. The abbreviated table will be omitted if no interesting changes are observed.

Changes in bytes_written_per_cpu_second with confidence ≥ 90.00% and absolute Δ mean >= ±5%:

experiment	Δ mean	Δ mean %	confidence
datadog_agent_remap_blackhole	2.95MiB/CPU-s	10.4	100.00%

Fine details of change detection per experiment.

experiment	Δ mean	Δ mean %	confidence	baseline mean	baseline stdev	baseline stderr	baseline CoV	comparison mean	comparison stdev	comparison stderr	comparison CoV	erratic	declared erratic
datadog_agent_remap_blackhole	2.95MiB/CPU-s	10.4	100.00%	28.38MiB/CPU-s	8.8MiB/CPU-s	116.27KiB/CPU-s	0.309986	31.33MiB/CPU-s	875.74KiB/CPU-s	11.3KiB/CPU-s	0.027297	True	False
syslog_humio_logs	213.28KiB/CPU-s	2.33	100.00%	8.96MiB/CPU-s	280.94KiB/CPU-s	3.63KiB/CPU-s	0.030633	9.16MiB/CPU-s	132.03KiB/CPU-s	1.7KiB/CPU-s	0.014069	False	False
syslog_log2metric_humio_metrics	107.96KiB/CPU-s	1.76	100.00%	5.99MiB/CPU-s	232.76KiB/CPU-s	3.0KiB/CPU-s	0.037974	6.09MiB/CPU-s	251.4KiB/CPU-s	3.25KiB/CPU-s	0.040305	False	False
syslog_splunk_hec_logs	127.58KiB/CPU-s	1.41	100.00%	8.84MiB/CPU-s	159.98KiB/CPU-s	2.07KiB/CPU-s	0.017662	8.97MiB/CPU-s	211.99KiB/CPU-s	2.74KiB/CPU-s	0.023079	False	False
syslog_loki	96.22KiB/CPU-s	1.08	100.00%	8.71MiB/CPU-s	361.1KiB/CPU-s	4.66KiB/CPU-s	0.040489	8.8MiB/CPU-s	182.73KiB/CPU-s	2.36KiB/CPU-s	0.02027	False	False
otlp_grpc_to_blackhole	10.46KiB/CPU-s	0.98	100.00%	1.04MiB/CPU-s	43.16KiB/CPU-s	570.43B/CPU-s	0.040517	1.05MiB/CPU-s	51.51KiB/CPU-s	680.4B/CPU-s	0.047882	False	False
syslog_regex_logs2metric_ddmetrics	35.3KiB/CPU-s	0.96	100.00%	3.6MiB/CPU-s	367.55KiB/CPU-s	4.74KiB/CPU-s	0.099749	3.63MiB/CPU-s	382.75KiB/CPU-s	4.94KiB/CPU-s	0.102887	True	False
http_text_to_http_json	204.27KiB/CPU-s	0.83	100.00%	24.14MiB/CPU-s	602.54KiB/CPU-s	7.78KiB/CPU-s	0.024374	24.34MiB/CPU-s	656.88KiB/CPU-s	8.48KiB/CPU-s	0.026355	False	False
socket_to_socket_blackhole	22.19KiB/CPU-s	0.16	99.67%	13.23MiB/CPU-s	436.71KiB/CPU-s	5.64KiB/CPU-s	0.032227	13.25MiB/CPU-s	389.04KiB/CPU-s	5.02KiB/CPU-s	0.028663	False	False
otlp_http_to_blackhole	1.67KiB/CPU-s	0.11	57.41%	1.54MiB/CPU-s	110.31KiB/CPU-s	1.42KiB/CPU-s	0.070011	1.54MiB/CPU-s	118.88KiB/CPU-s	1.53KiB/CPU-s	0.075371	False	False
enterprise_http_to_http	10.25KiB/CPU-s	0.07	96.24%	13.61MiB/CPU-s	329.86KiB/CPU-s	4.26KiB/CPU-s	0.023663	13.62MiB/CPU-s	192.38KiB/CPU-s	2.48KiB/CPU-s	0.013791	False	False
splunk_hec_to_splunk_hec_logs_noack	3.18KiB/CPU-s	0.02	60.23%	13.62MiB/CPU-s	220.48KiB/CPU-s	2.85KiB/CPU-s	0.015805	13.63MiB/CPU-s	190.27KiB/CPU-s	2.46KiB/CPU-s	0.013637	False	False
splunk_hec_to_splunk_hec_logs_acks	1.77KiB/CPU-s	0.01	22.28%	13.62MiB/CPU-s	342.28KiB/CPU-s	4.42KiB/CPU-s	0.024548	13.62MiB/CPU-s	342.65KiB/CPU-s	4.42KiB/CPU-s	0.024571	False	False
file_to_blackhole	1.51KiB/CPU-s	0.0	5.86%	54.49MiB/CPU-s	1.09MiB/CPU-s	14.39KiB/CPU-s	0.019992	54.5MiB/CPU-s	1.11MiB/CPU-s	14.69KiB/CPU-s	0.020423	False	False
fluent_elasticsearch	222.9B/CPU-s	0.0	31.30%	45.41MiB/CPU-s	29.89KiB/CPU-s	390.66B/CPU-s	0.000643	45.41MiB/CPU-s	29.99KiB/CPU-s	391.73B/CPU-s	0.000645	False	False
splunk_hec_indexer_ack_blackhole	646.41B/CPU-s	0.0	11.02%	13.62MiB/CPU-s	247.85KiB/CPU-s	3.2KiB/CPU-s	0.017774	13.62MiB/CPU-s	251.36KiB/CPU-s	3.24KiB/CPU-s	0.018025	False	False
http_to_http_noack	-2.1KiB/CPU-s	-0.02	28.26%	13.61MiB/CPU-s	305.23KiB/CPU-s	3.94KiB/CPU-s	0.021893	13.61MiB/CPU-s	330.28KiB/CPU-s	4.26KiB/CPU-s	0.023693	False	False
http_to_http_json	-2.72KiB/CPU-s	-0.02	45.42%	13.62MiB/CPU-s	211.91KiB/CPU-s	2.73KiB/CPU-s	0.015191	13.62MiB/CPU-s	278.05KiB/CPU-s	3.59KiB/CPU-s	0.019936	False	False
datadog_agent_remap_datadog_logs_acks	-24.01KiB/CPU-s	-0.07	74.82%	33.85MiB/CPU-s	1.13MiB/CPU-s	14.96KiB/CPU-s	0.033447	33.83MiB/CPU-s	1.11MiB/CPU-s	14.67KiB/CPU-s	0.032811	False	False
syslog_log2metric_splunk_hec_metrics	-29.09KiB/CPU-s	-0.3	100.00%	9.45MiB/CPU-s	150.11KiB/CPU-s	1.94KiB/CPU-s	0.015512	9.42MiB/CPU-s	215.98KiB/CPU-s	2.79KiB/CPU-s	0.022386	False	False
datadog_agent_remap_datadog_logs	-131.32KiB/CPU-s	-0.37	100.00%	34.25MiB/CPU-s	1.24MiB/CPU-s	16.32KiB/CPU-s	0.036081	34.12MiB/CPU-s	1.2MiB/CPU-s	15.86KiB/CPU-s	0.035196	False	False
http_to_http_acks	-43.62KiB/CPU-s	-0.81	59.53%	5.29MiB/CPU-s	2.8MiB/CPU-s	36.95KiB/CPU-s	0.528814	5.24MiB/CPU-s	2.81MiB/CPU-s	37.09KiB/CPU-s	0.53518	True	False
splunk_hec_route_s3	-141.35KiB/CPU-s	-1.18	100.00%	11.65MiB/CPU-s	589.2KiB/CPU-s	7.6KiB/CPU-s	0.049375	11.51MiB/CPU-s	595.81KiB/CPU-s	7.69KiB/CPU-s	0.050527	False	False
datadog_agent_remap_blackhole_acks	-442.26KiB/CPU-s	-1.39	100.00%	31.17MiB/CPU-s	1.36MiB/CPU-s	18.0KiB/CPU-s	0.043652	30.74MiB/CPU-s	1.36MiB/CPU-s	18.03KiB/CPU-s	0.044361	False	False

Jan 16 '23 06:01 github-actions[bot]

Regression Test Results

Run ID: cdf8f7db-3ffd-4e33-be3b-9509ffbcbf3b
Baseline: 94fcd43bbe562e290ba277b1e78d324cd6000f31
Comparison: d871dd807b65bc36854ff9d93d8e14c48e10c2a7
Total vector CPUs: 7

Explanation

A regression test is an integrated performance test for vector in a repeatable rig, with varying configuration for vector. What follows is a statistical summary of a brief vector run for each configuration across SHAs given above. The goal of these tests are to determine, quickly, if vector performance is changed and to what degree by a pull request. Where appropriate units are scaled per-core.

The table below, if present, lists those experiments that have experienced a statistically significant change in their bytes_written_per_cpu_second performance between baseline and comparison SHAs, with 90.0% confidence OR have been detected as newly erratic. Negative values mean that baseline is faster, positive comparison. Results that do not exhibit more than a ±5% change in mean bytes_written_per_cpu_second are discarded. An experiment is erratic if its coefficient of variation is greater than 0.1. The abbreviated table will be omitted if no interesting changes are observed.

No interesting changes in bytes_written_per_cpu_second with confidence ≥ 90.00% and absolute Δ mean >= ±5%.

Fine details of change detection per experiment.

experiment	Δ mean	Δ mean %	confidence	baseline mean	baseline stdev	baseline stderr	baseline CoV	comparison mean	comparison stdev	comparison stderr	comparison CoV	erratic	declared erratic
http_to_http_acks	121.36KiB/CPU-s	2.28	98.20%	5.2MiB/CPU-s	2.74MiB/CPU-s	36.16KiB/CPU-s	0.526084	5.32MiB/CPU-s	2.75MiB/CPU-s	36.36KiB/CPU-s	0.517239	True	False
syslog_regex_logs2metric_ddmetrics	43.31KiB/CPU-s	1.2	100.00%	3.53MiB/CPU-s	430.77KiB/CPU-s	5.56KiB/CPU-s	0.119067	3.58MiB/CPU-s	401.63KiB/CPU-s	5.19KiB/CPU-s	0.1097	True	False
datadog_agent_remap_blackhole	348.89KiB/CPU-s	1.1	100.00%	31.09MiB/CPU-s	1.24MiB/CPU-s	16.35KiB/CPU-s	0.039799	31.43MiB/CPU-s	875.04KiB/CPU-s	11.29KiB/CPU-s	0.027188	False	False
http_text_to_http_json	258.6KiB/CPU-s	1.04	100.00%	24.26MiB/CPU-s	603.3KiB/CPU-s	7.79KiB/CPU-s	0.024284	24.51MiB/CPU-s	588.75KiB/CPU-s	7.6KiB/CPU-s	0.023454	False	False
datadog_agent_remap_datadog_logs	230.67KiB/CPU-s	0.66	100.00%	33.92MiB/CPU-s	1.35MiB/CPU-s	17.82KiB/CPU-s	0.039775	34.15MiB/CPU-s	1.22MiB/CPU-s	16.17KiB/CPU-s	0.035852	False	False
syslog_log2metric_splunk_hec_metrics	60.9KiB/CPU-s	0.64	100.00%	9.33MiB/CPU-s	315.5KiB/CPU-s	4.07KiB/CPU-s	0.033016	9.39MiB/CPU-s	188.73KiB/CPU-s	2.44KiB/CPU-s	0.019625	False	False
http_to_http_json	11.43KiB/CPU-s	0.08	99.54%	13.61MiB/CPU-s	232.0KiB/CPU-s	2.99KiB/CPU-s	0.016644	13.62MiB/CPU-s	210.02KiB/CPU-s	2.71KiB/CPU-s	0.015055	False	False
enterprise_http_to_http	8.24KiB/CPU-s	0.06	95.33%	13.62MiB/CPU-s	283.91KiB/CPU-s	3.66KiB/CPU-s	0.020361	13.62MiB/CPU-s	149.4KiB/CPU-s	1.93KiB/CPU-s	0.010708	False	False
splunk_hec_to_splunk_hec_logs_noack	2.31KiB/CPU-s	0.02	46.98%	13.62MiB/CPU-s	211.81KiB/CPU-s	2.73KiB/CPU-s	0.015182	13.63MiB/CPU-s	191.53KiB/CPU-s	2.47KiB/CPU-s	0.013726	False	False
splunk_hec_indexer_ack_blackhole	1.2KiB/CPU-s	0.01	20.44%	13.62MiB/CPU-s	258.64KiB/CPU-s	3.34KiB/CPU-s	0.018549	13.62MiB/CPU-s	250.28KiB/CPU-s	3.23KiB/CPU-s	0.017948	False	False
fluent_elasticsearch	70.88B/CPU-s	0.0	10.24%	45.41MiB/CPU-s	30.23KiB/CPU-s	395.28B/CPU-s	0.00065	45.41MiB/CPU-s	29.31KiB/CPU-s	383.25B/CPU-s	0.00063	False	False
file_to_blackhole	1.77KiB/CPU-s	0.0	7.03%	54.49MiB/CPU-s	1.11MiB/CPU-s	14.6KiB/CPU-s	0.020278	54.49MiB/CPU-s	1.04MiB/CPU-s	13.77KiB/CPU-s	0.019151	False	False
http_to_http_noack	-136.65B/CPU-s	-0.0	1.89%	13.61MiB/CPU-s	309.75KiB/CPU-s	4.0KiB/CPU-s	0.022217	13.61MiB/CPU-s	308.92KiB/CPU-s	3.99KiB/CPU-s	0.022158	False	False
splunk_hec_to_splunk_hec_logs_acks	-484.36B/CPU-s	-0.0	5.91%	13.62MiB/CPU-s	351.32KiB/CPU-s	4.53KiB/CPU-s	0.025197	13.61MiB/CPU-s	347.88KiB/CPU-s	4.49KiB/CPU-s	0.024951	False	False
socket_to_socket_blackhole	-18.37KiB/CPU-s	-0.13	100.00%	13.39MiB/CPU-s	183.45KiB/CPU-s	2.37KiB/CPU-s	0.013376	13.37MiB/CPU-s	158.89KiB/CPU-s	2.05KiB/CPU-s	0.011601	False	False
syslog_log2metric_humio_metrics	-9.81KiB/CPU-s	-0.16	99.95%	6.03MiB/CPU-s	161.87KiB/CPU-s	2.09KiB/CPU-s	0.026223	6.02MiB/CPU-s	143.88KiB/CPU-s	1.86KiB/CPU-s	0.023346	False	False
datadog_agent_remap_datadog_logs_acks	-65.62KiB/CPU-s	-0.19	99.58%	33.63MiB/CPU-s	1.23MiB/CPU-s	16.23KiB/CPU-s	0.03651	33.57MiB/CPU-s	1.22MiB/CPU-s	16.17KiB/CPU-s	0.036453	False	False
otlp_grpc_to_blackhole	-4.08KiB/CPU-s	-0.38	100.00%	1.04MiB/CPU-s	45.73KiB/CPU-s	604.32B/CPU-s	0.042813	1.04MiB/CPU-s	49.92KiB/CPU-s	659.66B/CPU-s	0.046913	False	False
datadog_agent_remap_blackhole_acks	-168.6KiB/CPU-s	-0.53	100.00%	30.82MiB/CPU-s	1.24MiB/CPU-s	16.43KiB/CPU-s	0.0403	30.66MiB/CPU-s	1.74MiB/CPU-s	22.98KiB/CPU-s	0.056701	False	False
syslog_splunk_hec_logs	-55.41KiB/CPU-s	-0.59	100.00%	9.1MiB/CPU-s	144.48KiB/CPU-s	1.87KiB/CPU-s	0.015504	9.05MiB/CPU-s	200.58KiB/CPU-s	2.59KiB/CPU-s	0.021654	False	False
syslog_loki	-72.37KiB/CPU-s	-0.8	100.00%	8.84MiB/CPU-s	179.27KiB/CPU-s	2.31KiB/CPU-s	0.019806	8.77MiB/CPU-s	245.25KiB/CPU-s	3.17KiB/CPU-s	0.027315	False	False
otlp_http_to_blackhole	-13.79KiB/CPU-s	-0.87	100.00%	1.55MiB/CPU-s	103.37KiB/CPU-s	1.33KiB/CPU-s	0.065136	1.54MiB/CPU-s	119.05KiB/CPU-s	1.54KiB/CPU-s	0.075676	False	False
splunk_hec_route_s3	-174.13KiB/CPU-s	-1.47	100.00%	11.54MiB/CPU-s	568.88KiB/CPU-s	7.34KiB/CPU-s	0.048135	11.37MiB/CPU-s	540.42KiB/CPU-s	6.98KiB/CPU-s	0.04641	False	False
syslog_humio_logs	-166.63KiB/CPU-s	-1.78	100.00%	9.16MiB/CPU-s	170.37KiB/CPU-s	2.2KiB/CPU-s	0.018169	8.99MiB/CPU-s	253.98KiB/CPU-s	3.28KiB/CPU-s	0.027575	False	False

Jan 16 '23 06:01 github-actions[bot]

Regression Test Results

Run ID: fd59801e-49cc-4613-b87e-41710c2b10ac
Baseline: 94fcd43bbe562e290ba277b1e78d324cd6000f31
Comparison: 3743e151948c0c1fadb2d066700290b2890c5250
Total vector CPUs: 7

Explanation

A regression test is an integrated performance test for vector in a repeatable rig, with varying configuration for vector. What follows is a statistical summary of a brief vector run for each configuration across SHAs given above. The goal of these tests are to determine, quickly, if vector performance is changed and to what degree by a pull request. Where appropriate units are scaled per-core.

The table below, if present, lists those experiments that have experienced a statistically significant change in their bytes_written_per_cpu_second performance between baseline and comparison SHAs, with 90.0% confidence OR have been detected as newly erratic. Negative values mean that baseline is faster, positive comparison. Results that do not exhibit more than a ±5% change in mean bytes_written_per_cpu_second are discarded. An experiment is erratic if its coefficient of variation is greater than 0.1. The abbreviated table will be omitted if no interesting changes are observed.

No interesting changes in bytes_written_per_cpu_second with confidence ≥ 90.00% and absolute Δ mean >= ±5%.

Fine details of change detection per experiment.

experiment	Δ mean	Δ mean %	confidence	baseline mean	baseline stdev	baseline stderr	baseline CoV	comparison mean	comparison stdev	comparison stderr	comparison CoV	erratic	declared erratic
syslog_regex_logs2metric_ddmetrics	106.89KiB/CPU-s	2.86	100.00%	3.66MiB/CPU-s	462.57KiB/CPU-s	5.97KiB/CPU-s	0.123557	3.76MiB/CPU-s	440.9KiB/CPU-s	5.69KiB/CPU-s	0.114498	True	False
datadog_agent_remap_datadog_logs	965.05KiB/CPU-s	2.83	100.00%	33.34MiB/CPU-s	1.82MiB/CPU-s	24.03KiB/CPU-s	0.05457	34.28MiB/CPU-s	1.17MiB/CPU-s	15.42KiB/CPU-s	0.034053	False	False
datadog_agent_remap_datadog_logs_acks	390.99KiB/CPU-s	1.14	100.00%	33.51MiB/CPU-s	1.39MiB/CPU-s	18.31KiB/CPU-s	0.041346	33.9MiB/CPU-s	803.43KiB/CPU-s	10.37KiB/CPU-s	0.023145	False	False
http_text_to_http_json	143.14KiB/CPU-s	0.58	100.00%	24.23MiB/CPU-s	571.51KiB/CPU-s	7.38KiB/CPU-s	0.023032	24.37MiB/CPU-s	634.74KiB/CPU-s	8.19KiB/CPU-s	0.025433	False	False
enterprise_http_to_http	10.4KiB/CPU-s	0.07	96.33%	13.61MiB/CPU-s	333.8KiB/CPU-s	4.31KiB/CPU-s	0.023946	13.62MiB/CPU-s	193.32KiB/CPU-s	2.5KiB/CPU-s	0.013858	False	False
syslog_loki	4.68KiB/CPU-s	0.05	82.54%	8.76MiB/CPU-s	192.03KiB/CPU-s	2.48KiB/CPU-s	0.021413	8.76MiB/CPU-s	185.67KiB/CPU-s	2.4KiB/CPU-s	0.020692	False	False
splunk_hec_to_splunk_hec_logs_acks	4.04KiB/CPU-s	0.03	46.55%	13.61MiB/CPU-s	355.35KiB/CPU-s	4.58KiB/CPU-s	0.025487	13.62MiB/CPU-s	358.35KiB/CPU-s	4.62KiB/CPU-s	0.025695	False	False
splunk_hec_to_splunk_hec_logs_noack	3.59KiB/CPU-s	0.03	65.99%	13.62MiB/CPU-s	219.44KiB/CPU-s	2.83KiB/CPU-s	0.01573	13.63MiB/CPU-s	191.98KiB/CPU-s	2.48KiB/CPU-s	0.013759	False	False
splunk_hec_indexer_ack_blackhole	1.39KiB/CPU-s	0.01	24.26%	13.62MiB/CPU-s	250.21KiB/CPU-s	3.23KiB/CPU-s	0.017943	13.62MiB/CPU-s	243.64KiB/CPU-s	3.14KiB/CPU-s	0.01747	False	False
http_to_http_json	234.73B/CPU-s	0.0	4.77%	13.62MiB/CPU-s	210.05KiB/CPU-s	2.71KiB/CPU-s	0.015057	13.62MiB/CPU-s	210.34KiB/CPU-s	2.71KiB/CPU-s	0.015077	False	False
fluent_elasticsearch	-168.37B/CPU-s	-0.0	23.87%	45.41MiB/CPU-s	30.2KiB/CPU-s	394.61B/CPU-s	0.000649	45.41MiB/CPU-s	29.77KiB/CPU-s	389.14B/CPU-s	0.00064	False	False
file_to_blackhole	-3.69KiB/CPU-s	-0.01	14.31%	54.49MiB/CPU-s	1.06MiB/CPU-s	14.02KiB/CPU-s	0.019469	54.49MiB/CPU-s	1.13MiB/CPU-s	14.92KiB/CPU-s	0.020741	False	False
http_to_http_noack	-6.19KiB/CPU-s	-0.04	74.58%	13.62MiB/CPU-s	256.63KiB/CPU-s	3.31KiB/CPU-s	0.018402	13.61MiB/CPU-s	333.24KiB/CPU-s	4.3KiB/CPU-s	0.023906	False	False
otlp_grpc_to_blackhole	-850.9B/CPU-s	-0.08	66.30%	1.05MiB/CPU-s	44.85KiB/CPU-s	592.66B/CPU-s	0.041831	1.05MiB/CPU-s	49.86KiB/CPU-s	658.78B/CPU-s	0.046546	False	False
syslog_log2metric_humio_metrics	-12.09KiB/CPU-s	-0.19	100.00%	6.13MiB/CPU-s	148.74KiB/CPU-s	1.92KiB/CPU-s	0.023711	6.11MiB/CPU-s	164.3KiB/CPU-s	2.12KiB/CPU-s	0.026241	False	False
socket_to_socket_blackhole	-26.58KiB/CPU-s	-0.19	100.00%	13.36MiB/CPU-s	223.06KiB/CPU-s	2.88KiB/CPU-s	0.016305	13.33MiB/CPU-s	340.57KiB/CPU-s	4.4KiB/CPU-s	0.024943	False	False
syslog_splunk_hec_logs	-37.9KiB/CPU-s	-0.41	100.00%	9.04MiB/CPU-s	131.15KiB/CPU-s	1.69KiB/CPU-s	0.014173	9.0MiB/CPU-s	212.41KiB/CPU-s	2.74KiB/CPU-s	0.023047	False	False
splunk_hec_route_s3	-53.22KiB/CPU-s	-0.44	100.00%	11.7MiB/CPU-s	543.7KiB/CPU-s	7.01KiB/CPU-s	0.045376	11.65MiB/CPU-s	611.85KiB/CPU-s	7.9KiB/CPU-s	0.051292	False	False
syslog_log2metric_splunk_hec_metrics	-51.31KiB/CPU-s	-0.53	100.00%	9.48MiB/CPU-s	198.42KiB/CPU-s	2.56KiB/CPU-s	0.020443	9.43MiB/CPU-s	188.78KiB/CPU-s	2.44KiB/CPU-s	0.019553	False	False
otlp_http_to_blackhole	-11.8KiB/CPU-s	-0.74	100.00%	1.55MiB/CPU-s	110.01KiB/CPU-s	1.42KiB/CPU-s	0.069251	1.54MiB/CPU-s	120.8KiB/CPU-s	1.56KiB/CPU-s	0.076607	False	False
syslog_humio_logs	-134.78KiB/CPU-s	-1.44	100.00%	9.13MiB/CPU-s	167.34KiB/CPU-s	2.16KiB/CPU-s	0.017889	9.0MiB/CPU-s	222.05KiB/CPU-s	2.87KiB/CPU-s	0.024085	False	False
http_to_http_acks	-85.89KiB/CPU-s	-1.56	89.78%	5.37MiB/CPU-s	2.79MiB/CPU-s	36.86KiB/CPU-s	0.519589	5.28MiB/CPU-s	2.84MiB/CPU-s	37.47KiB/CPU-s	0.536805	True	False
datadog_agent_remap_blackhole	-762.53KiB/CPU-s	-2.37	100.00%	31.36MiB/CPU-s	869.23KiB/CPU-s	11.22KiB/CPU-s	0.027065	30.62MiB/CPU-s	747.32KiB/CPU-s	9.65KiB/CPU-s	0.023836	False	False
datadog_agent_remap_blackhole_acks	-793.58KiB/CPU-s	-2.48	100.00%	31.26MiB/CPU-s	760.32KiB/CPU-s	9.82KiB/CPU-s	0.023749	30.49MiB/CPU-s	1.33MiB/CPU-s	17.61KiB/CPU-s	0.043685	False	False

Jan 16 '23 07:01 github-actions[bot]

Regression Test Results

Run ID: a2a70c62-757e-4fba-8c87-0d219e542759
Baseline: 94fcd43bbe562e290ba277b1e78d324cd6000f31
Comparison: 77e44081078fa916bed7d98d64f48eb710aed021
Total vector CPUs: 7

Explanation

A regression test is an integrated performance test for vector in a repeatable rig, with varying configuration for vector. What follows is a statistical summary of a brief vector run for each configuration across SHAs given above. The goal of these tests are to determine, quickly, if vector performance is changed and to what degree by a pull request. Where appropriate units are scaled per-core.

The table below, if present, lists those experiments that have experienced a statistically significant change in their bytes_written_per_cpu_second performance between baseline and comparison SHAs, with 90.0% confidence OR have been detected as newly erratic. Negative values mean that baseline is faster, positive comparison. Results that do not exhibit more than a ±5% change in mean bytes_written_per_cpu_second are discarded. An experiment is erratic if its coefficient of variation is greater than 0.1. The abbreviated table will be omitted if no interesting changes are observed.

Changes in bytes_written_per_cpu_second with confidence ≥ 90.00% and absolute Δ mean >= ±5%:

experiment	Δ mean	Δ mean %	confidence
syslog_log2metric_splunk_hec_metrics	-968.85KiB/CPU-s	-9.93	100.00%

Fine details of change detection per experiment.

experiment	Δ mean	Δ mean %	confidence	baseline mean	baseline stdev	baseline stderr	baseline CoV	comparison mean	comparison stdev	comparison stderr	comparison CoV	erratic	declared erratic
syslog_log2metric_humio_metrics	210.17KiB/CPU-s	3.39	100.00%	6.06MiB/CPU-s	247.09KiB/CPU-s	3.19KiB/CPU-s	0.039825	6.26MiB/CPU-s	159.59KiB/CPU-s	2.06KiB/CPU-s	0.024879	False	False
datadog_agent_remap_datadog_logs	391.15KiB/CPU-s	1.12	100.00%	34.15MiB/CPU-s	1.16MiB/CPU-s	15.26KiB/CPU-s	0.033826	34.54MiB/CPU-s	1.17MiB/CPU-s	15.49KiB/CPU-s	0.033951	False	False
syslog_regex_logs2metric_ddmetrics	38.6KiB/CPU-s	1.03	100.00%	3.67MiB/CPU-s	395.04KiB/CPU-s	5.1KiB/CPU-s	0.105152	3.71MiB/CPU-s	419.89KiB/CPU-s	5.42KiB/CPU-s	0.110629	True	False
datadog_agent_remap_datadog_logs_acks	207.03KiB/CPU-s	0.59	100.00%	34.18MiB/CPU-s	1.02MiB/CPU-s	13.43KiB/CPU-s	0.029735	34.38MiB/CPU-s	582.34KiB/CPU-s	7.52KiB/CPU-s	0.016538	False	False
syslog_humio_logs	42.6KiB/CPU-s	0.45	100.00%	9.16MiB/CPU-s	165.91KiB/CPU-s	2.14KiB/CPU-s	0.017679	9.21MiB/CPU-s	126.05KiB/CPU-s	1.63KiB/CPU-s	0.013371	False	False
datadog_agent_remap_blackhole_acks	124.27KiB/CPU-s	0.38	100.00%	31.68MiB/CPU-s	980.96KiB/CPU-s	12.67KiB/CPU-s	0.030238	31.8MiB/CPU-s	845.25KiB/CPU-s	10.91KiB/CPU-s	0.025956	False	False
socket_to_socket_blackhole	49.5KiB/CPU-s	0.36	100.00%	13.34MiB/CPU-s	286.9KiB/CPU-s	3.7KiB/CPU-s	0.021009	13.38MiB/CPU-s	164.75KiB/CPU-s	2.13KiB/CPU-s	0.012021	False	False
http_text_to_http_json	37.92KiB/CPU-s	0.15	99.99%	24.45MiB/CPU-s	540.66KiB/CPU-s	6.98KiB/CPU-s	0.021594	24.49MiB/CPU-s	519.65KiB/CPU-s	6.7KiB/CPU-s	0.020723	False	False
enterprise_http_to_http	8.35KiB/CPU-s	0.06	92.39%	13.61MiB/CPU-s	309.89KiB/CPU-s	4.0KiB/CPU-s	0.022228	13.62MiB/CPU-s	192.22KiB/CPU-s	2.48KiB/CPU-s	0.013779	False	False
splunk_hec_to_splunk_hec_logs_noack	5.75KiB/CPU-s	0.04	84.97%	13.62MiB/CPU-s	242.27KiB/CPU-s	3.13KiB/CPU-s	0.01737	13.63MiB/CPU-s	192.63KiB/CPU-s	2.49KiB/CPU-s	0.013805	False	False
splunk_hec_to_splunk_hec_logs_acks	3.43KiB/CPU-s	0.02	40.30%	13.61MiB/CPU-s	371.42KiB/CPU-s	4.79KiB/CPU-s	0.026639	13.62MiB/CPU-s	339.5KiB/CPU-s	4.38KiB/CPU-s	0.024344	False	False
http_to_http_json	791.17B/CPU-s	0.01	15.87%	13.62MiB/CPU-s	211.81KiB/CPU-s	2.73KiB/CPU-s	0.015183	13.62MiB/CPU-s	211.25KiB/CPU-s	2.73KiB/CPU-s	0.015143	False	False
splunk_hec_indexer_ack_blackhole	1.75KiB/CPU-s	0.01	30.17%	13.62MiB/CPU-s	252.52KiB/CPU-s	3.26KiB/CPU-s	0.018108	13.62MiB/CPU-s	242.3KiB/CPU-s	3.13KiB/CPU-s	0.017373	False	False
http_to_http_noack	0B/CPU-s	0.0	0.00%	13.61MiB/CPU-s	333.71KiB/CPU-s	4.31KiB/CPU-s	0.02394	13.61MiB/CPU-s	332.0KiB/CPU-s	4.28KiB/CPU-s	0.023817	False	False
fluent_elasticsearch	259.84B/CPU-s	0.0	35.77%	45.41MiB/CPU-s	30.26KiB/CPU-s	395.35B/CPU-s	0.000651	45.41MiB/CPU-s	30.27KiB/CPU-s	395.66B/CPU-s	0.000651	False	False
file_to_blackhole	-13.94KiB/CPU-s	-0.02	46.74%	54.49MiB/CPU-s	1.18MiB/CPU-s	15.54KiB/CPU-s	0.021583	54.48MiB/CPU-s	1.22MiB/CPU-s	16.05KiB/CPU-s	0.022322	False	False
http_to_http_acks	-4.2KiB/CPU-s	-0.08	6.45%	5.29MiB/CPU-s	2.76MiB/CPU-s	36.41KiB/CPU-s	0.520588	5.29MiB/CPU-s	2.8MiB/CPU-s	36.96KiB/CPU-s	0.528976	True	False
syslog_loki	-21.77KiB/CPU-s	-0.24	100.00%	8.85MiB/CPU-s	237.02KiB/CPU-s	3.06KiB/CPU-s	0.026143	8.83MiB/CPU-s	227.28KiB/CPU-s	2.93KiB/CPU-s	0.02513	False	False
syslog_splunk_hec_logs	-38.92KiB/CPU-s	-0.42	100.00%	9.05MiB/CPU-s	156.9KiB/CPU-s	2.03KiB/CPU-s	0.016931	9.01MiB/CPU-s	212.07KiB/CPU-s	2.74KiB/CPU-s	0.02298	False	False
otlp_grpc_to_blackhole	-7.63KiB/CPU-s	-0.71	100.00%	1.05MiB/CPU-s	50.77KiB/CPU-s	670.87B/CPU-s	0.0474	1.04MiB/CPU-s	53.49KiB/CPU-s	706.71B/CPU-s	0.050294	False	False
datadog_agent_remap_blackhole	-286.79KiB/CPU-s	-0.89	100.00%	31.49MiB/CPU-s	909.86KiB/CPU-s	11.74KiB/CPU-s	0.028218	31.21MiB/CPU-s	802.0KiB/CPU-s	10.35KiB/CPU-s	0.025097	False	False
otlp_http_to_blackhole	-28.63KiB/CPU-s	-1.81	100.00%	1.54MiB/CPU-s	109.0KiB/CPU-s	1.41KiB/CPU-s	0.068973	1.52MiB/CPU-s	121.37KiB/CPU-s	1.57KiB/CPU-s	0.07822	False	False
splunk_hec_route_s3	-297.17KiB/CPU-s	-2.47	100.00%	11.76MiB/CPU-s	559.17KiB/CPU-s	7.21KiB/CPU-s	0.046414	11.47MiB/CPU-s	729.96KiB/CPU-s	9.42KiB/CPU-s	0.062124	False	False
syslog_log2metric_splunk_hec_metrics	-968.85KiB/CPU-s	-9.93	100.00%	9.53MiB/CPU-s	129.99KiB/CPU-s	1.68KiB/CPU-s	0.013322	8.58MiB/CPU-s	2.51MiB/CPU-s	33.19KiB/CPU-s	0.292434	True	False

Jan 16 '23 10:01 github-actions[bot]

Regression Test Results

Run ID: 202170dd-1267-46f0-a4bb-1ce6bfca3498
Baseline: 94fcd43bbe562e290ba277b1e78d324cd6000f31
Comparison: 357b38e2b9b4c13f5f6fbf0958a6b2bd53ffbe7b
Total vector CPUs: 7

Explanation

A regression test is an integrated performance test for vector in a repeatable rig, with varying configuration for vector. What follows is a statistical summary of a brief vector run for each configuration across SHAs given above. The goal of these tests are to determine, quickly, if vector performance is changed and to what degree by a pull request. Where appropriate units are scaled per-core.

The table below, if present, lists those experiments that have experienced a statistically significant change in their bytes_written_per_cpu_second performance between baseline and comparison SHAs, with 90.0% confidence OR have been detected as newly erratic. Negative values mean that baseline is faster, positive comparison. Results that do not exhibit more than a ±5% change in mean bytes_written_per_cpu_second are discarded. An experiment is erratic if its coefficient of variation is greater than 0.1. The abbreviated table will be omitted if no interesting changes are observed.

No interesting changes in bytes_written_per_cpu_second with confidence ≥ 90.00% and absolute Δ mean >= ±5%.

Fine details of change detection per experiment.

experiment	Δ mean	Δ mean %	confidence	baseline mean	baseline stdev	baseline stderr	baseline CoV	comparison mean	comparison stdev	comparison stderr	comparison CoV	erratic	declared erratic
datadog_agent_remap_datadog_logs_acks	817.14KiB/CPU-s	2.41	100.00%	33.17MiB/CPU-s	1.44MiB/CPU-s	19.02KiB/CPU-s	0.04341	33.96MiB/CPU-s	1.12MiB/CPU-s	14.79KiB/CPU-s	0.032954	False	False
syslog_log2metric_humio_metrics	99.41KiB/CPU-s	1.61	100.00%	6.04MiB/CPU-s	187.02KiB/CPU-s	2.41KiB/CPU-s	0.030236	6.14MiB/CPU-s	239.45KiB/CPU-s	3.09KiB/CPU-s	0.0381	False	False
datadog_agent_remap_datadog_logs	450.19KiB/CPU-s	1.3	100.00%	33.94MiB/CPU-s	1.22MiB/CPU-s	16.18KiB/CPU-s	0.036081	34.38MiB/CPU-s	1.17MiB/CPU-s	15.45KiB/CPU-s	0.034017	False	False
syslog_loki	70.22KiB/CPU-s	0.79	100.00%	8.73MiB/CPU-s	259.33KiB/CPU-s	3.35KiB/CPU-s	0.029016	8.8MiB/CPU-s	207.09KiB/CPU-s	2.67KiB/CPU-s	0.02299	False	False
splunk_hec_route_s3	84.35KiB/CPU-s	0.71	100.00%	11.57MiB/CPU-s	599.43KiB/CPU-s	7.73KiB/CPU-s	0.050578	11.66MiB/CPU-s	580.09KiB/CPU-s	7.49KiB/CPU-s	0.048601	False	False
syslog_humio_logs	50.19KiB/CPU-s	0.54	100.00%	9.09MiB/CPU-s	248.18KiB/CPU-s	3.2KiB/CPU-s	0.026648	9.14MiB/CPU-s	117.58KiB/CPU-s	1.52KiB/CPU-s	0.012557	False	False
syslog_log2metric_splunk_hec_metrics	37.05KiB/CPU-s	0.38	100.00%	9.47MiB/CPU-s	241.19KiB/CPU-s	3.11KiB/CPU-s	0.024864	9.51MiB/CPU-s	163.99KiB/CPU-s	2.12KiB/CPU-s	0.016842	False	False
syslog_splunk_hec_logs	6.12KiB/CPU-s	0.07	94.58%	9.02MiB/CPU-s	153.62KiB/CPU-s	1.98KiB/CPU-s	0.016623	9.03MiB/CPU-s	192.46KiB/CPU-s	2.48KiB/CPU-s	0.020812	False	False
enterprise_http_to_http	8.26KiB/CPU-s	0.06	85.86%	13.61MiB/CPU-s	350.11KiB/CPU-s	4.52KiB/CPU-s	0.02512	13.62MiB/CPU-s	258.32KiB/CPU-s	3.33KiB/CPU-s	0.018523	False	False
http_to_http_noack	4.05KiB/CPU-s	0.03	52.90%	13.61MiB/CPU-s	330.57KiB/CPU-s	4.27KiB/CPU-s	0.023714	13.62MiB/CPU-s	283.92KiB/CPU-s	3.66KiB/CPU-s	0.020362	False	False
splunk_hec_to_splunk_hec_logs_noack	4.07KiB/CPU-s	0.03	71.16%	13.62MiB/CPU-s	228.25KiB/CPU-s	2.95KiB/CPU-s	0.016363	13.63MiB/CPU-s	189.68KiB/CPU-s	2.45KiB/CPU-s	0.013594	False	False
file_to_blackhole	6.26KiB/CPU-s	0.01	24.21%	54.49MiB/CPU-s	1.05MiB/CPU-s	13.91KiB/CPU-s	0.019325	54.5MiB/CPU-s	1.12MiB/CPU-s	14.79KiB/CPU-s	0.020561	False	False
splunk_hec_indexer_ack_blackhole	1.17KiB/CPU-s	0.01	19.90%	13.62MiB/CPU-s	257.68KiB/CPU-s	3.32KiB/CPU-s	0.01848	13.62MiB/CPU-s	252.29KiB/CPU-s	3.25KiB/CPU-s	0.018092	False	False
splunk_hec_to_splunk_hec_logs_acks	1.74KiB/CPU-s	0.01	21.83%	13.62MiB/CPU-s	353.34KiB/CPU-s	4.56KiB/CPU-s	0.025338	13.62MiB/CPU-s	333.17KiB/CPU-s	4.3KiB/CPU-s	0.023888	False	False
fluent_elasticsearch	467.02B/CPU-s	0.0	60.20%	45.41MiB/CPU-s	30.17KiB/CPU-s	394.45B/CPU-s	0.000649	45.41MiB/CPU-s	29.61KiB/CPU-s	387.0B/CPU-s	0.000637	False	False
http_to_http_json	-197.11B/CPU-s	-0.0	3.99%	13.62MiB/CPU-s	210.88KiB/CPU-s	2.72KiB/CPU-s	0.015116	13.62MiB/CPU-s	211.22KiB/CPU-s	2.72KiB/CPU-s	0.015141	False	False
http_text_to_http_json	-71.64KiB/CPU-s	-0.29	100.00%	24.5MiB/CPU-s	500.47KiB/CPU-s	6.46KiB/CPU-s	0.019943	24.43MiB/CPU-s	557.22KiB/CPU-s	7.19KiB/CPU-s	0.022268	False	False
socket_to_socket_blackhole	-89.51KiB/CPU-s	-0.65	100.00%	13.37MiB/CPU-s	201.25KiB/CPU-s	2.6KiB/CPU-s	0.014696	13.28MiB/CPU-s	354.67KiB/CPU-s	4.58KiB/CPU-s	0.026069	False	False
otlp_grpc_to_blackhole	-7.92KiB/CPU-s	-0.74	100.00%	1.05MiB/CPU-s	37.8KiB/CPU-s	499.67B/CPU-s	0.035242	1.04MiB/CPU-s	52.17KiB/CPU-s	689.24B/CPU-s	0.048998	False	False
datadog_agent_remap_blackhole	-281.5KiB/CPU-s	-0.89	100.00%	30.96MiB/CPU-s	1.37MiB/CPU-s	18.13KiB/CPU-s	0.044326	30.68MiB/CPU-s	950.77KiB/CPU-s	12.27KiB/CPU-s	0.03026	False	False
otlp_http_to_blackhole	-14.12KiB/CPU-s	-0.9	100.00%	1.53MiB/CPU-s	114.53KiB/CPU-s	1.48KiB/CPU-s	0.072925	1.52MiB/CPU-s	119.25KiB/CPU-s	1.54KiB/CPU-s	0.07662	False	False
http_to_http_acks	-91.88KiB/CPU-s	-1.68	92.29%	5.33MiB/CPU-s	2.8MiB/CPU-s	36.95KiB/CPU-s	0.52437	5.24MiB/CPU-s	2.76MiB/CPU-s	36.54KiB/CPU-s	0.527348	True	False
datadog_agent_remap_blackhole_acks	-730.6KiB/CPU-s	-2.22	100.00%	32.09MiB/CPU-s	566.37KiB/CPU-s	7.31KiB/CPU-s	0.017237	31.37MiB/CPU-s	820.35KiB/CPU-s	10.59KiB/CPU-s	0.025534	False	False
syslog_regex_logs2metric_ddmetrics	-171.52KiB/CPU-s	-4.65	100.00%	3.6MiB/CPU-s	363.72KiB/CPU-s	4.69KiB/CPU-s	0.098611	3.43MiB/CPU-s	540.34KiB/CPU-s	6.98KiB/CPU-s	0.153642	True	False

Jan 16 '23 10:01 github-actions[bot]

Regression Test Results

Run ID: f347db02-13ce-4fa8-877c-3b43df742e01
Baseline: c66dd2a5f6700de1ba4e9ca84fed2f330f0f018a
Comparison: 60aa2e238e320c12c906d4a9e9454d8973cc6d7c
Total vector CPUs: 7

Explanation

A regression test is an integrated performance test for vector in a repeatable rig, with varying configuration for vector. What follows is a statistical summary of a brief vector run for each configuration across SHAs given above. The goal of these tests are to determine, quickly, if vector performance is changed and to what degree by a pull request. Where appropriate units are scaled per-core.

The table below, if present, lists those experiments that have experienced a statistically significant change in their bytes_written_per_cpu_second performance between baseline and comparison SHAs, with 90.0% confidence OR have been detected as newly erratic. Negative values mean that baseline is faster, positive comparison. Results that do not exhibit more than a ±5% change in mean bytes_written_per_cpu_second are discarded. An experiment is erratic if its coefficient of variation is greater than 0.1. The abbreviated table will be omitted if no interesting changes are observed.

No interesting changes in bytes_written_per_cpu_second with confidence ≥ 90.00% and absolute Δ mean >= ±5%.

Fine details of change detection per experiment.

experiment	Δ mean	Δ mean %	confidence	baseline mean	baseline stdev	baseline stderr	baseline CoV	comparison mean	comparison stdev	comparison stderr	comparison CoV	erratic	declared erratic
http_text_to_http_json	541.76KiB/CPU-s	2.21	100.00%	23.91MiB/CPU-s	608.03KiB/CPU-s	7.85KiB/CPU-s	0.024834	24.44MiB/CPU-s	722.6KiB/CPU-s	9.32KiB/CPU-s	0.028875	False	False
syslog_regex_logs2metric_ddmetrics	77.37KiB/CPU-s	2.06	100.00%	3.67MiB/CPU-s	391.33KiB/CPU-s	5.05KiB/CPU-s	0.104222	3.74MiB/CPU-s	438.5KiB/CPU-s	5.66KiB/CPU-s	0.114426	True	False
datadog_agent_remap_datadog_logs	592.67KiB/CPU-s	1.7	100.00%	33.98MiB/CPU-s	1.23MiB/CPU-s	16.21KiB/CPU-s	0.036108	34.56MiB/CPU-s	1.11MiB/CPU-s	14.71KiB/CPU-s	0.03222	False	False
syslog_humio_logs	100.25KiB/CPU-s	1.08	100.00%	9.09MiB/CPU-s	312.65KiB/CPU-s	4.04KiB/CPU-s	0.033583	9.19MiB/CPU-s	125.38KiB/CPU-s	1.62KiB/CPU-s	0.013324	False	False
socket_to_socket_blackhole	117.04KiB/CPU-s	0.87	100.00%	13.18MiB/CPU-s	329.16KiB/CPU-s	4.25KiB/CPU-s	0.024379	13.3MiB/CPU-s	278.67KiB/CPU-s	3.6KiB/CPU-s	0.020462	False	False
http_to_http_acks	36.03KiB/CPU-s	0.67	51.59%	5.28MiB/CPU-s	2.74MiB/CPU-s	36.26KiB/CPU-s	0.519978	5.31MiB/CPU-s	2.77MiB/CPU-s	36.57KiB/CPU-s	0.520914	True	False
syslog_log2metric_humio_metrics	34.47KiB/CPU-s	0.55	100.00%	6.14MiB/CPU-s	127.79KiB/CPU-s	1.65KiB/CPU-s	0.020336	6.17MiB/CPU-s	277.86KiB/CPU-s	3.59KiB/CPU-s	0.043976	False	False
datadog_agent_remap_blackhole	111.2KiB/CPU-s	0.35	100.00%	30.97MiB/CPU-s	1.16MiB/CPU-s	15.34KiB/CPU-s	0.03746	31.08MiB/CPU-s	1021.01KiB/CPU-s	13.18KiB/CPU-s	0.032075	False	False
otlp_grpc_to_blackhole	2.91KiB/CPU-s	0.27	99.94%	1.04MiB/CPU-s	39.98KiB/CPU-s	528.44B/CPU-s	0.03743	1.05MiB/CPU-s	51.91KiB/CPU-s	685.84B/CPU-s	0.048471	False	False
syslog_loki	21.12KiB/CPU-s	0.23	100.00%	8.89MiB/CPU-s	193.46KiB/CPU-s	2.5KiB/CPU-s	0.021242	8.91MiB/CPU-s	150.36KiB/CPU-s	1.94KiB/CPU-s	0.016471	False	False
enterprise_http_to_http	10.14KiB/CPU-s	0.07	97.86%	13.61MiB/CPU-s	306.88KiB/CPU-s	3.96KiB/CPU-s	0.022011	13.62MiB/CPU-s	149.99KiB/CPU-s	1.94KiB/CPU-s	0.01075	False	False
splunk_hec_to_splunk_hec_logs_noack	3.49KiB/CPU-s	0.03	64.63%	13.62MiB/CPU-s	219.37KiB/CPU-s	2.83KiB/CPU-s	0.015726	13.63MiB/CPU-s	191.61KiB/CPU-s	2.47KiB/CPU-s	0.013732	False	False
splunk_hec_indexer_ack_blackhole	1.29KiB/CPU-s	0.01	22.40%	13.62MiB/CPU-s	250.76KiB/CPU-s	3.23KiB/CPU-s	0.017982	13.62MiB/CPU-s	247.29KiB/CPU-s	3.19KiB/CPU-s	0.017731	False	False
fluent_elasticsearch	-92.72B/CPU-s	-0.0	13.37%	45.41MiB/CPU-s	29.97KiB/CPU-s	391.46B/CPU-s	0.000644	45.41MiB/CPU-s	29.67KiB/CPU-s	387.62B/CPU-s	0.000638	False	False
http_to_http_noack	-1.36KiB/CPU-s	-0.01	17.85%	13.61MiB/CPU-s	309.02KiB/CPU-s	3.99KiB/CPU-s	0.022169	13.61MiB/CPU-s	352.26KiB/CPU-s	4.55KiB/CPU-s	0.025274	False	False
file_to_blackhole	-3.03KiB/CPU-s	-0.01	11.69%	54.49MiB/CPU-s	1.1MiB/CPU-s	14.48KiB/CPU-s	0.020118	54.49MiB/CPU-s	1.11MiB/CPU-s	14.66KiB/CPU-s	0.020388	False	False
splunk_hec_to_splunk_hec_logs_acks	-1.58KiB/CPU-s	-0.01	19.89%	13.62MiB/CPU-s	341.18KiB/CPU-s	4.4KiB/CPU-s	0.024466	13.62MiB/CPU-s	347.12KiB/CPU-s	4.48KiB/CPU-s	0.024895	False	False
syslog_splunk_hec_logs	-3.63KiB/CPU-s	-0.04	68.38%	9.01MiB/CPU-s	197.45KiB/CPU-s	2.55KiB/CPU-s	0.021404	9.0MiB/CPU-s	199.68KiB/CPU-s	2.58KiB/CPU-s	0.021654	False	False
http_to_http_json	-46.08KiB/CPU-s	-0.33	100.00%	13.6MiB/CPU-s	250.07KiB/CPU-s	3.23KiB/CPU-s	0.017958	13.55MiB/CPU-s	301.59KiB/CPU-s	3.89KiB/CPU-s	0.02173	False	False
otlp_http_to_blackhole	-7.81KiB/CPU-s	-0.49	99.98%	1.54MiB/CPU-s	106.71KiB/CPU-s	1.38KiB/CPU-s	0.06761	1.53MiB/CPU-s	123.81KiB/CPU-s	1.6KiB/CPU-s	0.078835	False	False
splunk_hec_route_s3	-138.12KiB/CPU-s	-1.15	100.00%	11.74MiB/CPU-s	529.69KiB/CPU-s	6.83KiB/CPU-s	0.044046	11.61MiB/CPU-s	555.77KiB/CPU-s	7.17KiB/CPU-s	0.046751	False	False
datadog_agent_remap_datadog_logs_acks	-553.4KiB/CPU-s	-1.63	100.00%	33.22MiB/CPU-s	1.21MiB/CPU-s	15.92KiB/CPU-s	0.03627	32.68MiB/CPU-s	2.05MiB/CPU-s	27.15KiB/CPU-s	0.062859	False	False
datadog_agent_remap_blackhole_acks	-552.01KiB/CPU-s	-1.71	100.00%	31.53MiB/CPU-s	1.21MiB/CPU-s	15.99KiB/CPU-s	0.038356	30.99MiB/CPU-s	1.57MiB/CPU-s	20.74KiB/CPU-s	0.050631	False	False
syslog_log2metric_splunk_hec_metrics	-251.81KiB/CPU-s	-2.61	100.00%	9.41MiB/CPU-s	165.81KiB/CPU-s	2.14KiB/CPU-s	0.017201	9.17MiB/CPU-s	387.87KiB/CPU-s	5.01KiB/CPU-s	0.041318	False	False

Jan 16 '23 17:01 github-actions[bot]

Regression Test Results

Run ID: dfdcd445-c518-471d-bb3b-4c2a78c0e6c8
Baseline: 00b0d9c68b6991e6e953ad80dad243dd7a10ac2f
Comparison: 413624753e36d8d28f19dc22c0cd8f2db4e28843
Total vector CPUs: 7

Explanation

A regression test is an integrated performance test for vector in a repeatable rig, with varying configuration for vector. What follows is a statistical summary of a brief vector run for each configuration across SHAs given above. The goal of these tests are to determine, quickly, if vector performance is changed and to what degree by a pull request. Where appropriate units are scaled per-core.

The table below, if present, lists those experiments that have experienced a statistically significant change in their bytes_written_per_cpu_second performance between baseline and comparison SHAs, with 90.0% confidence OR have been detected as newly erratic. Negative values mean that baseline is faster, positive comparison. Results that do not exhibit more than a ±5% change in mean bytes_written_per_cpu_second are discarded. An experiment is erratic if its coefficient of variation is greater than 0.1. The abbreviated table will be omitted if no interesting changes are observed.

No interesting changes in bytes_written_per_cpu_second with confidence ≥ 90.00% and absolute Δ mean >= ±5%.

Fine details of change detection per experiment.

experiment	Δ mean	Δ mean %	confidence	baseline mean	baseline stdev	baseline stderr	baseline CoV	comparison mean	comparison stdev	comparison stderr	comparison CoV	erratic	declared erratic
socket_to_socket_blackhole	357.84KiB/CPU-s	2.67	100.00%	13.07MiB/CPU-s	149.66KiB/CPU-s	1.93KiB/CPU-s	0.011183	13.42MiB/CPU-s	126.42KiB/CPU-s	1.63KiB/CPU-s	0.009201	False	False
http_text_to_http_json	626.76KiB/CPU-s	2.61	100.00%	23.42MiB/CPU-s	561.22KiB/CPU-s	7.24KiB/CPU-s	0.023402	24.03MiB/CPU-s	685.94KiB/CPU-s	8.85KiB/CPU-s	0.027874	False	False
otlp_http_to_blackhole	36.0KiB/CPU-s	2.34	100.00%	1.5MiB/CPU-s	121.0KiB/CPU-s	1.56KiB/CPU-s	0.078791	1.53MiB/CPU-s	121.96KiB/CPU-s	1.57KiB/CPU-s	0.077596	False	False
syslog_log2metric_splunk_hec_metrics	215.45KiB/CPU-s	2.29	100.00%	9.2MiB/CPU-s	294.43KiB/CPU-s	3.8KiB/CPU-s	0.031265	9.41MiB/CPU-s	143.31KiB/CPU-s	1.85KiB/CPU-s	0.014877	False	False
otlp_grpc_to_blackhole	21.4KiB/CPU-s	2.04	100.00%	1.02MiB/CPU-s	40.75KiB/CPU-s	538.69B/CPU-s	0.038889	1.04MiB/CPU-s	49.88KiB/CPU-s	659.06B/CPU-s	0.046646	False	False
syslog_log2metric_humio_metrics	80.27KiB/CPU-s	1.32	100.00%	5.96MiB/CPU-s	301.13KiB/CPU-s	3.89KiB/CPU-s	0.049359	6.04MiB/CPU-s	332.97KiB/CPU-s	4.3KiB/CPU-s	0.053869	False	False
datadog_agent_remap_datadog_logs_acks	405.17KiB/CPU-s	1.18	100.00%	33.45MiB/CPU-s	1023.0KiB/CPU-s	13.2KiB/CPU-s	0.029863	33.85MiB/CPU-s	956.29KiB/CPU-s	12.34KiB/CPU-s	0.027589	False	False
datadog_agent_remap_blackhole_acks	295.16KiB/CPU-s	0.93	100.00%	31.1MiB/CPU-s	1.2MiB/CPU-s	15.81KiB/CPU-s	0.038451	31.39MiB/CPU-s	844.21KiB/CPU-s	10.9KiB/CPU-s	0.026263	False	False
datadog_agent_remap_datadog_logs	299.0KiB/CPU-s	0.86	100.00%	33.83MiB/CPU-s	1.23MiB/CPU-s	16.26KiB/CPU-s	0.03638	34.12MiB/CPU-s	1.28MiB/CPU-s	16.85KiB/CPU-s	0.037377	False	False
http_to_http_acks	11.5KiB/CPU-s	0.21	17.68%	5.27MiB/CPU-s	2.78MiB/CPU-s	36.7KiB/CPU-s	0.526408	5.29MiB/CPU-s	2.73MiB/CPU-s	36.07KiB/CPU-s	0.51639	True	False
http_to_http_json	22.8KiB/CPU-s	0.16	100.00%	13.6MiB/CPU-s	248.56KiB/CPU-s	3.21KiB/CPU-s	0.017846	13.62MiB/CPU-s	209.67KiB/CPU-s	2.71KiB/CPU-s	0.01503	False	False
enterprise_http_to_http	8.11KiB/CPU-s	0.06	88.04%	13.61MiB/CPU-s	333.65KiB/CPU-s	4.31KiB/CPU-s	0.023935	13.62MiB/CPU-s	227.39KiB/CPU-s	2.94KiB/CPU-s	0.016303	False	False
splunk_hec_to_splunk_hec_logs_noack	3.43KiB/CPU-s	0.02	63.88%	13.62MiB/CPU-s	220.12KiB/CPU-s	2.84KiB/CPU-s	0.015779	13.63MiB/CPU-s	190.03KiB/CPU-s	2.45KiB/CPU-s	0.013619	False	False
file_to_blackhole	4.49KiB/CPU-s	0.01	16.86%	54.5MiB/CPU-s	1.13MiB/CPU-s	14.92KiB/CPU-s	0.020726	54.5MiB/CPU-s	1.13MiB/CPU-s	14.93KiB/CPU-s	0.020753	False	False
splunk_hec_to_splunk_hec_logs_acks	971.11B/CPU-s	0.01	11.67%	13.62MiB/CPU-s	360.81KiB/CPU-s	4.65KiB/CPU-s	0.025876	13.62MiB/CPU-s	347.37KiB/CPU-s	4.48KiB/CPU-s	0.02491	False	False
fluent_elasticsearch	-246.68B/CPU-s	-0.0	34.30%	45.41MiB/CPU-s	30.11KiB/CPU-s	393.39B/CPU-s	0.000647	45.41MiB/CPU-s	30.02KiB/CPU-s	392.22B/CPU-s	0.000645	False	False
splunk_hec_indexer_ack_blackhole	-1.53KiB/CPU-s	-0.01	25.80%	13.62MiB/CPU-s	251.65KiB/CPU-s	3.25KiB/CPU-s	0.018046	13.62MiB/CPU-s	258.12KiB/CPU-s	3.33KiB/CPU-s	0.018512	False	False
http_to_http_noack	-1.85KiB/CPU-s	-0.01	26.72%	13.62MiB/CPU-s	286.15KiB/CPU-s	3.69KiB/CPU-s	0.020522	13.61MiB/CPU-s	306.82KiB/CPU-s	3.96KiB/CPU-s	0.022007	False	False
syslog_regex_logs2metric_ddmetrics	-2.39KiB/CPU-s	-0.07	25.91%	3.55MiB/CPU-s	406.96KiB/CPU-s	5.25KiB/CPU-s	0.111944	3.55MiB/CPU-s	385.52KiB/CPU-s	4.98KiB/CPU-s	0.106119	True	False
syslog_humio_logs	-16.45KiB/CPU-s	-0.18	100.00%	9.05MiB/CPU-s	260.42KiB/CPU-s	3.36KiB/CPU-s	0.0281	9.03MiB/CPU-s	140.19KiB/CPU-s	1.81KiB/CPU-s	0.015154	False	False
syslog_loki	-18.41KiB/CPU-s	-0.2	100.00%	8.78MiB/CPU-s	209.84KiB/CPU-s	2.71KiB/CPU-s	0.023351	8.76MiB/CPU-s	170.51KiB/CPU-s	2.2KiB/CPU-s	0.019013	False	False
datadog_agent_remap_blackhole	-298.93KiB/CPU-s	-0.94	100.00%	31.15MiB/CPU-s	1.09MiB/CPU-s	14.39KiB/CPU-s	0.034952	30.86MiB/CPU-s	962.26KiB/CPU-s	12.42KiB/CPU-s	0.030447	False	False
splunk_hec_route_s3	-122.69KiB/CPU-s	-1.02	100.00%	11.71MiB/CPU-s	548.52KiB/CPU-s	7.08KiB/CPU-s	0.045744	11.59MiB/CPU-s	586.22KiB/CPU-s	7.57KiB/CPU-s	0.049394	False	False
syslog_splunk_hec_logs	-137.8KiB/CPU-s	-1.49	100.00%	9.02MiB/CPU-s	118.22KiB/CPU-s	1.53KiB/CPU-s	0.012791	8.89MiB/CPU-s	254.05KiB/CPU-s	3.28KiB/CPU-s	0.027904	False	False

Jan 18 '23 08:01 github-actions[bot]

Just started reviewing this, and playing with it locally @everpcpc

The integration test is currently failing:

failures:
    sinks::databend::integration_tests::insert_events

test result: FAILED. 0 passed; 1 failed; 0 ignored; 0 measured; 245 filtered out; finished in 0.18s


--- TRY 1 STDERR:        vector sinks::databend::integration_tests::insert_events ---
thread 'sinks::databend::integration_tests::insert_events' panicked at 'Failed to assert compliance, errors:
  - Missing event `BytesSent`
  - Missing metric `component_sent_bytes_total{endpoint,protocol}`
', src/test_util/components.rs:427:16
note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace

As we're missing some required telemetry (ref: ComponentBytesSent)

Jan 18 '23 17:01 spencergilbert

Regression Test Results

Run ID: 7474d4e3-ddbf-4752-bc58-3e34a01480f9
Baseline: c6d81006ec03aa0db709559d5e08846f7a3b6caa
Comparison: ec91dafd40997a3bd18fd615746872cd7f63f4ba
Total vector CPUs: 7

Explanation

A regression test is an integrated performance test for vector in a repeatable rig, with varying configuration for vector. What follows is a statistical summary of a brief vector run for each configuration across SHAs given above. The goal of these tests are to determine, quickly, if vector performance is changed and to what degree by a pull request. Where appropriate units are scaled per-core.

The table below, if present, lists those experiments that have experienced a statistically significant change in their bytes_written_per_cpu_second performance between baseline and comparison SHAs, with 90.0% confidence OR have been detected as newly erratic. Negative values mean that baseline is faster, positive comparison. Results that do not exhibit more than a ±5% change in mean bytes_written_per_cpu_second are discarded. An experiment is erratic if its coefficient of variation is greater than 0.1. The abbreviated table will be omitted if no interesting changes are observed.

No interesting changes in bytes_written_per_cpu_second with confidence ≥ 90.00% and absolute Δ mean >= ±5%.

Fine details of change detection per experiment.

experiment	Δ mean	Δ mean %	confidence	baseline mean	baseline stdev	baseline stderr	baseline CoV	comparison mean	comparison stdev	comparison stderr	comparison CoV	erratic	declared erratic
syslog_log2metric_humio_metrics	77.2KiB/CPU-s	1.31	100.00%	5.76MiB/CPU-s	376.12KiB/CPU-s	4.86KiB/CPU-s	0.063817	5.83MiB/CPU-s	319.65KiB/CPU-s	4.13KiB/CPU-s	0.053534	False	False
syslog_log2metric_splunk_hec_metrics	115.5KiB/CPU-s	1.24	100.00%	9.06MiB/CPU-s	351.43KiB/CPU-s	4.54KiB/CPU-s	0.037862	9.18MiB/CPU-s	570.38KiB/CPU-s	7.37KiB/CPU-s	0.060695	False	False
datadog_agent_remap_datadog_logs	189.02KiB/CPU-s	0.55	100.00%	33.53MiB/CPU-s	1.48MiB/CPU-s	19.52KiB/CPU-s	0.044068	33.71MiB/CPU-s	1.2MiB/CPU-s	15.91KiB/CPU-s	0.035719	False	False
http_to_http_acks	27.96KiB/CPU-s	0.52	41.11%	5.26MiB/CPU-s	2.78MiB/CPU-s	36.69KiB/CPU-s	0.527914	5.29MiB/CPU-s	2.76MiB/CPU-s	36.47KiB/CPU-s	0.52204	True	False
datadog_agent_remap_blackhole_acks	66.43KiB/CPU-s	0.21	99.99%	31.07MiB/CPU-s	901.86KiB/CPU-s	11.64KiB/CPU-s	0.028347	31.13MiB/CPU-s	899.95KiB/CPU-s	11.62KiB/CPU-s	0.028227	False	False
syslog_loki	12.37KiB/CPU-s	0.14	100.00%	8.87MiB/CPU-s	152.78KiB/CPU-s	1.97KiB/CPU-s	0.016814	8.88MiB/CPU-s	137.37KiB/CPU-s	1.77KiB/CPU-s	0.015098	False	False
enterprise_http_to_http	8.37KiB/CPU-s	0.06	89.46%	13.61MiB/CPU-s	329.32KiB/CPU-s	4.25KiB/CPU-s	0.023625	13.62MiB/CPU-s	227.6KiB/CPU-s	2.94KiB/CPU-s	0.016317	False	False
splunk_hec_to_splunk_hec_logs_noack	4.79KiB/CPU-s	0.03	78.86%	13.62MiB/CPU-s	227.15KiB/CPU-s	2.93KiB/CPU-s	0.016285	13.63MiB/CPU-s	191.19KiB/CPU-s	2.47KiB/CPU-s	0.013702	False	False
fluent_elasticsearch	-157.24B/CPU-s	-0.0	22.06%	45.41MiB/CPU-s	30.55KiB/CPU-s	399.2B/CPU-s	0.000657	45.41MiB/CPU-s	30.19KiB/CPU-s	394.82B/CPU-s	0.000649	False	False
splunk_hec_to_splunk_hec_logs_acks	323.82B/CPU-s	0.0	4.07%	13.62MiB/CPU-s	333.92KiB/CPU-s	4.31KiB/CPU-s	0.023946	13.62MiB/CPU-s	345.04KiB/CPU-s	4.45KiB/CPU-s	0.024743	False	False
splunk_hec_indexer_ack_blackhole	-1.38KiB/CPU-s	-0.01	23.60%	13.62MiB/CPU-s	248.87KiB/CPU-s	3.21KiB/CPU-s	0.017846	13.62MiB/CPU-s	256.23KiB/CPU-s	3.31KiB/CPU-s	0.018376	False	False
http_to_http_noack	-2.13KiB/CPU-s	-0.02	28.23%	13.61MiB/CPU-s	308.67KiB/CPU-s	3.98KiB/CPU-s	0.02214	13.61MiB/CPU-s	335.5KiB/CPU-s	4.33KiB/CPU-s	0.024068	False	False
file_to_blackhole	-18.65KiB/CPU-s	-0.03	59.99%	54.5MiB/CPU-s	1.15MiB/CPU-s	15.13KiB/CPU-s	0.02101	54.48MiB/CPU-s	1.23MiB/CPU-s	16.21KiB/CPU-s	0.022538	False	False
http_to_http_json	-17.02KiB/CPU-s	-0.12	99.80%	13.57MiB/CPU-s	292.29KiB/CPU-s	3.77KiB/CPU-s	0.02103	13.56MiB/CPU-s	311.96KiB/CPU-s	4.02KiB/CPU-s	0.022472	False	False
datadog_agent_remap_datadog_logs_acks	-45.55KiB/CPU-s	-0.13	94.76%	33.87MiB/CPU-s	1.31MiB/CPU-s	17.36KiB/CPU-s	0.038779	33.83MiB/CPU-s	1.2MiB/CPU-s	15.81KiB/CPU-s	0.035379	False	False
otlp_http_to_blackhole	-3.84KiB/CPU-s	-0.25	92.38%	1.53MiB/CPU-s	115.73KiB/CPU-s	1.49KiB/CPU-s	0.074009	1.52MiB/CPU-s	121.46KiB/CPU-s	1.57KiB/CPU-s	0.077865	False	False
http_text_to_http_json	-81.75KiB/CPU-s	-0.32	100.00%	24.65MiB/CPU-s	718.92KiB/CPU-s	9.28KiB/CPU-s	0.028482	24.57MiB/CPU-s	592.96KiB/CPU-s	7.65KiB/CPU-s	0.023568	False	False
syslog_humio_logs	-44.73KiB/CPU-s	-0.5	100.00%	8.78MiB/CPU-s	305.74KiB/CPU-s	3.95KiB/CPU-s	0.034013	8.73MiB/CPU-s	290.58KiB/CPU-s	3.75KiB/CPU-s	0.032488	False	False
otlp_grpc_to_blackhole	-10.37KiB/CPU-s	-0.97	100.00%	1.05MiB/CPU-s	39.12KiB/CPU-s	517.17B/CPU-s	0.036464	1.04MiB/CPU-s	54.12KiB/CPU-s	715.05B/CPU-s	0.050934	False	False
datadog_agent_remap_blackhole	-350.03KiB/CPU-s	-1.12	100.00%	30.58MiB/CPU-s	1.14MiB/CPU-s	15.07KiB/CPU-s	0.037256	30.24MiB/CPU-s	1.23MiB/CPU-s	16.21KiB/CPU-s	0.040555	False	False
splunk_hec_route_s3	-135.57KiB/CPU-s	-1.14	100.00%	11.65MiB/CPU-s	539.2KiB/CPU-s	6.96KiB/CPU-s	0.045201	11.52MiB/CPU-s	611.76KiB/CPU-s	7.9KiB/CPU-s	0.051873	False	False
syslog_splunk_hec_logs	-130.18KiB/CPU-s	-1.43	100.00%	8.88MiB/CPU-s	217.08KiB/CPU-s	2.8KiB/CPU-s	0.023878	8.75MiB/CPU-s	314.16KiB/CPU-s	4.05KiB/CPU-s	0.035059	False	False
socket_to_socket_blackhole	-355.81KiB/CPU-s	-2.56	100.00%	13.58MiB/CPU-s	280.37KiB/CPU-s	3.62KiB/CPU-s	0.020154	13.24MiB/CPU-s	243.4KiB/CPU-s	3.14KiB/CPU-s	0.017955	False	False
syslog_regex_logs2metric_ddmetrics	-108.98KiB/CPU-s	-2.9	100.00%	3.67MiB/CPU-s	407.59KiB/CPU-s	5.26KiB/CPU-s	0.108389	3.57MiB/CPU-s	445.98KiB/CPU-s	5.76KiB/CPU-s	0.122138	True	False

Jan 20 '23 13:01 github-actions[bot]

Regression Test Results

Run ID: 5786e361-5e89-4e5e-bae6-98201ffcb778
Baseline: c6d81006ec03aa0db709559d5e08846f7a3b6caa
Comparison: 64c95226638da7485449baed1b894d309e8505c1
Total vector CPUs: 7

Explanation

A regression test is an integrated performance test for vector in a repeatable rig, with varying configuration for vector. What follows is a statistical summary of a brief vector run for each configuration across SHAs given above. The goal of these tests are to determine, quickly, if vector performance is changed and to what degree by a pull request. Where appropriate units are scaled per-core.

The table below, if present, lists those experiments that have experienced a statistically significant change in their bytes_written_per_cpu_second performance between baseline and comparison SHAs, with 90.0% confidence OR have been detected as newly erratic. Negative values mean that baseline is faster, positive comparison. Results that do not exhibit more than a ±5% change in mean bytes_written_per_cpu_second are discarded. An experiment is erratic if its coefficient of variation is greater than 0.1. The abbreviated table will be omitted if no interesting changes are observed.

No interesting changes in bytes_written_per_cpu_second with confidence ≥ 90.00% and absolute Δ mean >= ±5%.

Fine details of change detection per experiment.

experiment	Δ mean	Δ mean %	confidence	baseline mean	baseline stdev	baseline stderr	baseline CoV	comparison mean	comparison stdev	comparison stderr	comparison CoV	erratic	declared erratic
syslog_regex_logs2metric_ddmetrics	54.53KiB/CPU-s	1.43	100.00%	3.72MiB/CPU-s	410.49KiB/CPU-s	5.3KiB/CPU-s	0.10767	3.78MiB/CPU-s	446.21KiB/CPU-s	5.76KiB/CPU-s	0.115388	True	False
http_to_http_acks	65.04KiB/CPU-s	1.2	78.45%	5.27MiB/CPU-s	2.8MiB/CPU-s	37.07KiB/CPU-s	0.53188	5.34MiB/CPU-s	2.81MiB/CPU-s	37.19KiB/CPU-s	0.527344	True	False
syslog_humio_logs	58.08KiB/CPU-s	0.63	100.00%	8.99MiB/CPU-s	215.67KiB/CPU-s	2.78KiB/CPU-s	0.023413	9.05MiB/CPU-s	272.51KiB/CPU-s	3.52KiB/CPU-s	0.029398	False	False
syslog_loki	46.74KiB/CPU-s	0.52	100.00%	8.75MiB/CPU-s	243.54KiB/CPU-s	3.14KiB/CPU-s	0.027169	8.8MiB/CPU-s	201.59KiB/CPU-s	2.6KiB/CPU-s	0.022373	False	False
http_to_http_json	70.65KiB/CPU-s	0.51	100.00%	13.55MiB/CPU-s	305.17KiB/CPU-s	3.94KiB/CPU-s	0.021987	13.62MiB/CPU-s	210.62KiB/CPU-s	2.72KiB/CPU-s	0.015098	False	False
syslog_splunk_hec_logs	19.88KiB/CPU-s	0.22	100.00%	8.99MiB/CPU-s	195.67KiB/CPU-s	2.53KiB/CPU-s	0.021265	9.0MiB/CPU-s	213.47KiB/CPU-s	2.75KiB/CPU-s	0.023149	False	False
datadog_agent_remap_datadog_logs_acks	68.78KiB/CPU-s	0.2	99.93%	34.08MiB/CPU-s	1.35MiB/CPU-s	17.77KiB/CPU-s	0.039472	34.15MiB/CPU-s	755.21KiB/CPU-s	9.75KiB/CPU-s	0.021595	False	False
splunk_hec_to_splunk_hec_logs_noack	8.53KiB/CPU-s	0.06	96.33%	13.62MiB/CPU-s	253.17KiB/CPU-s	3.27KiB/CPU-s	0.018156	13.62MiB/CPU-s	189.49KiB/CPU-s	2.45KiB/CPU-s	0.013581	False	False
enterprise_http_to_http	6.18KiB/CPU-s	0.04	84.06%	13.62MiB/CPU-s	280.75KiB/CPU-s	3.62KiB/CPU-s	0.020134	13.62MiB/CPU-s	191.98KiB/CPU-s	2.48KiB/CPU-s	0.013762	False	False
splunk_hec_to_splunk_hec_logs_acks	748.34B/CPU-s	0.01	9.09%	13.62MiB/CPU-s	353.34KiB/CPU-s	4.56KiB/CPU-s	0.025338	13.62MiB/CPU-s	348.22KiB/CPU-s	4.49KiB/CPU-s	0.02497	False	False
file_to_blackhole	807.15B/CPU-s	0.0	3.05%	54.49MiB/CPU-s	1.14MiB/CPU-s	15.01KiB/CPU-s	0.020848	54.49MiB/CPU-s	1.07MiB/CPU-s	14.15KiB/CPU-s	0.019671	False	False
fluent_elasticsearch	-277.86B/CPU-s	-0.0	37.89%	45.41MiB/CPU-s	30.55KiB/CPU-s	399.36B/CPU-s	0.000657	45.41MiB/CPU-s	30.26KiB/CPU-s	395.52B/CPU-s	0.000651	False	False
http_to_http_noack	194.79B/CPU-s	0.0	2.71%	13.61MiB/CPU-s	307.28KiB/CPU-s	3.97KiB/CPU-s	0.022041	13.61MiB/CPU-s	305.47KiB/CPU-s	3.94KiB/CPU-s	0.021911	False	False
splunk_hec_indexer_ack_blackhole	-2.2KiB/CPU-s	-0.02	37.22%	13.62MiB/CPU-s	243.53KiB/CPU-s	3.14KiB/CPU-s	0.017462	13.62MiB/CPU-s	253.11KiB/CPU-s	3.26KiB/CPU-s	0.018152	False	False
http_text_to_http_json	-75.36KiB/CPU-s	-0.3	100.00%	24.85MiB/CPU-s	555.52KiB/CPU-s	7.17KiB/CPU-s	0.02183	24.78MiB/CPU-s	556.68KiB/CPU-s	7.18KiB/CPU-s	0.02194	False	False
syslog_log2metric_splunk_hec_metrics	-40.82KiB/CPU-s	-0.43	100.00%	9.29MiB/CPU-s	182.37KiB/CPU-s	2.35KiB/CPU-s	0.019168	9.25MiB/CPU-s	333.93KiB/CPU-s	4.31KiB/CPU-s	0.035249	False	False
datadog_agent_remap_datadog_logs	-287.21KiB/CPU-s	-0.81	100.00%	34.49MiB/CPU-s	1.14MiB/CPU-s	15.03KiB/CPU-s	0.032985	34.21MiB/CPU-s	1.18MiB/CPU-s	15.53KiB/CPU-s	0.03438	False	False
splunk_hec_route_s3	-135.16KiB/CPU-s	-1.13	100.00%	11.73MiB/CPU-s	749.18KiB/CPU-s	9.66KiB/CPU-s	0.062378	11.6MiB/CPU-s	561.6KiB/CPU-s	7.25KiB/CPU-s	0.047292	False	False
datadog_agent_remap_blackhole_acks	-373.23KiB/CPU-s	-1.16	100.00%	31.37MiB/CPU-s	714.19KiB/CPU-s	9.22KiB/CPU-s	0.022233	31.0MiB/CPU-s	965.03KiB/CPU-s	12.46KiB/CPU-s	0.030395	False	False
datadog_agent_remap_blackhole	-391.12KiB/CPU-s	-1.25	100.00%	30.68MiB/CPU-s	1.31MiB/CPU-s	17.33KiB/CPU-s	0.042717	30.29MiB/CPU-s	1.35MiB/CPU-s	17.9KiB/CPU-s	0.044696	False	False
otlp_grpc_to_blackhole	-14.24KiB/CPU-s	-1.33	100.00%	1.05MiB/CPU-s	32.21KiB/CPU-s	425.87B/CPU-s	0.030018	1.03MiB/CPU-s	56.13KiB/CPU-s	741.6B/CPU-s	0.053011	False	False
otlp_http_to_blackhole	-29.16KiB/CPU-s	-1.83	100.00%	1.55MiB/CPU-s	102.44KiB/CPU-s	1.32KiB/CPU-s	0.064373	1.53MiB/CPU-s	124.84KiB/CPU-s	1.61KiB/CPU-s	0.079908	False	False
socket_to_socket_blackhole	-328.29KiB/CPU-s	-2.35	100.00%	13.67MiB/CPU-s	173.85KiB/CPU-s	2.24KiB/CPU-s	0.012422	13.35MiB/CPU-s	118.76KiB/CPU-s	1.53KiB/CPU-s	0.008689	False	False
syslog_log2metric_humio_metrics	-150.4KiB/CPU-s	-2.51	100.00%	5.85MiB/CPU-s	346.95KiB/CPU-s	4.48KiB/CPU-s	0.05796	5.7MiB/CPU-s	425.32KiB/CPU-s	5.49KiB/CPU-s	0.072884	False	False

Jan 20 '23 13:01 github-actions[bot]

Regression Test Results

Run ID: 73a79368-7811-4ad2-9884-5b23918d4611
Baseline: c6d81006ec03aa0db709559d5e08846f7a3b6caa
Comparison: 6a3d11f8b686add7905f12f34da20f70d10e1383
Total vector CPUs: 7

Explanation

A regression test is an integrated performance test for vector in a repeatable rig, with varying configuration for vector. What follows is a statistical summary of a brief vector run for each configuration across SHAs given above. The goal of these tests are to determine, quickly, if vector performance is changed and to what degree by a pull request. Where appropriate units are scaled per-core.

The table below, if present, lists those experiments that have experienced a statistically significant change in their bytes_written_per_cpu_second performance between baseline and comparison SHAs, with 90.0% confidence OR have been detected as newly erratic. Negative values mean that baseline is faster, positive comparison. Results that do not exhibit more than a ±5% change in mean bytes_written_per_cpu_second are discarded. An experiment is erratic if its coefficient of variation is greater than 0.1. The abbreviated table will be omitted if no interesting changes are observed.

No interesting changes in bytes_written_per_cpu_second with confidence ≥ 90.00% and absolute Δ mean >= ±5%.

Fine details of change detection per experiment.

experiment	Δ mean	Δ mean %	confidence	baseline mean	baseline stdev	baseline stderr	baseline CoV	comparison mean	comparison stdev	comparison stderr	comparison CoV	erratic	declared erratic
syslog_log2metric_humio_metrics	217.31KiB/CPU-s	3.49	100.00%	6.08MiB/CPU-s	329.34KiB/CPU-s	4.25KiB/CPU-s	0.052934	6.29MiB/CPU-s	162.34KiB/CPU-s	2.1KiB/CPU-s	0.025212	False	False
syslog_humio_logs	84.66KiB/CPU-s	0.93	100.00%	8.85MiB/CPU-s	346.03KiB/CPU-s	4.47KiB/CPU-s	0.038171	8.93MiB/CPU-s	338.08KiB/CPU-s	4.36KiB/CPU-s	0.036949	False	False
syslog_loki	55.51KiB/CPU-s	0.61	100.00%	8.87MiB/CPU-s	221.38KiB/CPU-s	2.86KiB/CPU-s	0.024365	8.93MiB/CPU-s	106.2KiB/CPU-s	1.37KiB/CPU-s	0.011617	False	False
http_to_http_json	71.96KiB/CPU-s	0.52	100.00%	13.55MiB/CPU-s	337.44KiB/CPU-s	4.35KiB/CPU-s	0.024314	13.62MiB/CPU-s	212.1KiB/CPU-s	2.74KiB/CPU-s	0.015204	False	False
syslog_splunk_hec_logs	34.88KiB/CPU-s	0.38	100.00%	9.0MiB/CPU-s	165.99KiB/CPU-s	2.14KiB/CPU-s	0.018017	9.03MiB/CPU-s	207.52KiB/CPU-s	2.68KiB/CPU-s	0.022439	False	False
enterprise_http_to_http	12.39KiB/CPU-s	0.09	99.26%	13.61MiB/CPU-s	326.79KiB/CPU-s	4.22KiB/CPU-s	0.023443	13.62MiB/CPU-s	147.22KiB/CPU-s	1.9KiB/CPU-s	0.010552	False	False
splunk_hec_to_splunk_hec_logs_noack	4.62KiB/CPU-s	0.03	76.92%	13.62MiB/CPU-s	228.52KiB/CPU-s	2.95KiB/CPU-s	0.016383	13.63MiB/CPU-s	192.49KiB/CPU-s	2.49KiB/CPU-s	0.013795	False	False
splunk_hec_to_splunk_hec_logs_acks	334.56B/CPU-s	0.0	4.13%	13.61MiB/CPU-s	348.14KiB/CPU-s	4.49KiB/CPU-s	0.024969	13.62MiB/CPU-s	343.43KiB/CPU-s	4.43KiB/CPU-s	0.024631	False	False
fluent_elasticsearch	176.22B/CPU-s	0.0	24.83%	45.41MiB/CPU-s	30.0KiB/CPU-s	392.18B/CPU-s	0.000645	45.41MiB/CPU-s	30.25KiB/CPU-s	395.45B/CPU-s	0.00065	False	False
http_to_http_noack	60.98B/CPU-s	0.0	1.14%	13.62MiB/CPU-s	226.89KiB/CPU-s	2.93KiB/CPU-s	0.016267	13.62MiB/CPU-s	228.88KiB/CPU-s	2.95KiB/CPU-s	0.016409	False	False
splunk_hec_indexer_ack_blackhole	-280.98B/CPU-s	-0.0	4.86%	13.62MiB/CPU-s	245.84KiB/CPU-s	3.17KiB/CPU-s	0.017628	13.62MiB/CPU-s	247.17KiB/CPU-s	3.19KiB/CPU-s	0.017724	False	False
file_to_blackhole	-7.63KiB/CPU-s	-0.01	28.03%	54.5MiB/CPU-s	1.12MiB/CPU-s	14.81KiB/CPU-s	0.020572	54.49MiB/CPU-s	1.16MiB/CPU-s	15.27KiB/CPU-s	0.021226	False	False
datadog_agent_remap_datadog_logs_acks	-55.27KiB/CPU-s	-0.16	97.61%	33.64MiB/CPU-s	1.47MiB/CPU-s	19.42KiB/CPU-s	0.04368	33.59MiB/CPU-s	1.13MiB/CPU-s	14.88KiB/CPU-s	0.03352	False	False
http_to_http_acks	-26.15KiB/CPU-s	-0.48	38.69%	5.31MiB/CPU-s	2.77MiB/CPU-s	36.56KiB/CPU-s	0.520687	5.29MiB/CPU-s	2.77MiB/CPU-s	36.56KiB/CPU-s	0.523128	True	False
http_text_to_http_json	-129.49KiB/CPU-s	-0.51	100.00%	24.86MiB/CPU-s	732.4KiB/CPU-s	9.45KiB/CPU-s	0.028763	24.74MiB/CPU-s	544.94KiB/CPU-s	7.03KiB/CPU-s	0.021511	False	False
datadog_agent_remap_blackhole	-210.03KiB/CPU-s	-0.65	100.00%	31.5MiB/CPU-s	631.73KiB/CPU-s	8.16KiB/CPU-s	0.019586	31.29MiB/CPU-s	938.06KiB/CPU-s	12.11KiB/CPU-s	0.029275	False	False
datadog_agent_remap_datadog_logs	-263.98KiB/CPU-s	-0.75	100.00%	34.32MiB/CPU-s	1.21MiB/CPU-s	15.92KiB/CPU-s	0.035115	34.06MiB/CPU-s	1.23MiB/CPU-s	16.28KiB/CPU-s	0.036192	False	False
syslog_log2metric_splunk_hec_metrics	-104.87KiB/CPU-s	-1.1	100.00%	9.29MiB/CPU-s	302.12KiB/CPU-s	3.9KiB/CPU-s	0.031743	9.19MiB/CPU-s	315.08KiB/CPU-s	4.07KiB/CPU-s	0.033474	False	False
otlp_grpc_to_blackhole	-16.32KiB/CPU-s	-1.53	100.00%	1.04MiB/CPU-s	38.75KiB/CPU-s	512.31B/CPU-s	0.036342	1.03MiB/CPU-s	53.72KiB/CPU-s	709.84B/CPU-s	0.051162	False	False
splunk_hec_route_s3	-237.02KiB/CPU-s	-1.98	100.00%	11.69MiB/CPU-s	552.33KiB/CPU-s	7.12KiB/CPU-s	0.046121	11.46MiB/CPU-s	652.14KiB/CPU-s	8.42KiB/CPU-s	0.055555	False	False
syslog_regex_logs2metric_ddmetrics	-87.6KiB/CPU-s	-2.36	100.00%	3.62MiB/CPU-s	470.16KiB/CPU-s	6.07KiB/CPU-s	0.126924	3.53MiB/CPU-s	463.27KiB/CPU-s	5.98KiB/CPU-s	0.128091	True	False
otlp_http_to_blackhole	-44.88KiB/CPU-s	-2.82	100.00%	1.55MiB/CPU-s	102.45KiB/CPU-s	1.32KiB/CPU-s	0.064422	1.51MiB/CPU-s	123.8KiB/CPU-s	1.6KiB/CPU-s	0.08011	False	False
socket_to_socket_blackhole	-404.32KiB/CPU-s	-2.9	100.00%	13.64MiB/CPU-s	340.67KiB/CPU-s	4.4KiB/CPU-s	0.024394	13.24MiB/CPU-s	201.58KiB/CPU-s	2.6KiB/CPU-s	0.014865	False	False
datadog_agent_remap_blackhole_acks	-984.82KiB/CPU-s	-3.01	100.00%	31.92MiB/CPU-s	592.87KiB/CPU-s	7.65KiB/CPU-s	0.018137	30.96MiB/CPU-s	1.26MiB/CPU-s	16.6KiB/CPU-s	0.040558	False	False

Jan 20 '23 14:01 github-actions[bot]

It seems Integration - Linux, datadog-* are always failing since they cannot get secrets when running on forks. Maybe we should separate these to another workflow, or ignore them on forks?

Jan 20 '23 14:01 everpcpc

Regression Test Results

Run ID: 714d6f83-8f1d-448d-b8cc-fa25d71b456e
Baseline: c6d81006ec03aa0db709559d5e08846f7a3b6caa
Comparison: 831447a4bc601d595faa1203b14b1e2911912eed
Total vector CPUs: 7

Explanation

A regression test is an integrated performance test for vector in a repeatable rig, with varying configuration for vector. What follows is a statistical summary of a brief vector run for each configuration across SHAs given above. The goal of these tests are to determine, quickly, if vector performance is changed and to what degree by a pull request. Where appropriate units are scaled per-core.

The table below, if present, lists those experiments that have experienced a statistically significant change in their bytes_written_per_cpu_second performance between baseline and comparison SHAs, with 90.0% confidence OR have been detected as newly erratic. Negative values mean that baseline is faster, positive comparison. Results that do not exhibit more than a ±5% change in mean bytes_written_per_cpu_second are discarded. An experiment is erratic if its coefficient of variation is greater than 0.1. The abbreviated table will be omitted if no interesting changes are observed.

No interesting changes in bytes_written_per_cpu_second with confidence ≥ 90.00% and absolute Δ mean >= ±5%.

Fine details of change detection per experiment.

experiment	Δ mean	Δ mean %	confidence	baseline mean	baseline stdev	baseline stderr	baseline CoV	comparison mean	comparison stdev	comparison stderr	comparison CoV	erratic	declared erratic
datadog_agent_remap_blackhole_acks	858.12KiB/CPU-s	2.74	100.00%	30.61MiB/CPU-s	2.31MiB/CPU-s	30.49KiB/CPU-s	0.075306	31.45MiB/CPU-s	807.46KiB/CPU-s	10.43KiB/CPU-s	0.025071	False	False
syslog_log2metric_humio_metrics	132.8KiB/CPU-s	2.26	100.00%	5.73MiB/CPU-s	324.71KiB/CPU-s	4.19KiB/CPU-s	0.055348	5.86MiB/CPU-s	376.03KiB/CPU-s	4.85KiB/CPU-s	0.062676	False	False
otlp_http_to_blackhole	31.86KiB/CPU-s	2.03	100.00%	1.53MiB/CPU-s	117.66KiB/CPU-s	1.52KiB/CPU-s	0.074956	1.56MiB/CPU-s	109.78KiB/CPU-s	1.42KiB/CPU-s	0.068542	False	False
syslog_regex_logs2metric_ddmetrics	61.27KiB/CPU-s	1.69	100.00%	3.54MiB/CPU-s	525.04KiB/CPU-s	6.78KiB/CPU-s	0.144642	3.6MiB/CPU-s	439.39KiB/CPU-s	5.67KiB/CPU-s	0.119038	True	False
http_text_to_http_json	391.32KiB/CPU-s	1.57	100.00%	24.39MiB/CPU-s	692.53KiB/CPU-s	8.94KiB/CPU-s	0.027728	24.77MiB/CPU-s	637.74KiB/CPU-s	8.23KiB/CPU-s	0.02514	False	False
splunk_hec_route_s3	134.61KiB/CPU-s	1.12	100.00%	11.72MiB/CPU-s	635.36KiB/CPU-s	8.2KiB/CPU-s	0.052953	11.85MiB/CPU-s	559.7KiB/CPU-s	7.22KiB/CPU-s	0.046129	False	False
http_to_http_acks	54.86KiB/CPU-s	1.03	70.79%	5.21MiB/CPU-s	2.8MiB/CPU-s	37.01KiB/CPU-s	0.537239	5.27MiB/CPU-s	2.77MiB/CPU-s	36.63KiB/CPU-s	0.526355	True	False
splunk_hec_to_splunk_hec_logs_noack	6.54KiB/CPU-s	0.05	90.28%	13.62MiB/CPU-s	238.55KiB/CPU-s	3.08KiB/CPU-s	0.017104	13.63MiB/CPU-s	191.02KiB/CPU-s	2.47KiB/CPU-s	0.01369	False	False
enterprise_http_to_http	6.01KiB/CPU-s	0.04	73.76%	13.61MiB/CPU-s	325.86KiB/CPU-s	4.21KiB/CPU-s	0.023376	13.62MiB/CPU-s	258.18KiB/CPU-s	3.33KiB/CPU-s	0.018513	False	False
splunk_hec_to_splunk_hec_logs_acks	-117.46B/CPU-s	-0.0	1.50%	13.62MiB/CPU-s	340.68KiB/CPU-s	4.4KiB/CPU-s	0.024431	13.62MiB/CPU-s	329.53KiB/CPU-s	4.25KiB/CPU-s	0.023631	False	False
fluent_elasticsearch	22.48B/CPU-s	0.0	3.22%	45.41MiB/CPU-s	30.16KiB/CPU-s	394.22B/CPU-s	0.000649	45.41MiB/CPU-s	30.19KiB/CPU-s	394.39B/CPU-s	0.000649	False	False
http_to_http_json	-239.06B/CPU-s	-0.0	4.82%	13.62MiB/CPU-s	212.13KiB/CPU-s	2.74KiB/CPU-s	0.015206	13.62MiB/CPU-s	211.26KiB/CPU-s	2.73KiB/CPU-s	0.015144	False	False
file_to_blackhole	-13.02KiB/CPU-s	-0.02	41.32%	54.49MiB/CPU-s	1.15MiB/CPU-s	15.24KiB/CPU-s	0.021171	54.48MiB/CPU-s	1.4MiB/CPU-s	18.48KiB/CPU-s	0.025702	False	False
splunk_hec_indexer_ack_blackhole	-2.37KiB/CPU-s	-0.02	41.85%	13.62MiB/CPU-s	229.1KiB/CPU-s	2.96KiB/CPU-s	0.016424	13.62MiB/CPU-s	242.25KiB/CPU-s	3.13KiB/CPU-s	0.01737	False	False
http_to_http_noack	-7.93KiB/CPU-s	-0.06	82.03%	13.62MiB/CPU-s	278.73KiB/CPU-s	3.6KiB/CPU-s	0.019989	13.61MiB/CPU-s	363.47KiB/CPU-s	4.69KiB/CPU-s	0.026081	False	False
datadog_agent_remap_datadog_logs	-76.99KiB/CPU-s	-0.22	99.57%	33.74MiB/CPU-s	1.46MiB/CPU-s	19.34KiB/CPU-s	0.043386	33.67MiB/CPU-s	1.42MiB/CPU-s	18.77KiB/CPU-s	0.042206	False	False
datadog_agent_remap_blackhole	-73.28KiB/CPU-s	-0.23	98.43%	30.66MiB/CPU-s	1.63MiB/CPU-s	21.49KiB/CPU-s	0.053031	30.59MiB/CPU-s	1.62MiB/CPU-s	21.38KiB/CPU-s	0.052877	False	False
otlp_grpc_to_blackhole	-3.51KiB/CPU-s	-0.33	99.99%	1.05MiB/CPU-s	39.24KiB/CPU-s	518.69B/CPU-s	0.036609	1.04MiB/CPU-s	56.04KiB/CPU-s	740.18B/CPU-s	0.052452	False	False
socket_to_socket_blackhole	-98.11KiB/CPU-s	-0.7	100.00%	13.72MiB/CPU-s	182.94KiB/CPU-s	2.36KiB/CPU-s	0.013018	13.63MiB/CPU-s	118.78KiB/CPU-s	1.53KiB/CPU-s	0.008511	False	False
syslog_splunk_hec_logs	-117.9KiB/CPU-s	-1.27	100.00%	9.04MiB/CPU-s	175.56KiB/CPU-s	2.27KiB/CPU-s	0.018963	8.93MiB/CPU-s	170.82KiB/CPU-s	2.2KiB/CPU-s	0.018688	False	False
datadog_agent_remap_datadog_logs_acks	-496.34KiB/CPU-s	-1.43	100.00%	33.84MiB/CPU-s	1.29MiB/CPU-s	17.07KiB/CPU-s	0.038178	33.35MiB/CPU-s	1.79MiB/CPU-s	23.71KiB/CPU-s	0.053787	False	False
syslog_loki	-162.56KiB/CPU-s	-1.8	100.00%	8.83MiB/CPU-s	217.24KiB/CPU-s	2.8KiB/CPU-s	0.024012	8.68MiB/CPU-s	317.59KiB/CPU-s	4.1KiB/CPU-s	0.035747	False	False
syslog_humio_logs	-190.32KiB/CPU-s	-2.08	100.00%	8.94MiB/CPU-s	308.39KiB/CPU-s	3.98KiB/CPU-s	0.033687	8.75MiB/CPU-s	317.82KiB/CPU-s	4.1KiB/CPU-s	0.035454	False	False
syslog_log2metric_splunk_hec_metrics	-271.22KiB/CPU-s	-2.82	100.00%	9.38MiB/CPU-s	192.89KiB/CPU-s	2.49KiB/CPU-s	0.020084	9.11MiB/CPU-s	291.26KiB/CPU-s	3.76KiB/CPU-s	0.031208	False	False

Jan 20 '23 15:01 github-actions[bot]

It seems Integration - Linux, datadog-* are always failing since they cannot get secrets when running on forks. Maybe we should separate these to another workflow, or ignore them on forks?

Yeah, ☹️ it's on our todo list to run them conditionally but we haven't gotten to it.

Jan 20 '23 19:01 spencergilbert

we probably want to probe the endpoint until it's up before starting the tests.

Sure, I added a healthcheck for the databend service in docker compose file.

Jan 28 '23 04:01 everpcpc

Regression Test Results

Run ID: 2abfe74f-47f7-4772-b1e8-c270e94496e4
Baseline: a5692595ea705ef981bc3043546105e6449a67c8
Comparison: fb8918456f042f791e6b4341ed54fdcbe06a4306
Total vector CPUs: 7

Explanation

A regression test is an integrated performance test for vector in a repeatable rig, with varying configuration for vector. What follows is a statistical summary of a brief vector run for each configuration across SHAs given above. The goal of these tests are to determine, quickly, if vector performance is changed and to what degree by a pull request. Where appropriate units are scaled per-core.

The table below, if present, lists those experiments that have experienced a statistically significant change in their bytes_written_per_cpu_second performance between baseline and comparison SHAs, with 90.0% confidence OR have been detected as newly erratic. Negative values mean that baseline is faster, positive comparison. Results that do not exhibit more than a ±5% change in mean bytes_written_per_cpu_second are discarded. An experiment is erratic if its coefficient of variation is greater than 0.1. The abbreviated table will be omitted if no interesting changes are observed.

No interesting changes in bytes_written_per_cpu_second with confidence ≥ 90.00% and absolute Δ mean >= ±5%.

Fine details of change detection per experiment.

experiment	Δ mean	Δ mean %	confidence	baseline mean	baseline stdev	baseline stderr	baseline CoV	comparison mean	comparison stdev	comparison stderr	comparison CoV	erratic	declared erratic
splunk_hec_route_s3	107.24KiB/CPU-s	0.9	100.00%	11.67MiB/CPU-s	585.33KiB/CPU-s	7.55KiB/CPU-s	0.048975	11.78MiB/CPU-s	526.8KiB/CPU-s	6.8KiB/CPU-s	0.043686	False	False
datadog_agent_remap_blackhole	37.91KiB/CPU-s	0.12	97.15%	30.91MiB/CPU-s	739.95KiB/CPU-s	9.55KiB/CPU-s	0.023374	30.95MiB/CPU-s	1.09MiB/CPU-s	14.42KiB/CPU-s	0.035275	False	False
enterprise_http_to_http	10.4KiB/CPU-s	0.07	96.50%	13.61MiB/CPU-s	331.97KiB/CPU-s	4.28KiB/CPU-s	0.023814	13.62MiB/CPU-s	188.93KiB/CPU-s	2.44KiB/CPU-s	0.013543	False	False
splunk_hec_to_splunk_hec_logs_noack	3.26KiB/CPU-s	0.02	61.45%	13.62MiB/CPU-s	220.65KiB/CPU-s	2.85KiB/CPU-s	0.015817	13.63MiB/CPU-s	190.27KiB/CPU-s	2.46KiB/CPU-s	0.013636	False	False
file_to_blackhole	10.01KiB/CPU-s	0.02	38.30%	54.49MiB/CPU-s	1.06MiB/CPU-s	13.97KiB/CPU-s	0.01941	54.5MiB/CPU-s	1.08MiB/CPU-s	14.32KiB/CPU-s	0.019904	False	False
splunk_hec_to_splunk_hec_logs_acks	613.14B/CPU-s	0.0	7.71%	13.62MiB/CPU-s	331.0KiB/CPU-s	4.27KiB/CPU-s	0.023738	13.62MiB/CPU-s	346.79KiB/CPU-s	4.47KiB/CPU-s	0.024868	False	False
http_to_http_json	169.27B/CPU-s	0.0	3.44%	13.62MiB/CPU-s	209.98KiB/CPU-s	2.71KiB/CPU-s	0.015052	13.62MiB/CPU-s	210.2KiB/CPU-s	2.71KiB/CPU-s	0.015068	False	False
fluent_elasticsearch	54.06B/CPU-s	0.0	7.83%	45.41MiB/CPU-s	29.77KiB/CPU-s	389.02B/CPU-s	0.00064	45.41MiB/CPU-s	29.74KiB/CPU-s	388.62B/CPU-s	0.000639	False	False
splunk_hec_indexer_ack_blackhole	-1.47KiB/CPU-s	-0.01	25.73%	13.62MiB/CPU-s	240.08KiB/CPU-s	3.1KiB/CPU-s	0.017214	13.62MiB/CPU-s	251.78KiB/CPU-s	3.25KiB/CPU-s	0.018054	False	False
http_to_http_noack	-6.39KiB/CPU-s	-0.05	76.16%	13.62MiB/CPU-s	254.92KiB/CPU-s	3.29KiB/CPU-s	0.018279	13.61MiB/CPU-s	333.55KiB/CPU-s	4.3KiB/CPU-s	0.023928	False	False
syslog_loki	-25.54KiB/CPU-s	-0.29	100.00%	8.71MiB/CPU-s	249.7KiB/CPU-s	3.22KiB/CPU-s	0.028002	8.68MiB/CPU-s	122.59KiB/CPU-s	1.58KiB/CPU-s	0.013787	False	False
http_text_to_http_json	-116.31KiB/CPU-s	-0.45	100.00%	25.4MiB/CPU-s	753.86KiB/CPU-s	9.73KiB/CPU-s	0.02898	25.29MiB/CPU-s	600.81KiB/CPU-s	7.75KiB/CPU-s	0.0232	False	False
datadog_agent_remap_datadog_logs_acks	-200.14KiB/CPU-s	-0.58	100.00%	33.98MiB/CPU-s	1.12MiB/CPU-s	14.83KiB/CPU-s	0.033031	33.78MiB/CPU-s	1.13MiB/CPU-s	14.94KiB/CPU-s	0.033474	False	False
socket_to_socket_blackhole	-93.58KiB/CPU-s	-0.68	100.00%	13.41MiB/CPU-s	255.49KiB/CPU-s	3.3KiB/CPU-s	0.018601	13.32MiB/CPU-s	151.75KiB/CPU-s	1.96KiB/CPU-s	0.011124	False	False
http_to_http_acks	-60.82KiB/CPU-s	-1.12	76.30%	5.3MiB/CPU-s	2.73MiB/CPU-s	36.12KiB/CPU-s	0.515821	5.24MiB/CPU-s	2.77MiB/CPU-s	36.61KiB/CPU-s	0.528625	True	False
datadog_agent_remap_datadog_logs	-416.53KiB/CPU-s	-1.21	100.00%	33.69MiB/CPU-s	1.41MiB/CPU-s	18.57KiB/CPU-s	0.041715	33.29MiB/CPU-s	1.56MiB/CPU-s	20.62KiB/CPU-s	0.046887	False	False
datadog_agent_remap_blackhole_acks	-435.66KiB/CPU-s	-1.35	100.00%	31.41MiB/CPU-s	778.45KiB/CPU-s	10.05KiB/CPU-s	0.024198	30.99MiB/CPU-s	993.85KiB/CPU-s	12.83KiB/CPU-s	0.031317	False	False
otlp_grpc_to_blackhole	-15.42KiB/CPU-s	-1.44	100.00%	1.04MiB/CPU-s	40.96KiB/CPU-s	541.45B/CPU-s	0.038354	1.03MiB/CPU-s	51.54KiB/CPU-s	681.1B/CPU-s	0.048974	False	False
syslog_log2metric_humio_metrics	-90.87KiB/CPU-s	-1.46	100.00%	6.08MiB/CPU-s	276.94KiB/CPU-s	3.58KiB/CPU-s	0.044478	5.99MiB/CPU-s	280.7KiB/CPU-s	3.62KiB/CPU-s	0.045748	False	False
syslog_splunk_hec_logs	-142.98KiB/CPU-s	-1.55	100.00%	8.99MiB/CPU-s	123.24KiB/CPU-s	1.59KiB/CPU-s	0.013389	8.85MiB/CPU-s	210.39KiB/CPU-s	2.71KiB/CPU-s	0.023218	False	False
otlp_http_to_blackhole	-24.98KiB/CPU-s	-1.6	100.00%	1.52MiB/CPU-s	118.38KiB/CPU-s	1.53KiB/CPU-s	0.07602	1.5MiB/CPU-s	128.1KiB/CPU-s	1.65KiB/CPU-s	0.083602	False	False
syslog_log2metric_splunk_hec_metrics	-259.06KiB/CPU-s	-2.74	100.00%	9.24MiB/CPU-s	329.94KiB/CPU-s	4.26KiB/CPU-s	0.034884	8.98MiB/CPU-s	244.81KiB/CPU-s	3.16KiB/CPU-s	0.026613	False	False
syslog_humio_logs	-314.68KiB/CPU-s	-3.37	100.00%	9.12MiB/CPU-s	200.92KiB/CPU-s	2.59KiB/CPU-s	0.021524	8.81MiB/CPU-s	256.64KiB/CPU-s	3.31KiB/CPU-s	0.028453	False	False
syslog_regex_logs2metric_ddmetrics	-143.72KiB/CPU-s	-3.82	100.00%	3.67MiB/CPU-s	408.14KiB/CPU-s	5.27KiB/CPU-s	0.108473	3.53MiB/CPU-s	427.32KiB/CPU-s	5.52KiB/CPU-s	0.11808	True	False

Jan 28 '23 06:01 github-actions[bot]

Regression Test Results

Run ID: 59c194c3-508d-47be-8f44-cc9723be8e50
Baseline: a5692595ea705ef981bc3043546105e6449a67c8
Comparison: 19bbfa93dff005bd012f1e47bc60d074c3662788
Total vector CPUs: 7

Explanation

A regression test is an integrated performance test for vector in a repeatable rig, with varying configuration for vector. What follows is a statistical summary of a brief vector run for each configuration across SHAs given above. The goal of these tests are to determine, quickly, if vector performance is changed and to what degree by a pull request. Where appropriate units are scaled per-core.

The table below, if present, lists those experiments that have experienced a statistically significant change in their bytes_written_per_cpu_second performance between baseline and comparison SHAs, with 90.0% confidence OR have been detected as newly erratic. Negative values mean that baseline is faster, positive comparison. Results that do not exhibit more than a ±5% change in mean bytes_written_per_cpu_second are discarded. An experiment is erratic if its coefficient of variation is greater than 0.1. The abbreviated table will be omitted if no interesting changes are observed.

No interesting changes in bytes_written_per_cpu_second with confidence ≥ 90.00% and absolute Δ mean >= ±5%.

Fine details of change detection per experiment.

experiment	Δ mean	Δ mean %	confidence	baseline mean	baseline stdev	baseline stderr	baseline CoV	comparison mean	comparison stdev	comparison stderr	comparison CoV	erratic	declared erratic
datadog_agent_remap_blackhole_acks	422.71KiB/CPU-s	1.32	100.00%	31.25MiB/CPU-s	704.34KiB/CPU-s	9.09KiB/CPU-s	0.022009	31.66MiB/CPU-s	866.09KiB/CPU-s	11.18KiB/CPU-s	0.026711	False	False
datadog_agent_remap_datadog_logs_acks	406.9KiB/CPU-s	1.17	100.00%	33.92MiB/CPU-s	1.08MiB/CPU-s	14.21KiB/CPU-s	0.031697	34.32MiB/CPU-s	828.08KiB/CPU-s	10.69KiB/CPU-s	0.02356	False	False
syslog_log2metric_humio_metrics	50.63KiB/CPU-s	0.82	100.00%	6.01MiB/CPU-s	206.57KiB/CPU-s	2.67KiB/CPU-s	0.03355	6.06MiB/CPU-s	197.72KiB/CPU-s	2.55KiB/CPU-s	0.03185	False	False
http_to_http_acks	7.25KiB/CPU-s	0.13	11.15%	5.26MiB/CPU-s	2.74MiB/CPU-s	36.24KiB/CPU-s	0.521554	5.26MiB/CPU-s	2.79MiB/CPU-s	36.92KiB/CPU-s	0.530591	True	False
enterprise_http_to_http	14.63KiB/CPU-s	0.11	99.28%	13.61MiB/CPU-s	375.27KiB/CPU-s	4.84KiB/CPU-s	0.026929	13.62MiB/CPU-s	192.28KiB/CPU-s	2.48KiB/CPU-s	0.013783	False	False
http_to_http_json	15.76KiB/CPU-s	0.11	99.98%	13.61MiB/CPU-s	246.35KiB/CPU-s	3.18KiB/CPU-s	0.017679	13.62MiB/CPU-s	208.53KiB/CPU-s	2.69KiB/CPU-s	0.014948	False	False
splunk_hec_to_splunk_hec_logs_noack	5.45KiB/CPU-s	0.04	83.78%	13.62MiB/CPU-s	236.45KiB/CPU-s	3.05KiB/CPU-s	0.016952	13.62MiB/CPU-s	188.43KiB/CPU-s	2.43KiB/CPU-s	0.013505	False	False
datadog_agent_remap_datadog_logs	9.76KiB/CPU-s	0.03	34.37%	34.48MiB/CPU-s	1.22MiB/CPU-s	16.1KiB/CPU-s	0.035356	34.49MiB/CPU-s	1.13MiB/CPU-s	14.89KiB/CPU-s	0.032691	False	False
splunk_hec_to_splunk_hec_logs_acks	2.38KiB/CPU-s	0.02	28.29%	13.61MiB/CPU-s	371.73KiB/CPU-s	4.79KiB/CPU-s	0.026664	13.62MiB/CPU-s	347.03KiB/CPU-s	4.48KiB/CPU-s	0.024889	False	False
splunk_hec_indexer_ack_blackhole	830.76B/CPU-s	0.01	14.26%	13.62MiB/CPU-s	248.36KiB/CPU-s	3.2KiB/CPU-s	0.017809	13.62MiB/CPU-s	246.39KiB/CPU-s	3.18KiB/CPU-s	0.017667	False	False
fluent_elasticsearch	589.86B/CPU-s	0.0	71.47%	45.41MiB/CPU-s	29.79KiB/CPU-s	389.35B/CPU-s	0.000641	45.41MiB/CPU-s	29.93KiB/CPU-s	391.27B/CPU-s	0.000644	False	False
http_to_http_noack	-4.43KiB/CPU-s	-0.03	53.95%	13.61MiB/CPU-s	303.4KiB/CPU-s	3.92KiB/CPU-s	0.021761	13.61MiB/CPU-s	352.93KiB/CPU-s	4.55KiB/CPU-s	0.025322	False	False
file_to_blackhole	-15.99KiB/CPU-s	-0.03	53.60%	54.5MiB/CPU-s	1.12MiB/CPU-s	14.76KiB/CPU-s	0.020496	54.48MiB/CPU-s	1.22MiB/CPU-s	16.1KiB/CPU-s	0.022399	False	False
otlp_grpc_to_blackhole	-2.94KiB/CPU-s	-0.28	99.96%	1.04MiB/CPU-s	41.86KiB/CPU-s	553.25B/CPU-s	0.039228	1.04MiB/CPU-s	48.65KiB/CPU-s	642.82B/CPU-s	0.045719	False	False
splunk_hec_route_s3	-69.22KiB/CPU-s	-0.58	100.00%	11.66MiB/CPU-s	539.99KiB/CPU-s	6.97KiB/CPU-s	0.045228	11.59MiB/CPU-s	593.9KiB/CPU-s	7.67KiB/CPU-s	0.050034	False	False
datadog_agent_remap_blackhole	-213.71KiB/CPU-s	-0.68	100.00%	30.78MiB/CPU-s	1.04MiB/CPU-s	13.73KiB/CPU-s	0.033756	30.57MiB/CPU-s	987.0KiB/CPU-s	12.74KiB/CPU-s	0.03153	False	False
syslog_log2metric_splunk_hec_metrics	-63.9KiB/CPU-s	-0.68	100.00%	9.17MiB/CPU-s	354.15KiB/CPU-s	4.57KiB/CPU-s	0.037716	9.11MiB/CPU-s	295.55KiB/CPU-s	3.82KiB/CPU-s	0.031691	False	False
socket_to_socket_blackhole	-121.69KiB/CPU-s	-0.88	100.00%	13.43MiB/CPU-s	267.66KiB/CPU-s	3.45KiB/CPU-s	0.019454	13.32MiB/CPU-s	161.87KiB/CPU-s	2.09KiB/CPU-s	0.01187	False	False
http_text_to_http_json	-323.18KiB/CPU-s	-1.24	100.00%	25.51MiB/CPU-s	596.89KiB/CPU-s	7.7KiB/CPU-s	0.022849	25.19MiB/CPU-s	735.95KiB/CPU-s	9.49KiB/CPU-s	0.028526	False	False
syslog_humio_logs	-130.01KiB/CPU-s	-1.4	100.00%	9.1MiB/CPU-s	207.1KiB/CPU-s	2.67KiB/CPU-s	0.022233	8.97MiB/CPU-s	207.2KiB/CPU-s	2.67KiB/CPU-s	0.022558	False	False
syslog_regex_logs2metric_ddmetrics	-62.66KiB/CPU-s	-1.67	100.00%	3.67MiB/CPU-s	393.63KiB/CPU-s	5.08KiB/CPU-s	0.1047	3.61MiB/CPU-s	425.01KiB/CPU-s	5.49KiB/CPU-s	0.114963	True	False
syslog_splunk_hec_logs	-177.97KiB/CPU-s	-1.93	100.00%	9.01MiB/CPU-s	147.27KiB/CPU-s	1.9KiB/CPU-s	0.015966	8.83MiB/CPU-s	212.29KiB/CPU-s	2.74KiB/CPU-s	0.023468	False	False
otlp_http_to_blackhole	-32.29KiB/CPU-s	-2.06	100.00%	1.53MiB/CPU-s	110.88KiB/CPU-s	1.43KiB/CPU-s	0.070826	1.5MiB/CPU-s	127.19KiB/CPU-s	1.64KiB/CPU-s	0.082959	False	False
syslog_loki	-267.17KiB/CPU-s	-2.92	100.00%	8.93MiB/CPU-s	172.94KiB/CPU-s	2.23KiB/CPU-s	0.018907	8.67MiB/CPU-s	128.65KiB/CPU-s	1.66KiB/CPU-s	0.014487	False	False

Jan 28 '23 06:01 github-actions[bot]

Regression Test Results

Run ID: 534684a2-e199-4e4a-8c8c-4cd6a11c55d0
Baseline: c96313e58c624b54ea9bd7c64447fa98e91e95e7
Comparison: 0f31fb973ea7f13894244e44edd2c868eaccf8d5
Total vector CPUs: 7

Explanation

A regression test is an integrated performance test for vector in a repeatable rig, with varying configuration for vector. What follows is a statistical summary of a brief vector run for each configuration across SHAs given above. The goal of these tests are to determine, quickly, if vector performance is changed and to what degree by a pull request. Where appropriate units are scaled per-core.

The table below, if present, lists those experiments that have experienced a statistically significant change in their bytes_written_per_cpu_second performance between baseline and comparison SHAs, with 90.0% confidence OR have been detected as newly erratic. Negative values mean that baseline is faster, positive comparison. Results that do not exhibit more than a ±5% change in mean bytes_written_per_cpu_second are discarded. An experiment is erratic if its coefficient of variation is greater than 0.1. The abbreviated table will be omitted if no interesting changes are observed.

No interesting changes in bytes_written_per_cpu_second with confidence ≥ 90.00% and absolute Δ mean >= ±5%.

Fine details of change detection per experiment.

experiment	Δ mean	Δ mean %	confidence	baseline mean	baseline stdev	baseline stderr	baseline CoV	comparison mean	comparison stdev	comparison stderr	comparison CoV	erratic	declared erratic
datadog_agent_remap_datadog_logs_acks	623.78KiB/CPU-s	1.81	100.00%	33.59MiB/CPU-s	1.16MiB/CPU-s	15.32KiB/CPU-s	0.034514	34.2MiB/CPU-s	777.89KiB/CPU-s	10.04KiB/CPU-s	0.022212	False	False
syslog_regex_logs2metric_ddmetrics	50.86KiB/CPU-s	1.37	100.00%	3.62MiB/CPU-s	392.52KiB/CPU-s	5.07KiB/CPU-s	0.105963	3.67MiB/CPU-s	385.02KiB/CPU-s	4.97KiB/CPU-s	0.10253	True	False
syslog_humio_logs	50.69KiB/CPU-s	0.54	100.00%	9.12MiB/CPU-s	194.39KiB/CPU-s	2.51KiB/CPU-s	0.020804	9.17MiB/CPU-s	98.94KiB/CPU-s	1.28KiB/CPU-s	0.010531	False	False
http_text_to_http_json	68.8KiB/CPU-s	0.26	100.00%	25.54MiB/CPU-s	583.98KiB/CPU-s	7.54KiB/CPU-s	0.02233	25.6MiB/CPU-s	633.32KiB/CPU-s	8.17KiB/CPU-s	0.024154	False	False
splunk_hec_route_s3	14.55KiB/CPU-s	0.12	86.51%	11.69MiB/CPU-s	537.02KiB/CPU-s	6.93KiB/CPU-s	0.04484	11.71MiB/CPU-s	529.78KiB/CPU-s	6.84KiB/CPU-s	0.044181	False	False
enterprise_http_to_http	8.43KiB/CPU-s	0.06	95.74%	13.62MiB/CPU-s	285.48KiB/CPU-s	3.68KiB/CPU-s	0.020474	13.62MiB/CPU-s	149.2KiB/CPU-s	1.93KiB/CPU-s	0.010694	False	False
splunk_hec_to_splunk_hec_logs_noack	5.62KiB/CPU-s	0.04	84.67%	13.62MiB/CPU-s	237.45KiB/CPU-s	3.06KiB/CPU-s	0.017024	13.63MiB/CPU-s	190.92KiB/CPU-s	2.46KiB/CPU-s	0.013683	False	False
fluent_elasticsearch	346.88B/CPU-s	0.0	47.17%	45.41MiB/CPU-s	29.7KiB/CPU-s	388.22B/CPU-s	0.000639	45.41MiB/CPU-s	29.8KiB/CPU-s	389.69B/CPU-s	0.000641	False	False
http_to_http_json	317.59B/CPU-s	0.0	6.43%	13.62MiB/CPU-s	212.04KiB/CPU-s	2.74KiB/CPU-s	0.015199	13.62MiB/CPU-s	209.27KiB/CPU-s	2.7KiB/CPU-s	0.015001	False	False
syslog_log2metric_humio_metrics	-386.5B/CPU-s	-0.01	9.12%	6.04MiB/CPU-s	174.5KiB/CPU-s	2.25KiB/CPU-s	0.02821	6.04MiB/CPU-s	186.09KiB/CPU-s	2.4KiB/CPU-s	0.030085	False	False
splunk_hec_indexer_ack_blackhole	-1.37KiB/CPU-s	-0.01	23.33%	13.62MiB/CPU-s	247.11KiB/CPU-s	3.19KiB/CPU-s	0.01772	13.62MiB/CPU-s	258.0KiB/CPU-s	3.33KiB/CPU-s	0.018502	False	False
file_to_blackhole	-10.02KiB/CPU-s	-0.02	36.16%	54.49MiB/CPU-s	1.07MiB/CPU-s	14.13KiB/CPU-s	0.019631	54.48MiB/CPU-s	1.21MiB/CPU-s	15.96KiB/CPU-s	0.022195	False	False
splunk_hec_to_splunk_hec_logs_acks	-2.42KiB/CPU-s	-0.02	28.79%	13.62MiB/CPU-s	358.75KiB/CPU-s	4.63KiB/CPU-s	0.025726	13.61MiB/CPU-s	358.84KiB/CPU-s	4.63KiB/CPU-s	0.025737	False	False
http_to_http_noack	-4.23KiB/CPU-s	-0.03	58.21%	13.62MiB/CPU-s	258.74KiB/CPU-s	3.34KiB/CPU-s	0.018553	13.61MiB/CPU-s	310.76KiB/CPU-s	4.01KiB/CPU-s	0.02229	False	False
http_to_http_acks	-21.7KiB/CPU-s	-0.4	32.34%	5.24MiB/CPU-s	2.81MiB/CPU-s	37.11KiB/CPU-s	0.535922	5.22MiB/CPU-s	2.76MiB/CPU-s	36.44KiB/CPU-s	0.528386	True	False
datadog_agent_remap_datadog_logs	-150.98KiB/CPU-s	-0.43	100.00%	34.45MiB/CPU-s	1.23MiB/CPU-s	16.31KiB/CPU-s	0.035828	34.3MiB/CPU-s	1.12MiB/CPU-s	14.79KiB/CPU-s	0.032642	False	False
socket_to_socket_blackhole	-61.75KiB/CPU-s	-0.45	100.00%	13.41MiB/CPU-s	300.34KiB/CPU-s	3.88KiB/CPU-s	0.021871	13.35MiB/CPU-s	533.11KiB/CPU-s	6.89KiB/CPU-s	0.038996	False	False
syslog_splunk_hec_logs	-49.37KiB/CPU-s	-0.54	100.00%	9.01MiB/CPU-s	147.13KiB/CPU-s	1.9KiB/CPU-s	0.015945	8.96MiB/CPU-s	238.31KiB/CPU-s	3.08KiB/CPU-s	0.025966	False	False
otlp_grpc_to_blackhole	-11.9KiB/CPU-s	-1.11	100.00%	1.05MiB/CPU-s	37.82KiB/CPU-s	499.93B/CPU-s	0.035297	1.03MiB/CPU-s	52.38KiB/CPU-s	692.07B/CPU-s	0.049436	False	False
syslog_log2metric_splunk_hec_metrics	-110.89KiB/CPU-s	-1.17	100.00%	9.26MiB/CPU-s	266.17KiB/CPU-s	3.44KiB/CPU-s	0.028073	9.15MiB/CPU-s	500.93KiB/CPU-s	6.47KiB/CPU-s	0.053459	False	False
datadog_agent_remap_blackhole	-378.08KiB/CPU-s	-1.17	100.00%	31.43MiB/CPU-s	459.2KiB/CPU-s	5.93KiB/CPU-s	0.014268	31.06MiB/CPU-s	802.89KiB/CPU-s	10.36KiB/CPU-s	0.025243	False	False
syslog_loki	-114.26KiB/CPU-s	-1.26	100.00%	8.86MiB/CPU-s	194.35KiB/CPU-s	2.51KiB/CPU-s	0.021417	8.75MiB/CPU-s	179.35KiB/CPU-s	2.32KiB/CPU-s	0.020016	False	False
otlp_http_to_blackhole	-23.29KiB/CPU-s	-1.47	100.00%	1.54MiB/CPU-s	110.86KiB/CPU-s	1.43KiB/CPU-s	0.070161	1.52MiB/CPU-s	120.79KiB/CPU-s	1.56KiB/CPU-s	0.077591	False	False
datadog_agent_remap_blackhole_acks	-508.09KiB/CPU-s	-1.57	100.00%	31.67MiB/CPU-s	881.77KiB/CPU-s	11.39KiB/CPU-s	0.027187	31.17MiB/CPU-s	1.35MiB/CPU-s	17.88KiB/CPU-s	0.043395	False	False

Jan 29 '23 11:01 github-actions[bot]

Regression Test Results

Run ID: 7d1added-410d-4a50-ada9-bb3eb5293a64
Baseline: c96313e58c624b54ea9bd7c64447fa98e91e95e7
Comparison: 392deec198b116770253d510fb3be76efa718460
Total vector CPUs: 7

Explanation

A regression test is an integrated performance test for vector in a repeatable rig, with varying configuration for vector. What follows is a statistical summary of a brief vector run for each configuration across SHAs given above. The goal of these tests are to determine, quickly, if vector performance is changed and to what degree by a pull request. Where appropriate units are scaled per-core.

The table below, if present, lists those experiments that have experienced a statistically significant change in their bytes_written_per_cpu_second performance between baseline and comparison SHAs, with 90.0% confidence OR have been detected as newly erratic. Negative values mean that baseline is faster, positive comparison. Results that do not exhibit more than a ±5% change in mean bytes_written_per_cpu_second are discarded. An experiment is erratic if its coefficient of variation is greater than 0.1. The abbreviated table will be omitted if no interesting changes are observed.

No interesting changes in bytes_written_per_cpu_second with confidence ≥ 90.00% and absolute Δ mean >= ±5%.

Fine details of change detection per experiment.

experiment	Δ mean	Δ mean %	confidence	baseline mean	baseline stdev	baseline stderr	baseline CoV	comparison mean	comparison stdev	comparison stderr	comparison CoV	erratic	declared erratic
datadog_agent_remap_blackhole	685.08KiB/CPU-s	2.21	100.00%	30.34MiB/CPU-s	1.23MiB/CPU-s	16.26KiB/CPU-s	0.040531	31.01MiB/CPU-s	1.08MiB/CPU-s	14.22KiB/CPU-s	0.034696	False	False
socket_to_socket_blackhole	161.64KiB/CPU-s	1.17	100.00%	13.46MiB/CPU-s	339.5KiB/CPU-s	4.38KiB/CPU-s	0.024635	13.61MiB/CPU-s	317.79KiB/CPU-s	4.1KiB/CPU-s	0.022792	False	False
syslog_log2metric_splunk_hec_metrics	106.09KiB/CPU-s	1.11	100.00%	9.3MiB/CPU-s	198.56KiB/CPU-s	2.56KiB/CPU-s	0.020855	9.4MiB/CPU-s	169.71KiB/CPU-s	2.19KiB/CPU-s	0.017629	False	False
otlp_http_to_blackhole	15.75KiB/CPU-s	1.0	100.00%	1.53MiB/CPU-s	110.7KiB/CPU-s	1.43KiB/CPU-s	0.070425	1.55MiB/CPU-s	114.76KiB/CPU-s	1.48KiB/CPU-s	0.072281	False	False
otlp_grpc_to_blackhole	9.71KiB/CPU-s	0.91	100.00%	1.04MiB/CPU-s	42.46KiB/CPU-s	561.19B/CPU-s	0.039728	1.05MiB/CPU-s	48.5KiB/CPU-s	640.87B/CPU-s	0.044972	False	False
http_text_to_http_json	209.78KiB/CPU-s	0.8	100.00%	25.49MiB/CPU-s	600.63KiB/CPU-s	7.75KiB/CPU-s	0.023013	25.69MiB/CPU-s	650.45KiB/CPU-s	8.39KiB/CPU-s	0.024723	False	False
splunk_hec_route_s3	86.71KiB/CPU-s	0.73	100.00%	11.68MiB/CPU-s	574.71KiB/CPU-s	7.41KiB/CPU-s	0.048055	11.76MiB/CPU-s	535.11KiB/CPU-s	6.91KiB/CPU-s	0.044421	False	False
syslog_loki	60.96KiB/CPU-s	0.67	100.00%	8.87MiB/CPU-s	193.89KiB/CPU-s	2.5KiB/CPU-s	0.021336	8.93MiB/CPU-s	100.04KiB/CPU-s	1.29KiB/CPU-s	0.010936	False	False
datadog_agent_remap_datadog_logs	207.39KiB/CPU-s	0.6	100.00%	33.89MiB/CPU-s	1.31MiB/CPU-s	17.3KiB/CPU-s	0.038649	34.1MiB/CPU-s	1.23MiB/CPU-s	16.28KiB/CPU-s	0.036154	False	False
http_to_http_acks	17.83KiB/CPU-s	0.33	27.12%	5.24MiB/CPU-s	2.75MiB/CPU-s	36.31KiB/CPU-s	0.524168	5.26MiB/CPU-s	2.76MiB/CPU-s	36.43KiB/CPU-s	0.524261	True	False
enterprise_http_to_http	14.26KiB/CPU-s	0.1	99.59%	13.61MiB/CPU-s	355.21KiB/CPU-s	4.58KiB/CPU-s	0.025486	13.62MiB/CPU-s	149.38KiB/CPU-s	1.93KiB/CPU-s	0.010707	False	False
splunk_hec_to_splunk_hec_logs_noack	5.48KiB/CPU-s	0.04	83.85%	13.62MiB/CPU-s	236.32KiB/CPU-s	3.05KiB/CPU-s	0.016943	13.63MiB/CPU-s	190.1KiB/CPU-s	2.45KiB/CPU-s	0.013624	False	False
fluent_elasticsearch	75.37B/CPU-s	0.0	10.91%	45.41MiB/CPU-s	29.66KiB/CPU-s	387.8B/CPU-s	0.000638	45.41MiB/CPU-s	29.8KiB/CPU-s	389.41B/CPU-s	0.000641	False	False
http_to_http_json	2.86B/CPU-s	0.0	0.06%	13.62MiB/CPU-s	210.96KiB/CPU-s	2.72KiB/CPU-s	0.015122	13.62MiB/CPU-s	208.96KiB/CPU-s	2.7KiB/CPU-s	0.014979	False	False
http_to_http_noack	53.54B/CPU-s	0.0	0.80%	13.62MiB/CPU-s	286.0KiB/CPU-s	3.69KiB/CPU-s	0.020511	13.62MiB/CPU-s	283.33KiB/CPU-s	3.66KiB/CPU-s	0.020319	False	False
file_to_blackhole	-7.93KiB/CPU-s	-0.01	28.87%	54.49MiB/CPU-s	1.12MiB/CPU-s	14.83KiB/CPU-s	0.020608	54.49MiB/CPU-s	1.17MiB/CPU-s	15.45KiB/CPU-s	0.021483	False	False
splunk_hec_to_splunk_hec_logs_acks	-2.05KiB/CPU-s	-0.01	25.26%	13.62MiB/CPU-s	342.7KiB/CPU-s	4.42KiB/CPU-s	0.024573	13.62MiB/CPU-s	355.59KiB/CPU-s	4.59KiB/CPU-s	0.025501	False	False
splunk_hec_indexer_ack_blackhole	-2.81KiB/CPU-s	-0.02	46.48%	13.62MiB/CPU-s	241.07KiB/CPU-s	3.11KiB/CPU-s	0.017285	13.62MiB/CPU-s	255.84KiB/CPU-s	3.3KiB/CPU-s	0.018348	False	False
syslog_splunk_hec_logs	-2.97KiB/CPU-s	-0.03	66.63%	9.08MiB/CPU-s	161.74KiB/CPU-s	2.09KiB/CPU-s	0.017402	9.07MiB/CPU-s	174.59KiB/CPU-s	2.25KiB/CPU-s	0.018791	False	False
datadog_agent_remap_blackhole_acks	-63.32KiB/CPU-s	-0.2	99.99%	31.39MiB/CPU-s	757.84KiB/CPU-s	9.79KiB/CPU-s	0.023573	31.33MiB/CPU-s	983.34KiB/CPU-s	12.69KiB/CPU-s	0.030648	False	False
syslog_humio_logs	-39.76KiB/CPU-s	-0.43	100.00%	9.13MiB/CPU-s	190.36KiB/CPU-s	2.46KiB/CPU-s	0.020369	9.09MiB/CPU-s	167.07KiB/CPU-s	2.16KiB/CPU-s	0.017953	False	False
datadog_agent_remap_datadog_logs_acks	-219.89KiB/CPU-s	-0.63	100.00%	33.96MiB/CPU-s	1.29MiB/CPU-s	17.02KiB/CPU-s	0.037931	33.75MiB/CPU-s	981.7KiB/CPU-s	12.67KiB/CPU-s	0.028404	False	False
syslog_regex_logs2metric_ddmetrics	-26.62KiB/CPU-s	-0.72	99.96%	3.61MiB/CPU-s	449.3KiB/CPU-s	5.8KiB/CPU-s	0.12162	3.58MiB/CPU-s	372.87KiB/CPU-s	4.81KiB/CPU-s	0.101665	True	False
syslog_log2metric_humio_metrics	-77.81KiB/CPU-s	-1.25	100.00%	6.09MiB/CPU-s	165.41KiB/CPU-s	2.14KiB/CPU-s	0.026521	6.01MiB/CPU-s	192.31KiB/CPU-s	2.48KiB/CPU-s	0.031223	False	False

Jan 29 '23 12:01 github-actions[bot]

Server { code: 507, message: "Presigned Upload Failed" }

This error seems from MinIO. I could add a more detailed log to see what happened. Maybe disk full I guess ?

Feb 01 '23 17:02 everpcpc

Server { code: 507, message: "Presigned Upload Failed" }

This error seems from MinIO. I could add a more detailed log to see what happened. Maybe disk full I guess ?

Ah, for the life of me I can't find how to get logs out of that minio container 😅 but using a volume for that /data dir solves the problem for me. I'm not sure why that happens for me locally vs yours locally vs CI 😆 but assuming Docker on Mac problems.

If it's a consistent problem for Mac's locally we might want to consider mounting a temp dir to avoid it.

Feb 01 '23 19:02 spencergilbert

but assuming Docker on Mac problems.

I use colima on macOS, and also encountered similar problem. But my situation is that I set the colima disk size limit to 60GiB and it was full. After cleaning up some old docker images it recoverd. 😄

❯ colima list
PROFILE    STATUS     ARCH       CPUS    MEMORY    DISK     RUNTIME    ADDRESS
default    Stopped    aarch64    4       8GiB      60GiB

Feb 01 '23 19:02 everpcpc

😅 I wish docker for mac was easier to use...

Might need to take another look at colima.

Feb 01 '23 19:02 spencergilbert

vector
vector copied to clipboard

feat(new sink): Initial `databend` sink

Deploy Preview for vector-project canceled.

Deploy Preview for vrl-playground canceled.

Regression Test Results

Regression Test Results

Regression Test Results

Regression Test Results

Regression Test Results

Regression Test Results

Regression Test Results

Regression Test Results

Regression Test Results

Regression Test Results

Regression Test Results

Regression Test Results

Regression Test Results

Regression Test Results

Regression Test Results

Regression Test Results

Regression Test Results

Regression Test Results

Regression Test Results

Regression Test Results

vector vector copied to clipboard

feat(new sink): Initial `databend` sink

✅ Deploy Preview for vector-project canceled.

✅ Deploy Preview for vrl-playground canceled.

Regression Test Results

Regression Test Results

Regression Test Results

Regression Test Results

Regression Test Results

Regression Test Results

Regression Test Results

Regression Test Results

Regression Test Results

Regression Test Results

Regression Test Results

Regression Test Results

Regression Test Results

Regression Test Results

Regression Test Results

Regression Test Results

Regression Test Results

Regression Test Results

Regression Test Results

Regression Test Results

vector
vector copied to clipboard

Deploy Preview for vector-project canceled.

Deploy Preview for vrl-playground canceled.