syslog-message doesn't show up in search and seems to cause memory-leak

[fpetersen-gl]

Customer-request: Graylog2/support#357

At least these two syslog-messages do not show up in the search after ingesting them via a regular syslog-TCP input with no further illuminate processing:

<134>1 2025-10-31T11:14:42.431280+01:00 vvc02-atkla vpxd-main - - - 2025-10-31T11:14:42.420+01:00 error vpxd[05738] [Originator@6876 sub=Default opID=7e211f4b] [VpxLRO] -- ERROR lro-118807853 -- 523a7807-b692-b973-0574-ed2eeab39b3d(52d789d7-a1a0-2b95-0be2-0fb7dc55e83d) -- PerfMgr -- vim.PerformanceManager.queryStats: :vmodl.fault.SystemError\\n--> Result:\\n--> (vmodl.fault.SystemError) {\\n-->    faultCause = (vmodl.MethodFault) null, \\n-- (file://n--)>    faultMessage = <unset>, \\n-- (file://n--)>    reason = \"HTTP error response: Service Unavailable\"\\n-->    msg = \"\"\\n--> }\\n--> Args:\\n--> \\n--> Arg querySpec:\\n--> (vim.PerformanceManager.QuerySpec) [\\n-->    (vim.PerformanceManager.QuerySpec) {\\n-->       entity = 'vim.HostSystem:host-4153', \\n-->       startTime = \"2025-10-31T11:00:00+01:00\", \\n-- (file://n--)>       endTime = \"2025-10-31T11:05:00+01:00\", \\n-- (file://n--)>       maxSample = 1, \\n-- (file://n--)>       metricId = (vim.PerformanceManager.MetricId) [\\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 162, \\n-- (file://n--)>             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 2, \\n-->             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 24, \\n-->             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 150, \\n-->             instance = \"\"\\n-->          }\\n-->       ], \\n-->       intervalId = 300, \\n-->       format = \"csv\"\\n-->    }, \\n-->    (vim.PerformanceManager.QuerySpec) {\\n-->       entity = 'vim.HostSystem:host-11356', \\n-->       startTime = \"2025-10-31T11:00:00+01:00\", \\n-- (file://n--)>       endTime = \"2025-10-31T11:05:00+01:00\", \\n-- (file://n--)>       maxSample = 1, \\n-- (file://n--)>       metricId = (vim.PerformanceManager.MetricId) [\\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 162, \\n-- (file://n--)>             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 2, \\n-->             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 24, \\n-->             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 150, \\n-->             instance = \"\"\\n-->          }\\n-->       ], \\n-->       intervalId = 300, \\n-->       format = \"csv\"\\n-->    }, \\n-->    (vim.PerformanceManager.QuerySpec) {\\n-->       entity = 'vim.HostSystem:host-36017', \\n-->       startTime = \"2025-10-31T11:00:00+01:00\", \\n-- (file://n--)>       endTime = \"2025-10-31T11:05:00+01:00\", \\n-- (file://n--)>       maxSample = 1, \\n-- (file://n--)>       metricId = (vim.PerformanceManager.MetricId) [\\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 162, \\n-- (file://n--)>             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 2, \\n-->             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 24, \\n-->             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 150, \\n-->             instance = \"\"\\n-->          }\\n-->       ], \\n-->       intervalId = 300, \\n-->       format = \"csv\"\\n-->    }, \\n-->    (vim.PerformanceManager.QuerySpec) {\\n-->       entity = 'vim.HostSystem:host-5322', \\n-->       startTime = \"2025-10-31T11:00:00+01:00\", \\n-- (file://n--)>       endTime = \"2025-10-31T11:05:00+01:00\", \\n-- (file://n--)>       maxSample = 1, \\n-- (file://n--)>       metricId = (vim.PerformanceManager.MetricId) [\\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 162, \\n-- (file://n--)>             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 2, \\n-->             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 24, \\n-->             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 150, \\n-->             instance = \"\"\\n-->          }\\n-->       ], \\n-->       intervalId = 300, \\n-->       format = \"csv\"\\n-->    }, \\n-->    (vim.PerformanceManager.QuerySpec) {\\n-->       entity = 'vim.HostSystem:host-5388', \\n-->       startTime = \"2025-10-31T11:00:00+01:00\", \\n-- (file://n--)>       endTime = \"2025-10-31T11:05:00+01:00\", \\n-- (file://n--)>       maxSample = 1, \\n-- (file://n--)>       metricId = (vim.PerformanceManager.MetricId) [\\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 162, \\n-- (file://n--)>             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 2, \\n-->             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 24, \\n-->             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 150, \\n-->             instance = \"\"\\n-->          }\\n-->       ], \\n-->       intervalId = 300, \\n-->       format = \"csv\"\\n-->    }, \\n-->    (vim.PerformanceManager.QuerySpec) {\\n-->       entity = 'vim.HostSystem:host-4178', \\n-->       startTime = \"2025-10-31T11:00:00+01:00\", \\n-- (file://n--)>       endTime = \"2025-10-31T11:05:00+01:00\", \\n-- (file://n--)>       maxSample = 1, \\n-- (file://n--)>       metricId = (vim.PerformanceManager.MetricId) [\\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 162, \\n-- (file://n--)>             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 2, \\n-->             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 24, \\n-->             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 150, \\n-->             instance = \"\"\\n-->          }\\n-->       ], \\n-->       intervalId = 300, \\n-->       format = \"csv\"\\n-->    }, \\n-->    (vim.PerformanceManager.QuerySpec) {\\n-->       entity = 'vim.HostSystem:host-5420', \\n-->       startTime = \"2025-10-31T11:00:00+01:00\", \\n-- (file://n--)>       endTime = \"2025-10-31T11:05:00+01:00\", \\n-- (file://n--)>       maxSample = 1, \\n-- (file://n--)>       metricId = (vim.PerformanceManager.MetricId) [\\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 162, \\n-- (file://n--)>             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 2, \\n-->             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 24, \\n-->             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 150, \\n-->             instance = \"\"\\n-->          }\\n-->       ], \\n-->       intervalId = 300, \\n-->       format = \"csv\"\\n-->    }, \\n-->    (vim.PerformanceManager.QuerySpec) {\\n-->       entity = 'vim.HostSystem:host-4234', \\n-->       startTime = \"2025-10-31T11:00:00+01:00\", \\n-- (file://n--)>       endTime = \"2025-10-31T11:05:00+01:00\", \\n-- (file://n--)>       maxSample = 1, \\n-- (file://n--)>       metricId = (vim.PerformanceManager.MetricId) [\\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 162, \\n-- (file://n--)>             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 2, \\n-->             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 24, \\n-->             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 150, \\n-->             instance = \"\"\\n-->          }\\n-->       ], \\n-->       intervalId = 300, \\n-->       format = \"csv\"\\n-->    }, \\n-->    (vim.PerformanceManager.QuerySpec) {\\n-->       entity = 'vim.HostSystem:host-202868', \\n-->       startTime = \"2025-10-31T11:00:00+01:00\", \\n-- (file://n--)>       endTime = \"2025-10-31T11:05:00+01:00\", \\n-- (file://n--)>       maxSample = 1, \\n-- (file://n--)>       metricId = (vim.PerformanceManager.MetricId) [\\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 162, \\n-- (file://n--)>             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 2, \\n-->             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 24, \\n-->             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 150, \\n-->             instance = \"\"\\n-->          }\\n-->       ], \\n-->       intervalId = 300, \\n-->       format = \"csv\"\\n-->    }, \\n-->    (vim.PerformanceManager.QuerySpec) {\\n-->       entity = 'vim.HostSystem:host-5327', \\n-->       startTime = \"2025-10-31T11:00:00+01:00\", \\n-- (file://n--)>       endTime = \"2025-10-31T11:05:00+01:00\", \\n-- (file://n--)>       maxSample = 1, \\n-- (file://n--)>       metricId = (vim.PerformanceManager.MetricId) [\\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 162, \\n-- (file://n--)>             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 2, \\n-->             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 24, \\n-->             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 150, \\n-->             instance = \"\"\\n-->          }\\n-->       ], \\n-->       intervalId = 300, \\n-->       format = \"csv\"\\n-->    }, \\n-->    (vim.PerformanceManager.QuerySpec) {\\n-->       entity = 'vim.HostSystem:host-132116', \\n-->       startTime = \"2025-10-31T11:00:00+01:00\", \\n-- (file://n--)>       endTime = \"2025-10-31T11:05:00+01:00\", \\n-- (file://n--)>       maxSample = 1, \\n-- (file://n--)>       metricId = (vim.PerformanceManager.MetricId) [\\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 162, \\n-- (file://n--)>             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 2, \\n-->             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 24, \\n-->             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 150, \\n-->             instance = \"\"\\n-->          }\\n-->       ], \\n-->       intervalId = 300, \\n-->       format = \"csv\"\\n-->    }, \\n-->    (vim.PerformanceManager.QuerySpec) {\\n-->       entity = 'vim.HostSystem:host-170027', \\n-->       startTime = \"2025-10-31T11:00:00+01:00\", \\n-- (file://n--)>       endTime = \"2025-10-31T11:05:00+01:00\", \\n-- (file://n--)>       maxSample = 1, \\n-- (file://n--)>       metricId = (vim.PerformanceManager.MetricId) [\\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 162, \\n-- (file://n--)>             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 2, \\n-->             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 24, \\n-->             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 150, \\n-->             instance = \"\"\\n-->          }\\n-->       ], \\n-->       intervalId = 300, \\n-->       format = \"csv\"\\n-->    }, \\n-->    (vim.PerformanceManager.QuerySpec) {\\n-->       entity = 'vim.HostSystem:host-131408', \\n-->       startTime = \"2025-10-31T11:00:00+01:00\", \\n-- (file://n--)>       endTime = \"2025-10-31T11:05:00+01:00\", \\n-- (file://n--)>       maxSample = 1, \\n-- (file://n--)>       metricId = (vim.PerformanceManager.MetricId) [\\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 162, \\n-- (file://n--)>             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 2, \\n-->             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 24, \\n-->             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 150, \\n-->             instance = \"\"\\n-->          }\\n-->       ], \\n-->       intervalId = 300, \\n-->       format = \"csv\"\\n-->    }, \\n-->    (vim.PerformanceManager.QuerySpec) {\\n-->       entity = 'vim.HostSystem:host-248170', \\n-->       startTime = \"2025-10-31T11:00:00+01:00\", \\n-- (file://n--)>       endTime = \"2025-10-31T11:05:00+01:00\", \\n-- (file://n--)>       maxSample = 1, \\n-- (file://n--)>       metricId = (vim.PerformanceManager.MetricId) [\\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 162, \\n-- (file://n--)>             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 2, \\n-->             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 24, \\n-->             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 150, \\n-->             instance = \"\"\\n-->          }\\n-->       ], \\n-->       intervalId = 300, \\n-->       format = \"csv\"\\n-->    }, \\n-->    (vim.PerformanceManager.QuerySpec) {\\n-->       entity = 'vim.HostSystem:host-11915', \\n-->       startTime = \"2025-10-31T11:00:00+01:00\", \\n-- (file://n--)>       endTime = \"2025-10-31T11:05:00+01:00\", \\n-- (file://n--)>       maxSample = 1, \\n-- (file://n--)>       metricId = (vim.PerformanceManager.MetricId) [\\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 162, \\n-- (file://n--)>             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 2, \\n-->             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 24, \\n-->             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 150, \\n-->             instance = \"\"\\n-->          }\\n-->       ], \\n-->       intervalId = 300, \\n-->       format = \"csv\"\\n-->    }, \\n-->    (vim.PerformanceManager.QuerySpec) {\\n-->       entity = 'vim.HostSystem:host-12360', \\n-->       startTime = \"2025-10-31T11:00:00+01:00\", \\n-- (file://n--)>       endTime = \"2025-10-31T11:05:00+01:00\", \\n-- (file://n--)>       maxSample = 1, \\n-- (file://n--)>       metricId = (vim.PerformanceManager.MetricId) [\\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 162, \\n-- (file://n--)>             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 2, \\n-->             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 24, \\n-->             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 150, \\n-->             instance = \"\"\\n-->          }\\n-->       ], \\n-->       intervalId = 300, \\n-->       format = \"csv\"\\n-->    }, \\n-->    (vim.PerformanceManager.QuerySpec) {\\n-->       entity = 'vim.HostSystem:host-171278', \\n-->       startTime = \"2025-10-31T11:00:00+01:00\", \\n-- (file://n--)>       endTime = \"2025-10-31T11:05:00+01:00\", \\n-- (file://n--)>       maxSample = 1, \\n-- (file://n--)>       metricId = (vim.PerformanceManager.MetricId) [\\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 162, \\n-- (file://n--)>             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 2, \\n-->             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 24, \\n-->             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 150, \\n-->             instance = \"\"\\n-->          }\\n-->       ], \\n-->       intervalId = 300, \\n-->       format = \"csv\"\\n-->    }, \\n-->    (vim.PerformanceManager.QuerySpec) {\\n-->       entity = 'vim.HostSystem:host-169977', \\n-->       startTime = \"2025-10-31T11:00:00+01:00\", \\n-- (file://n--)>       endTime = \"2025-10-31T11:05:00+01:00\", \\n-- (file://n--)>       maxSample = 1, \\n-- (file://n--)>       metricId = (vim.PerformanceManager.MetricId) [\\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 162, \\n-- (file://n--)>             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 2, \\n-->             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 24, \\n-->             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 150, \\n-->             instance = \"\"\\n-->          }\\n-->       ], \\n-->       intervalId = 300, \\n-->       format = \"csv\"\\n-->    }, \\n-->    (vim.PerformanceManager.QuerySpec) {\\n-->       entity = 'vim.HostSystem:host-12882', \\n-->       startTime = \"2025-10-31T11:00:00+01:00\", \\n-- (file://n--)>       endTime = \"2025-10-31T11:05:00+01:00\", \\n-- (file://n--)>       maxSample = 1, \\n-- (file://n--)>       metricId = (vim.PerformanceManager.MetricId) [\\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 162, \\n-- (file://n--)>             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 2, \\n-->             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 24, \\n-->             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 150, \\n-->             instance = \"\"\\n-->          }\\n-->       ], \\n-->       intervalId = 300, \\n-->       format = \"csv\"\\n-->    }, \\n-->    (vim.PerformanceManager.QuerySpec) {\\n-->       entity = 'vim.HostSystem:host-5370', \\n-->       startTime = \"2025-10-31T11:00:00+01:00\", \\n-- (file://n--)>       endTime = \"2025-10-31T11:05:00+01:00\", \\n-- (file://n--)>       maxSample = 1, \\n-- (file://n--)>       metricId = (vim.PerformanceManager.MetricId) [\\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 162, \\n-- (file://n--)>             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 2, \\n-->             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 24, \\n-->             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 150, \\n-->             instance = \"\"\\n-->          }\\n-->       ], \\n-->       intervalId = 300, \\n-->       format = \"csv\"\\n-->    }, \\n-->    (vim.PerformanceManager.QuerySpec) {\\n-->       entity = 'vim.HostSystem:host-5373', \\n-->       startTime = \"2025-10-31T11:00:00+01:00\", \\n-- (file://n--)>       endTime = \"2025-10-31T11:05:00+01:00\", \\n-- (file://n--)>       maxSample = 1, \\n-- (file://n--)>       metricId = (vim.PerformanceManager.MetricId) [\\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 162, \\n-- (file://n--)>             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 2, \\n-->             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 24, \\n-->             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 150, \\n-->             instance = \"\"\\n-->          }\\n-->       ], \\n-->       intervalId = 300, \\n-->       format = \"csv\"\\n-->    }, \\n-->    (vim.PerformanceManager.QuerySpec) {\\n-->       entity = 'vim.HostSystem:host-5330', \\n-->       startTime = \"2025-10-31T11:00:00+01:00\", \\n-- (file://n--)>       endTime = \"2025-10-31T11:05:00+01:00\", \\n-- (file://n--)>       maxSample = 1, \\n-- (file://n--)>       metricId = (vim.PerformanceManager.MetricId) [\\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 162, \\n-- (file://n--)>             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 2, \\n-->             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 24, \\n-->             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 150, \\n-->             instance = \"\"\\n-->          }\\n-->       ], \\n-->       intervalId = 300, \\n-->       format = \"csv\"\\n-->    }, \\n-->    (vim.PerformanceManager.QuerySpec) {\\n-->       entity = 'vim.HostSystem:host-36007', \\n-->       startTime = \"2025-10-31T11:00:00+01:00\", \\n-- (file://n--)>       endTime = \"2025-10-31T11:05:00+01:00\", \\n-- (file://n--)>       maxSample = 1, \\n-- (file://n--)>       metricId = (vim.PerformanceManager.MetricId) [\\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 162, \\n-- (file://n--)>             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 2, \\n-->             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 24, \\n-->             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 150, \\n-->             instance = \"\"\\n-->          }\\n-->       ], \\n-->       intervalId = 300, \\n-->       format = \"csv\"\\n-->    }, \\n-->    (vim.PerformanceManager.QuerySpec) {\\n-->       entity = 'vim.HostSystem:host-5376', \\n-->       startTime = \"2025-10-31T11:00:00+01:00\", \\n-- (file://n--)>       endTime = \"2025-10-31T11:05:00+01:00\", \\n-- (file://n--)>       maxSample = 1, \\n-- (file://n--)>       metricId = (vim.PerformanceManager.MetricId) [\\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 162, \\n-- (file://n--)>             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 2, \\n-->             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 24, \\n-->             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 150, \\n-->             instance = \"\"\\n-->          }\\n-->       ], \\n-->       intervalId = 300, \\n-->       format = \"csv\"\\n-->    }, \\n-->    (vim.PerformanceManager.QuerySpec) {\\n-->       entity = 'vim.HostSystem:host-5312', \\n-->       startTime = \"2025-10-31T11:00:00+01:00\", \\n-- (file://n--)>       endTime = \"2025-10-31T11:05:00+01:00\", \\n-- (file://n--)>       maxSample = 1, \\n-- (file://n--)>       metricId = (vim.PerformanceManager.MetricId) [\\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 162, \\n-- (file://n--)>             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 2, \\n-->             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 24, \\n-->             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 150, \\n-->             instance = \"\"\\n-->          }\\n-->       ], \\n-->       intervalId = 300, \\n-->       format = \"csv\"\\n-->    }, \\n-->    (vim.PerformanceManager.QuerySpec) {\\n-->       entity = 'vim.HostSystem:host-202535', \\n-->       startTime = \"2025-10-31T11:00:00+01:00\", \\n-- (file://n--)>       endTime = \"2025-10-31T11:05:00+01:00\", \\n-- (file://n--)>       maxSample = 1, \\n-- (file://n--)>       metricId = (vim.PerformanceManager.MetricId) [\\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 162, \\n-- (file://n--)>             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 2, \\n-->             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 24, \\n-->             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 150, \\n-->             instance = \"\"\\n-->          }\\n-->       ], \\n-->       intervalId = 300, \\n-->       format = \"csv\"\\n-->    }, \\n-->    (vim.PerformanceManager.QuerySpec) {\\n-->       entity = 'vim.HostSystem:host-202876', \\n-->       startTime = \"2025-10-31T11:00:00+01:00\", \\n-- (file://n--)>       endTime = \"2025-10-31T11:05:00+01:00\", \\n-- (file://n--)>       maxSample = 1, \\n-- (file://n--)>       metricId = (vim.PerformanceManager.MetricId) [\\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 162, \\n-- (file://n--)>             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 2, \\n-->             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 24, \\n-->             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 150, \\n-->             instance = \"\"\\n-->          }\\n-->       ], \\n-->       intervalId = 300, \\n-->       format = \"csv\"\\n-->    }, \\n-->    (vim.PerformanceManager.QuerySpec) {\\n-->       entity = 'vim.HostSystem:host-5877', \\n-->       startTime = \"2025-10-31T11:00:00+01:00\", \\n-- (file://n--)>       endTime = \"2025-10-31T11:05:00+01:00\", \\n-- (file://n--)>       maxSample = 1, \\n-- (file://n--)>       metricId = (vim.PerformanceManager.MetricId) [\\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 162, \\n-- (file://n--)>             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 2, \\n-->             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 24, \\n-->             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->>

<134>1 2025-11-04T06:36:21.252131+01:00 vvc02-atkla vpxd-main - - - 2025-11-04T06:36:21.251+01:00 error vpxd[05719] [Originator@6876 sub=Default opID=44a037bf] [VpxLRO] -- ERROR lro-123502576 -- 5253b3f6-9358-ba63-212e-55846ddfc4de(52bdfa9f-0020-c533-5984-c72b87b8d083) -- PerfMgr -- vim.PerformanceManager.queryStats: :vmodl.fault.SystemError\\n--> Result:\\n--> (vmodl.fault.SystemError) {\\n-->    faultCause = (vmodl.MethodFault) null, \\n-- (file://n--)>    faultMessage = <unset>, \\n-- (file://n--)>    reason = \"Operation was canceled\"\\n-->    msg = \"\"\\n--> }\\n--> Args:\\n--> \\n--> Arg querySpec:\\n--> (vim.PerformanceManager.QuerySpec) [\\n-->    (vim.PerformanceManager.QuerySpec) {\\n-->       entity = 'vim.HostSystem:host-4153', \\n-->       startTime = \"2025-11-04T06:20:00+01:00\", \\n-- (file://n--)>       endTime = \"2025-11-04T06:25:00+01:00\", \\n-- (file://n--)>       maxSample = 1, \\n-- (file://n--)>       metricId = (vim.PerformanceManager.MetricId) [\\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 162, \\n-- (file://n--)>             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 2, \\n-->             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 24, \\n-->             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 150, \\n-->             instance = \"\"\\n-->          }\\n-->       ], \\n-->       intervalId = 300, \\n-->       format = \"csv\"\\n-->    }, \\n-->    (vim.PerformanceManager.QuerySpec) {\\n-->       entity = 'vim.HostSystem:host-11356', \\n-->       startTime = \"2025-11-04T06:20:00+01:00\", \\n-- (file://n--)>       endTime = \"2025-11-04T06:25:00+01:00\", \\n-- (file://n--)>       maxSample = 1, \\n-- (file://n--)>       metricId = (vim.PerformanceManager.MetricId) [\\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 162, \\n-- (file://n--)>             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 2, \\n-->             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 24, \\n-->             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 150, \\n-->             instance = \"\"\\n-->          }\\n-->       ], \\n-->       intervalId = 300, \\n-->       format = \"csv\"\\n-->    }, \\n-->    (vim.PerformanceManager.QuerySpec) {\\n-->       entity = 'vim.HostSystem:host-36017', \\n-->       startTime = \"2025-11-04T06:20:00+01:00\", \\n-- (file://n--)>       endTime = \"2025-11-04T06:25:00+01:00\", \\n-- (file://n--)>       maxSample = 1, \\n-- (file://n--)>       metricId = (vim.PerformanceManager.MetricId) [\\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 162, \\n-- (file://n--)>             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 2, \\n-->             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 24, \\n-->             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 150, \\n-->             instance = \"\"\\n-->          }\\n-->       ], \\n-->       intervalId = 300, \\n-->       format = \"csv\"\\n-->    }, \\n-->    (vim.PerformanceManager.QuerySpec) {\\n-->       entity = 'vim.HostSystem:host-5322', \\n-->       startTime = \"2025-11-04T06:20:00+01:00\", \\n-- (file://n--)>       endTime = \"2025-11-04T06:25:00+01:00\", \\n-- (file://n--)>       maxSample = 1, \\n-- (file://n--)>       metricId = (vim.PerformanceManager.MetricId) [\\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 162, \\n-- (file://n--)>             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 2, \\n-->             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 24, \\n-->             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 150, \\n-->             instance = \"\"\\n-->          }\\n-->       ], \\n-->       intervalId = 300, \\n-->       format = \"csv\"\\n-->    }, \\n-->    (vim.PerformanceManager.QuerySpec) {\\n-->       entity = 'vim.HostSystem:host-5388', \\n-->       startTime = \"2025-11-04T06:20:00+01:00\", \\n-- (file://n--)>       endTime = \"2025-11-04T06:25:00+01:00\", \\n-- (file://n--)>       maxSample = 1, \\n-- (file://n--)>       metricId = (vim.PerformanceManager.MetricId) [\\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 162, \\n-- (file://n--)>             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 2, \\n-->             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 24, \\n-->             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 150, \\n-->             instance = \"\"\\n-->          }\\n-->       ], \\n-->       intervalId = 300, \\n-->       format = \"csv\"\\n-->    }, \\n-->    (vim.PerformanceManager.QuerySpec) {\\n-->       entity = 'vim.HostSystem:host-4178', \\n-->       startTime = \"2025-11-04T06:20:00+01:00\", \\n-- (file://n--)>       endTime = \"2025-11-04T06:25:00+01:00\", \\n-- (file://n--)>       maxSample = 1, \\n-- (file://n--)>       metricId = (vim.PerformanceManager.MetricId) [\\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 162, \\n-- (file://n--)>             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 2, \\n-->             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 24, \\n-->             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 150, \\n-->             instance = \"\"\\n-->          }\\n-->       ], \\n-->       intervalId = 300, \\n-->       format = \"csv\"\\n-->    }, \\n-->    (vim.PerformanceManager.QuerySpec) {\\n-->       entity = 'vim.HostSystem:host-5420', \\n-->       startTime = \"2025-11-04T06:20:00+01:00\", \\n-- (file://n--)>       endTime = \"2025-11-04T06:25:00+01:00\", \\n-- (file://n--)>       maxSample = 1, \\n-- (file://n--)>       metricId = (vim.PerformanceManager.MetricId) [\\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 162, \\n-- (file://n--)>             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 2, \\n-->             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 24, \\n-->             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 150, \\n-->             instance = \"\"\\n-->          }\\n-->       ], \\n-->       intervalId = 300, \\n-->       format = \"csv\"\\n-->    }, \\n-->    (vim.PerformanceManager.QuerySpec) {\\n-->       entity = 'vim.HostSystem:host-4234', \\n-->       startTime = \"2025-11-04T06:20:00+01:00\", \\n-- (file://n--)>       endTime = \"2025-11-04T06:25:00+01:00\", \\n-- (file://n--)>       maxSample = 1, \\n-- (file://n--)>       metricId = (vim.PerformanceManager.MetricId) [\\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 162, \\n-- (file://n--)>             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 2, \\n-->             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 24, \\n-->             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 150, \\n-->             instance = \"\"\\n-->          }\\n-->       ], \\n-->       intervalId = 300, \\n-->       format = \"csv\"\\n-->    }, \\n-->    (vim.PerformanceManager.QuerySpec) {\\n-->       entity = 'vim.HostSystem:host-202868', \\n-->       startTime = \"2025-11-04T06:20:00+01:00\", \\n-- (file://n--)>       endTime = \"2025-11-04T06:25:00+01:00\", \\n-- (file://n--)>       maxSample = 1, \\n-- (file://n--)>       metricId = (vim.PerformanceManager.MetricId) [\\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 162, \\n-- (file://n--)>             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 2, \\n-->             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 24, \\n-->             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 150, \\n-->             instance = \"\"\\n-->          }\\n-->       ], \\n-->       intervalId = 300, \\n-->       format = \"csv\"\\n-->    }, \\n-->    (vim.PerformanceManager.QuerySpec) {\\n-->       entity = 'vim.HostSystem:host-5327', \\n-->       startTime = \"2025-11-04T06:20:00+01:00\", \\n-- (file://n--)>       endTime = \"2025-11-04T06:25:00+01:00\", \\n-- (file://n--)>       maxSample = 1, \\n-- (file://n--)>       metricId = (vim.PerformanceManager.MetricId) [\\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 162, \\n-- (file://n--)>             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 2, \\n-->             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 24, \\n-->             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 150, \\n-->             instance = \"\"\\n-->          }\\n-->       ], \\n-->       intervalId = 300, \\n-->       format = \"csv\"\\n-->    }, \\n-->    (vim.PerformanceManager.QuerySpec) {\\n-->       entity = 'vim.HostSystem:host-132116', \\n-->       startTime = \"2025-11-04T06:20:00+01:00\", \\n-- (file://n--)>       endTime = \"2025-11-04T06:25:00+01:00\", \\n-- (file://n--)>       maxSample = 1, \\n-- (file://n--)>       metricId = (vim.PerformanceManager.MetricId) [\\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 162, \\n-- (file://n--)>             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 2, \\n-->             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 24, \\n-->             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 150, \\n-->             instance = \"\"\\n-->          }\\n-->       ], \\n-->       intervalId = 300, \\n-->       format = \"csv\"\\n-->    }, \\n-->    (vim.PerformanceManager.QuerySpec) {\\n-->       entity = 'vim.HostSystem:host-170027', \\n-->       startTime = \"2025-11-04T06:20:00+01:00\", \\n-- (file://n--)>       endTime = \"2025-11-04T06:25:00+01:00\", \\n-- (file://n--)>       maxSample = 1, \\n-- (file://n--)>       metricId = (vim.PerformanceManager.MetricId) [\\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 162, \\n-- (file://n--)>             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 2, \\n-->             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 24, \\n-->             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 150, \\n-->             instance = \"\"\\n-->          }\\n-->       ], \\n-->       intervalId = 300, \\n-->       format = \"csv\"\\n-->    }, \\n-->    (vim.PerformanceManager.QuerySpec) {\\n-->       entity = 'vim.HostSystem:host-131408', \\n-->       startTime = \"2025-11-04T06:20:00+01:00\", \\n-- (file://n--)>       endTime = \"2025-11-04T06:25:00+01:00\", \\n-- (file://n--)>       maxSample = 1, \\n-- (file://n--)>       metricId = (vim.PerformanceManager.MetricId) [\\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 162, \\n-- (file://n--)>             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 2, \\n-->             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 24, \\n-->             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 150, \\n-->             instance = \"\"\\n-->          }\\n-->       ], \\n-->       intervalId = 300, \\n-->       format = \"csv\"\\n-->    }, \\n-->    (vim.PerformanceManager.QuerySpec) {\\n-->       entity = 'vim.HostSystem:host-248170', \\n-->       startTime = \"2025-11-04T06:20:00+01:00\", \\n-- (file://n--)>       endTime = \"2025-11-04T06:25:00+01:00\", \\n-- (file://n--)>       maxSample = 1, \\n-- (file://n--)>       metricId = (vim.PerformanceManager.MetricId) [\\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 162, \\n-- (file://n--)>             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 2, \\n-->             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 24, \\n-->             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 150, \\n-->             instance = \"\"\\n-->          }\\n-->       ], \\n-->       intervalId = 300, \\n-->       format = \"csv\"\\n-->    }, \\n-->    (vim.PerformanceManager.QuerySpec) {\\n-->       entity = 'vim.HostSystem:host-11915', \\n-->       startTime = \"2025-11-04T06:20:00+01:00\", \\n-- (file://n--)>       endTime = \"2025-11-04T06:25:00+01:00\", \\n-- (file://n--)>       maxSample = 1, \\n-- (file://n--)>       metricId = (vim.PerformanceManager.MetricId) [\\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 162, \\n-- (file://n--)>             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 2, \\n-->             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 24, \\n-->             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 150, \\n-->             instance = \"\"\\n-->          }\\n-->       ], \\n-->       intervalId = 300, \\n-->       format = \"csv\"\\n-->    }, \\n-->    (vim.PerformanceManager.QuerySpec) {\\n-->       entity = 'vim.HostSystem:host-12360', \\n-->       startTime = \"2025-11-04T06:20:00+01:00\", \\n-- (file://n--)>       endTime = \"2025-11-04T06:25:00+01:00\", \\n-- (file://n--)>       maxSample = 1, \\n-- (file://n--)>       metricId = (vim.PerformanceManager.MetricId) [\\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 162, \\n-- (file://n--)>             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 2, \\n-->             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 24, \\n-->             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 150, \\n-->             instance = \"\"\\n-->          }\\n-->       ], \\n-->       intervalId = 300, \\n-->       format = \"csv\"\\n-->    }, \\n-->    (vim.PerformanceManager.QuerySpec) {\\n-->       entity = 'vim.HostSystem:host-171278', \\n-->       startTime = \"2025-11-04T06:20:00+01:00\", \\n-- (file://n--)>       endTime = \"2025-11-04T06:25:00+01:00\", \\n-- (file://n--)>       maxSample = 1, \\n-- (file://n--)>       metricId = (vim.PerformanceManager.MetricId) [\\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 162, \\n-- (file://n--)>             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 2, \\n-->             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 24, \\n-->             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 150, \\n-->             instance = \"\"\\n-->          }\\n-->       ], \\n-->       intervalId = 300, \\n-->       format = \"csv\"\\n-->    }, \\n-->    (vim.PerformanceManager.QuerySpec) {\\n-->       entity = 'vim.HostSystem:host-169977', \\n-->       startTime = \"2025-11-04T06:20:00+01:00\", \\n-- (file://n--)>       endTime = \"2025-11-04T06:25:00+01:00\", \\n-- (file://n--)>       maxSample = 1, \\n-- (file://n--)>       metricId = (vim.PerformanceManager.MetricId) [\\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 162, \\n-- (file://n--)>             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 2, \\n-->             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 24, \\n-->             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 150, \\n-->             instance = \"\"\\n-->          }\\n-->       ], \\n-->       intervalId = 300, \\n-->       format = \"csv\"\\n-->    }, \\n-->    (vim.PerformanceManager.QuerySpec) {\\n-->       entity = 'vim.HostSystem:host-12882', \\n-->       startTime = \"2025-11-04T06:20:00+01:00\", \\n-- (file://n--)>       endTime = \"2025-11-04T06:25:00+01:00\", \\n-- (file://n--)>       maxSample = 1, \\n-- (file://n--)>       metricId = (vim.PerformanceManager.MetricId) [\\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 162, \\n-- (file://n--)>             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 2, \\n-->             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 24, \\n-->             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 150, \\n-->             instance = \"\"\\n-->          }\\n-->       ], \\n-->       intervalId = 300, \\n-->       format = \"csv\"\\n-->    }, \\n-->    (vim.PerformanceManager.QuerySpec) {\\n-->       entity = 'vim.HostSystem:host-5370', \\n-->       startTime = \"2025-11-04T06:20:00+01:00\", \\n-- (file://n--)>       endTime = \"2025-11-04T06:25:00+01:00\", \\n-- (file://n--)>       maxSample = 1, \\n-- (file://n--)>       metricId = (vim.PerformanceManager.MetricId) [\\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 162, \\n-- (file://n--)>             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 2, \\n-->             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 24, \\n-->             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 150, \\n-->             instance = \"\"\\n-->          }\\n-->       ], \\n-->       intervalId = 300, \\n-->       format = \"csv\"\\n-->    }, \\n-->    (vim.PerformanceManager.QuerySpec) {\\n-->       entity = 'vim.HostSystem:host-5373', \\n-->       startTime = \"2025-11-04T06:20:00+01:00\", \\n-- (file://n--)>       endTime = \"2025-11-04T06:25:00+01:00\", \\n-- (file://n--)>       maxSample = 1, \\n-- (file://n--)>       metricId = (vim.PerformanceManager.MetricId) [\\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 162, \\n-- (file://n--)>             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 2, \\n-->             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 24, \\n-->             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 150, \\n-->             instance = \"\"\\n-->          }\\n-->       ], \\n-->       intervalId = 300, \\n-->       format = \"csv\"\\n-->    }, \\n-->    (vim.PerformanceManager.QuerySpec) {\\n-->       entity = 'vim.HostSystem:host-5330', \\n-->       startTime = \"2025-11-04T06:20:00+01:00\", \\n-- (file://n--)>       endTime = \"2025-11-04T06:25:00+01:00\", \\n-- (file://n--)>       maxSample = 1, \\n-- (file://n--)>       metricId = (vim.PerformanceManager.MetricId) [\\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 162, \\n-- (file://n--)>             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 2, \\n-->             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 24, \\n-->             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 150, \\n-->             instance = \"\"\\n-->          }\\n-->       ], \\n-->       intervalId = 300, \\n-->       format = \"csv\"\\n-->    }, \\n-->    (vim.PerformanceManager.QuerySpec) {\\n-->       entity = 'vim.HostSystem:host-36007', \\n-->       startTime = \"2025-11-04T06:20:00+01:00\", \\n-- (file://n--)>       endTime = \"2025-11-04T06:25:00+01:00\", \\n-- (file://n--)>       maxSample = 1, \\n-- (file://n--)>       metricId = (vim.PerformanceManager.MetricId) [\\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 162, \\n-- (file://n--)>             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 2, \\n-->             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 24, \\n-->             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 150, \\n-->             instance = \"\"\\n-->          }\\n-->       ], \\n-->       intervalId = 300, \\n-->       format = \"csv\"\\n-->    }, \\n-->    (vim.PerformanceManager.QuerySpec) {\\n-->       entity = 'vim.HostSystem:host-5376', \\n-->       startTime = \"2025-11-04T06:20:00+01:00\", \\n-- (file://n--)>       endTime = \"2025-11-04T06:25:00+01:00\", \\n-- (file://n--)>       maxSample = 1, \\n-- (file://n--)>       metricId = (vim.PerformanceManager.MetricId) [\\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 162, \\n-- (file://n--)>             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 2, \\n-->             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 24, \\n-->             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 150, \\n-->             instance = \"\"\\n-->          }\\n-->       ], \\n-->       intervalId = 300, \\n-->       format = \"csv\"\\n-->    }, \\n-->    (vim.PerformanceManager.QuerySpec) {\\n-->       entity = 'vim.HostSystem:host-5312', \\n-->       startTime = \"2025-11-04T06:20:00+01:00\", \\n-- (file://n--)>       endTime = \"2025-11-04T06:25:00+01:00\", \\n-- (file://n--)>       maxSample = 1, \\n-- (file://n--)>       metricId = (vim.PerformanceManager.MetricId) [\\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 162, \\n-- (file://n--)>             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 2, \\n-->             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 24, \\n-->             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 150, \\n-->             instance = \"\"\\n-->          }\\n-->       ], \\n-->       intervalId = 300, \\n-->       format = \"csv\"\\n-->    }, \\n-->    (vim.PerformanceManager.QuerySpec) {\\n-->       entity = 'vim.HostSystem:host-202535', \\n-->       startTime = \"2025-11-04T06:20:00+01:00\", \\n-- (file://n--)>       endTime = \"2025-11-04T06:25:00+01:00\", \\n-- (file://n--)>       maxSample = 1, \\n-- (file://n--)>       metricId = (vim.PerformanceManager.MetricId) [\\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 162, \\n-- (file://n--)>             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 2, \\n-->             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 24, \\n-->             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 150, \\n-->             instance = \"\"\\n-->          }\\n-->       ], \\n-->       intervalId = 300, \\n-->       format = \"csv\"\\n-->    }, \\n-->    (vim.PerformanceManager.QuerySpec) {\\n-->       entity = 'vim.HostSystem:host-202876', \\n-->       startTime = \"2025-11-04T06:20:00+01:00\", \\n-- (file://n--)>       endTime = \"2025-11-04T06:25:00+01:00\", \\n-- (file://n--)>       maxSample = 1, \\n-- (file://n--)>       metricId = (vim.PerformanceManager.MetricId) [\\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 162, \\n-- (file://n--)>             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 2, \\n-->             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 24, \\n-->             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 150, \\n-->             instance = \"\"\\n-->          }\\n-->       ], \\n-->       intervalId = 300, \\n-->       format = \"csv\"\\n-->    }, \\n-->    (vim.PerformanceManager.QuerySpec) {\\n-->       entity = 'vim.HostSystem:host-5877', \\n-->       startTime = \"2025-11-04T06:20:00+01:00\", \\n-- (file://n--)>       endTime = \"2025-11-04T06:25:00+01:00\", \\n-- (file://n--)>       maxSample = 1, \\n-- (file://n--)>       metricId = (vim.PerformanceManager.MetricId) [\\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 162, \\n-- (file://n--)>             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 2, \\n-->             instance = \"\"\\n-->          }, \\n-->          (vim.PerformanceManager.MetricId) {\\n-->             counterId = 24, \\n-->             instance = …}

Expected Behavior

The message should be normally processed and also show up in a search after being ingested. Furthermore, there should be no indication of a memory-leak by netty.

Current Behavior

No of the message is found by a searrch and once in a while, netty prints its leak records. Apart from this, even with TRACE-logging for org.graylog2.inputs, I couldn't see any exception in the logs.

Possible Solution

Steps to Reproduce (for bugs)

1. Set up a syslog TCP input
2. Send a message from above to the input, like cat msg1 | nc -N localhost 1514 - please change filename and port accordingly.
3. Check the search if the message shows up

The attached leak reports are very similar, but I've attached all I have to provide as much information as possible: leak_report_1.txt leak_report_2.txt leak_report_3.txt leak_report_4.txt leak_report_5.txt leak_report_6.txt leak_report_7.txt

Your Environment

• Graylog Version: 6.3.3
• Java Version: Adoptium 17.0.16
• OpenSearch Version: 2.15.0
• MongoDB Version: 6.0.26
• Operating System: Linux 5.15.0-143-generic

Checklist

• [x] This issue fix need to be backported.
• [ ] Does this issue have security implications?

[tellistone]

Promoting to current cycle (syslog input is one of the most used, and memory leaks of all forms are urgent).