hertzbeat icon indicating copy to clipboard operation
hertzbeat copied to clipboard
verified publisher icon apache

[BUG] Deploy to kubernetes failed using helm

Open ASCE1885 opened this issue 1 month ago • 0 comments

Is there an existing issue for this?

  • [x] I have searched the existing issues

Current Behavior

install script

helm repo add hertzbeat https://charts.hertzbeat.apache.org/
helm repo update
helm install hertzbeat hertzbeat/hertzbeat --version 1.7.3 \
  --namespace monitoring \
  --create-namespace

and hertzbeat-collector pod can be started successfully, but hertzbeat pod cannot be started successfully. The events of pod is:

Back-off restarting failed container hertzbeat in pod hertzbeat-797b7898b9-kjspx_monitoring(a3f90f2b-4cce-47df-a277-18578a3bb6bb)

and there are no useful log, the container log are as below:

-e Starting the HertzBeat apache-hertzbeat-1.7.3 ...

 WARNING: Unknown module: org.apache.arrow.memory.core specified to --add-opens

 17:54:58,710 |-INFO in ch.qos.logback.classic.LoggerContext[default] - This is logback-classic version 1.5.16

 17:54:58,713 |-INFO in ch.qos.logback.classic.util.ContextInitializer@fac80 - Here is a list of configurators discovered as a service, by rank: 

 17:54:58,713 |-INFO in ch.qos.logback.classic.util.ContextInitializer@fac80 -   org.springframework.boot.logging.logback.RootLogLevelConfigurator

 17:54:58,713 |-INFO in ch.qos.logback.classic.util.ContextInitializer@fac80 - They will be invoked in order until ExecutionStatus.DO_NOT_INVOKE_NEXT_IF_ANY is returned.

 17:54:58,713 |-INFO in ch.qos.logback.classic.util.ContextInitializer@fac80 - Constructed configurator of type class org.springframework.boot.logging.logback.RootLogLevelConfigurator

 17:54:58,728 |-INFO in ch.qos.logback.classic.util.ContextInitializer@fac80 - org.springframework.boot.logging.logback.RootLogLevelConfigurator.configure() call lasted 0 milliseconds. ExecutionStatus=INVOKE_NEXT_IF_ANY

 17:54:58,728 |-INFO in ch.qos.logback.classic.util.ContextInitializer@fac80 - Trying to configure with ch.qos.logback.classic.joran.SerializedModelConfigurator

 17:54:58,728 |-INFO in ch.qos.logback.classic.util.ContextInitializer@fac80 - Constructed configurator of type class ch.qos.logback.classic.joran.SerializedModelConfigurator

 17:54:58,732 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Could NOT find resource [logback-test.scmo]

 17:54:58,732 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Could NOT find resource [logback.scmo]

 17:54:58,732 |-INFO in ch.qos.logback.classic.util.ContextInitializer@fac80 - ch.qos.logback.classic.joran.SerializedModelConfigurator.configure() call lasted 4 milliseconds. ExecutionStatus=INVOKE_NEXT_IF_ANY

 17:54:58,732 |-INFO in ch.qos.logback.classic.util.ContextInitializer@fac80 - Trying to configure with ch.qos.logback.classic.util.DefaultJoranConfigurator

 17:54:58,733 |-INFO in ch.qos.logback.classic.util.ContextInitializer@fac80 - Constructed configurator of type class ch.qos.logback.classic.util.DefaultJoranConfigurator

 17:54:58,734 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Could NOT find resource [logback-test.xml]

 17:54:58,734 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Could NOT find resource [logback.xml]

 17:54:58,734 |-INFO in ch.qos.logback.classic.util.ContextInitializer@fac80 - ch.qos.logback.classic.util.DefaultJoranConfigurator.configure() call lasted 1 milliseconds. ExecutionStatus=INVOKE_NEXT_IF_ANY

 17:54:58,734 |-INFO in ch.qos.logback.classic.util.ContextInitializer@fac80 - Trying to configure with ch.qos.logback.classic.BasicConfigurator

 17:54:58,735 |-INFO in ch.qos.logback.classic.util.ContextInitializer@fac80 - Constructed configurator of type class ch.qos.logback.classic.BasicConfigurator

 17:54:58,735 |-INFO in ch.qos.logback.classic.BasicConfigurator@726386ed - Setting up default configuration.

 17:54:58,754 |-INFO in ch.qos.logback.core.ConsoleAppender[console] - BEWARE: Writing to the console can be very slow. Avoid logging to the 

 17:54:58,754 |-INFO in ch.qos.logback.core.ConsoleAppender[console] - console in production environments, especially in high volume systems.

 17:54:58,754 |-INFO in ch.qos.logback.core.ConsoleAppender[console] - See also https://logback.qos.ch/codes.html#slowConsole

 17:54:58,754 |-INFO in ch.qos.logback.classic.util.ContextInitializer@fac80 - ch.qos.logback.classic.BasicConfigurator.configure() call lasted 19 milliseconds. ExecutionStatus=NEUTRAL

 17:54:59,311 |-INFO in ch.qos.logback.classic.model.processor.ConfigurationModelHandlerFull - Registering a new ReconfigureOnChangeTask ReconfigureOnChangeTask(born:1762509299310)

 17:54:59,311 |-INFO in ch.qos.logback.classic.model.processor.ConfigurationModelHandlerFull - No 'scanPeriod' specified. Defaulting to 1 minutes

 17:54:59,312 |-INFO in ch.qos.logback.classic.model.processor.ConfigurationModelHandlerFull - Will scan for changes in [ConfigurationWatchList(mainURL=file:/opt/hertzbeat/config/logback-spring.xml, fileWatchList={/opt/hertzbeat/config/logback-spring.xml}, urlWatchList=[})] 

 17:54:59,312 |-INFO in ch.qos.logback.classic.model.processor.ConfigurationModelHandlerFull - Setting ReconfigureOnChangeTask scanning period to 1 minutes

 17:54:59,314 |-WARN in ch.qos.logback.core.model.processor.AppenderModelHandler - Appender named [ConsoleAppender] not referenced. Skipping further processing.

 17:54:59,314 |-INFO in ch.qos.logback.core.model.processor.AppenderModelHandler - Processing appender named [SystemOutFileAppender]

 17:54:59,314 |-INFO in ch.qos.logback.core.model.processor.AppenderModelHandler - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]

 17:54:59,321 |-INFO in ch.qos.logback.core.model.processor.ModelInterpretationContext@649f2009 - value "logs/hertzbeat-797b7898b9-kjspx11-%d{yyyy-MM-dd}.%i.log.zip" substituted for "logs/${application_name}-%d{yyyy-MM-dd}.%i.log.zip"

 17:54:59,325 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@347808407 - setting totalSizeCap to 5 GB

 17:54:59,334 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@347808407 - Will use zip compression

 17:54:59,334 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@347808407 - Will use the pattern logs/hertzbeat-797b7898b9-kjspx11-%d{yyyy-MM-dd}.%i.log for the active file

 17:54:59,334 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@69adf72c - SizeAndTimeBasedFNATP class was renamed as SizeAndTimeBasedFileNamingAndTriggeringPolicy.

 17:54:59,357 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@69adf72c - The date pattern is 'yyyy-MM-dd' from file name pattern 'logs/hertzbeat-797b7898b9-kjspx11-%d{yyyy-MM-dd}.%i.log.zip'.

 17:54:59,357 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@69adf72c - Roll-over at midnight.

 17:54:59,363 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@69adf72c - Setting initial period to 2025-11-07T09:54:59.363Z

 17:54:59,363 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@69adf72c - Direct use of either SizeAndTimeBasedFNATP or SizeAndTimeBasedFileNamingAndTriggeringPolicy 

 17:54:59,363 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@69adf72c - is deprecated. Please use SizeAndTimeBasedRollingPolicy instead.

 17:54:59,363 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@69adf72c - For more information see https://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy

 17:54:59,364 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@347808407 - Cleaning on start up

 17:54:59,365 |-INFO in c.q.l.core.rolling.helper.TimeBasedArchiveRemover - first clean up after appender initialization

 17:54:59,365 |-INFO in c.q.l.core.rolling.helper.TimeBasedArchiveRemover - Multiple periods, i.e. 32 periods, seem to have elapsed. This is expected at application start.

 17:54:59,370 |-INFO in c.q.l.core.rolling.helper.TimeBasedArchiveRemover - No removal attempts were made.

 17:54:59,382 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[SystemOutFileAppender] - Active log file name: logs/hertzbeat-797b7898b9-kjspx11-2025-11-07.0.log

 17:54:59,383 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[SystemOutFileAppender] - File property is set to [null]

 17:54:59,383 |-INFO in ch.qos.logback.core.model.processor.AppenderModelHandler - Processing appender named [ErrOutFileAppender]

 17:54:59,383 |-INFO in ch.qos.logback.core.model.processor.AppenderModelHandler - About to instantiate appender of type [ch.qos.logback.core.rolling.RollingFileAppender]

 17:54:59,383 |-INFO in ch.qos.logback.core.model.processor.ModelInterpretationContext@649f2009 - value "logs/hertzbeat-797b7898b9-kjspx11-%d{yyyy-MM-dd}-error.%i.log.zip" substituted for "logs/${application_name}-%d{yyyy-MM-dd}-error.%i.log.zip"

 17:54:59,384 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@127356954 - setting totalSizeCap to 5 GB

 17:54:59,384 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@127356954 - Will use zip compression

 17:54:59,384 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@127356954 - Will use the pattern logs/hertzbeat-797b7898b9-kjspx11-%d{yyyy-MM-dd}-error.%i.log for the active file

 17:54:59,384 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@1a15b789 - SizeAndTimeBasedFNATP class was renamed as SizeAndTimeBasedFileNamingAndTriggeringPolicy.

 17:54:59,385 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@1a15b789 - The date pattern is 'yyyy-MM-dd' from file name pattern 'logs/hertzbeat-797b7898b9-kjspx11-%d{yyyy-MM-dd}-error.%i.log.zip'.

 17:54:59,385 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@1a15b789 - Roll-over at midnight.

 17:54:59,385 |-INFO in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@1a15b789 - Setting initial period to 2025-11-07T09:54:59.385Z

 17:54:59,385 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@1a15b789 - Direct use of either SizeAndTimeBasedFNATP or SizeAndTimeBasedFileNamingAndTriggeringPolicy 

 17:54:59,385 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@1a15b789 - is deprecated. Please use SizeAndTimeBasedRollingPolicy instead.

 17:54:59,385 |-WARN in ch.qos.logback.core.rolling.SizeAndTimeBasedFNATP@1a15b789 - For more information see https://logback.qos.ch/manual/appenders.html#SizeAndTimeBasedRollingPolicy

 17:54:59,385 |-INFO in c.q.l.core.rolling.TimeBasedRollingPolicy@127356954 - Cleaning on start up

 17:54:59,385 |-INFO in c.q.l.core.rolling.helper.TimeBasedArchiveRemover - first clean up after appender initialization

 17:54:59,386 |-INFO in c.q.l.core.rolling.helper.TimeBasedArchiveRemover - Multiple periods, i.e. 32 periods, seem to have elapsed. This is expected at application start.

 17:54:59,387 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[ErrOutFileAppender] - Active log file name: logs/hertzbeat-797b7898b9-kjspx11-2025-11-07-error.0.log

 17:54:59,387 |-INFO in ch.qos.logback.core.rolling.RollingFileAppender[ErrOutFileAppender] - File property is set to [null]

 17:54:59,387 |-INFO in ch.qos.logback.core.model.processor.AppenderModelHandler - Processing appender named [OpenTelemetryAppender]

 17:54:59,387 |-INFO in ch.qos.logback.core.model.processor.AppenderModelHandler - About to instantiate appender of type [io.opentelemetry.instrumentation.logback.appender.v1_0.OpenTelemetryAppender]

 17:54:59,390 |-WARN in ch.qos.logback.core.model.processor.ImplicitModelHandler - Ignoring unknown property [pattern] in [io.opentelemetry.instrumentation.logback.appender.v1_0.OpenTelemetryAppender]

 17:54:59,392 |-INFO in c.q.l.core.rolling.helper.TimeBasedArchiveRemover - No removal attempts were made.

 17:54:59,398 |-INFO in ch.qos.logback.classic.model.processor.LoggerModelHandler - Setting level of logger [org.springframework] to INFO

 17:54:59,398 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@57f791c6 - Propagating INFO level on Logger[org.springframework] onto the JUL framework

 17:54:59,399 |-INFO in ch.qos.logback.classic.model.processor.LoggerModelHandler - Setting level of logger [org.json] to ERROR

 17:54:59,399 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@57f791c6 - Propagating ERROR level on Logger[org.json] onto the JUL framework

 17:54:59,399 |-INFO in ch.qos.logback.classic.model.processor.LoggerModelHandler - Setting level of logger [io.netty] to INFO

 17:54:59,399 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@57f791c6 - Propagating INFO level on Logger[io.netty] onto the JUL framework

 17:54:59,399 |-INFO in ch.qos.logback.classic.model.processor.LoggerModelHandler - Setting level of logger [org.slf4j] to INFO

 17:54:59,399 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@57f791c6 - Propagating INFO level on Logger[org.slf4j] onto the JUL framework

 17:54:59,399 |-INFO in ch.qos.logback.classic.model.processor.LoggerModelHandler - Setting level of logger [ch.qos.logback] to WARN

 17:54:59,399 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@57f791c6 - Propagating WARN level on Logger[ch.qos.logback] onto the JUL framework

 17:54:59,399 |-INFO in ch.qos.logback.classic.model.processor.LoggerModelHandler - Setting level of logger [org.hibernate] to INFO

 17:54:59,399 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@57f791c6 - Propagating INFO level on Logger[org.hibernate] onto the JUL framework

 17:54:59,399 |-INFO in ch.qos.logback.classic.model.processor.LoggerModelHandler - Setting level of logger [org.apache.http] to INFO

 17:54:59,399 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@57f791c6 - Propagating INFO level on Logger[org.apache.http] onto the JUL framework

 17:54:59,399 |-INFO in ch.qos.logback.classic.model.processor.LoggerModelHandler - Setting level of logger [com.zaxxer] to INFO

 17:54:59,399 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@57f791c6 - Propagating INFO level on Logger[com.zaxxer] onto the JUL framework

 17:54:59,399 |-INFO in ch.qos.logback.classic.model.processor.LoggerModelHandler - Setting level of logger [springfox] to INFO

 17:54:59,399 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@57f791c6 - Propagating INFO level on Logger[springfox] onto the JUL framework

 17:54:59,399 |-INFO in ch.qos.logback.classic.model.processor.LoggerModelHandler - Setting level of logger [org.mongodb] to WARN

 17:54:59,399 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@57f791c6 - Propagating WARN level on Logger[org.mongodb] onto the JUL framework

 17:54:59,399 |-INFO in ch.qos.logback.classic.model.processor.LoggerModelHandler - Setting level of logger [io.greptime] to WARN

 17:54:59,399 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@57f791c6 - Propagating WARN level on Logger[io.greptime] onto the JUL framework

 17:54:59,399 |-INFO in ch.qos.logback.classic.model.processor.LoggerModelHandler - Setting level of logger [org.apache.kafka] to WARN

 17:54:59,400 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@57f791c6 - Propagating WARN level on Logger[org.apache.kafka] onto the JUL framework

 17:54:59,400 |-INFO in ch.qos.logback.classic.model.processor.LoggerModelHandler - Setting level of logger [io.opentelemetry] to INFO

 17:54:59,400 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@57f791c6 - Propagating INFO level on Logger[io.opentelemetry] onto the JUL framework

 17:54:59,400 |-INFO in ch.qos.logback.classic.model.processor.RootLoggerModelHandler - Setting level of ROOT logger to INFO

 17:54:59,400 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@57f791c6 - Propagating INFO level on Logger[ROOT] onto the JUL framework

 17:54:59,400 |-INFO in ch.qos.logback.core.model.processor.AppenderRefModelHandler - Attaching appender named [SystemOutFileAppender] to Logger[ROOT]

 17:54:59,400 |-INFO in ch.qos.logback.core.model.processor.AppenderRefModelHandler - Attaching appender named [ErrOutFileAppender] to Logger[ROOT]

 17:54:59,400 |-INFO in ch.qos.logback.core.model.processor.AppenderRefModelHandler - Attaching appender named [OpenTelemetryAppender] to Logger[ROOT]

 17:54:59,400 |-INFO in ch.qos.logback.classic.model.processor.LoggerModelHandler - Setting level of logger [com.obs.services.AbstractClient] to OFF

 17:54:59,400 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@57f791c6 - Propagating OFF level on Logger[com.obs.services.AbstractClient] onto the JUL framework

 17:54:59,403 |-INFO in ch.qos.logback.classic.model.processor.LoggerModelHandler - Setting additivity of logger [com.obs.services.AbstractClient] to false

 17:54:59,403 |-INFO in ch.qos.logback.classic.model.processor.LoggerModelHandler - Setting level of logger [com.obs.services.internal.RestStorageService] to OFF

 17:54:59,403 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@57f791c6 - Propagating OFF level on Logger[com.obs.services.internal.RestStorageService] onto the JUL framework

 17:54:59,404 |-INFO in ch.qos.logback.classic.model.processor.LoggerModelHandler - Setting additivity of logger [com.obs.services.internal.RestStorageService] to false

 17:54:59,404 |-INFO in ch.qos.logback.classic.model.processor.LoggerModelHandler - Setting level of logger [com.obs.log.AccessLogger] to OFF

 17:54:59,404 |-INFO in ch.qos.logback.classic.jul.LevelChangePropagator@57f791c6 - Propagating OFF level on Logger[com.obs.log.AccessLogger] onto the JUL framework

 17:54:59,404 |-INFO in ch.qos.logback.classic.model.processor.LoggerModelHandler - Setting additivity of logger [com.obs.log.AccessLogger] to false

 17:54:59,404 |-INFO in ch.qos.logback.core.model.processor.DefaultProcessor@51650883 - End of configuration.

 17:54:59,404 |-INFO in org.springframework.boot.logging.logback.SpringBootJoranConfigurator@6c4f9535 - Registering current configuration as safe fallback point

 

   _   _           _       ____             _

  | | | | ___ _ __| |_ ___| __ )  ___  __ _| |_

  | |_| |/ _ \ '__| __|_  /  _ \ / _ \/ _` | __|        Profile: prod

  |  _  |  __/ |  | |_ / /| |_) |  __/ (_| | |_         Name: hertzbeat-797b7898b9-kjspx11 Port: 1157 Pid: 11

  |_| |_|\___|_|   \__/___|____/ \___|\__,_|\__|        https://hertzbeat.apache.org/

Expected Behavior

No response

Steps To Reproduce

No response

Environment

HertzBeat version(s):

Debug logs

No response

Anything else?

No response

ASCE1885 avatar Nov 07 '25 09:11 ASCE1885