telegraf icon indicating copy to clipboard operation
telegraf copied to clipboard

MQTT stops working after few minutes

Open userwithoutpassword opened this issue 4 months ago • 4 comments

Relevant telegraf.conf

[[inputs.mqtt_consumer]]

  servers = ["${MQTT_BROKER}"]

  ## Topics that will be subscribed to.
  topics = [
    "ZGW16-IP/#",
  ]

  topic_tag = "topic"

  username = "${MQTT_USER}"
  password = "${MQTT_PASSWORD}"

  data_format = "xpath_json"

  [inputs.mqtt_consumer.tags]
   bucket = "MQTT"

    [[inputs.mqtt_consumer.topic_parsing]]
      topic = "ZGW16-IP/devices/+/+"
      measurement = "_/_/_/measurement"
      tags = "_/_/device/_"
 

    [[inputs.mqtt_consumer.xpath]]
      timestamp = "timestamp"
      timestamp_format = "2006-01-02T15:04:05Z0700"

      [inputs.mqtt_consumer.xpath.tags]
       unit = "unit"

      [inputs.mqtt_consumer.xpath.fields]
       value = "number(value)"

Logs from Telegraf

n/a

System info

Proxmox, mqtt container

Docker

No response

Steps to reproduce

  1. Disconnect the ethernet connection for an hour or so
  2. Reconnect
  3. MQTT is writing data but stops after a few seconds

If you disconnect ethernet for a short period of time, lets say, 1 or 2 Minutes the problem does not occur. But longer disconnection time leads to problems.

userwithoutpassword avatar Sep 01 '25 21:09 userwithoutpassword

Do you see any logging output?

srebhan avatar Sep 08 '25 18:09 srebhan

Yes but not much.

2025-10-03T17:32:27Z D! [parsers.xpath_json::mqtt_consumer] Number of selected metric nodes: 1 2025-10-03T17:32:27Z D! [parsers.xpath_json::mqtt_consumer] Number of configs: 1 2025-10-03T17:32:27Z D! [parsers.xpath_json::mqtt_consumer] Number of selected metric nodes: 1 2025-10-03T17:32:27Z D! [parsers.xpath_json::mqtt_consumer] Number of configs: 1 2025-10-03T17:32:27Z D! [parsers.xpath_json::mqtt_consumer] Number of selected metric nodes: 1 2025-10-03T17:32:28Z D! [parsers.xpath_json::mqtt_consumer] Number of configs: 1 2025-10-03T17:32:28Z D! [parsers.xpath_json::mqtt_consumer] Number of selected metric nodes: 1 2025-10-03T17:32:28Z D! [parsers.xpath_json::mqtt_consumer] Number of configs: 1 2025-10-03T17:32:28Z D! [parsers.xpath_json::mqtt_consumer] Number of selected metric nodes: 1 2025-10-03T17:32:29Z D! [parsers.xpath_json::mqtt_consumer] Number of configs: 1 2025-10-03T17:32:29Z D! [parsers.xpath_json::mqtt_consumer] Number of selected metric nodes: 1 2025-10-03T17:32:29Z D! [parsers.xpath_json::mqtt_consumer] Number of configs: 1 2025-10-03T17:32:29Z D! [parsers.xpath_json::mqtt_consumer] Number of selected metric nodes: 1 2025-10-03T17:32:29Z D! [parsers.xpath_json::mqtt_consumer] Number of configs: 1 2025-10-03T17:32:29Z D! [parsers.xpath_json::mqtt_consumer] Number of selected metric nodes: 1 2025-10-03T17:32:29Z D! [parsers.xpath_json::mqtt_consumer] Number of configs: 1 2025-10-03T17:32:29Z D! [parsers.xpath_json::mqtt_consumer] Number of selected metric nodes: 1 2025-10-03T17:32:29Z D! [parsers.xpath_json::mqtt_consumer] Number of configs: 1 2025-10-03T17:32:29Z D! [parsers.xpath_json::mqtt_consumer] Number of selected metric nodes: 1 2025-10-03T17:32:30Z D! [parsers.xpath_json::mqtt_consumer] Number of configs: 1 2025-10-03T17:32:30Z D! [parsers.xpath_json::mqtt_consumer] Number of selected metric nodes: 1 2025-10-03T17:32:31Z D! [parsers.xpath_json::mqtt_consumer] Number of configs: 1 2025-10-03T17:32:31Z D! [parsers.xpath_json::mqtt_consumer] Number of selected metric nodes: 1 2025-10-03T17:32:31Z D! [parsers.xpath_json::mqtt_consumer] Number of configs: 1 2025-10-03T17:32:31Z D! [parsers.xpath_json::mqtt_consumer] Number of selected metric nodes: 1 2025-10-03T17:32:31Z D! [parsers.xpath_json::mqtt_consumer] Number of configs: 1 2025-10-03T17:32:31Z D! [parsers.xpath_json::mqtt_consumer] Number of selected metric nodes: 1 2025-10-03T17:32:31Z D! [parsers.xpath_json::mqtt_consumer] Number of configs: 1 2025-10-03T17:32:31Z D! [parsers.xpath_json::mqtt_consumer] Number of selected metric nodes: 1 2025-10-03T17:32:32Z D! [parsers.xpath_json::mqtt_consumer] Number of configs: 1 2025-10-03T17:32:32Z D! [parsers.xpath_json::mqtt_consumer] Number of selected metric nodes: 1 2025-10-03T17:32:32Z D! [outputs.influxdb_v2] Wrote batch of 33 metrics in 4.352777ms 2025-10-03T17:32:32Z D! [outputs.influxdb_v2] Buffer fullness: 0 / 10000 metrics 2025-10-03T17:32:33Z D! [parsers.xpath_json::mqtt_consumer] Number of configs: 1 2025-10-03T17:32:33Z D! [parsers.xpath_json::mqtt_consumer] Number of selected metric nodes: 1 2025-10-03T17:32:33Z D! [parsers.xpath_json::mqtt_consumer] Number of configs: 1 2025-10-03T17:32:33Z D! [parsers.xpath_json::mqtt_consumer] Number of selected metric nodes: 1 2025-10-03T17:32:33Z D! [parsers.xpath_json::mqtt_consumer] Number of configs: 1 2025-10-03T17:32:33Z D! [parsers.xpath_json::mqtt_consumer] Number of selected metric nodes: 1 2025-10-03T17:32:33Z D! [parsers.xpath_json::mqtt_consumer] Number of configs: 1 2025-10-03T17:32:33Z D! [parsers.xpath_json::mqtt_consumer] Number of selected metric nodes: 1 2025-10-03T17:32:33Z D! [parsers.xpath_json::mqtt_consumer] Number of configs: 1 2025-10-03T17:32:33Z D! [parsers.xpath_json::mqtt_consumer] Number of selected metric nodes: 1 2025-10-03T17:32:33Z D! [parsers.xpath_json::mqtt_consumer] Number of configs: 1 2025-10-03T17:32:33Z D! [parsers.xpath_json::mqtt_consumer] Number of selected metric nodes: 1 2025-10-03T17:32:34Z D! [parsers.xpath_json::mqtt_consumer] Number of configs: 1 2025-10-03T17:32:34Z D! [parsers.xpath_json::mqtt_consumer] Number of selected metric nodes: 1 2025-10-03T17:32:34Z D! [parsers.xpath_json::mqtt_consumer] Number of configs: 1 2025-10-03T17:32:34Z D! [parsers.xpath_json::mqtt_consumer] Number of selected metric nodes: 1 2025-10-03T17:32:34Z D! [parsers.xpath_json::mqtt_consumer] Number of configs: 1 2025-10-03T17:32:34Z D! [parsers.xpath_json::mqtt_consumer] Number of selected metric nodes: 1 2025-10-03T17:32:34Z D! [parsers.xpath_json::mqtt_consumer] Number of configs: 1 2025-10-03T17:32:34Z D! [parsers.xpath_json::mqtt_consumer] Number of selected metric nodes: 1 2025-10-03T17:32:34Z D! [parsers.xpath_json::mqtt_consumer] Number of configs: 1 2025-10-03T17:32:34Z D! [parsers.xpath_json::mqtt_consumer] Number of selected metric nodes: 1 2025-10-03T17:32:36Z D! [parsers.xpath_json::mqtt_consumer] Number of configs: 1 2025-10-03T17:32:36Z D! [parsers.xpath_json::mqtt_consumer] Number of selected metric nodes: 1 2025-10-03T17:32:36Z D! [parsers.xpath_json::mqtt_consumer] Number of configs: 1 2025-10-03T17:32:36Z D! [parsers.xpath_json::mqtt_consumer] Number of selected metric nodes: 1 2025-10-03T17:32:36Z D! [parsers.xpath_json::mqtt_consumer] Number of configs: 1 2025-10-03T17:32:36Z D! [parsers.xpath_json::mqtt_consumer] Number of selected metric nodes: 1 2025-10-03T17:32:36Z D! [parsers.xpath_json::mqtt_consumer] Number of configs: 1 2025-10-03T17:32:36Z D! [parsers.xpath_json::mqtt_consumer] Number of selected metric nodes: 1 2025-10-03T17:32:42Z D! [outputs.influxdb_v2] Wrote batch of 15 metrics in 3.820983ms 2025-10-03T17:32:42Z D! [outputs.influxdb_v2] Buffer fullness: 0 / 10000 metrics 2025-10-03T17:32:52Z D! [outputs.influxdb_v2] Buffer fullness: 0 / 10000 metrics 2025-10-03T17:33:02Z D! [outputs.influxdb_v2] Buffer fullness: 0 / 10000 metrics 2025-10-03T17:33:12Z D! [outputs.influxdb_v2] Buffer fullness: 0 / 10000 metrics 2025-10-03T17:33:22Z D! [outputs.influxdb_v2] Buffer fullness: 0 / 10000 metrics 2025-10-03T17:33:32Z D! [outputs.influxdb_v2] Buffer fullness: 0 / 10000 metrics 2025-10-03T17:33:42Z D! [outputs.influxdb_v2] Buffer fullness: 0 / 10000 metrics 2025-10-03T17:33:50Z D! [inputs.mqtt_consumer] Connecting [tcp://192.168.1.12:1883] 2025-10-03T17:33:50Z I! [inputs.mqtt_consumer] Connected [tcp://192.168.1.12:1883] 2025-10-03T17:33:52Z D! [outputs.influxdb_v2] Buffer fullness: 0 / 10000 metrics 2025-10-03T17:34:02Z D! [outputs.influxdb_v2] Buffer fullness: 0 / 10000 metrics 2025-10-03T17:34:12Z D! [outputs.influxdb_v2] Buffer fullness: 0 / 10000 metrics

suddently it stopped working...after around 4min30s more or less

userwithoutpassword avatar Oct 03 '25 17:10 userwithoutpassword

2025-10-03T17:33:22Z D! [outputs.influxdb_v2] Buffer fullness: 0 / 10000 metrics 2025-10-03T17:33:32Z D! [outputs.influxdb_v2] Buffer fullness: 0 / 10000 metrics 2025-10-03T17:33:42Z D! [outputs.influxdb_v2] Buffer fullness: 0 / 10000 metrics 2025-10-03T17:33:50Z D! [inputs.mqtt_consumer] Connecting [tcp://192.168.1.12:1883] 2025-10-03T17:33:50Z I! [inputs.mqtt_consumer] Connected [tcp://192.168.1.12:1883] 2025-10-03T17:33:52Z D! [outputs.influxdb_v2] Buffer fullness: 0 / 10000 metrics 2025-10-03T17:34:02Z D! [outputs.influxdb_v2] Buffer fullness: 0 / 10000 metrics 2025-10-03T17:34:12Z D! [outputs.influxdb_v2] Buffer fullness: 0 / 10000 metrics 2025-10-03T17:34:22Z D! [outputs.influxdb_v2] Buffer fullness: 0 / 10000 metrics 2025-10-03T17:34:32Z D! [outputs.influxdb_v2] Buffer fullness: 0 / 10000 metrics 2025-10-03T17:34:42Z D! [outputs.influxdb_v2] Buffer fullness: 0 / 10000 metrics 2025-10-03T17:34:52Z D! [outputs.influxdb_v2] Buffer fullness: 0 / 10000 metrics 2025-10-03T17:35:02Z D! [outputs.influxdb_v2] Buffer fullness: 0 / 10000 metrics 2025-10-03T17:35:10Z D! [inputs.mqtt_consumer] Connecting [tcp://192.168.1.12:1883] 2025-10-03T17:35:10Z I! [inputs.mqtt_consumer] Connected [tcp://192.168.1.12:1883] 2025-10-03T17:35:12Z D! [outputs.influxdb_v2] Buffer fullness: 0 / 10000 metrics 2025-10-03T17:35:22Z D! [outputs.influxdb_v2] Buffer fullness: 0 / 10000 metrics 2025-10-03T17:35:32Z D! [outputs.influxdb_v2] Buffer fullness: 0 / 10000 metrics 2025-10-03T17:35:42Z D! [outputs.influxdb_v2] Buffer fullness: 0 / 10000 metrics 2025-10-03T17:35:52Z D! [outputs.influxdb_v2] Buffer fullness: 0 / 10000 metrics 2025-10-03T17:36:02Z D! [outputs.influxdb_v2] Buffer fullness: 0 / 10000 metrics 2025-10-03T17:36:12Z D! [outputs.influxdb_v2] Buffer fullness: 0 / 10000 metrics 2025-10-03T17:36:22Z D! [outputs.influxdb_v2] Buffer fullness: 0 / 10000 metrics 2025-10-03T17:36:30Z D! [inputs.mqtt_consumer] Connecting [tcp://192.168.1.12:1883] 2025-10-03T17:36:30Z I! [inputs.mqtt_consumer] Connected [tcp://192.168.1.12:1883] 2025-10-03T17:36:32Z D! [outputs.influxdb_v2] Buffer fullness: 0 / 10000 metrics

there are reconnects from time to time, but not writing any data...

userwithoutpassword avatar Oct 03 '25 17:10 userwithoutpassword

any idea?

userwithoutpassword avatar Oct 10 '25 15:10 userwithoutpassword