thingsboard-gateway icon indicating copy to clipboard operation
thingsboard-gateway copied to clipboard

Gateway 3.7.6 Cannot send message to platform

Open pro100805 opened this issue 4 months ago • 6 comments

thingsboard-gateway.service - ThingsBoard Gateway Loaded: loaded (/etc/systemd/system/thingsboard-gateway.service; enabled; preset: enabled) Active: active (running) since Tue 2025-08-05 21:38:07 CEST; 4 days ago Main PID: 6349 (python3) Tasks: 21 (limit: 1045) Memory: 225.7M CPU: 1d 2h 49min 33.647s CGroup: /system.slice/thingsboard-gateway.service └─6349 /var/lib/thingsboard_gateway/venv/bin/python3 -c "from thingsboard_gateway.tb_gateway import daemon; daemon()"

Aug 10 18:44:26 debian python3[6349]: 2025-08-10 18:44:26 - |WARNING| - [tb_device_mqtt.py] - tb_device_mqtt - __send_split_message - 1169 - Cannot send message to platform in 75 seconds, queue size exceeded, current max inflight messages: 80, max queued messages: 50000. Aug 10 18:44:26 debian python3[6349]: 2025-08-10 18:44:26 - |WARNING| - [tb_device_mqtt.py] - tb_device_mqtt - __send_split_message - 1169 - Cannot send message to platform in 79 seconds, queue size exceeded, current max inflight messages: 80, max queued messages: 50000. Aug 10 18:44:26 debian python3[6349]: 2025-08-10 18:44:26 - |WARNING| - [tb_device_mqtt.py] - tb_device_mqtt - __send_split_message - 1169 - Cannot send message to platform in 68 seconds, queue size exceeded, current max inflight messages: 80, max queued messages: 50000. Aug 10 18:44:26 debian python3[6349]: 2025-08-10 18:44:26 - |WARNING| - [tb_device_mqtt.py] - tb_device_mqtt - __send_split_message - 1169 - Cannot send message to platform in 75 seconds, queue size exceeded, current max inflight messages: 80, max queued messages: 50000. Aug 10 18:44:26 debian python3[6349]: 2025-08-10 18:44:26 - |WARNING| - [tb_device_mqtt.py] - tb_device_mqtt - __send_split_message - 1169 - Cannot send message to platform in 80 seconds, queue size exceeded, current max inflight messages: 80, max queued messages: 50000. Aug 10 18:44:26 debian python3[6349]: 2025-08-10 18:44:26 - |WARNING| - [tb_device_mqtt.py] - tb_device_mqtt - __send_split_message - 1169 - Cannot send message to platform in 68 seconds, queue size exceeded, current max inflight messages: 80, max queued messages: 50000. Aug 10 18:44:26 debian python3[6349]: 2025-08-10 18:44:26 - |WARNING| - [tb_device_mqtt.py] - tb_device_mqtt - __send_split_message - 1169 - Cannot send message to platform in 75 seconds, queue size exceeded, current max inflight messages: 80, max queued messages: 50000. Aug 10 18:44:26 debian python3[6349]: 2025-08-10 18:44:26 - |WARNING| - [tb_device_mqtt.py] - tb_device_mqtt - __send_split_message - 1169 - Cannot send message to platform in 80 seconds, queue size exceeded, current max inflight messages: 80, max queued messages: 50000. Aug 10 18:44:26 debian python3[6349]: 2025-08-10 18:44:26 - |WARNING| - [tb_device_mqtt.py] - tb_device_mqtt - __send_split_message - 1169 - Cannot send message to platform in 68 seconds, queue size exceeded, current max inflight messages: 80, max queued messages: 50000. Aug 10 18:44:26 debian python3[6349]: 2025-08-10 18:44:26 - |WARNING| - [tb_device_mqtt.py] - tb_device_mqtt - __send_split_message - 1169 - Cannot send message to platform in 75 seconds, queue size exceeded, current max inflight messages: 80, max queued messages: 50000.

pro100805 avatar Aug 10 '25 16:08 pro100805

Disconnecting/connecting connectors had no effect. Worked normally after restarting the service.

pro100805 avatar Aug 10 '25 16:08 pro100805

Hi, I have the same problem.

""2025-08-19 09:32:17" - |INFO| - [bmt_connector.py] - bmt_connector - __convert_data - 839 - Confirmation Sent"
""2025-08-19 09:32:17" - |INFO| - [bmt_connector.py] - bmt_connector - __convert_data - 841 - BMT Connector"
""2025-08-19 09:32:17" - |WARNING| - [tb_device_mqtt.py] - tb_device_mqtt - __send_split_message - 1169 - Cannot send message to platform in 41031 seconds, queue size exceeded, current max inflight messages: 0, max queued messages: 0."
""2025-08-19 09:32:17" - |WARNING| - [tb_device_mqtt.py] - tb_device_mqtt - __send_split_message - 1169 - Cannot send message to platform in 41030 seconds, queue size exceeded, current max inflight messages: 0, max queued messages: 0."
""2025-08-19 09:32:17" - |WARNING| - [tb_device_mqtt.py] - tb_device_mqtt - __send_split_message - 1169 - Cannot send message to platform in 40977 seconds, queue size exceeded, current max inflight messages: 0, max queued messages: 0."
""2025-08-19 09:32:17" - |WARNING| - [tb_device_mqtt.py] - tb_device_mqtt - __send_split_message - 1169 - Cannot send message to platform in 41011 seconds, queue size exceeded, current max inflight messages: 0, max queued messages: 0."
""2025-08-19 09:32:17" - |INFO| - [bmt_connector.py] - bmt_connector - __convert_data - 770 - 438"

maghibus avatar Aug 19 '25 09:08 maghibus

same problem

2025-08-27 13:47:03 - |WARNING| - [tb_device_mqtt.py] - tb_device_mqtt - __send_split_message - 1169 - Cannot send message to platform in 374 seconds, queue size exceeded, current max inflight messages: 0, max queued messages: 0.
2025-08-27 13:47:03 - |WARNING| - [tb_device_mqtt.py] - tb_device_mqtt - __send_split_message - 1169 - Cannot send message to platform in 212 seconds, queue size exceeded, current max inflight messages: 0, max queued messages: 0.

arthuryunze avatar Aug 27 '25 08:08 arthuryunze

Hi @pro100805, @maghibus, @arthuryunze, thanks for your interest in ThingsBoard IoT Gateway! Could you write the steps to reproduce, including config files and DEBUG logs? Also, could you confirm that this bug is reproducible on Gateway 3.7.7?

samson0v avatar Sep 04 '25 11:09 samson0v

Hi @samson0v, thank you for keeping this thread updated. I can confirm that the issue is still present in v3.7.7.

From my point of view, the root cause is related to connection problems between the gateway and the MQTT broker. When the connection is unstable or temporarily unavailable, the gateway cannot send messages, and since the MQTT client (tb_device_mqtt.py) has limited buffer capacity (max_inflight_messages, max_queued_messages), the queue fills up quickly and triggers the warning.

In other words, the problem seems to appear not because of the server itself, but when the gateway experiences connectivity issues with the broker.

maghibus avatar Sep 04 '25 12:09 maghibus

Hi @samson0v

Same error for me. Is there a solution?

szdavid0504 avatar Nov 15 '25 14:11 szdavid0504