ntopng icon indicating copy to clipboard operation
ntopng copied to clipboard

Published 20 hours ago • verified publisher icon ntop

local hosts show no traffic and no reports, and throw RRD error while all data is there..

Open jult opened this issue 1 year ago • 5 comments

Environment:

  • OS name: Debian bookworm
  • OS version: 12.4
  • Architecture: amd64
  • ntopng version/revision: 6.0.231229

What happened: nprobe receives full netflow (v9) from a core router, exports to ntopng on same host, plus SNMP feeds, but ntop fails to show per Host traffic graphs or traffic reports (see attached images), while the data is all there in the dashboard view, that shows totals for the WAN iface and Top charts, drilling down to per hosts bytes and sources etc is working as it should, except for when I'm in Hosts view. This is unexpected, because earlier (year ago) I would see this with the same config (see older screengrab).

How did you reproduce it? It is valid for each local host in the probed network. I've tried tagging timeseries on/off, storing reports on/off but to no avail.

Debug Information: Screenshot 2024-01-06 at 21-50-46 ntopng - Host 192 168 1 240 Screenshot 2024-01-06 at 21-50-06 ntopng - Host 192 168 1 240

See below when it still worked (in 2022), this was also on a debian machine, same config, older ntopng version (which -I must say- had a better looking layout for this purpose..);

Screenshot 2024-01-06 at 23-18-15 How to Configure Traffic Monitoring with ntopng on pfsense - YouTube Screenshot 2024-01-06 at 23-16-10 How to Configure Traffic Monitoring with ntopng on pfsense - YouTube

● ntopng.service - ntopng high-speed web-based traffic monitoring and analysis tool
     Loaded: loaded (/etc/systemd/system/ntopng.service; enabled; preset: enabled)
     Active: active (running) since Sat 2024-01-06 22:24:42 CET; 42min ago
   Main PID: 13568 (ntopng-main)
      Tasks: 41 (limit: 9242)
     Memory: 317.6M
        CPU: 5min 13.566s
     CGroup: /system.slice/ntopng.service
             └─13568 /usr/bin/ntopng /run/ntopng.conf

Jan 06 23:02:56 ntopng[13568]: 06/Jan/2024 23:02:56 [LuaEngine.cpp:1396] WARNING: Script failure [/usr/share/ntopng/scripts/lua/pro/rest/v2/get/host/top/ts_stats.lua][...ntopng/scripts/lua/pro/rest/v2/get/host/top/ts_stats.lua:31: attempt to index a nil value (local 'host_info')]
Jan 06 23:02:56 ntopng[13568]: 06/Jan/2024 23:02:56 [LuaEngine.cpp:1396] WARNING: Script failure [/usr/share/ntopng/scripts/lua/pro/rest/v2/get/host/top/ts_stats.lua][...ntopng/scripts/lua/pro/rest/v2/get/host/top/ts_stats.lua:31: attempt to index a nil value (local 'host_info')]
Jan 06 23:03:56 ntopng[13568]: 06/Jan/2024 23:03:56 [LuaEngine.cpp:1396] WARNING: Script failure [/usr/share/ntopng/scripts/lua/pro/rest/v2/get/host/top/ts_stats.lua][...ntopng/scripts/lua/pro/rest/v2/get/host/top/ts_stats.lua:31: attempt to index a nil value (local 'host_info')]
Jan 06 23:03:56 ntopng[13568]: 06/Jan/2024 23:03:56 [LuaEngine.cpp:1396] WARNING: Script failure [/usr/share/ntopng/scripts/lua/pro/rest/v2/get/host/top/ts_stats.lua][...ntopng/scripts/lua/pro/rest/v2/get/host/top/ts_stats.lua:31: attempt to index a nil value (local 'host_info')]
Jan 06 23:04:57 ntopng[13568]: 06/Jan/2024 23:04:57 [LuaEngine.cpp:1396] WARNING: Script failure [/usr/share/ntopng/scripts/lua/pro/rest/v2/get/host/top/ts_stats.lua][...ntopng/scripts/lua/pro/rest/v2/get/host/top/ts_stats.lua:31: attempt to index a nil value (local 'host_info')]
Jan 06 23:04:57 ntopng[13568]: 06/Jan/2024 23:04:57 [LuaEngine.cpp:1396] WARNING: Script failure [/usr/share/ntopng/scripts/lua/pro/rest/v2/get/host/top/ts_stats.lua][...ntopng/scripts/lua/pro/rest/v2/get/host/top/ts_stats.lua:31: attempt to index a nil value (local 'host_info')]
Jan 06 23:05:57 ntopng[13568]: 06/Jan/2024 23:05:57 [LuaEngine.cpp:1396] WARNING: Script failure [/usr/share/ntopng/scripts/lua/pro/rest/v2/get/host/top/ts_stats.lua][...ntopng/scripts/lua/pro/rest/v2/get/host/top/ts_stats.lua:31: attempt to index a nil value (local 'host_info')]
Jan 06 23:05:57 ntopng[13568]: 06/Jan/2024 23:05:57 [LuaEngine.cpp:1396] WARNING: Script failure [/usr/share/ntopng/scripts/lua/pro/rest/v2/get/host/top/ts_stats.lua][...ntopng/scripts/lua/pro/rest/v2/get/host/top/ts_stats.lua:31: attempt to index a nil value (local 'host_info')]
Jan 06 23:06:58 ntopng[13568]: 06/Jan/2024 23:06:58 [LuaEngine.cpp:1396] WARNING: Script failure [/usr/share/ntopng/scripts/lua/pro/rest/v2/get/host/top/ts_stats.lua][...ntopng/scripts/lua/pro/rest/v2/get/host/top/ts_stats.lua:31: attempt to index a nil value (local 'host_info')]
Jan 06 23:06:58 ntopng[13568]: 06/Jan/2024 23:06:58 [LuaEngine.cpp:1396] WARNING: Script failure [/usr/share/ntopng/scripts/lua/pro/rest/v2/get/host/top/ts_stats.lua][...ntopng/scripts/lua/pro/rest/v2/get/host/top/ts_stats.lua:31: attempt to index a nil value (local 'host_info')]

and the journal:

Jan 06 22:24:22 systemd[1]: Starting ntopng.service - ntopng high-speed web-based traffic monitoring and analysis tool...
Jan 06 22:24:22 systemd[1]: Started ntopng.service - ntopng high-speed web-based traffic monitoring and analysis tool.
Jan 06 22:24:22 ntopng[12143]: 06/Jan/2024 22:24:22 [Redis.cpp:164] Successfully connected to redis 127.0.0.1:6379@0
Jan 06 22:24:22 ntopng[12143]: 06/Jan/2024 22:24:22 [Redis.cpp:164] Successfully connected to redis 127.0.0.1:6379@0
Jan 06 22:24:22 ntopng[12143]: 06/Jan/2024 22:24:22 [NtopPro.cpp:342] [LICENSE] Reading license from /etc/ntopng.license
Jan 06 22:24:22 ntopng[12143]: 06/Jan/2024 22:24:22 [NtopPro.cpp:505] [LICENSE] /etc/ntopng.license: found valid Enterprise XL license
Jan 06 22:24:32 systemd[1]: Stopping ntopng.service - ntopng high-speed web-based traffic monitoring and analysis tool...
Jan 06 22:24:35 ntopng[12143]: 06/Jan/2024 22:24:35 [LuaEngine.cpp:1396] WARNING: Script failure [/usr/share/ntopng/scripts/lua/pro/rest/v2/get/host/top/ts_stats.lua][...ntopng/scripts/lua/pro/rest/v2/get/host/top/ts_stats.lua:31: attempt to index a nil value (local 'host_info')]
Jan 06 22:24:35 ntopng[12143]: 06/Jan/2024 22:24:35 [LuaEngine.cpp:1396] WARNING: Script failure [/usr/share/ntopng/scripts/lua/pro/rest/v2/get/host/top/ts_stats.lua][...ntopng/scripts/lua/pro/rest/v2/get/host/top/ts_stats.lua:31: attempt to index a nil value (local 'host_info')]
Jan 06 22:24:37 systemd[1]: ntopng.service: Deactivated successfully.
Jan 06 22:24:37 systemd[1]: Stopped ntopng.service - ntopng high-speed web-based traffic monitoring and analysis tool.
Jan 06 22:24:37 systemd[1]: ntopng.service: Consumed 2.602s CPU time.
Jan 06 22:24:41 systemd[1]: Starting ntopng.service - ntopng high-speed web-based traffic monitoring and analysis tool...
Jan 06 22:24:41 systemd[1]: ntopng.service: Control process exited, code=killed, status=15/TERM
Jan 06 22:24:41 systemd[1]: ntopng.service: Failed with result 'signal'.
Jan 06 22:24:41 systemd[1]: Stopped ntopng.service - ntopng high-speed web-based traffic monitoring and analysis tool.
Jan 06 22:24:42 systemd[1]: Starting ntopng.service - ntopng high-speed web-based traffic monitoring and analysis tool...
Jan 06 22:24:42 systemd[1]: Started ntopng.service - ntopng high-speed web-based traffic monitoring and analysis tool.
Jan 06 22:24:42 ntopng[13568]: 06/Jan/2024 22:24:42 [Redis.cpp:164] Successfully connected to redis 127.0.0.1:6379@0
Jan 06 22:24:42 ntopng[13568]: 06/Jan/2024 22:24:42 [Redis.cpp:164] Successfully connected to redis 127.0.0.1:6379@0
Jan 06 22:24:42 ntopng[13568]: 06/Jan/2024 22:24:42 [NtopPro.cpp:342] [LICENSE] Reading license from /etc/ntopng.license
Jan 06 22:24:42 ntopng[13568]: 06/Jan/2024 22:24:42 [NtopPro.cpp:505] [LICENSE] /etc/ntopng.license: found valid Enterprise XL license
Jan 06 22:25:36 ntopng[13568]: 06/Jan/2024 22:25:36 [LuaEngine.cpp:1396] WARNING: Script failure [/usr/share/ntopng/scripts/lua/pro/rest/v2/get/host/top/ts_stats.lua][...ntopng/scripts/lua/pro/rest/v2/get/host/top/ts_stats.lua:31: attempt to index a nil value (local 'host_info')]
Jan 06 22:25:36 ntopng[13568]: 06/Jan/2024 22:25:36 [LuaEngine.cpp:1396] WARNING: Script failure [/usr/share/ntopng/scripts/lua/pro/rest/v2/get/host/top/ts_stats.lua][...ntopng/scripts/lua/pro/rest/v2/get/host/top/ts_stats.lua:31: attempt to index a nil value (local 'host_info')]
Jan 06 22:26:36 ntopng[13568]: 06/Jan/2024 22:26:36 [LuaEngine.cpp:1396] WARNING: Script failure [/usr/share/ntopng/scripts/lua/pro/rest/v2/get/host/top/ts_stats.lua][...ntopng/scripts/lua/pro/rest/v2/get/host/top/ts_stats.lua:31: attempt to index a nil value (local 'host_info')]
Jan 06 22:26:36 ntopng[13568]: 06/Jan/2024 22:26:36 [LuaEngine.cpp:1396] WARNING: Script failure [/usr/share/ntopng/scripts/lua/pro/rest/v2/get/host/top/ts_stats.lua][...ntopng/scripts/lua/pro/rest/v2/get/host/top/ts_stats.lua:31: attempt to index a nil value (local 'host_info')]
Jan 06 22:27:37 ntopng[13568]: 06/Jan/2024 22:27:37 [LuaEngine.cpp:1396] WARNING: Script failure [/usr/share/ntopng/scripts/lua/pro/rest/v2/get/host/top/ts_stats.lua][...ntopng/scripts/lua/pro/rest/v2/get/host/top/ts_stats.lua:31: attempt to index a nil value (local 'host_info')]
Jan 06 22:27:37 ntopng[13568]: 06/Jan/2024 22:27:37 [LuaEngine.cpp:1396] WARNING: Script failure [/usr/share/ntopng/scripts/lua/pro/rest/v2/get/host/top/ts_stats.lua][...ntopng/scripts/lua/pro/rest/v2/get/host/top/ts_stats.lua:31: attempt to index a nil value (local 'host_info')]
Jan 06 22:28:38 ntopng[13568]: 06/Jan/2024 22:28:38 [LuaEngine.cpp:1396] WARNING: Script failure [/usr/share/ntopng/scripts/lua/pro/rest/v2/get/host/top/ts_stats.lua][...ntopng/scripts/lua/pro/rest/v2/get/host/top/ts_stats.lua:31: attempt to index a nil value (local 'host_info')]
Jan 06 22:28:38 ntopng[13568]: 06/Jan/2024 22:28:38 [LuaEngine.cpp:1396] WARNING: Script failure [/usr/share/ntopng/scripts/lua/pro/rest/v2/get/host/top/ts_stats.lua][...ntopng/scripts/lua/pro/rest/v2/get/host/top/ts_stats.lua:31: attempt to index a nil value (local 'host_info')]
Jan 06 22:29:38 ntopng[13568]: 06/Jan/2024 22:29:38 [LuaEngine.cpp:1396] WARNING: Script failure [/usr/share/ntopng/scripts/lua/pro/rest/v2/get/host/top/ts_stats.lua][...ntopng/scripts/lua/pro/rest/v2/get/host/top/ts_stats.lua:31: attempt to index a nil value (local 'host_info')]
Jan 06 22:29:38 ntopng[13568]: 06/Jan/2024 22:29:38 [LuaEngine.cpp:1396] WARNING: Script failure [/usr/share/ntopng/scripts/lua/pro/rest/v2/get/host/top/ts_stats.lua][...ntopng/scripts/lua/pro/rest/v2/get/host/top/ts_stats.lua:31: attempt to index a nil value (local 'host_info')]
Jan 06 22:30:39 ntopng[13568]: 06/Jan/2024 22:30:39 [LuaEngine.cpp:1396] WARNING: Script failure [/usr/share/ntopng/scripts/lua/pro/rest/v2/get/host/top/ts_stats.lua][...ntopng/scripts/lua/pro/rest/v2/get/host/top/ts_stats.lua:31: attempt to index a nil value (local 'host_info')]
Jan 06 22:30:39 ntopng[13568]: 06/Jan/2024 22:30:39 [LuaEngine.cpp:1396] WARNING: Script failure [/usr/share/ntopng/scripts/lua/pro/rest/v2/get/host/top/ts_stats.lua][...ntopng/scripts/lua/pro/rest/v2/get/host/top/ts_stats.lua:31: attempt to index a nil value (local 'host_info')]
Jan 06 22:31:40 ntopng[13568]: 06/Jan/2024 22:31:40 [LuaEngine.cpp:1396] WARNING: Script failure [/usr/share/ntopng/scripts/lua/pro/rest/v2/get/host/top/ts_stats.lua][...ntopng/scripts/lua/pro/rest/v2/get/host/top/ts_stats.lua:31: attempt to index a nil value (local 'host_info')]
Jan 06 22:31:40 ntopng[13568]: 06/Jan/2024 22:31:40 [LuaEngine.cpp:1396] WARNING: Script failure [/usr/share/ntopng/scripts/lua/pro/rest/v2/get/host/top/ts_stats.lua][...ntopng/scripts/lua/pro/rest/v2/get/host/top/ts_stats.lua:31: attempt to index a nil value (local 'host_info')]
Jan 06 22:32:41 ntopng[13568]: 06/Jan/2024 22:32:41 [LuaEngine.cpp:1396] WARNING: Script failure [/usr/share/ntopng/scripts/lua/pro/rest/v2/get/host/top/ts_stats.lua][...ntopng/scripts/lua/pro/rest/v2/get/host/top/ts_stats.lua:31: attempt to index a nil value (local 'host_info')]
Jan 06 22:32:41 ntopng[13568]: 06/Jan/2024 22:32:41 [LuaEngine.cpp:1396] WARNING: Script failure [/usr/share/ntopng/scripts/lua/pro/rest/v2/get/host/top/ts_stats.lua][...ntopng/scripts/lua/pro/rest/v2/get/host/top/ts_stats.lua:31: attempt to index a nil value (local 'host_info')]
Jan 06 22:33:41 ntopng[13568]: 06/Jan/2024 22:33:41 [LuaEngine.cpp:1396] WARNING: Script failure [/usr/share/ntopng/scripts/lua/pro/rest/v2/get/host/top/ts_stats.lua][...ntopng/scripts/lua/pro/rest/v2/get/host/top/ts_stats.lua:31: attempt to index a nil value (local 'host_info')]
Jan 06 22:33:41 ntopng[13568]: 06/Jan/2024 22:33:41 [LuaEngine.cpp:1396] WARNING: Script failure [/usr/share/ntopng/scripts/lua/pro/rest/v2/get/host/top/ts_stats.lua][...ntopng/scripts/lua/pro/rest/v2/get/host/top/ts_stats.lua:31: attempt to index a nil value (local 'host_info')]
Jan 06 22:34:42 ntopng[13568]: 06/Jan/2024 22:34:42 [LuaEngine.cpp:1396] WARNING: Script failure [/usr/share/ntopng/scripts/lua/pro/rest/v2/get/host/top/ts_stats.lua][...ntopng/scripts/lua/pro/rest/v2/get/host/top/ts_stats.lua:31: attempt to index a nil value (local 'host_info')]
Jan 06 22:34:42 ntopng[13568]: 06/Jan/2024 22:34:42 [LuaEngine.cpp:1396] WARNING: Script failure [/usr/share/ntopng/scripts/lua/pro/rest/v2/get/host/top/ts_stats.lua][...ntopng/scripts/lua/pro/rest/v2/get/host/top/ts_stats.lua:31: attempt to index a nil value (local 'host_info')]
Jan 06 22:35:43 ntopng[13568]: 06/Jan/2024 22:35:43 [LuaEngine.cpp:1396] WARNING: Script failure [/usr/share/ntopng/scripts/lua/pro/rest/v2/get/host/top/ts_stats.lua][...ntopng/scripts/lua/pro/rest/v2/get/host/top/ts_stats.lua:31: attempt to index a nil value (local 'host_info')]
Jan 06 22:35:43 ntopng[13568]: 06/Jan/2024 22:35:43 [LuaEngine.cpp:1396] WARNING: Script failure [/usr/share/ntopng/scripts/lua/pro/rest/v2/get/host/top/ts_stats.lua][...ntopng/scripts/lua/pro/rest/v2/get/host/top/ts_stats.lua:31: attempt to index a nil value (local 'host_info')]
Jan 06 22:36:43 ntopng[13568]: 06/Jan/2024 22:36:43 [LuaEngine.cpp:1396] WARNING: Script failure [/usr/share/ntopng/scripts/lua/pro/rest/v2/get/host/top/ts_stats.lua][...ntopng/scripts/lua/pro/rest/v2/get/host/top/ts_stats.lua:31: attempt to index a nil value (local 'host_info')]
Jan 06 22:36:43 ntopng[13568]: 06/Jan/2024 22:36:43 [LuaEngine.cpp:1396] WARNING: Script failure [/usr/share/ntopng/scripts/lua/pro/rest/v2/get/host/top/ts_stats.lua][...ntopng/scripts/lua/pro/rest/v2/get/host/top/ts_stats.lua:31: attempt to index a nil value (local 'host_info')]
Jan 06 22:37:44 ntopng[13568]: 06/Jan/2024 22:37:44 [LuaEngine.cpp:1396] WARNING: Script failure [/usr/share/ntopng/scripts/lua/pro/rest/v2/get/host/top/ts_stats.lua][...ntopng/scripts/lua/pro/rest/v2/get/host/top/ts_stats.lua:31: attempt to index a nil value (local 'host_info')]
Jan 06 22:37:44 ntopng[13568]: 06/Jan/2024 22:37:44 [LuaEngine.cpp:1396] WARNING: Script failure [/usr/share/ntopng/scripts/lua/pro/rest/v2/get/host/top/ts_stats.lua][...ntopng/scripts/lua/pro/rest/v2/get/host/top/ts_stats.lua:31: attempt to index a nil value (local 'host_info')]
Jan 06 22:38:44 ntopng[13568]: 06/Jan/2024 22:38:44 [LuaEngine.cpp:1396] WARNING: Script failure [/usr/share/ntopng/scripts/lua/pro/rest/v2/get/host/top/ts_stats.lua][...ntopng/scripts/lua/pro/rest/v2/get/host/top/ts_stats.lua:31: attempt to index a nil value (local 'host_info')]
Jan 06 22:38:44 ntopng[13568]: 06/Jan/2024 22:38:44 [LuaEngine.cpp:1396] WARNING: Script failure [/usr/share/ntopng/scripts/lua/pro/rest/v2/get/host/top/ts_stats.lua][...ntopng/scripts/lua/pro/rest/v2/get/host/top/ts_stats.lua:31: attempt to index a nil value (local 'host_info')]
Jan 06 22:39:44 ntopng[13568]: 06/Jan/2024 22:39:44 [LuaEngine.cpp:1396] WARNING: Script failure [/usr/share/ntopng/scripts/lua/pro/rest/v2/get/host/top/ts_stats.lua][...ntopng/scripts/lua/pro/rest/v2/get/host/top/ts_stats.lua:31: attempt to index a nil value (local 'host_info')]
Jan 06 22:39:44 ntopng[13568]: 06/Jan/2024 22:39:44 [LuaEngine.cpp:1396] WARNING: Script failure [/usr/share/ntopng/scripts/lua/pro/rest/v2/get/host/top/ts_stats.lua][...ntopng/scripts/lua/pro/rest/v2/get/host/top/ts_stats.lua:31: attempt to index a nil value (local 'host_info')]
Jan 06 22:40:45 ntopng[13568]: 06/Jan/2024 22:40:45 [LuaEngine.cpp:1396] WARNING: Script failure [/usr/share/ntopng/scripts/lua/pro/rest/v2/get/host/top/ts_stats.lua][...ntopng/scripts/lua/pro/rest/v2/get/host/top/ts_stats.lua:31: attempt to index a nil value (local 'host_info')]
Jan 06 22:40:45 ntopng[13568]: 06/Jan/2024 22:40:45 [LuaEngine.cpp:1396] WARNING: Script failure [/usr/share/ntopng/scripts/lua/pro/rest/v2/get/host/top/ts_stats.lua][...ntopng/scripts/lua/pro/rest/v2/get/host/top/ts_stats.lua:31: attempt to index a nil value (local 'host_info')]
etc ad nauseum..

jult avatar Jan 06 '24 22:01 jult

Hi @jult could you please share your ntopng configuration file?

MatteoBiscosi avatar Jan 08 '24 10:01 MatteoBiscosi

Hi @jult could you please share your ntopng configuration file?

-i=tcp://127.0.0.1:5556
-m=192.168.1.0/24
-n=1
-d=/var/lib/ntopng
-q=
-X=200000
-x=240000

but I suppose you mean the exported json (I wiped the logincreds etc..): configuration.json

jult avatar Jan 08 '24 13:01 jult

The Traffic report issue should be fixed now and a new build should be available in an hour or so. Could you please share the interface preferences on which it was not working? image

MatteoBiscosi avatar Jan 10 '24 18:01 MatteoBiscosi

I assume you mean the interface from which I want to see the flows; Screenshot 2024-01-11 at 17-08-01 ntopng - Details if If not, let me know, I'll gladly provide more details. It seems to work fine now, after having done an apt upgrade! I do miss the view where I could see on the right side what the traffic graph consisted of based on where the cursor is at, the way you see in: Screenshot 2024-01-06 at 23-18-15 How to Configure Traffic Monitoring with ntopng on pfsense - YouTube

Am I missing something that could make it look like that again?

jult avatar Jan 11 '24 16:01 jult

I am having the same issue. Top applications show up, but no host graphs. I am using InfluxDb and not RRD. Current version is 6.1.240207 (FreeBSD 14.0). I have all timeseries enabled.

image

image

dkggpeters avatar Feb 07 '24 15:02 dkggpeters

Hi @jult sorry for the late response, the data you could see before can now seen too, you just see them below the chart image

MatteoBiscosi avatar Feb 29 '24 09:02 MatteoBiscosi