Check for open file descriptors
Use a check to verify that there are not too many open file descriptors.
Hint:
for p in $(pidof icinga2); do echo -e "$p\r\n" && lsof -p $p && echo -e "\n"; done
Keep in mind that sockets count into this as well, so with many endpoint connections this is a "normal" expected behaviour. The stats as numbers, compared to the system limits (ulimit) are interesting over time.
A check over time might not be possible with the current implementation of diagnostics. But I planned for fetching the currently set limits and compare them to the actual use.
Thanks for the hint with the sockets.
You'll likely have other tasks where you need some data points in say 5 or 10 seconds. This could be added in there as well. Similar to what vmstat does.
ref/NC/628417