qubes-mirage-firewall icon indicating copy to clipboard operation
qubes-mirage-firewall copied to clipboard

meminfo logspam after some uptime

Open xaki23 opened this issue 1 year ago • 12 comments

[2022-12-11 21:00:22] 2022-12-11 20:00:22 -00:00: INF [memory_pressure] Writing meminfo: free 30MiB / 37MiB (80.11 %)

[2022-12-12 04:16:04] 2022-12-12 03:16:03 -00:00: INF [memory_pressure] Writing meminfo: free 23MiB / 37MiB (59.97 %)
[2022-12-12 17:15:51] 2022-12-12 16:15:51 -00:00: INF [memory_pressure] Writing meminfo: free 22MiB / 37MiB (59.72 %)
[2022-12-12 18:16:07] 2022-12-12 17:16:07 -00:00: INF [memory_pressure] Writing meminfo: free 23MiB / 37MiB (60.00 %)
[2022-12-13 04:17:06] 2022-12-13 03:17:05 -00:00: INF [memory_pressure] Writing meminfo: free 23MiB / 37MiB (59.94 %)
[2022-12-14 06:16:33] 2022-12-14 05:16:31 -00:00: INF [memory_pressure] Writing meminfo: free 22MiB / 37MiB (59.84 %)
[2022-12-14 08:15:56] 2022-12-14 07:15:53 -00:00: INF [memory_pressure] Writing meminfo: free 23MiB / 37MiB (59.90 %)
[2022-12-15 17:16:18] 2022-12-15 16:16:14 -00:00: INF [memory_pressure] Writing meminfo: free 22MiB / 37MiB (59.77 %)
[2022-12-15 19:16:32] 2022-12-15 18:16:29 -00:00: INF [memory_pressure] Writing meminfo: free 23MiB / 37MiB (59.90 %)
[2022-12-15 20:16:10] 2022-12-15 19:16:07 -00:00: INF [memory_pressure] Writing meminfo: free 23MiB / 37MiB (59.99 %)
[2022-12-16 10:16:20] 2022-12-16 09:16:16 -00:00: INF [memory_pressure] Writing meminfo: free 23MiB / 37MiB (59.94 %)
[2022-12-17 02:17:06] 2022-12-17 01:17:01 -00:00: INF [memory_pressure] Writing meminfo: free 23MiB / 37MiB (59.93 %)
[2022-12-18 04:17:05] 2022-12-18 03:16:59 -00:00: INF [memory_pressure] Writing meminfo: free 23MiB / 37MiB (59.95 %)
[2022-12-19 08:16:25] 2022-12-19 07:16:18 -00:00: INF [memory_pressure] Writing meminfo: free 23MiB / 37MiB (59.99 %)
[2022-12-21 19:15:59] 2022-12-21 18:15:49 -00:00: INF [memory_pressure] Writing meminfo: free 23MiB / 37MiB (59.93 %)
[2022-12-21 21:17:06] 2022-12-21 20:16:58 -00:00: INF [memory_pressure] Writing meminfo: free 22MiB / 37MiB (59.71 %)

[2022-12-22 15:16:49] 2022-12-22 14:16:40 -00:00: INF [memory_pressure] Writing meminfo: free 21MiB / 37MiB (57.05 %)
[2022-12-22 15:16:50] 2022-12-22 14:16:40 -00:00: INF [memory_pressure] Writing meminfo: free 22MiB / 37MiB (57.16 %)
[2022-12-22 15:16:50] 2022-12-22 14:16:41 -00:00: INF [memory_pressure] Writing meminfo: free 22MiB / 37MiB (57.19 %)
[2022-12-22 15:16:51] 2022-12-22 14:16:42 -00:00: INF [memory_pressure] Writing meminfo: free 22MiB / 37MiB (57.19 %)
[2022-12-22 15:16:52] 2022-12-22 14:16:42 -00:00: INF [memory_pressure] Writing meminfo: free 21MiB / 37MiB (57.08 %)
[2022-12-22 15:16:52] 2022-12-22 14:16:43 -00:00: INF [memory_pressure] Writing meminfo: free 21MiB / 37MiB (57.11 %)
[2022-12-22 15:16:53] 2022-12-22 14:16:43 -00:00: INF [memory_pressure] Writing meminfo: free 22MiB / 37MiB (57.16 %)
[2022-12-22 15:16:54] 2022-12-22 14:16:44 -00:00: INF [memory_pressure] Writing meminfo: free 22MiB / 37MiB (57.18 %)
[2022-12-22 15:16:54] 2022-12-22 14:16:45 -00:00: INF [memory_pressure] Writing meminfo: free 21MiB / 37MiB (57.10 %)
[2022-12-22 15:16:55] 2022-12-22 14:16:45 -00:00: INF [memory_pressure] Writing meminfo: free 21MiB / 37MiB (57.03 %)
[2022-12-22 15:16:55] 2022-12-22 14:16:46 -00:00: INF [memory_pressure] Writing meminfo: free 22MiB / 37MiB (57.18 %)
[2022-12-22 15:16:56] 2022-12-22 14:16:47 -00:00: INF [memory_pressure] Writing meminfo: free 22MiB / 37MiB (57.22 %)
[2022-12-22 15:16:58] 2022-12-22 14:16:48 -00:00: INF [memory_pressure] Writing meminfo: free 22MiB / 37MiB (57.22 %)
[2022-12-22 15:16:59] 2022-12-22 14:16:50 -00:00: INF [memory_pressure] Writing meminfo: free 22MiB / 37MiB (57.21 %)
[2022-12-22 15:17:00] 2022-12-22 14:16:50 -00:00: INF [memory_pressure] Writing meminfo: free 21MiB / 37MiB (56.98 %)
[2022-12-22 15:17:00] 2022-12-22 14:16:50 -00:00: INF [memory_pressure] Writing meminfo: free 21MiB / 37MiB (57.08 %)
[2022-12-22 15:17:00] 2022-12-22 14:16:51 -00:00: INF [memory_pressure] Writing meminfo: free 22MiB / 37MiB (57.18 %)
[2022-12-22 15:17:01] 2022-12-22 14:16:52 -00:00: INF [memory_pressure] Writing meminfo: free 22MiB / 37MiB (57.22 %)
[thousands of lines all around 57% omitted]
[2022-12-23 16:58:07] 2022-12-23 15:57:56 -00:00: INF [memory_pressure] Writing meminfo: free 22MiB / 37MiB (57.21 %)
[2022-12-23 16:58:07] 2022-12-23 15:57:56 -00:00: INF [memory_pressure] Writing meminfo: free 22MiB / 37MiB (57.22 %)
[2022-12-23 16:58:14] 2022-12-23 15:58:04 -00:00: INF [memory_pressure] Writing meminfo: free 22MiB / 37MiB (57.21 %)
[2022-12-23 16:58:56] 2022-12-23 15:58:45 -00:00: INF [memory_pressure] Writing meminfo: free 22MiB / 37MiB (57.21 %)
[2022-12-23 16:59:08] 2022-12-23 15:58:57 -00:00: INF [memory_pressure] Writing meminfo: free 22MiB / 37MiB (57.21 %)
[2022-12-23 16:59:08] 2022-12-23 15:58:57 -00:00: INF [memory_pressure] Writing meminfo: free 22MiB / 37MiB (57.21 %)
[2022-12-23 16:59:15] 2022-12-23 15:59:04 -00:00: INF [memory_pressure] Writing meminfo: free 22MiB / 37MiB (57.21 %)
[2022-12-23 16:59:15] 2022-12-23 15:59:04 -00:00: INF [memory_pressure] Writing meminfo: free 22MiB / 37MiB (57.21 %)
[2022-12-23 16:59:15] 2022-12-23 15:59:04 -00:00: INF [memory_pressure] Writing meminfo: free 22MiB / 37MiB (57.21 %)
[2022-12-23 16:59:15] 2022-12-23 15:59:04 -00:00: INF [memory_pressure] Writing meminfo: free 22MiB / 37MiB (57.23 %)
[and still ongoing]

the first line is startup/init. then 10 days of occasional dipping to right below the 60% mark (which triggers the logging). then something seems to have taken at least 3%+ of memory at once, and is not giving it back (so far).

there is nothing relevant-looking in the log right before it. most of the "right below 60%" events and the jump to 57% are around 15-17 minutes "after the hour", which is the usual time a sync-backup-offsite job is running, which starts/stops a VM.

is there something like vm-state that is allocated in larger chunks when hitting some limit or so? (which would explain the sudden big jump)

i will keep it running for now, perhaps at some point it will move away from the 57% area...

xaki23 avatar Dec 23 '22 16:12 xaki23