MeshCentral icon indicating copy to clipboard operation
MeshCentral copied to clipboard

RAM leak to the MeshCentral server

Open sheshko-as opened this issue 8 months ago • 53 comments

Describe the bug During operation, there is a sharp consumption of RAM until it runs out. I increased the amount of memory: it was 4 , then 8, now 16. Increasing the amount of memory does not help. I checked on a dedicated server: when the memory runs out, the service is running, but the memory is at the limit. I checked on the VPS server, the service restarts when memory runs out. The problem may occur once a day, perhaps once every three days, but no patterns have been found. image image image

Information from journalctl:

Jun 14 18:56:41 kernel: oom-kill:constraint=CONSTRAINT_NONE,nodemask=(null),cpuset=/,mems_allowed=0,global_oom,task_memcg=/system.slice/meshcentral.service,task=node,pid=1> Jun 14 18:56:41 kernel: Out of memory: Killed process 15892 (node) total-vm:28494740kB, anon-rss:15090984kB, file-rss:1304kB, shmem-rss:0kB, UID:0 pgtables:49396kB oom_sco> Jun 14 18:56:41 systemd[1]: meshcentral.service: A process of this unit has been killed by the OOM killer. Jun 14 18:56:42 systemd[1]: meshcentral.service: Failed with result 'oom-kill'. Jun 14 18:56:42 systemd[1]: meshcentral.service: Consumed 4h 57min 33.871s CPU time. Jun 14 18:56:52 systemd[1]: meshcentral.service: Scheduled restart job, restart counter is at 1. Jun 14 18:56:52 systemd[1]: Stopped MeshCentral Server. Jun 14 18:56:52 systemd[1]: meshcentral.service: Consumed 4h 57min 33.871s CPU time. Jun 14 18:56:52 systemd[1]: Started MeshCentral Server.

Server Software (please complete the following information):

  • OS: Ubuntu 22.04
  • Virtualization: VPS
  • RAM: 16Gb
  • vCPU: 4 core 2,2 Ghz
  • SSD: 20 Gb
  • Network: WAN
  • Version: 1.1.24
  • Node: 18.20.3
  • MongoDB: "version": "7.0.11", "gitVersion": "f451220f0df2b9dfe073f1521837f8ec5c208a8c", "openSSLVersion": "OpenSSL 3.0.2 15 Mar 2022",

Client Device (please complete the following information):

  • Device: PC
  • OS: Windows 10
  • Network: Remote over WAN
  • Browser: Google Chrome, Yandex, Opera GX
  • MeshCentralRouter Version: 1.8.8795

Remote Device (please complete the following information):

  • Device: PC
  • Quantity: 1500 devices
  • OS: Windows 10 Pro - 22H2
  • Network: Remote over WAN
  • Current Core Version (if known): Dec 9 2022, 3840084365

Your config.json file

{
  "settings": {
    "cert": "XXXXXX",
    "MongoDb": "mongodb://127.0.0.1:27017/meshcentral",
    "WANonly": true,
    "autoBackup": {
      "backupIntervalHours": 24,
      "keepLastDaysBackup": 30,
      "zipPassword": "XXXXXX",
      "webdav": {
        "url": "XXXXXX",
        "username": "XXXXXX",
        "password": "XXXXXX",
        "folderName": "XXXXXX",
        "maxFiles": 30
      }
    }
  },
  "domains": {
    "": {
      "title": "XXXXXX",
      "title2": "XXXXXX",
      "hide": 5
    }
  },
  "letsencrypt": {
    "email": "XXXXXX@XXXXXX",
    "names": "XXXXXX",
    "production": true
  }
}

sheshko-as avatar Jun 15 '24 12:06 sheshko-as