Not displaying memory of containers

[mbseid]

First, great project. Thank you!

I set up the dashboard on a new swarm cluster and it's not showing the memory usage. CPU usage is being captured. Picture attached:

I checked the websocket information and it's sending 0 on the wire. It may not be collecting it properly.

Additional context:

There is a two node cluster. It's running a few levels of virtualization (which shouldn't be the cause). Proxmox => Ubuntu => Docker Swarm

Thanks for the help!

[mohsenasm]

Hi @mbseid, Could you send some logs?

Please ssh into the manager (newman) and send the output of these commands:

1. docker service ps homelab_cadvisor
2. docker exec -it homelab_cadvisor<tab> sh
   • Then, curl -sS http://localhost:8080/metrics | grep memory_

The above log will contain your services' name & image. If you don't want to send those, use these commands instead:

1. docker service ps homelab_cadvisor
   • Copy the ID of the current task running in the newman server.
2. docker exec -it homelab_cadvisor<tab> sh
   • Then, curl -sS http://localhost:8080/metrics | grep -E 'memory_.*<the_copied_id>'

[trajano]

In my case I use PATH_PREFIX=/swarm-visualizer and I get

curl -v https://trajano.net/swarm-visualizer/metrics as a 404

[mohsenasm]

@trajano Swarm Dashboard does not export any mertics. I meant cadvisor's metrics in my comment (localhost after execing into cadvisor container).

[trajano]

cadvisor doesn't have an ARM build at least not the latest tag https://github.com/hetznercloud/apps/issues/98

[trajano]

@trajano Swarm Dashboard does not export any mertics. I meant cadvisor's metrics in my comment (localhost after execing into cadvisor container).

So are you saying cadvisor has to be exposed to the Internet? Oh wait no it doesn't but there's no curl inside cadvisor

[mohsenasm]

So are you saying cadvisor has to be exposed to the Internet?

No! Swarm Dashboard reads conatiners' metrics from /metrics exposed locally by cadvisor.

there's no curl inside cadvisor

Some images have curl installed (mine does). If it's not, we can install it with apk or apt for example.

---

Anyway, mbseid encuntered some issue with memory usage report, and that's why I asked if he could send some logs to better investigate the issue.

[mbseid]

@mohsenasm Thanks for the fast response. I'm new to docker swarm, so I couldn't figure out how what the right ID from the docker service ps command. I SSHed into the the machine and got this from the response. Sorry for the SUPER long logs, it's unfiltered grep on cadvisor.

/ # wget -q -S -O - http://localhost:8080/metrics |  grep -E 'cadvisor'
  HTTP/1.1 200 OK
  Content-Type: text/plain; version=0.0.4; charset=utf-8
  Date: Mon, 30 Oct 2023 01:45:09 GMT
  Connection: close
  Transfer-Encoding: chunked
  
# HELP cadvisor_version_info A metric with a constant '1' value labeled by kernel version, OS version, docker version, cadvisor version & cadvisor revision.
# TYPE cadvisor_version_info gauge
cadvisor_version_info{cadvisorRevision="30515557",cadvisorVersion="v0.38.6",dockerVersion="24.0.6",kernelVersion="5.15.0-87-generic",osVersion="Alpine Linux v3.12"} 1
container_cpu_load_average_10s{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0"} 0 1698630308622
container_cpu_system_seconds_total{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0"} 7186.052781 1698630308622
container_cpu_usage_seconds_total{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",cpu="total",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0"} 21686.785235 1698630308622
container_cpu_user_seconds_total{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0"} 14500.732454 1698630308622
container_fs_inodes_free{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",device="/dev/mapper/ubuntu--vg-ubuntu--lv",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0"} 0 1698630308622
container_fs_inodes_total{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",device="/dev/mapper/ubuntu--vg-ubuntu--lv",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0"} 11 1698630308622
container_fs_io_current{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",device="/dev/mapper/ubuntu--vg-ubuntu--lv",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0"} 0 1698630308622
container_fs_io_time_seconds_total{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",device="/dev/mapper/ubuntu--vg-ubuntu--lv",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0"} 0 1698630308622
container_fs_io_time_weighted_seconds_total{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",device="/dev/mapper/ubuntu--vg-ubuntu--lv",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0"} 0 1698630308622
container_fs_limit_bytes{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",device="/dev/mapper/ubuntu--vg-ubuntu--lv",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0"} 6.520010752e+10 1698630308622
container_fs_read_seconds_total{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",device="/dev/mapper/ubuntu--vg-ubuntu--lv",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0"} 0 1698630308622
container_fs_reads_bytes_total{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",device="/dev/dm-0",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0"} 0 1698630308622
container_fs_reads_bytes_total{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",device="/dev/sda",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0"} 0 1698630308622
container_fs_reads_merged_total{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",device="/dev/mapper/ubuntu--vg-ubuntu--lv",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0"} 0 1698630308622
container_fs_reads_total{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",device="/dev/mapper/ubuntu--vg-ubuntu--lv",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0"} 0 1698630308622
container_fs_sector_reads_total{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",device="/dev/mapper/ubuntu--vg-ubuntu--lv",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0"} 0 1698630308622
container_fs_sector_writes_total{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",device="/dev/mapper/ubuntu--vg-ubuntu--lv",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0"} 0 1698630308622
container_fs_usage_bytes{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",device="/dev/mapper/ubuntu--vg-ubuntu--lv",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0"} 2.99008e+06 1698630308622
container_fs_write_seconds_total{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",device="/dev/mapper/ubuntu--vg-ubuntu--lv",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0"} 0 1698630308622
container_fs_writes_bytes_total{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",device="/dev/dm-0",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0"} 0 1698630308622
container_fs_writes_bytes_total{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",device="/dev/sda",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0"} 0 1698630308622
container_fs_writes_merged_total{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",device="/dev/mapper/ubuntu--vg-ubuntu--lv",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0"} 0 1698630308622
container_fs_writes_total{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",device="/dev/mapper/ubuntu--vg-ubuntu--lv",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0"} 0 1698630308622
container_last_seen{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0"} 1.698630309e+09 1698630309443
container_memory_cache{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0"} 0 1698630308622
container_memory_failcnt{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0"} 0 1698630308622
container_memory_failures_total{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",failure_type="pgfault",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",scope="container"} 9.425465e+06 1698630308622
container_memory_failures_total{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",failure_type="pgfault",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",scope="hierarchy"} 9.425465e+06 1698630308622
container_memory_failures_total{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",failure_type="pgmajfault",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",scope="container"} 220 1698630308622
container_memory_failures_total{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",failure_type="pgmajfault",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",scope="hierarchy"} 220 1698630308622
container_memory_mapped_file{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0"} 0 1698630308622
container_memory_max_usage_bytes{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0"} 0 1698630308622
container_memory_rss{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0"} 0 1698630308622
container_memory_swap{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0"} 0 1698630308622
container_memory_usage_bytes{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0"} 9.9475456e+07 1698630308622
container_memory_working_set_bytes{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0"} 1.8644992e+07 1698630308622
container_network_receive_bytes_total{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",interface="eth0",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0"} 2.658521764e+09 1698630308622
container_network_receive_bytes_total{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",interface="eth1",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0"} 7894 1698630308622
container_network_receive_errors_total{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",interface="eth0",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0"} 0 1698630308622
container_network_receive_errors_total{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",interface="eth1",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0"} 0 1698630308622
container_network_receive_packets_dropped_total{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",interface="eth0",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0"} 0 1698630308622
container_network_receive_packets_dropped_total{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",interface="eth1",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0"} 0 1698630308622
container_network_receive_packets_total{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",interface="eth0",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0"} 4.0200904e+07 1698630308622
container_network_receive_packets_total{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",interface="eth1",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0"} 115 1698630308622
container_network_transmit_bytes_total{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",interface="eth0",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0"} 1.93616254677e+11 1698630308622
container_network_transmit_bytes_total{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",interface="eth1",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0"} 0 1698630308622
container_network_transmit_errors_total{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",interface="eth0",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0"} 0 1698630308622
container_network_transmit_errors_total{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",interface="eth1",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0"} 0 1698630308622
container_network_transmit_packets_dropped_total{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",interface="eth0",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0"} 0 1698630308622
container_network_transmit_packets_dropped_total{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",interface="eth1",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0"} 0 1698630308622
container_network_transmit_packets_total{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",interface="eth0",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0"} 4.2738414e+07 1698630308622
container_network_transmit_packets_total{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",interface="eth1",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0"} 0 1698630308622
container_spec_cpu_period{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0"} 0
container_spec_cpu_shares{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0"} 0
container_spec_memory_limit_bytes{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0"} 1.0423386112e+10
container_spec_memory_reservation_limit_bytes{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0"} 0
container_spec_memory_swap_limit_bytes{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0"} 0
container_start_time_seconds{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0"} 1.698294452e+09
container_tasks_state{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",state="iowaiting"} 0 1698630308622
container_tasks_state{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",state="running"} 0 1698630308622
container_tasks_state{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",state="sleeping"} 0 1698630308622
container_tasks_state{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",state="stopped"} 0 1698630308622
container_tasks_state{container_label_com_docker_stack_namespace="homelab",container_label_com_docker_swarm_node_id="qxni7qcbmp4l04uy9vr5mzcfu",container_label_com_docker_swarm_service_id="livjm5opcbhufxxcw5cmv8yrz",container_label_com_docker_swarm_service_name="homelab_cadvisor",container_label_com_docker_swarm_task="",container_label_com_docker_swarm_task_id="3wfz02tsgv2m9bxf1np6ehtp0",container_label_com_docker_swarm_task_name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",container_label_maintainer="",container_label_org_label_schema_cmd="",container_label_org_label_schema_description="",container_label_org_label_schema_license="",container_label_org_label_schema_name="",container_label_org_label_schema_schema_version="",container_label_org_label_schema_url="",container_label_org_label_schema_vcs_url="",container_label_org_opencontainers_image_created="",container_label_org_opencontainers_image_description="",container_label_org_opencontainers_image_licenses="",container_label_org_opencontainers_image_revision="",container_label_org_opencontainers_image_source="",container_label_org_opencontainers_image_title="",container_label_org_opencontainers_image_url="",container_label_org_opencontainers_image_version="",id="/system.slice/docker-e917c97db859b8b99e233510ddccfcce7c14b713ecfc2e2782d947650488666a.scope",image="gcr.io/cadvisor/cadvisor:latest@sha256:ddadf3e2fd880deb4e0f3606d34a0d9da1165e3801116075d98a1901635dc9e8",name="homelab_cadvisor.qxni7qcbmp4l04uy9vr5mzcfu.3wfz02tsgv2m9bxf1np6ehtp0",state="uninterruptible"} 0 1698630308622

[mohsenasm]

Thanks @mbseid. The problem is the container_memory_rss metric, which is reported as 0 incorrectly (you can see the end of the line).

Please use the newest version of cadvisor in your compose.yml file. According to this issue, the latest tag is not the newest version! So, specify the version like this:

image: gcr.io/cadvisor/cadvisor:v0.47.2

---

If updating the image tag didn't solve the issue, please send some info about your environment:

• Host OS and its version? (Debian/Ubuntu/...)
• Host CPU architecture? (amd64/arm64/...)
• Docker version? (docker version command)

[schenklklopfer]

Hi @mbseid,

for Version v0.47.2 as well as for the newest v0.49.1 exists architecture specific images.

Have a look: https://github.com/google/cadvisor/releases/tag/v0.47.2 or https://github.com/google/cadvisor/releases/tag/v0.49.1

Sorry, commented on the wrong issue, but maybe it helps you?

[Docjones]

Hello,

i am in the same boat: cadvisor:v0.51.0 in conjunction with dashboard does not show container memory or CPU:

I am missing the node memory/cpu as well:

cURL'ing into the cadvisor, i get the metrics:

[mohsenasm]

Hi @Docjones, can you check the log of swarm-dashboard?

docker service logs --tail 100 -f ids-docker-check_swarm-dashboard

[Docjones]

Hm - should have checked the logs first:

Here is my compose file:

version: '3'

services:
  node-exporter:
    image: repo.ids.net/de.ids.ids-docker-node-exporter:latest
    volumes:
      - /:/rootfs:ro
      - /sys:/rootfs/sys:ro
      - /proc:/rootfs/proc:ro
      - /etc/hostname:/etc/host_hostname:ro
    command:
      - '--web.listen-address=:9091'
      - '--path.procfs=/rootfs/proc'
      - '--path.sysfs=/rootfs/sys'
      - '--collector.filesystem.ignored-mount-points=^/(sys|proc|dev|host|etc)($$|/)'
      - '--collector.textfile.directory=/etc/node-exporter/'
      - '--no-collector.ipvs'
    environment:
      - HOST_HOSTNAME=/etc/host_hostname
    deploy:
      mode: global

  cadvisor:
    image: gcr.io/cadvisor/cadvisor:v0.51.0
#    hostname: '{{.Node.ID}}'
    privileged: true
    volumes:
      - /dev/disk/:/dev/disk:ro
      - /:/rootfs:ro
      - /var/run:/var/run:rw
      - /sys:/sys:ro
      - /var/lib/docker/:/var/lib/docker:ro
      - /var/run/docker.sock:/var/run/docker.sock:rw
    command: -port=9092 -logtostderr -housekeeping_interval=10s -docker_only
    ports:
      - 9092:9092
    healthcheck:
      disable: true
    deploy:
      mode: global
    cap_add:
      - SYS_ADMIN
    devices:
      - /dev/kmsg

  swarm-dashboard:
    image: mohsenasm/swarm-dashboard:latest
    volumes:
      - /var/run/docker.sock:/var/run/docker.sock
    ports:
      - 9059:9059
    environment:
      PORT: 9059
      TZ: "GMT+1"
      ENABLE_AUTHENTICATION: "false"
      ENABLE_HTTPS: "false"
      NODE_EXPORTER_SERVICE_NAME_REGEX: "node-exporter"
      NODE_EXPORTER_INTERESTED_MOUNT_POINT: "/rootfs"
      CADVISOR_SERVICE_NAME_REGEX: "cadvisor"
      CADVISOR_PORT: "9092"
    deploy:
      placement:
        constraints:
          - node.role == manager
networks:
  default:
    external:
      name: ids-net

[mohsenasm]

@Docjones I suspect that there is a network or DNS issue. Could you exec into the swarm-dashboard container and try cURL'ing the cadvisor (or node-exporter) from there?

1. ssh into the manager
2. docker ps | grep swarm-dashboard and copy the its ID
3. docker exec -it the_container_id sh
4. try cURL'ing cadvisor (or node-exporter)

Thanks.

[Docjones]

@Docjones I suspect that there is a network or DNS issue. Could you exec into the swarm-dashboard container and try cURL'ing the cadvisor (or node-exporter) from there?

1. ssh into the manager

2. `docker ps | grep swarm-dashboard` and copy the its ID

3. `docker exec -it the_container_id sh`

4. try cURL'ing cadvisor (or node-exporter)

Done that in my previous comment

Thanks.

[Docjones]

Managed to get the Node CPU/RAM working (node_exporter was running on a different port)

Container-Metrics still dont work (cAdvisor). Connection error in dashboard-log persists.