flexo icon indicating copy to clipboard operation
flexo copied to clipboard

[Potential Bug] High CPU useage due to stuck fetch cycle

Open chrishoage opened this issue 1 year ago • 5 comments

Describe the bug

Sometimes Flexo gets stuck in an update cycle that eats a ton of CPU. The logs below are abbreviated but go on for several hours.

The fall off in the image below is after i restarted the container.

I unfortunately have not figured out how to reproduce this. It hapens once every few weeks and has happened for many months now

image

Installation method Docker

Distribution default arch

Version If you've installed Flexo from AUR, provide the output of: pacman -Qi flexo-git. If you use Docker, provide the version tag of the Docker image you're using (check docker image ls nroi/flexo for example).

Log

[2023-08-04T06:17:09.549Z INFO  flexo::mirror_flexo] File is still empty: extra.db.sig-782290d3-bcca-43e3-b6e7-84b819dfce31
[2023-08-04T06:17:09.626Z INFO  flexo::mirror_flexo] HTTP response code is 404
[2023-08-04T06:17:09.626Z INFO  flexo] extra/os/x86_64/extra.db.sig is not available at https://mirrors.lug.mtu.edu/archlinux/
[2023-08-04T06:17:09.626Z INFO  flexo] extra/os/x86_64/extra.db.sig was unavailable at all remote mirrors.
[2023-08-04T06:17:09.626Z INFO  flexo] Request served [NO PAYLOAD]: "extra/os/x86_64/extra.db.sig"
[2023-08-04T06:22:11.124Z INFO  flexo] Received request for path "core/os/x86_64/core.db". Range start: 0
[2023-08-04T06:22:11.124Z INFO  flexo] Received request for path "extra/os/x86_64/extra.db". Range start: 0
[2023-08-04T06:22:11.125Z INFO  flexo::mirror_flexo] File is still empty: core.db-b56ac11a-8bf0-40d5-b0b8-3fea4e1b9887
[2023-08-04T06:22:11.125Z INFO  flexo::mirror_flexo] File is still empty: extra.db-40afe6ee-cd1c-484b-a434-6f550f2b5473
[2023-08-04T06:22:11.419Z INFO  flexo::mirror_flexo] HTTP response code is 200
[2023-08-04T06:22:11.419Z INFO  flexo::mirror_flexo] Server replied with content length 133624 for core/os/x86_64/core.db
[2023-08-04T06:22:11.419Z INFO  flexo] Content length of path "core/os/x86_64/core.db" is 133624
[2023-08-04T06:22:11.422Z INFO  flexo::mirror_flexo] HTTP response code is 200
[2023-08-04T06:22:11.422Z INFO  flexo::mirror_flexo] Server replied with content length 8749495 for extra/os/x86_64/extra.db
[2023-08-04T06:22:11.422Z INFO  flexo] Content length of path "extra/os/x86_64/extra.db" is 8749495
[2023-08-04T06:22:11.732Z INFO  flexo::mirror_flexo] File size of core.db-b56ac11a-8bf0-40d5-b0b8-3fea4e1b9887 is 133624
[2023-08-04T06:22:11.732Z INFO  flexo] Request served [CACHE MISS]: "core/os/x86_64/core.db"
[2023-08-04T06:22:11.745Z INFO  flexo] Received request for path "core/os/x86_64/core.db.sig". Range start: 0
[2023-08-04T06:22:11.746Z INFO  flexo::mirror_flexo] File is still empty: core.db.sig-0b712886-ea1f-4e6a-9c0f-131caa37e717
[2023-08-04T06:22:11.826Z INFO  flexo::mirror_flexo] HTTP response code is 404
[2023-08-04T06:22:11.826Z INFO  flexo] core/os/x86_64/core.db.sig is not available at https://mirrors.lug.mtu.edu/archlinux/
[2023-08-04T06:22:11.826Z INFO  flexo] core/os/x86_64/core.db.sig was unavailable at all remote mirrors.
[2023-08-04T06:22:11.826Z INFO  flexo] Request served [NO PAYLOAD]: "core/os/x86_64/core.db.sig"
[2023-08-04T06:22:14.255Z INFO  flexo::mirror_flexo] File size of extra.db-40afe6ee-cd1c-484b-a434-6f550f2b5473 is 8749495
[2023-08-04T06:22:14.255Z INFO  flexo] Request served [CACHE MISS]: "extra/os/x86_64/extra.db"
[2023-08-04T06:22:14.259Z INFO  flexo] Received request for path "extra/os/x86_64/extra.db.sig". Range start: 0
[2023-08-04T06:22:14.260Z INFO  flexo::mirror_flexo] File is still empty: extra.db.sig-ac246c52-75dc-4f27-8a97-908ba3b152a1
[2023-08-04T06:22:14.342Z INFO  flexo::mirror_flexo] HTTP response code is 404
[2023-08-04T06:22:14.342Z INFO  flexo] extra/os/x86_64/extra.db.sig is not available at https://mirrors.lug.mtu.edu/archlinux/
[2023-08-04T06:22:14.342Z INFO  flexo] extra/os/x86_64/extra.db.sig was unavailable at all remote mirrors.
[2023-08-04T06:22:14.342Z INFO  flexo] Request served [NO PAYLOAD]: "extra/os/x86_64/extra.db.sig"
[2023-08-04T06:27:15.828Z INFO  flexo] Received request for path "core/os/x86_64/core.db". Range start: 0
[2023-08-04T06:27:15.828Z INFO  flexo] Received request for path "extra/os/x86_64/extra.db". Range start: 0
[2023-08-04T06:27:15.829Z INFO  flexo::mirror_flexo] File is still empty: core.db-31a9a98a-61c0-4362-954b-0b7b8e7920c5
[2023-08-04T06:27:15.829Z INFO  flexo::mirror_flexo] File is still empty: extra.db-9f2aec36-2b7c-45fc-bfa1-99d104bdf14d
[2023-08-04T06:27:16.116Z INFO  flexo::mirror_flexo] HTTP response code is 200
[2023-08-04T06:27:16.116Z INFO  flexo::mirror_flexo] Server replied with content length 133624 for core/os/x86_64/core.db
[2023-08-04T06:27:16.116Z INFO  flexo] Content length of path "core/os/x86_64/core.db" is 133624
[2023-08-04T06:27:16.122Z INFO  flexo::mirror_flexo] HTTP response code is 200
[2023-08-04T06:27:16.122Z INFO  flexo::mirror_flexo] Server replied with content length 8749495 for extra/os/x86_64/extra.db
[2023-08-04T06:27:16.122Z INFO  flexo] Content length of path "extra/os/x86_64/extra.db" is 8749495
[2023-08-04T06:27:16.430Z INFO  flexo::mirror_flexo] File size of core.db-31a9a98a-61c0-4362-954b-0b7b8e7920c5 is 133624
[2023-08-04T06:27:16.431Z INFO  flexo] Request served [CACHE MISS]: "core/os/x86_64/core.db"
[2023-08-04T06:27:16.449Z INFO  flexo] Received request for path "core/os/x86_64/core.db.sig". Range start: 0
[2023-08-04T06:27:16.449Z INFO  flexo::mirror_flexo] File is still empty: core.db.sig-868c4ef9-f731-4099-8ec9-25088cf7d463
[2023-08-04T06:27:16.531Z INFO  flexo::mirror_flexo] HTTP response code is 404
[2023-08-04T06:27:16.531Z INFO  flexo] core/os/x86_64/core.db.sig is not available at https://mirrors.lug.mtu.edu/archlinux/
[2023-08-04T06:27:16.531Z INFO  flexo] core/os/x86_64/core.db.sig was unavailable at all remote mirrors.
[2023-08-04T06:27:16.531Z INFO  flexo] Request served [NO PAYLOAD]: "core/os/x86_64/core.db.sig"
[2023-08-04T06:27:18.968Z INFO  flexo::mirror_flexo] File size of extra.db-9f2aec36-2b7c-45fc-bfa1-99d104bdf14d is 8749495
[2023-08-04T06:27:18.968Z INFO  flexo] Request served [CACHE MISS]: "extra/os/x86_64/extra.db"
[2023-08-04T06:27:18.974Z INFO  flexo] Received request for path "extra/os/x86_64/extra.db.sig". Range start: 0
[2023-08-04T06:27:18.975Z INFO  flexo::mirror_flexo] File is still empty: extra.db.sig-2b330e2a-1f82-4595-ab8f-0475d52be1e8
[2023-08-04T06:27:19.053Z INFO  flexo::mirror_flexo] HTTP response code is 404
[2023-08-04T06:27:19.053Z INFO  flexo] extra/os/x86_64/extra.db.sig is not available at https://mirrors.lug.mtu.edu/archlinux/
[2023-08-04T06:27:19.053Z INFO  flexo] extra/os/x86_64/extra.db.sig was unavailable at all remote mirrors.
[2023-08-04T06:27:19.053Z INFO  flexo] Request served [NO PAYLOAD]: "extra/os/x86_64/extra.db.sig"
[2023-08-04T06:32:20.478Z INFO  flexo] Received request for path "core/os/x86_64/core.db". Range start: 0
[2023-08-04T06:32:20.478Z INFO  flexo] Received request for path "extra/os/x86_64/extra.db". Range start: 0
[2023-08-04T06:32:20.479Z INFO  flexo::mirror_flexo] File is still empty: extra.db-547f8478-9bed-401a-9370-f4cefe10b398
[2023-08-04T06:32:20.479Z INFO  flexo::mirror_flexo] File is still empty: core.db-770d5c76-dfa8-4ce9-a0f4-8b0d5e9eb37a
[2023-08-04T06:32:20.865Z INFO  flexo::mirror_flexo] HTTP response code is 200
[2023-08-04T06:32:20.865Z INFO  flexo::mirror_flexo] Server replied with content length 8749495 for extra/os/x86_64/extra.db
[2023-08-04T06:32:20.865Z INFO  flexo] Content length of path "extra/os/x86_64/extra.db" is 8749495
[2023-08-04T06:32:20.871Z INFO  flexo::mirror_flexo] HTTP response code is 200
[2023-08-04T06:32:20.871Z INFO  flexo::mirror_flexo] Server replied with content length 133624 for core/os/x86_64/core.db
[2023-08-04T06:32:20.871Z INFO  flexo] Content length of path "core/os/x86_64/core.db" is 133624
[2023-08-04T06:32:21.193Z INFO  flexo::mirror_flexo] File size of core.db-770d5c76-dfa8-4ce9-a0f4-8b0d5e9eb37a is 133624
[2023-08-04T06:32:21.194Z INFO  flexo] Request served [CACHE MISS]: "core/os/x86_64/core.db"
[2023-08-04T06:32:21.260Z INFO  flexo] Received request for path "core/os/x86_64/core.db.sig". Range start: 0
[2023-08-04T06:32:21.260Z INFO  flexo::mirror_flexo] File is still empty: core.db.sig-fd56debc-3fce-4b21-b471-7e22fd157336
[2023-08-04T06:32:21.341Z INFO  flexo::mirror_flexo] HTTP response code is 404
[2023-08-04T06:32:21.341Z INFO  flexo] core/os/x86_64/core.db.sig is not available at https://mirrors.lug.mtu.edu/archlinux/
[2023-08-04T06:32:21.341Z INFO  flexo] core/os/x86_64/core.db.sig was unavailable at all remote mirrors.
[2023-08-04T06:32:21.341Z INFO  flexo] Request served [NO PAYLOAD]: "core/os/x86_64/core.db.sig"
[2023-08-04T06:32:23.609Z INFO  flexo::mirror_flexo] File size of extra.db-547f8478-9bed-401a-9370-f4cefe10b398 is 8749495
[2023-08-04T06:32:23.610Z INFO  flexo] Request served [CACHE MISS]: "extra/os/x86_64/extra.db"
[2023-08-04T06:32:23.613Z INFO  flexo] Received request for path "extra/os/x86_64/extra.db.sig". Range start: 0
[2023-08-04T06:32:23.614Z INFO  flexo::mirror_flexo] File is still empty: extra.db.sig-f0b81c8b-c555-47c6-bbfd-e3e1be22a3ce
[2023-08-04T06:32:23.707Z INFO  flexo::mirror_flexo] HTTP response code is 404
[2023-08-04T06:32:23.707Z INFO  flexo] extra/os/x86_64/extra.db.sig is not available at https://mirrors.lug.mtu.edu/archlinux/
[2023-08-04T06:32:23.707Z INFO  flexo] extra/os/x86_64/extra.db.sig was unavailable at all remote mirrors.
[2023-08-04T06:32:23.708Z INFO  flexo] Request served [NO PAYLOAD]: "extra/os/x86_64/extra.db.sig"
[2023-08-04T06:37:25.131Z INFO  flexo] Received request for path "core/os/x86_64/core.db". Range start: 0
[2023-08-04T06:37:25.131Z INFO  flexo] Received request for path "extra/os/x86_64/extra.db". Range start: 0
[2023-08-04T06:37:25.131Z INFO  flexo::mirror_flexo] File is still empty: core.db-00d86d93-609b-4fd3-be06-51537236215c
[2023-08-04T06:37:25.131Z INFO  flexo::mirror_flexo] File is still empty: extra.db-b3fd1001-1cca-47dc-aad1-a4cb0076911b
[2023-08-04T06:37:25.417Z INFO  flexo::mirror_flexo] HTTP response code is 200
[2023-08-04T06:37:25.417Z INFO  flexo::mirror_flexo] Server replied with content length 133624 for core/os/x86_64/core.db
[2023-08-04T06:37:25.417Z INFO  flexo] Content length of path "core/os/x86_64/core.db" is 133624
[2023-08-04T06:37:25.422Z INFO  flexo::mirror_flexo] HTTP response code is 200
[2023-08-04T06:37:25.422Z INFO  flexo::mirror_flexo] Server replied with content length 8749495 for extra/os/x86_64/extra.db
[2023-08-04T06:37:25.422Z INFO  flexo] Content length of path "extra/os/x86_64/extra.db" is 8749495
[2023-08-04T06:37:25.731Z INFO  flexo::mirror_flexo] File size of core.db-00d86d93-609b-4fd3-be06-51537236215c is 133624
[2023-08-04T06:37:25.732Z INFO  flexo] Request served [CACHE MISS]: "core/os/x86_64/core.db"
[2023-08-04T06:37:25.749Z INFO  flexo] Received request for path "core/os/x86_64/core.db.sig". Range start: 0
[2023-08-04T06:37:25.749Z INFO  flexo::mirror_flexo] File is still empty: core.db.sig-6986290a-b899-4f72-9a3c-6cf0668cde1c
[2023-08-04T06:37:25.832Z INFO  flexo::mirror_flexo] HTTP response code is 404
[2023-08-04T06:37:25.832Z INFO  flexo] core/os/x86_64/core.db.sig is not available at https://mirrors.lug.mtu.edu/archlinux/
[2023-08-04T06:37:25.832Z INFO  flexo] core/os/x86_64/core.db.sig was unavailable at all remote mirrors.
[2023-08-04T06:37:25.832Z INFO  flexo] Request served [NO PAYLOAD]: "core/os/x86_64/core.db.sig"
[2023-08-04T06:37:27.988Z INFO  flexo::mirror_flexo] File size of extra.db-b3fd1001-1cca-47dc-aad1-a4cb0076911b is 8749495
[2023-08-04T06:37:27.989Z INFO  flexo] Request served [CACHE MISS]: "extra/os/x86_64/extra.db"
[2023-08-04T06:37:27.993Z INFO  flexo] Received request for path "extra/os/x86_64/extra.db.sig". Range start: 0
[2023-08-04T06:37:27.993Z INFO  flexo::mirror_flexo] File is still empty: extra.db.sig-425bf804-320f-4c5f-8cd7-9f20842790b0
[2023-08-04T06:37:28.072Z INFO  flexo::mirror_flexo] HTTP response code is 404
[2023-08-04T06:37:28.073Z INFO  flexo] extra/os/x86_64/extra.db.sig is not available at https://mirrors.lug.mtu.edu/archlinux/
[2023-08-04T06:37:28.073Z INFO  flexo] extra/os/x86_64/extra.db.sig was unavailable at all remote mirrors.
[2023-08-04T06:37:28.073Z INFO  flexo] Request served [NO PAYLOAD]: "extra/os/x86_64/extra.db.sig"
[2023-08-04T06:42:29.479Z INFO  flexo] Received request for path "core/os/x86_64/core.db". Range start: 0
[2023-08-04T06:42:29.480Z INFO  flexo::mirror_flexo] File is still empty: core.db-e90df7cf-f675-4d08-b1de-188bd4128a99
[2023-08-04T06:42:29.480Z INFO  flexo] Received request for path "extra/os/x86_64/extra.db". Range start: 0
[2023-08-04T06:42:29.483Z INFO  flexo::mirror_flexo] File is still empty: extra.db-2c8e7c9b-d72b-4c57-a93f-5ffd4a5f8516
[2023-08-04T06:42:29.765Z INFO  flexo::mirror_flexo] HTTP response code is 200
[2023-08-04T06:42:29.765Z INFO  flexo::mirror_flexo] Server replied with content length 133624 for core/os/x86_64/core.db
[2023-08-04T06:42:29.765Z INFO  flexo] Content length of path "core/os/x86_64/core.db" is 133624
[2023-08-04T06:42:29.816Z INFO  flexo::mirror_flexo] HTTP response code is 200
[2023-08-04T06:42:29.816Z INFO  flexo::mirror_flexo] Server replied with content length 8749495 for extra/os/x86_64/extra.db
[2023-08-04T06:42:29.816Z INFO  flexo] Content length of path "extra/os/x86_64/extra.db" is 8749495
[2023-08-04T06:42:30.058Z INFO  flexo::mirror_flexo] File size of core.db-e90df7cf-f675-4d08-b1de-188bd4128a99 is 133624
[2023-08-04T06:42:30.059Z INFO  flexo] Request served [CACHE MISS]: "core/os/x86_64/core.db"
[2023-08-04T06:42:30.070Z INFO  flexo] Received request for path "core/os/x86_64/core.db.sig". Range start: 0
[2023-08-04T06:42:30.071Z INFO  flexo::mirror_flexo] File is still empty: core.db.sig-f1620c2d-721e-4104-bce6-d48f6b318397
[2023-08-04T06:42:30.151Z INFO  flexo::mirror_flexo] HTTP response code is 404
[2023-08-04T06:42:30.151Z INFO  flexo] core/os/x86_64/core.db.sig is not available at https://mirrors.lug.mtu.edu/archlinux/
[2023-08-04T06:42:30.151Z INFO  flexo] core/os/x86_64/core.db.sig was unavailable at all remote mirrors.
[2023-08-04T06:42:30.151Z INFO  flexo] Request served [NO PAYLOAD]: "core/os/x86_64/core.db.sig"
[2023-08-04T06:42:32.456Z INFO  flexo::mirror_flexo] File size of extra.db-2c8e7c9b-d72b-4c57-a93f-5ffd4a5f8516 is 8749495
[2023-08-04T06:42:32.457Z INFO  flexo] Request served [CACHE MISS]: "extra/os/x86_64/extra.db"
[2023-08-04T06:42:32.461Z INFO  flexo] Received request for path "extra/os/x86_64/extra.db.sig". Range start: 0
[2023-08-04T06:42:32.467Z INFO  flexo::mirror_flexo] File is still empty: extra.db.sig-24e0e8d1-34be-4440-a9ab-19331c3bdc27
[2023-08-04T06:42:32.545Z INFO  flexo::mirror_flexo] HTTP response code is 404
[2023-08-04T06:42:32.545Z INFO  flexo] extra/os/x86_64/extra.db.sig is not available at https://mirrors.lug.mtu.edu/archlinux/
[2023-08-04T06:42:32.545Z INFO  flexo] extra/os/x86_64/extra.db.sig was unavailable at all remote mirrors.
[2023-08-04T06:42:32.545Z INFO  flexo] Request served [NO PAYLOAD]: "extra/os/x86_64/extra.db.sig"
[2023-08-04T06:47:33.904Z INFO  flexo] Received request for path "core/os/x86_64/core.db". Range start: 0
[2023-08-04T06:47:33.905Z INFO  flexo::mirror_flexo] File is still empty: core.db-60720604-2a80-4e10-9182-9cfe8efe3780
[2023-08-04T06:47:33.905Z INFO  flexo] Received request for path "extra/os/x86_64/extra.db". Range start: 0
[2023-08-04T06:47:33.905Z INFO  flexo::mirror_flexo] File is still empty: extra.db-c333c15b-a6ce-4cc2-b4db-e09d8f017208
[2023-08-04T06:47:34.202Z INFO  flexo::mirror_flexo] HTTP response code is 200
[2023-08-04T06:47:34.202Z INFO  flexo::mirror_flexo] Server replied with content length 133624 for core/os/x86_64/core.db
[2023-08-04T06:47:34.202Z INFO  flexo] Content length of path "core/os/x86_64/core.db" is 133624
[2023-08-04T06:47:34.205Z INFO  flexo::mirror_flexo] HTTP response code is 200
[2023-08-04T06:47:34.205Z INFO  flexo::mirror_flexo] Server replied with content length 8750657 for extra/os/x86_64/extra.db
[2023-08-04T06:47:34.205Z INFO  flexo] Content length of path "extra/os/x86_64/extra.db" is 8750657
[2023-08-04T06:47:34.527Z INFO  flexo::mirror_flexo] File size of core.db-60720604-2a80-4e10-9182-9cfe8efe3780 is 133624
[2023-08-04T06:47:34.528Z INFO  flexo] Request served [CACHE MISS]: "core/os/x86_64/core.db"
[2023-08-04T06:47:34.541Z INFO  flexo] Received request for path "core/os/x86_64/core.db.sig". Range start: 0
[2023-08-04T06:47:34.541Z INFO  flexo::mirror_flexo] File is still empty: core.db.sig-b206d929-f832-4161-8a33-0536cd0e80f3
[2023-08-04T06:47:34.623Z INFO  flexo::mirror_flexo] HTTP response code is 404
[2023-08-04T06:47:34.623Z INFO  flexo] core/os/x86_64/core.db.sig is not available at https://mirrors.lug.mtu.edu/archlinux/
[2023-08-04T06:47:34.623Z INFO  flexo] core/os/x86_64/core.db.sig was unavailable at all remote mirrors.
[2023-08-04T06:47:34.623Z INFO  flexo] Request served [NO PAYLOAD]: "core/os/x86_64/core.db.sig"
[2023-08-04T06:47:43.278Z INFO  flexo::mirror_flexo] File size of extra.db-c333c15b-a6ce-4cc2-b4db-e09d8f017208 is 8750657
[2023-08-04T06:47:43.278Z INFO  flexo] Request served [CACHE MISS]: "extra/os/x86_64/extra.db"
[2023-08-04T06:47:43.282Z INFO  flexo] Received request for path "extra/os/x86_64/extra.db.sig". Range start: 0
[2023-08-04T06:47:43.283Z INFO  flexo::mirror_flexo] File is still empty: extra.db.sig-d8f0acda-59ba-4dd1-9ac0-22bf848164ef
[2023-08-04T06:47:43.361Z INFO  flexo::mirror_flexo] HTTP response code is 404
[2023-08-04T06:47:43.361Z INFO  flexo] extra/os/x86_64/extra.db.sig is not available at https://mirrors.lug.mtu.edu/archlinux/
[2023-08-04T06:47:43.361Z INFO  flexo] extra/os/x86_64/extra.db.sig was unavailable at all remote mirrors.
[2023-08-04T06:47:43.361Z INFO  flexo] Request served [NO PAYLOAD]: "extra/os/x86_64/extra.db.sig"

chrishoage avatar Aug 04 '23 15:08 chrishoage