flexo
flexo copied to clipboard
[Potential Bug] High CPU useage due to stuck fetch cycle
Describe the bug
Sometimes Flexo gets stuck in an update cycle that eats a ton of CPU. The logs below are abbreviated but go on for several hours.
The fall off in the image below is after i restarted the container.
I unfortunately have not figured out how to reproduce this. It hapens once every few weeks and has happened for many months now
Installation method Docker
Distribution default arch
Version
If you've installed Flexo from AUR, provide the output of: pacman -Qi flexo-git
. If you use Docker, provide the version tag of the Docker image you're using (check docker image ls nroi/flexo
for example).
Log
[2023-08-04T06:17:09.549Z INFO flexo::mirror_flexo] File is still empty: extra.db.sig-782290d3-bcca-43e3-b6e7-84b819dfce31
[2023-08-04T06:17:09.626Z INFO flexo::mirror_flexo] HTTP response code is 404
[2023-08-04T06:17:09.626Z INFO flexo] extra/os/x86_64/extra.db.sig is not available at https://mirrors.lug.mtu.edu/archlinux/
[2023-08-04T06:17:09.626Z INFO flexo] extra/os/x86_64/extra.db.sig was unavailable at all remote mirrors.
[2023-08-04T06:17:09.626Z INFO flexo] Request served [NO PAYLOAD]: "extra/os/x86_64/extra.db.sig"
[2023-08-04T06:22:11.124Z INFO flexo] Received request for path "core/os/x86_64/core.db". Range start: 0
[2023-08-04T06:22:11.124Z INFO flexo] Received request for path "extra/os/x86_64/extra.db". Range start: 0
[2023-08-04T06:22:11.125Z INFO flexo::mirror_flexo] File is still empty: core.db-b56ac11a-8bf0-40d5-b0b8-3fea4e1b9887
[2023-08-04T06:22:11.125Z INFO flexo::mirror_flexo] File is still empty: extra.db-40afe6ee-cd1c-484b-a434-6f550f2b5473
[2023-08-04T06:22:11.419Z INFO flexo::mirror_flexo] HTTP response code is 200
[2023-08-04T06:22:11.419Z INFO flexo::mirror_flexo] Server replied with content length 133624 for core/os/x86_64/core.db
[2023-08-04T06:22:11.419Z INFO flexo] Content length of path "core/os/x86_64/core.db" is 133624
[2023-08-04T06:22:11.422Z INFO flexo::mirror_flexo] HTTP response code is 200
[2023-08-04T06:22:11.422Z INFO flexo::mirror_flexo] Server replied with content length 8749495 for extra/os/x86_64/extra.db
[2023-08-04T06:22:11.422Z INFO flexo] Content length of path "extra/os/x86_64/extra.db" is 8749495
[2023-08-04T06:22:11.732Z INFO flexo::mirror_flexo] File size of core.db-b56ac11a-8bf0-40d5-b0b8-3fea4e1b9887 is 133624
[2023-08-04T06:22:11.732Z INFO flexo] Request served [CACHE MISS]: "core/os/x86_64/core.db"
[2023-08-04T06:22:11.745Z INFO flexo] Received request for path "core/os/x86_64/core.db.sig". Range start: 0
[2023-08-04T06:22:11.746Z INFO flexo::mirror_flexo] File is still empty: core.db.sig-0b712886-ea1f-4e6a-9c0f-131caa37e717
[2023-08-04T06:22:11.826Z INFO flexo::mirror_flexo] HTTP response code is 404
[2023-08-04T06:22:11.826Z INFO flexo] core/os/x86_64/core.db.sig is not available at https://mirrors.lug.mtu.edu/archlinux/
[2023-08-04T06:22:11.826Z INFO flexo] core/os/x86_64/core.db.sig was unavailable at all remote mirrors.
[2023-08-04T06:22:11.826Z INFO flexo] Request served [NO PAYLOAD]: "core/os/x86_64/core.db.sig"
[2023-08-04T06:22:14.255Z INFO flexo::mirror_flexo] File size of extra.db-40afe6ee-cd1c-484b-a434-6f550f2b5473 is 8749495
[2023-08-04T06:22:14.255Z INFO flexo] Request served [CACHE MISS]: "extra/os/x86_64/extra.db"
[2023-08-04T06:22:14.259Z INFO flexo] Received request for path "extra/os/x86_64/extra.db.sig". Range start: 0
[2023-08-04T06:22:14.260Z INFO flexo::mirror_flexo] File is still empty: extra.db.sig-ac246c52-75dc-4f27-8a97-908ba3b152a1
[2023-08-04T06:22:14.342Z INFO flexo::mirror_flexo] HTTP response code is 404
[2023-08-04T06:22:14.342Z INFO flexo] extra/os/x86_64/extra.db.sig is not available at https://mirrors.lug.mtu.edu/archlinux/
[2023-08-04T06:22:14.342Z INFO flexo] extra/os/x86_64/extra.db.sig was unavailable at all remote mirrors.
[2023-08-04T06:22:14.342Z INFO flexo] Request served [NO PAYLOAD]: "extra/os/x86_64/extra.db.sig"
[2023-08-04T06:27:15.828Z INFO flexo] Received request for path "core/os/x86_64/core.db". Range start: 0
[2023-08-04T06:27:15.828Z INFO flexo] Received request for path "extra/os/x86_64/extra.db". Range start: 0
[2023-08-04T06:27:15.829Z INFO flexo::mirror_flexo] File is still empty: core.db-31a9a98a-61c0-4362-954b-0b7b8e7920c5
[2023-08-04T06:27:15.829Z INFO flexo::mirror_flexo] File is still empty: extra.db-9f2aec36-2b7c-45fc-bfa1-99d104bdf14d
[2023-08-04T06:27:16.116Z INFO flexo::mirror_flexo] HTTP response code is 200
[2023-08-04T06:27:16.116Z INFO flexo::mirror_flexo] Server replied with content length 133624 for core/os/x86_64/core.db
[2023-08-04T06:27:16.116Z INFO flexo] Content length of path "core/os/x86_64/core.db" is 133624
[2023-08-04T06:27:16.122Z INFO flexo::mirror_flexo] HTTP response code is 200
[2023-08-04T06:27:16.122Z INFO flexo::mirror_flexo] Server replied with content length 8749495 for extra/os/x86_64/extra.db
[2023-08-04T06:27:16.122Z INFO flexo] Content length of path "extra/os/x86_64/extra.db" is 8749495
[2023-08-04T06:27:16.430Z INFO flexo::mirror_flexo] File size of core.db-31a9a98a-61c0-4362-954b-0b7b8e7920c5 is 133624
[2023-08-04T06:27:16.431Z INFO flexo] Request served [CACHE MISS]: "core/os/x86_64/core.db"
[2023-08-04T06:27:16.449Z INFO flexo] Received request for path "core/os/x86_64/core.db.sig". Range start: 0
[2023-08-04T06:27:16.449Z INFO flexo::mirror_flexo] File is still empty: core.db.sig-868c4ef9-f731-4099-8ec9-25088cf7d463
[2023-08-04T06:27:16.531Z INFO flexo::mirror_flexo] HTTP response code is 404
[2023-08-04T06:27:16.531Z INFO flexo] core/os/x86_64/core.db.sig is not available at https://mirrors.lug.mtu.edu/archlinux/
[2023-08-04T06:27:16.531Z INFO flexo] core/os/x86_64/core.db.sig was unavailable at all remote mirrors.
[2023-08-04T06:27:16.531Z INFO flexo] Request served [NO PAYLOAD]: "core/os/x86_64/core.db.sig"
[2023-08-04T06:27:18.968Z INFO flexo::mirror_flexo] File size of extra.db-9f2aec36-2b7c-45fc-bfa1-99d104bdf14d is 8749495
[2023-08-04T06:27:18.968Z INFO flexo] Request served [CACHE MISS]: "extra/os/x86_64/extra.db"
[2023-08-04T06:27:18.974Z INFO flexo] Received request for path "extra/os/x86_64/extra.db.sig". Range start: 0
[2023-08-04T06:27:18.975Z INFO flexo::mirror_flexo] File is still empty: extra.db.sig-2b330e2a-1f82-4595-ab8f-0475d52be1e8
[2023-08-04T06:27:19.053Z INFO flexo::mirror_flexo] HTTP response code is 404
[2023-08-04T06:27:19.053Z INFO flexo] extra/os/x86_64/extra.db.sig is not available at https://mirrors.lug.mtu.edu/archlinux/
[2023-08-04T06:27:19.053Z INFO flexo] extra/os/x86_64/extra.db.sig was unavailable at all remote mirrors.
[2023-08-04T06:27:19.053Z INFO flexo] Request served [NO PAYLOAD]: "extra/os/x86_64/extra.db.sig"
[2023-08-04T06:32:20.478Z INFO flexo] Received request for path "core/os/x86_64/core.db". Range start: 0
[2023-08-04T06:32:20.478Z INFO flexo] Received request for path "extra/os/x86_64/extra.db". Range start: 0
[2023-08-04T06:32:20.479Z INFO flexo::mirror_flexo] File is still empty: extra.db-547f8478-9bed-401a-9370-f4cefe10b398
[2023-08-04T06:32:20.479Z INFO flexo::mirror_flexo] File is still empty: core.db-770d5c76-dfa8-4ce9-a0f4-8b0d5e9eb37a
[2023-08-04T06:32:20.865Z INFO flexo::mirror_flexo] HTTP response code is 200
[2023-08-04T06:32:20.865Z INFO flexo::mirror_flexo] Server replied with content length 8749495 for extra/os/x86_64/extra.db
[2023-08-04T06:32:20.865Z INFO flexo] Content length of path "extra/os/x86_64/extra.db" is 8749495
[2023-08-04T06:32:20.871Z INFO flexo::mirror_flexo] HTTP response code is 200
[2023-08-04T06:32:20.871Z INFO flexo::mirror_flexo] Server replied with content length 133624 for core/os/x86_64/core.db
[2023-08-04T06:32:20.871Z INFO flexo] Content length of path "core/os/x86_64/core.db" is 133624
[2023-08-04T06:32:21.193Z INFO flexo::mirror_flexo] File size of core.db-770d5c76-dfa8-4ce9-a0f4-8b0d5e9eb37a is 133624
[2023-08-04T06:32:21.194Z INFO flexo] Request served [CACHE MISS]: "core/os/x86_64/core.db"
[2023-08-04T06:32:21.260Z INFO flexo] Received request for path "core/os/x86_64/core.db.sig". Range start: 0
[2023-08-04T06:32:21.260Z INFO flexo::mirror_flexo] File is still empty: core.db.sig-fd56debc-3fce-4b21-b471-7e22fd157336
[2023-08-04T06:32:21.341Z INFO flexo::mirror_flexo] HTTP response code is 404
[2023-08-04T06:32:21.341Z INFO flexo] core/os/x86_64/core.db.sig is not available at https://mirrors.lug.mtu.edu/archlinux/
[2023-08-04T06:32:21.341Z INFO flexo] core/os/x86_64/core.db.sig was unavailable at all remote mirrors.
[2023-08-04T06:32:21.341Z INFO flexo] Request served [NO PAYLOAD]: "core/os/x86_64/core.db.sig"
[2023-08-04T06:32:23.609Z INFO flexo::mirror_flexo] File size of extra.db-547f8478-9bed-401a-9370-f4cefe10b398 is 8749495
[2023-08-04T06:32:23.610Z INFO flexo] Request served [CACHE MISS]: "extra/os/x86_64/extra.db"
[2023-08-04T06:32:23.613Z INFO flexo] Received request for path "extra/os/x86_64/extra.db.sig". Range start: 0
[2023-08-04T06:32:23.614Z INFO flexo::mirror_flexo] File is still empty: extra.db.sig-f0b81c8b-c555-47c6-bbfd-e3e1be22a3ce
[2023-08-04T06:32:23.707Z INFO flexo::mirror_flexo] HTTP response code is 404
[2023-08-04T06:32:23.707Z INFO flexo] extra/os/x86_64/extra.db.sig is not available at https://mirrors.lug.mtu.edu/archlinux/
[2023-08-04T06:32:23.707Z INFO flexo] extra/os/x86_64/extra.db.sig was unavailable at all remote mirrors.
[2023-08-04T06:32:23.708Z INFO flexo] Request served [NO PAYLOAD]: "extra/os/x86_64/extra.db.sig"
[2023-08-04T06:37:25.131Z INFO flexo] Received request for path "core/os/x86_64/core.db". Range start: 0
[2023-08-04T06:37:25.131Z INFO flexo] Received request for path "extra/os/x86_64/extra.db". Range start: 0
[2023-08-04T06:37:25.131Z INFO flexo::mirror_flexo] File is still empty: core.db-00d86d93-609b-4fd3-be06-51537236215c
[2023-08-04T06:37:25.131Z INFO flexo::mirror_flexo] File is still empty: extra.db-b3fd1001-1cca-47dc-aad1-a4cb0076911b
[2023-08-04T06:37:25.417Z INFO flexo::mirror_flexo] HTTP response code is 200
[2023-08-04T06:37:25.417Z INFO flexo::mirror_flexo] Server replied with content length 133624 for core/os/x86_64/core.db
[2023-08-04T06:37:25.417Z INFO flexo] Content length of path "core/os/x86_64/core.db" is 133624
[2023-08-04T06:37:25.422Z INFO flexo::mirror_flexo] HTTP response code is 200
[2023-08-04T06:37:25.422Z INFO flexo::mirror_flexo] Server replied with content length 8749495 for extra/os/x86_64/extra.db
[2023-08-04T06:37:25.422Z INFO flexo] Content length of path "extra/os/x86_64/extra.db" is 8749495
[2023-08-04T06:37:25.731Z INFO flexo::mirror_flexo] File size of core.db-00d86d93-609b-4fd3-be06-51537236215c is 133624
[2023-08-04T06:37:25.732Z INFO flexo] Request served [CACHE MISS]: "core/os/x86_64/core.db"
[2023-08-04T06:37:25.749Z INFO flexo] Received request for path "core/os/x86_64/core.db.sig". Range start: 0
[2023-08-04T06:37:25.749Z INFO flexo::mirror_flexo] File is still empty: core.db.sig-6986290a-b899-4f72-9a3c-6cf0668cde1c
[2023-08-04T06:37:25.832Z INFO flexo::mirror_flexo] HTTP response code is 404
[2023-08-04T06:37:25.832Z INFO flexo] core/os/x86_64/core.db.sig is not available at https://mirrors.lug.mtu.edu/archlinux/
[2023-08-04T06:37:25.832Z INFO flexo] core/os/x86_64/core.db.sig was unavailable at all remote mirrors.
[2023-08-04T06:37:25.832Z INFO flexo] Request served [NO PAYLOAD]: "core/os/x86_64/core.db.sig"
[2023-08-04T06:37:27.988Z INFO flexo::mirror_flexo] File size of extra.db-b3fd1001-1cca-47dc-aad1-a4cb0076911b is 8749495
[2023-08-04T06:37:27.989Z INFO flexo] Request served [CACHE MISS]: "extra/os/x86_64/extra.db"
[2023-08-04T06:37:27.993Z INFO flexo] Received request for path "extra/os/x86_64/extra.db.sig". Range start: 0
[2023-08-04T06:37:27.993Z INFO flexo::mirror_flexo] File is still empty: extra.db.sig-425bf804-320f-4c5f-8cd7-9f20842790b0
[2023-08-04T06:37:28.072Z INFO flexo::mirror_flexo] HTTP response code is 404
[2023-08-04T06:37:28.073Z INFO flexo] extra/os/x86_64/extra.db.sig is not available at https://mirrors.lug.mtu.edu/archlinux/
[2023-08-04T06:37:28.073Z INFO flexo] extra/os/x86_64/extra.db.sig was unavailable at all remote mirrors.
[2023-08-04T06:37:28.073Z INFO flexo] Request served [NO PAYLOAD]: "extra/os/x86_64/extra.db.sig"
[2023-08-04T06:42:29.479Z INFO flexo] Received request for path "core/os/x86_64/core.db". Range start: 0
[2023-08-04T06:42:29.480Z INFO flexo::mirror_flexo] File is still empty: core.db-e90df7cf-f675-4d08-b1de-188bd4128a99
[2023-08-04T06:42:29.480Z INFO flexo] Received request for path "extra/os/x86_64/extra.db". Range start: 0
[2023-08-04T06:42:29.483Z INFO flexo::mirror_flexo] File is still empty: extra.db-2c8e7c9b-d72b-4c57-a93f-5ffd4a5f8516
[2023-08-04T06:42:29.765Z INFO flexo::mirror_flexo] HTTP response code is 200
[2023-08-04T06:42:29.765Z INFO flexo::mirror_flexo] Server replied with content length 133624 for core/os/x86_64/core.db
[2023-08-04T06:42:29.765Z INFO flexo] Content length of path "core/os/x86_64/core.db" is 133624
[2023-08-04T06:42:29.816Z INFO flexo::mirror_flexo] HTTP response code is 200
[2023-08-04T06:42:29.816Z INFO flexo::mirror_flexo] Server replied with content length 8749495 for extra/os/x86_64/extra.db
[2023-08-04T06:42:29.816Z INFO flexo] Content length of path "extra/os/x86_64/extra.db" is 8749495
[2023-08-04T06:42:30.058Z INFO flexo::mirror_flexo] File size of core.db-e90df7cf-f675-4d08-b1de-188bd4128a99 is 133624
[2023-08-04T06:42:30.059Z INFO flexo] Request served [CACHE MISS]: "core/os/x86_64/core.db"
[2023-08-04T06:42:30.070Z INFO flexo] Received request for path "core/os/x86_64/core.db.sig". Range start: 0
[2023-08-04T06:42:30.071Z INFO flexo::mirror_flexo] File is still empty: core.db.sig-f1620c2d-721e-4104-bce6-d48f6b318397
[2023-08-04T06:42:30.151Z INFO flexo::mirror_flexo] HTTP response code is 404
[2023-08-04T06:42:30.151Z INFO flexo] core/os/x86_64/core.db.sig is not available at https://mirrors.lug.mtu.edu/archlinux/
[2023-08-04T06:42:30.151Z INFO flexo] core/os/x86_64/core.db.sig was unavailable at all remote mirrors.
[2023-08-04T06:42:30.151Z INFO flexo] Request served [NO PAYLOAD]: "core/os/x86_64/core.db.sig"
[2023-08-04T06:42:32.456Z INFO flexo::mirror_flexo] File size of extra.db-2c8e7c9b-d72b-4c57-a93f-5ffd4a5f8516 is 8749495
[2023-08-04T06:42:32.457Z INFO flexo] Request served [CACHE MISS]: "extra/os/x86_64/extra.db"
[2023-08-04T06:42:32.461Z INFO flexo] Received request for path "extra/os/x86_64/extra.db.sig". Range start: 0
[2023-08-04T06:42:32.467Z INFO flexo::mirror_flexo] File is still empty: extra.db.sig-24e0e8d1-34be-4440-a9ab-19331c3bdc27
[2023-08-04T06:42:32.545Z INFO flexo::mirror_flexo] HTTP response code is 404
[2023-08-04T06:42:32.545Z INFO flexo] extra/os/x86_64/extra.db.sig is not available at https://mirrors.lug.mtu.edu/archlinux/
[2023-08-04T06:42:32.545Z INFO flexo] extra/os/x86_64/extra.db.sig was unavailable at all remote mirrors.
[2023-08-04T06:42:32.545Z INFO flexo] Request served [NO PAYLOAD]: "extra/os/x86_64/extra.db.sig"
[2023-08-04T06:47:33.904Z INFO flexo] Received request for path "core/os/x86_64/core.db". Range start: 0
[2023-08-04T06:47:33.905Z INFO flexo::mirror_flexo] File is still empty: core.db-60720604-2a80-4e10-9182-9cfe8efe3780
[2023-08-04T06:47:33.905Z INFO flexo] Received request for path "extra/os/x86_64/extra.db". Range start: 0
[2023-08-04T06:47:33.905Z INFO flexo::mirror_flexo] File is still empty: extra.db-c333c15b-a6ce-4cc2-b4db-e09d8f017208
[2023-08-04T06:47:34.202Z INFO flexo::mirror_flexo] HTTP response code is 200
[2023-08-04T06:47:34.202Z INFO flexo::mirror_flexo] Server replied with content length 133624 for core/os/x86_64/core.db
[2023-08-04T06:47:34.202Z INFO flexo] Content length of path "core/os/x86_64/core.db" is 133624
[2023-08-04T06:47:34.205Z INFO flexo::mirror_flexo] HTTP response code is 200
[2023-08-04T06:47:34.205Z INFO flexo::mirror_flexo] Server replied with content length 8750657 for extra/os/x86_64/extra.db
[2023-08-04T06:47:34.205Z INFO flexo] Content length of path "extra/os/x86_64/extra.db" is 8750657
[2023-08-04T06:47:34.527Z INFO flexo::mirror_flexo] File size of core.db-60720604-2a80-4e10-9182-9cfe8efe3780 is 133624
[2023-08-04T06:47:34.528Z INFO flexo] Request served [CACHE MISS]: "core/os/x86_64/core.db"
[2023-08-04T06:47:34.541Z INFO flexo] Received request for path "core/os/x86_64/core.db.sig". Range start: 0
[2023-08-04T06:47:34.541Z INFO flexo::mirror_flexo] File is still empty: core.db.sig-b206d929-f832-4161-8a33-0536cd0e80f3
[2023-08-04T06:47:34.623Z INFO flexo::mirror_flexo] HTTP response code is 404
[2023-08-04T06:47:34.623Z INFO flexo] core/os/x86_64/core.db.sig is not available at https://mirrors.lug.mtu.edu/archlinux/
[2023-08-04T06:47:34.623Z INFO flexo] core/os/x86_64/core.db.sig was unavailable at all remote mirrors.
[2023-08-04T06:47:34.623Z INFO flexo] Request served [NO PAYLOAD]: "core/os/x86_64/core.db.sig"
[2023-08-04T06:47:43.278Z INFO flexo::mirror_flexo] File size of extra.db-c333c15b-a6ce-4cc2-b4db-e09d8f017208 is 8750657
[2023-08-04T06:47:43.278Z INFO flexo] Request served [CACHE MISS]: "extra/os/x86_64/extra.db"
[2023-08-04T06:47:43.282Z INFO flexo] Received request for path "extra/os/x86_64/extra.db.sig". Range start: 0
[2023-08-04T06:47:43.283Z INFO flexo::mirror_flexo] File is still empty: extra.db.sig-d8f0acda-59ba-4dd1-9ac0-22bf848164ef
[2023-08-04T06:47:43.361Z INFO flexo::mirror_flexo] HTTP response code is 404
[2023-08-04T06:47:43.361Z INFO flexo] extra/os/x86_64/extra.db.sig is not available at https://mirrors.lug.mtu.edu/archlinux/
[2023-08-04T06:47:43.361Z INFO flexo] extra/os/x86_64/extra.db.sig was unavailable at all remote mirrors.
[2023-08-04T06:47:43.361Z INFO flexo] Request served [NO PAYLOAD]: "extra/os/x86_64/extra.db.sig"