backup icon indicating copy to clipboard operation
backup copied to clipboard

failed restoring points in the appdata directory

Open fuchsi3010 opened this issue 4 years ago • 1 comments

i've had problems with my 100GB disk filling up, while only having 20GB of files. tonight my nextcloud docker instance got auto-upgraded over night and was defunct in the morning. i restarted the containers, the disk usage went from 97% to 84% (i guess logs that didn't survive the restart?)

i noticed the backup app folder

34G     data/appdata_xxxxxxxxxxxx/backup

is bigger than my files + db

20G     data/username
8.5G    db

so i had a peek into the backup folder and found:

➜  nextcloud du -hs data/appdata_xxxxxxx/backup/*
24G     data/appdata_xxxxxxxxx/backup/20211217173501-full-znh9ZeZtCJjVCff
2.1G    data/appdata_xxxxxxxxx/backup/20211218200001-differential-q72lubELMj4YJOr
2.2G    data/appdata_xxxxxxxxx/backup/20211219205002-differential-8mkBhNRj8B7bQDf
5.1G    data/appdata_xxxxxxxxx/backup/20211221005002-full-hs5O4HKEXBbuMlD
7.3M    data/appdata_xxxxxxxxx/backup/20211221022502-full-dyV2brPdga1rb3m
7.3M    data/appdata_xxxxxxxxx/backup/20211221024505-full-Z4qTBfsUb42nERs
7.3M    data/appdata_xxxxxxxxx/backup/20211221030501-full-FZbYCgRRN1GSpW1
7.3M    data/appdata_xxxxxxxxx/backup/20211221032501-full-DP8xVJbeClVMUJo
848M    data/appdata_xxxxxxxxx/backup/20211221034035-full-4PBVFXQgrgTKjkz
7.3M    data/appdata_xxxxxxxxx/backup/20211221040001-full-jzAnWuqm7kfTBGW
7.3M    data/appdata_xxxxxxxxx/backup/20211221042003-full-lJ74BLA4MwMyxVt
7.3M    data/appdata_xxxxxxxxx/backup/20211221044008-full-2QP8wd2aIrWto6r
7.3M    data/appdata_xxxxxxxxx/backup/20211221050001-full-Uf5bdzZxfGPro44
7.3M    data/appdata_xxxxxxxxx/backup/20211221052001-full-9Vgan4p9uXshnka
7.3M    data/appdata_xxxxxxxxx/backup/20211221054001-full-uiz4UwGZ6ItAfMQ
7.3M    data/appdata_xxxxxxxxx/backup/20211221060003-full-LImhZWIyQoGTGY4
7.3M    data/appdata_xxxxxxxxx/backup/20211221062001-full-bKmTqbqq3x92gVZ
7.3M    data/appdata_xxxxxxxxx/backup/20211221063502-full-Ertch2wNGuTvbQ1
7.3M    data/appdata_xxxxxxxxx/backup/20211221065009-full-nsWAhQZpmJLTKMp
7.3M    data/appdata_xxxxxxxxx/backup/20211221071002-full-bNT2R3M6yOOrtgO
7.3M    data/appdata_xxxxxxxxx/backup/20211221073002-full-Wz6KSAUGoFS6GNh
7.3M    data/appdata_xxxxxxxxx/backup/20211221075002-full-IExnzCwBVyIOF1L
7.3M    data/appdata_xxxxxxxxx/backup/20211221081001-full-Xqc7165ZvnFTxG9
7.3M    data/appdata_xxxxxxxxx/backup/20211221082501-full-X6JYYLFFJJRgBV8
7.3M    data/appdata_xxxxxxxxx/backup/20211221084502-full-DA8zHuVx3E8CWz3
7.3M    data/appdata_xxxxxxxxx/backup/20211221090510-full-6JixbUTQubi33CI
7.3M    data/appdata_xxxxxxxxx/backup/20211221092506-full-SpcPe2FTrjAJz3f
7.3M    data/appdata_xxxxxxxxx/backup/20211221094501-full-uvjibiiQ1RCK31p
7.3M    data/appdata_xxxxxxxxx/backup/20211221100501-full-Tih7Hxwbojgh1W8
7.3M    data/appdata_xxxxxxxxx/backup/20211221102501-full-UotupR2rY1N1EKF
7.3M    data/appdata_xxxxxxxxx/backup/20211221104501-full-h6ycMVaQfI8ylCN
7.3M    data/appdata_xxxxxxxxx/backup/20211221110002-full-okeU9hnX7BsIbLb
7.3M    data/appdata_xxxxxxxxx/backup/20211221111510-full-5gYJjVXUwIUINRI
7.3M    data/appdata_xxxxxxxxx/backup/20211221113502-full-JAuUySlQikceNls
7.3M    data/appdata_xxxxxxxxx/backup/20211221115004-full-XDQ9e2eSHsaaKoC
7.3M    data/appdata_xxxxxxxxx/backup/20211221121002-full-3wcQAuok7T2n6tx
7.3M    data/appdata_xxxxxxxxx/backup/20211221122502-full-D5oBnW4gdFF5jNe
7.3M    data/appdata_xxxxxxxxx/backup/20211221124515-full-OMdpFJtrre6oshD
7.3M    data/appdata_xxxxxxxxx/backup/20211221171502-full-D9usZMcCQrVu2W3
7.3M    data/appdata_xxxxxxxxx/backup/20211221192502-full-22KwX2bYHxxUZLw
7.3M    data/appdata_xxxxxxxxx/backup/20211221223506-full-vkFcDNIZUlsd6vq
7.3M    data/appdata_xxxxxxxxx/backup/20211222030003-full-Hq4JX7gA6WHTPB9
7.3M    data/appdata_xxxxxxxxx/backup/20211222032001-full-hxteIwzLToEVTv8
7.3M    data/appdata_xxxxxxxxx/backup/20211222034001-full-OiQVFskL8FgWD6E
7.3M    data/appdata_xxxxxxxxx/backup/20211222040002-full-pcxD6oDa3trT3W5
7.3M    data/appdata_xxxxxxxxx/backup/20211222041510-full-VTly3nSi8aYq7ic
7.3M    data/appdata_xxxxxxxxx/backup/20211222043501-full-r2cr3AngABasMye
7.3M    data/appdata_xxxxxxxxx/backup/20211222045501-full-mkVu6Xyn9JbvaNx
7.3M    data/appdata_xxxxxxxxx/backup/20211222051501-full-vxVuWPVtwYU8jDV
7.3M    data/appdata_xxxxxxxxx/backup/20211222053502-full-bSRbE7Xkp5njJ66
7.3M    data/appdata_xxxxxxxxx/backup/20211222055502-full-pde1191SipGA2ed
7.3M    data/appdata_xxxxxxxxx/backup/20211222061002-full-7RklVG883B7B9BJ
7.3M    data/appdata_xxxxxxxxx/backup/20211222062510-full-UOVaIWQlStC4MZg
7.3M    data/appdata_xxxxxxxxx/backup/20211222064502-full-Gjdz25xwntFqFRn
7.3M    data/appdata_xxxxxxxxx/backup/20211222070501-full-citiBHWVt5OKgGc
7.3M    data/appdata_xxxxxxxxx/backup/20211222072003-full-1kNzmmMaNjd8SEp
7.3M    data/appdata_xxxxxxxxx/backup/20211222074002-full-54A9l1PMmOFgInY
7.3M    data/appdata_xxxxxxxxx/backup/20211222080001-full-YfhhPnXGx6HxIvq
7.3M    data/appdata_xxxxxxxxx/backup/20211222082001-full-zXxb9wrXUWlsLMP
7.3M    data/appdata_xxxxxxxxx/backup/20211222084001-full-heXGQhHp3ZWyGsH
7.3M    data/appdata_xxxxxxxxx/backup/20211222090001-full-oEUpAjqGKSWgRcy
7.3M    data/appdata_xxxxxxxxx/backup/20211222092001-full-efNxFH1MVptZgqb
7.3M    data/appdata_xxxxxxxxx/backup/20211222093508-full-C4jiJhUjF5LBD1T
7.3M    data/appdata_xxxxxxxxx/backup/20211222095502-full-htGApOO7uA3cALN
7.3M    data/appdata_xxxxxxxxx/backup/20211222101501-full-uT9mu1mJMWxoDCl
7.3M    data/appdata_xxxxxxxxx/backup/20211222103002-full-4oxhzThXEn3rZzy
7.3M    data/appdata_xxxxxxxxx/backup/20211222105002-full-H92i95kdGcVcge8
7.3M    data/appdata_xxxxxxxxx/backup/20211222110502-full-puoJQLHucMOMFw1
7.3M    data/appdata_xxxxxxxxx/backup/20211222112502-full-RC4X7lsSEyrEQH5
7.3M    data/appdata_xxxxxxxxx/backup/20211222114009-full-rHf69FUrDY9JKhT
7.3M    data/appdata_xxxxxxxxx/backup/20211222120002-full-DB8u9GFoagyo4nJ
7.3M    data/appdata_xxxxxxxxx/backup/20211222122003-full-axDFtveBmhRVEci
7.3M    data/appdata_xxxxxxxxx/backup/20211222124001-full-MRLdfWibpGGc9KL
7.3M    data/appdata_xxxxxxxxx/backup/20211222130001-full-za2yVDlDx1wO4Lf
7.3M    data/appdata_xxxxxxxxx/backup/20211222132001-full-7AQfUvkhcEaQtMm
7.3M    data/appdata_xxxxxxxxx/backup/20211222134004-full-mpSmYEXP9sbGqdX
7.3M    data/appdata_xxxxxxxxx/backup/20211222160009-full-fUYeRxXCk4FWFYu
7.3M    data/appdata_xxxxxxxxx/backup/20211222191510-full-ITTn84BsGh8NOlK
7.3M    data/appdata_xxxxxxxxx/backup/20211222212502-full-dBjTz2cj2tj1DNt
7.3M    data/appdata_xxxxxxxxx/backup/20211223024531-full-FDDwjWAkZz3Stxd

i configured the backup app via the web gui, and set

Limit restoring points creation to the following hours interval: 01:00 and 06:00

Time interval between two full restoring points: 3 days
Time interval between two partial restoring points: 1 day

the web gui also shows me the same as this command:

www-data@1105961a72f4:~/html$ ./occ backup:point:list
- retreiving data from local
 > found RestoringPoint 20211217173501-full-znh9ZeZtCJjVCff
 > found RestoringPoint 20211218200001-differential-q72lubELMj4YJOr
 > found RestoringPoint 20211219205002-differential-8mkBhNRj8B7bQDf
- retreiving data from external:5
 > found RestoringPoint 20211217173501-full-znh9ZeZtCJjVCff
+----------------------------------------------+---------------------+-----------+----------+-------------------------------------+---------+-----------------------------+------------+-----------------+--+
| Restoring Point                              | Date                | NC        | Database | Parent                              | Comment | Status                      | Instance   | Health          |  |
+----------------------------------------------+---------------------+-----------+----------+-------------------------------------+---------+-----------------------------+------------+-----------------+--+
|  20211217173501-full-znh9ZeZtCJjVCff         | 2021-12-17 17:35:01 | 23.0.0.10 | mysql    |                                     |         | packed,compressed,encrypted | local      | 5D, 7H, 31M ago |  |
|                                              |                     |           |          |                                     |         | packed,compressed,encrypted | external:5 | not complete    |  |
|  20211218200001-differential-q72lubELMj4YJOr | 2021-12-18 20:00:01 | 23.0.0.10 | mysql    | 20211217173501-full-znh9ZeZtCJjVCff |         | not packed                  | local      | not checked     |  |
|  20211219205002-differential-8mkBhNRj8B7bQDf | 2021-12-19 20:50:02 | 23.0.0.10 | mysql    | 20211217173501-full-znh9ZeZtCJjVCff |         | not packed                  | local      | not checked     |  |
+----------------------------------------------+---------------------+-----------+----------+-------------------------------------+---------+-----------------------------+------------+-----------------+--+

so is this normal? can i provide more logs from somewhere? i did turn off automatic backup creation for now...

i originally configured everything with external storage (in v1.0.0), after the upgrade to v1.0.3 i configured the appdata to be stored locally. i guess something got messed up? can i just remove & reinstall the app and start fresh?

PS: thanks for the app, i finally backed my stuff up. i dont only want to complain, i really appreciate the work that goes into creating this, thank all of you!

fuchsi3010 avatar Dec 23 '21 12:12 fuchsi3010

What do you mean by defunct ?

do you have anything in data/nextcloud.log ?

Now, you can:

  • run a full backup manually and see what is happening, this will put your instance in maintenance mode while running it,
  • or run ./occ config:app:set --value 1 backup generate_logs. This will generate a log file at the root of each backup next time it is initiated by the background job.

On a side note, the default delay for full backup is now 24 days.

ArtificialOwl avatar Dec 24 '21 11:12 ArtificialOwl