backintime icon indicating copy to clipboard operation
backintime copied to clipboard

Backintime always does full backup, even when no files have changed

Open MrAnon-dev opened this issue 3 years ago • 2 comments

Hi!

This is my enviroment

  • Ubuntu 20.04
  • Backintime 1.3.1 from official PPA
  • Snapshots to USB hard disk, NTFS partition

And the problem is what every snapshot that I do, BIT copy again unchanged files, ¿how can I change that? I want to incremental backups

after read some issues #1207, #1093, #1128, #1086 I try add this to config but no luck...

profile1.snapshots.rsync_options.value=--no-perms --no-group --no-owner

I also tried install version 1.1.x but doesn´t work, dependencies problem.

2022-01-08_19-32

thanks!!

MrAnon-dev avatar Jan 08 '22 19:01 MrAnon-dev

Your additional options should help to get the old v1.1.x style permission handling. But this is only relevant when switching from BiT < 1.2 to BiT >= 1.2. When the previous backup was already in BiT >=1.2, the new one should definitely not be a full backup, when no files have changed.

I guess there is some issue with NTFS. NTFS as file system for the backup location should work according to #924, but it is not recommended. Some people report problems with it (e.g. in #762).

AlexSchr avatar Jan 09 '22 11:01 AlexSchr

Hi AlexSchr,

Well, I did a test with ext4 on a usb stick and it seems to have worked fine.

So there is no way for incremental backups to work on NTFS? if it's a problem with permissions mismatch, can't I get rsync to ignore them completely?

Thanks for the help!

MrAnon-dev avatar Jan 09 '22 14:01 MrAnon-dev

Is this related #988?

buhtz avatar Sep 25 '22 11:09 buhtz

Hi @MrAnon-dev, I'm sorry to say that this will always happen with NTFS, because NTFS doesn't support hardlinks. I'm closing this Issue, but feel free to re-open or discuss further if you have more questions.

emtiu avatar Oct 09 '22 23:10 emtiu

@emtiu , this article by Microsoft says that NTFS does support hard links:

Depixelate avatar Oct 02 '23 09:10 Depixelate

Hmm, I see. Thanks for the information! Then I guess it depends on the NTFS driver whether or not rsync can really use those NTFS-native hardlinks.

I guess it's worth keeping this open to find out whether we can/should support NTFS as a target filesystem in principle.

emtiu avatar Oct 02 '23 10:10 emtiu

it depends on the NTFS driver whether or not rsync can really use those NTFS-native hardlinks.

I have just opened an issue for ntfs-3g to add documentation if Linux hardlinks are supported:

https://github.com/tuxera/ntfs-3g/issues/91

Edit: NTFS-3G does support hardlinks so BiT should work (with the now known issues described in https://github.com/bit-team/backintime/issues/988#issuecomment-1733411627)

aryoda avatar Oct 02 '23 11:10 aryoda

I' getting this issue on an external SSD drive formatted as ext4.

  • elementary OS 7.1 (based on Ubuntu 22.04.3)
  • Linux 6.2.0-34-generic
  • Backintime 1.3.3-3

Captura de pantalla de 2023-10-12 16 23 26

Captura de pantalla de 2023-10-12 16 23 34

Gabriel-p avatar Oct 12 '23 19:10 Gabriel-p

@Gabriel-p Could you please double check that your snapshots are really a full copy (= using the same amount of disk space) or if only changed files are copied (unchanged files are hard-linked, use ls -la or stat to check this for files in the snapshot)?

If you are affected by this issue: Could you please apply the workaround described in our README and tell us if it works?

Note: Despite the workaround still some files are unnecessary duplicates because of the open issue https://github.com/bit-team/backintime/issues/988#issuecomment-1733411627

aryoda avatar Oct 12 '23 21:10 aryoda

I think I was wrong. I just checked and although the folder sizes seem equivalent, it appears to be because of hard links. This is what I did:

$ du -hc --max-depth=1 1/   
57G	1/20231011-190002-345
109M	1/20231012-120002-619
123M	1/20231013-095738-704
135M	1/20231011-164539-515
57G	1/
57G	total

Also if each of those folders really occupied ~57 Gbs each, my 250 Gb SSD would be out of space already.

Gabriel-p avatar Oct 13 '23 13:10 Gabriel-p

I always think about a GUI application to better visualize the difference between file size and "on disc occupied size"... 🧠

buhtz avatar Oct 13 '23 13:10 buhtz

I always think about a GUI application to better visualize the difference between file size and "on disc occupied size"... 🧠

Would be great. My confusion originated from using Filelight to check sizes...

Gabriel-p avatar Oct 13 '23 14:10 Gabriel-p

IMHO this is about the hard-link feature which is documented in the FAQ for example. So closing this. Feel free to reopen it.

buhtz avatar Jan 09 '24 15:01 buhtz