duplicacy icon indicating copy to clipboard operation
duplicacy copied to clipboard

B2 Lifecycle Settings

Open stevenhorner opened this issue 8 years ago • 5 comments

I just pruned my Duplicacy backups which removed 3 revisions but B2 didn't appear to show any change to the Storage Bucket. I noticed that there is a lifecycle setting which by default says:

Keep all versions of the file (default)

Would the above setting mean even if we prune our files that we would not save any space or would the filenames be different so "pruning" would save us space?

stevenhorner avatar Sep 08 '17 15:09 stevenhorner

Duplicacy uses the two-step fossil collection algorithm. In the first step it only renames unreferenced chunks into fossils and doesn't reclaim any space. Only in the second step when it can be sure that fossils are no longer needed they will be remove to release the space. If you run the prune command with the -exclusive switch the two-step fossil collection will be disabled which means unreferenced chunks are removed right away.

The B2 version setting doesn't matter. Turning chunks into fossils is done by hiding the file (via the b2_hide_file api call). Moreover, all Duplicacy chunks are immutable -- if they are two versions of the same file they are going to be identical.

gilbertchen avatar Sep 08 '17 16:09 gilbertchen

I had noticed that I was seeing multiple versions of the snapshot revisions files on B2, which I didn't understand why that would be happening. Part of the pull request I submitted for PR #154 I believe fixed this behavior. This was only merged yesterday, so the next published release should fix that behavior.

leftytennis avatar Sep 08 '17 18:09 leftytennis

My claim that the B2 version setting doesn't matter is wrong. The Keep all versions of the file setting is recommended. See #362 for details.

gilbertchen avatar Feb 21 '18 01:02 gilbertchen

This issue has been mentioned on Duplicacy Forum. There might be relevant details there:

https://forum.duplicacy.com/t/backblaze-b2-bucket-size-does-not-match-storage-size/6836/3

gilbertchen avatar Nov 03 '22 12:11 gilbertchen

This issue has been mentioned on Duplicacy Forum. There might be relevant details there:

https://forum.duplicacy.com/t/backblaze-b2-bucket-size-does-not-match-storage-size/6836/5

gilbertchen avatar Nov 04 '22 12:11 gilbertchen