duplicacy icon indicating copy to clipboard operation
duplicacy copied to clipboard

Optimized snapshot check and prune

Open sevimo123 opened this issue 2 years ago • 4 comments

Implemented optimizations for checking snapshots (with optional stats) on large datasets, with up to 18x speedup and 2-3x memory reduction. More discussion at the forum: https://forum.duplicacy.com/t/optimizations-for-large-datasets/7233

sevimo123 avatar Feb 07 '23 02:02 sevimo123

This pull request has been mentioned on Duplicacy Forum. There might be relevant details there:

https://forum.duplicacy.com/t/optimizations-for-large-datasets/7233/9

gilbertchen avatar Feb 07 '23 02:02 gilbertchen

Implemented optimizations for finding snapshots for pruning on large datasets, with another order of magnitude speedup for the dry run portion. More discussion at the forum: https://forum.duplicacy.com/t/optimizations-for-large-datasets/7233/10.

sevimo123 avatar Feb 22 '23 10:02 sevimo123

This pull request has been mentioned on Duplicacy Forum. There might be relevant details there:

https://forum.duplicacy.com/t/optimizations-for-large-datasets/7233/16

gilbertchen avatar Feb 22 '23 10:02 gilbertchen

This pull request has been mentioned on Duplicacy Forum. There might be relevant details there:

https://forum.duplicacy.com/t/optimizations-for-large-datasets/7233/18

gilbertchen avatar Feb 23 '23 19:02 gilbertchen