alvinstarr

got side tracked a bit. I will take a look at your changes and see if it helps our situation. We have a backup and an incremental of our 27TB...

bbcp is defiantly not a replacement for rsync because of delete and sync of existing files like you mentioned. Also for lots of small files like we are running here...

We have not turned on dedup. My fear was that it would use up too much memory. There are 2 python processes running. the main command using 65G and a...

It looks like it may have finished but then puked. ``` scl enable rh-python38 'wyng --dest=file:/edocs_snapshots/prod/wyng.backup --local=EDOCS_VOLUMEGROUP1/edocs_SNAP_thinpool send PROD' Wyng 0.8beta release 20231002 Un-encrypted archive 'file:/edocs_snapshots/prod/wyng.backup' Last updated 2024-02-11 23:01:42.216172...

We would hope to do a full copy and then incremental copies based on the tick/tock snapshots. It took almost 7 days to backup the full volume. looking at the...

Is there a way to disable compression? I have run a smaller volume with differing chunk sizes but the backup time remains relatively constant. The time increased a bit when...

An interesting observation. The first 3 blurps of traffic are: 1) with 128K blocks 2) with 2048K blocks 3) with 2048K blocks and compression set to zstd:1 Those tests were...

This change allows the DigitalOcean plugin to load and somewhat work but other things fail. Which is good in a way.