rsync-time-backup icon indicating copy to clipboard operation
rsync-time-backup copied to clipboard

rsync hanging w/ 3 open processes over ssh

Open stanleyjs opened this issue 2 years ago • 0 comments

Hi

I am running rsync_tm_backup to time machine backup my entire laptop. My laptop is running the latest pop-os and my NAS is running Manjaro ARM.

For initial backup I have my computer connected to my NAS directly through the ethernet port. I have assigned the NAS IP 2.2.2.2. Subsequent backups I will add the NAS to my LAN. I just needed to get max speed for the first run, so I connected them directly over gigabit ports.

I have two jobs: a single half hour refresh of the full computer using barebones rsync, and an hourly time machine backup. The rsync command seems to run successfully.

The command I am using is

rsync_tmbackup.sh --rsync-append-flags "-hiva -e \"ssh\" --rsync-path=\"sudo rsync\" -vv --exclude-from=\"/home/user/.config/rsync/exclude.txt\"" --log-dir /var/log/rsynctm_hourly -p 22 / [email protected]:/deimos-hdd/user/pop-os >> /var/log/rsynctm_hourly/cron.log

i am setting rsync-path in order to run everything as root so i can copy the whole computer without messing up permissions

I know I need to refine my exclusion list to not include some more things, but I wanted to get as close as possible to a full system backup. My exclusion list is

*.cache*
*cache*
*CACHE*
*Cache*
/proc*
proc/*
proc

The tm backup hangs. Right now it is hung here.

2022/02/06 18:04:04 [107599] <f+++++++++ usr/share/texlive/texmf-dist/fonts/tfm/google/roboto/RobotoCondensed-Light-tosf-sc-ly1--base.tfm
2022/02/06 18:04:04 [107599] sender finished //usr/share/texlive/texmf-dist/fonts/tfm/google/roboto/RobotoCondensed-Light-tosf-sc-ly1--base.tfm
2022/02/06 18:04:04 [107599] send_files(1575026, //usr/share/texlive/texmf-dist/fonts/tfm/google/roboto/RobotoCondensed-Light-tosf-sc-ly1.tfm)
2022/02/06 18:04:04 [107599] send_files mapped //usr/share/texlive/texmf-dist/fonts/tfm/google/roboto/RobotoCondensed-Light-tosf-sc-ly1.tfm of size 8040
2022/02/06 18:04:04 [107599] calling match_sums //usr/share/texlive/texmf-dist/fonts/tfm/google/roboto/RobotoCondensed-Light-tosf-sc-ly1.tfm

On the Manjaro NAS I see this after calling ps aux | grep rsync

root        1455  0.0  0.0  15680  6172 ?        Ss   Feb06   0:00 sudo rsync --server -vvvlHogDtprxe.iLsfxCIvu --log-format=%i%I --new-compress --stats --numeric-ids . /deimos-hdd/user/pop-os/2022-02-06-165614/
root        1459  0.1  0.9 114472 73180 ?        S    Feb06   1:42 rsync --server -vvvlHogDtprxe.iLsfxCIvu --log-format=%i%I --new-compress --stats --numeric-ids . /deimos-hdd/user/pop-os/2022-02-06-165614/
root        1460  4.0  0.9 264396 78116 ?        S    Feb06  41:11 rsync --server -vvvlHogDtprxe.iLsfxCIvu --log-format=%i%I --new-compress --stats --numeric-ids . /deimos-hdd/user/pop-os/2022-02-06-165614/

On the host (pop-os) ps aux | grep rsync returned this last night after it had hung before I went to bed:

root      107541  0.0  0.0  19904  4128 pts/4    S+   Feb06   0:00 bash /usr/local/bin/rsync_tmbackup.sh --rsync-append-flags -hiva -e "ssh"  --rsync-path="sudo rsync" -vv --exclude-from="/home/user/.config/rsync/exclude.txt" --log-dir /var/log/rsynctm_hourly -p 22 / [email protected]:/deimos-hdd/jay/pop-os
root      107599  6.1  0.2 190992 167168 pts/4   S+   Feb06  62:08 rsync -e ssh -p 22 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null -D --numeric-ids --links --hard-links --one-file-system --itemize-changes --times --recursive --perms --owner --group --stats --human-readable -hiva -e ssh --compress --rsync-path=sudo rsync -vv --exclude-from=/home/user/.config/rsync/exclude.txt --compress --log-file /var/log/rsynctm_hourly/2022-02-06-165616.log -- / [email protected]:/deimos-hdd/user/pop-os/2022-02-06-165614/
root      107600  0.3  0.0  33072 15392 pts/4    S+   Feb06   3:42 ssh -l user 2.2.2.2 sudo rsync --server -vvvlHogDtprxe.iLsfxCIvu --log-format=%i%I --new-compress --stats --numeric-ids . /deimos-hdd/user/pop-os/2022-02-06-165614/

However, this morning, ps aux | grep rsync shows nothing on the host, but the Manjaro NAS still has the three calls to rsync --server open.

Edit: I removed the -e "ssh", cleared all my logs, wiped the old, hung backup, killed all processes, etc. Running again. Still shows 3 rsync processes on both points

stanleyjs avatar Feb 07 '22 15:02 stanleyjs