rsync-time-backup
rsync-time-backup copied to clipboard
rsync hanging w/ 3 open processes over ssh
Hi
I am running rsync_tm_backup to time machine backup my entire laptop. My laptop is running the latest pop-os and my NAS is running Manjaro ARM.
For initial backup I have my computer connected to my NAS directly through the ethernet port. I have assigned the NAS IP 2.2.2.2. Subsequent backups I will add the NAS to my LAN. I just needed to get max speed for the first run, so I connected them directly over gigabit ports.
I have two jobs: a single half hour refresh of the full computer using barebones rsync, and an hourly time machine backup. The rsync command seems to run successfully.
The command I am using is
rsync_tmbackup.sh --rsync-append-flags "-hiva -e \"ssh\" --rsync-path=\"sudo rsync\" -vv --exclude-from=\"/home/user/.config/rsync/exclude.txt\"" --log-dir /var/log/rsynctm_hourly -p 22 / [email protected]:/deimos-hdd/user/pop-os >> /var/log/rsynctm_hourly/cron.log
i am setting rsync-path
in order to run everything as root so i can copy the whole computer without messing up permissions
I know I need to refine my exclusion list to not include some more things, but I wanted to get as close as possible to a full system backup. My exclusion list is
*.cache*
*cache*
*CACHE*
*Cache*
/proc*
proc/*
proc
The tm backup hangs. Right now it is hung here.
2022/02/06 18:04:04 [107599] <f+++++++++ usr/share/texlive/texmf-dist/fonts/tfm/google/roboto/RobotoCondensed-Light-tosf-sc-ly1--base.tfm
2022/02/06 18:04:04 [107599] sender finished //usr/share/texlive/texmf-dist/fonts/tfm/google/roboto/RobotoCondensed-Light-tosf-sc-ly1--base.tfm
2022/02/06 18:04:04 [107599] send_files(1575026, //usr/share/texlive/texmf-dist/fonts/tfm/google/roboto/RobotoCondensed-Light-tosf-sc-ly1.tfm)
2022/02/06 18:04:04 [107599] send_files mapped //usr/share/texlive/texmf-dist/fonts/tfm/google/roboto/RobotoCondensed-Light-tosf-sc-ly1.tfm of size 8040
2022/02/06 18:04:04 [107599] calling match_sums //usr/share/texlive/texmf-dist/fonts/tfm/google/roboto/RobotoCondensed-Light-tosf-sc-ly1.tfm
On the Manjaro NAS I see this after calling ps aux | grep rsync
root 1455 0.0 0.0 15680 6172 ? Ss Feb06 0:00 sudo rsync --server -vvvlHogDtprxe.iLsfxCIvu --log-format=%i%I --new-compress --stats --numeric-ids . /deimos-hdd/user/pop-os/2022-02-06-165614/
root 1459 0.1 0.9 114472 73180 ? S Feb06 1:42 rsync --server -vvvlHogDtprxe.iLsfxCIvu --log-format=%i%I --new-compress --stats --numeric-ids . /deimos-hdd/user/pop-os/2022-02-06-165614/
root 1460 4.0 0.9 264396 78116 ? S Feb06 41:11 rsync --server -vvvlHogDtprxe.iLsfxCIvu --log-format=%i%I --new-compress --stats --numeric-ids . /deimos-hdd/user/pop-os/2022-02-06-165614/
On the host (pop-os) ps aux | grep rsync
returned this last night after it had hung before I went to bed:
root 107541 0.0 0.0 19904 4128 pts/4 S+ Feb06 0:00 bash /usr/local/bin/rsync_tmbackup.sh --rsync-append-flags -hiva -e "ssh" --rsync-path="sudo rsync" -vv --exclude-from="/home/user/.config/rsync/exclude.txt" --log-dir /var/log/rsynctm_hourly -p 22 / [email protected]:/deimos-hdd/jay/pop-os
root 107599 6.1 0.2 190992 167168 pts/4 S+ Feb06 62:08 rsync -e ssh -p 22 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null -D --numeric-ids --links --hard-links --one-file-system --itemize-changes --times --recursive --perms --owner --group --stats --human-readable -hiva -e ssh --compress --rsync-path=sudo rsync -vv --exclude-from=/home/user/.config/rsync/exclude.txt --compress --log-file /var/log/rsynctm_hourly/2022-02-06-165616.log -- / [email protected]:/deimos-hdd/user/pop-os/2022-02-06-165614/
root 107600 0.3 0.0 33072 15392 pts/4 S+ Feb06 3:42 ssh -l user 2.2.2.2 sudo rsync --server -vvvlHogDtprxe.iLsfxCIvu --log-format=%i%I --new-compress --stats --numeric-ids . /deimos-hdd/user/pop-os/2022-02-06-165614/
However, this morning, ps aux | grep rsync
shows nothing on the host, but the Manjaro NAS still has the three calls to rsync --server open.
Edit: I removed the -e "ssh"
, cleared all my logs, wiped the old, hung backup, killed all processes, etc. Running again. Still shows 3 rsync processes on both points