Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

rsync hanging w/ 3 open processes over ssh #244

Open
stanleyjs opened this issue Feb 7, 2022 · 0 comments
Open

rsync hanging w/ 3 open processes over ssh #244

stanleyjs opened this issue Feb 7, 2022 · 0 comments

Comments

@stanleyjs
Copy link

stanleyjs commented Feb 7, 2022

Hi

I am running rsync_tm_backup to time machine backup my entire laptop. My laptop is running the latest pop-os and my NAS is running Manjaro ARM.

For initial backup I have my computer connected to my NAS directly through the ethernet port. I have assigned the NAS IP 2.2.2.2. Subsequent backups I will add the NAS to my LAN. I just needed to get max speed for the first run, so I connected them directly over gigabit ports.

I have two jobs: a single half hour refresh of the full computer using barebones rsync, and an hourly time machine backup.
The rsync command seems to run successfully.

The command I am using is

rsync_tmbackup.sh --rsync-append-flags "-hiva -e \"ssh\" --rsync-path=\"sudo rsync\" -vv --exclude-from=\"/home/user/.config/rsync/exclude.txt\"" --log-dir /var/log/rsynctm_hourly -p 22 / [email protected]:/deimos-hdd/user/pop-os >> /var/log/rsynctm_hourly/cron.log

i am setting rsync-path in order to run everything as root so i can copy the whole computer without messing up permissions

I know I need to refine my exclusion list to not include some more things, but I wanted to get as close as possible to a full system backup. My exclusion list is

*.cache*
*cache*
*CACHE*
*Cache*
/proc*
proc/*
proc

The tm backup hangs. Right now it is hung here.

2022/02/06 18:04:04 [107599] <f+++++++++ usr/share/texlive/texmf-dist/fonts/tfm/google/roboto/RobotoCondensed-Light-tosf-sc-ly1--base.tfm
2022/02/06 18:04:04 [107599] sender finished //usr/share/texlive/texmf-dist/fonts/tfm/google/roboto/RobotoCondensed-Light-tosf-sc-ly1--base.tfm
2022/02/06 18:04:04 [107599] send_files(1575026, //usr/share/texlive/texmf-dist/fonts/tfm/google/roboto/RobotoCondensed-Light-tosf-sc-ly1.tfm)
2022/02/06 18:04:04 [107599] send_files mapped //usr/share/texlive/texmf-dist/fonts/tfm/google/roboto/RobotoCondensed-Light-tosf-sc-ly1.tfm of size 8040
2022/02/06 18:04:04 [107599] calling match_sums //usr/share/texlive/texmf-dist/fonts/tfm/google/roboto/RobotoCondensed-Light-tosf-sc-ly1.tfm

On the Manjaro NAS I see this after calling ps aux | grep rsync

root        1455  0.0  0.0  15680  6172 ?        Ss   Feb06   0:00 sudo rsync --server -vvvlHogDtprxe.iLsfxCIvu --log-format=%i%I --new-compress --stats --numeric-ids . /deimos-hdd/user/pop-os/2022-02-06-165614/
root        1459  0.1  0.9 114472 73180 ?        S    Feb06   1:42 rsync --server -vvvlHogDtprxe.iLsfxCIvu --log-format=%i%I --new-compress --stats --numeric-ids . /deimos-hdd/user/pop-os/2022-02-06-165614/
root        1460  4.0  0.9 264396 78116 ?        S    Feb06  41:11 rsync --server -vvvlHogDtprxe.iLsfxCIvu --log-format=%i%I --new-compress --stats --numeric-ids . /deimos-hdd/user/pop-os/2022-02-06-165614/

On the host (pop-os) ps aux | grep rsync returned this last night after it had hung before I went to bed:

root      107541  0.0  0.0  19904  4128 pts/4    S+   Feb06   0:00 bash /usr/local/bin/rsync_tmbackup.sh --rsync-append-flags -hiva -e "ssh"  --rsync-path="sudo rsync" -vv --exclude-from="/home/user/.config/rsync/exclude.txt" --log-dir /var/log/rsynctm_hourly -p 22 / [email protected]:/deimos-hdd/jay/pop-os
root      107599  6.1  0.2 190992 167168 pts/4   S+   Feb06  62:08 rsync -e ssh -p 22 -o StrictHostKeyChecking=no -o UserKnownHostsFile=/dev/null -D --numeric-ids --links --hard-links --one-file-system --itemize-changes --times --recursive --perms --owner --group --stats --human-readable -hiva -e ssh --compress --rsync-path=sudo rsync -vv --exclude-from=/home/user/.config/rsync/exclude.txt --compress --log-file /var/log/rsynctm_hourly/2022-02-06-165616.log -- / [email protected]:/deimos-hdd/user/pop-os/2022-02-06-165614/
root      107600  0.3  0.0  33072 15392 pts/4    S+   Feb06   3:42 ssh -l user 2.2.2.2 sudo rsync --server -vvvlHogDtprxe.iLsfxCIvu --log-format=%i%I --new-compress --stats --numeric-ids . /deimos-hdd/user/pop-os/2022-02-06-165614/

However, this morning, ps aux | grep rsync shows nothing on the host, but the Manjaro NAS still has the three calls to rsync --server open.

Edit: I removed the -e "ssh", cleared all my logs, wiped the old, hung backup, killed all processes, etc. Running again. Still shows 3 rsync processes on both points

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant