Help with output redirect please.

wizardknight · December 21, 2017 at 11:44 PM

I have loaded my Rock64 with LibreElec, and I am also using it as my Samba server.

I want to run a sync between the two USB hard drives I have attached to maintain a backup of my media.

I can't seem to get the command quite right. I want to copy the data, and redirect the output to a text file so I can see what it is doing later on.

I do want it to overwrite the old log file.

This is the command I am trying to use:

Code

rsync -rav --modify-window=300 --homan-readable --progress  --stats --force --delete /var/media/8TB_WD/ /var/media/8TB_WD2/ |& tee /var/media/8TB_WD2/synclog.txt 

-sh: syntax error: unexpected "&"

I have also tried > but I get no log file output at all.

Code

rsync -rav --modify-window=300 --homan-readable --progress  --stats --force --delete /var/media/8TB_WD/ /var/media/8TB_WD2/ > /var/media/8TB_WD2/synclog.txt

If I cut off the redirect, it outputs to bash exactly what I would expect, but I can't get it to output to a log file.

Works with output to bash ->

Code

rsync -rav --modify-window=300 --homan-readable --progress  --stats --force --delete /var/media/8TB_WD/ /var/media/8TB_WD2/

Can someone make a suggestion. I am probably missing something crazy simple, but just can't see it.

PS for some reason the word hu.man is censored here. Please replace the homan with hu.man when reading my code above.

subzero79 · December 22, 2017 at 12:16 AM

Maybe try

rsync -rav --modify-window=300 --homan-readable --progress --log-file=var/media/8TB_WD2/synclog.txt --force --delete /var/media/8TB_WD/ /var/media/8TB_WD2/ &>/dev/null

subzero79 · December 22, 2017 at 12:17 AM

take out the redirect if you want to see in terminal the output.

wizardknight · December 22, 2017 at 12:44 AM

It would be nice to get the output in the terminal and the log file, but I can live with not having it in the terminal.

Thanks for the suggestion, but no luck. The rsync starts, but there is no log file.

I am using almost identical code on my dd-wrt router, and it works there as expected.

Code

DD-WRT:
rsync -rav --modify-window=300 --hu.man-readable --progress  --stats --force --delete /tmp/mnt/8TB_USB/ /tmp/mnt/5TB_Seagate_USB/ > /tmp/mnt/8TB_USB/rsync_Status.txt

subzero79 · December 22, 2017 at 6:46 AM

Ive miss a slash in the log file path? Did you fix that?

**nickr** · December 22, 2017 at 6:56 AM Official Post

from the man page

Code

--log-file=FILE
This option causes rsync to log what it is doing to a file.  This is similar to the logging that  a  daemon  does,  but  can  be
requested  for  the client side and/or the server side of a non-daemon transfer.  If specified as a client option, transfer log‐
ging will be enabled with a default format of "%i %n%L".  See the --log-file-format option if you wish to override this..

subzero79 · December 22, 2017 at 7:11 AM

Quote from wizardknight

Thanks for the suggestion, but no luck. The rsync starts, but there is no log file.

Just came back home and test it and it works. Just correct the path in the --log-file option

**vpeter** · December 22, 2017 at 7:51 AM

For general use

Code

some_command 2>&1 | tee log_file

wizardknight · December 22, 2017 at 9:32 PM

Just tried both suggestions, and there was no log file created.

Suggestion #1

Code

rsync -rav --modify-window=300 --hu.man-readable --progress --log-file=/var/media/8TB_WD2/synclog.txt --force --delete /var/media/8TB_WD/ /var/media/8TB_WD2/ &>/dev/null

Suggestion #2

Code

rsync -rav --modify-window=300 --hu.man-readable --progress --force --delete /var/media/8TB_WD/ /var/media/8TB_WD2/ 2>&1 | tee /var/media/8TB_WD2/synclog.txt

Terminal output:

Code

^CLibreELEC:/var/media/8TB_WD2/Media/Movies # rsync -rav --modify-window=300 --hu.man-readable --progress --force --delete /var/media/8TB_WD/ /var/media/8TB_WD2/ 2>&1 | tee /var/media/8TB_WD2/synclog.txt

sending incremental file list
deleting synclog.txt
./
Media/Epsoides/Hogans Heroes/Hogans.Heroes.S1.DVDRip/
Media/Epsoides/Hogans Heroes/Hogans.Heroes.S1.DVDRip/Hogans.Heroes.1x32.dvdrip.xvid-BBBear_TMindTV.avi
        314.32M 100%   50.49MB/s    0:00:05 (xfr#1, ir-chk=1013/63529)

Second SSH to check for log file:

Code

LibreELEC (Raybuntu): rb-leia20 (ROCK64.arm)
LibreELEC:~ # ls
backup       music        pictures     tvshows
lost+found   nohup.out    screenshots  videos
LibreELEC:~ # cd ..
LibreELEC:/ # ls
bin      etc      lib      proc     sbin     sys      usr
dev      flash    media    run      storage  tmp      var
LibreELEC:/ # cd media/
LibreELEC:/var/media # ls
8TB_WD   8TB_WD2
LibreELEC:/var/media # cd 8TB_WD2
LibreELEC:/var/media/8TB_WD2 # ls
Apps                       Other
Bios                       PhoneStuff
Documents                  Pics
Drivers                    System Volume Information
ISOs                       gamez
Kodi                       tomato_137_7_14_16.cfg
Media
LibreELEC:/var/media/8TB_WD2 #

No log file here :(

Display More

Am I missing something, or is the system not working right?

I feel like an idiot. I can't see any reason why all of these would fail to generate some kind of output file.

I did just notice a .fuse_hidden0000f49000000005 file being created when I kick off these commands.

I am assuming that is a temp file for rsync, but it is the only thing at the root of that drive which is new.

It also vanishes when I kill the rsync command.

Thanks for the suggestions.

Maybe I need to get out my voodoo chicken bones and grass skirt...

Could be running low on magic smoke.

subzero79 · December 23, 2017 at 1:32 AM

I didn’t test to output the log to the destination disk maybe is getting deleted at the end. Try another location maybe /storage for the log file

wizardknight · December 23, 2017 at 4:39 AM

Quote from subzero79

I didn’t test to output the log to the destination disk maybe is getting deleted at the end. Try another location maybe /storage for the log file

I redirected the log to storage, and it worked. A gold star to you.

Code

rsync -rav --modify-window=300 --hu.man-readable --progress --log-file=/storage/backup/synclog.txt --force --delete /var/media/8TB_WD/ /var/media/8TB_WD2/ &>/dev/null

Code

LibreELEC:~/backup # ls
synclog.txt

Now the question is why can't I write to my external HD as root? That is just all kinds of special.

nickr

Can you tell me why hum.an is a censored word? I have to admit I am curious.

Is this place ran by aliens, or powered by the screams of children? That would make sense.

**nickr** · December 23, 2017 at 4:50 AM Official Post

No I don't know, I was going to correct you on your options, but it wouldn't let me, and I realised that your post was deliberately misspelled.

I'll see if someone higher up the foad chain can help with that.

PS apparently f o o d is banned too.

wizardknight · December 23, 2017 at 4:59 AM

Quote from nickr

No I don't know, I was going to correct you on your options, but it wouldn't let me, and I realised that your post was deliberately misspelled.

I'll see if someone higher up the foad chain can help with that.

PS apparently f o o d is banned too.

It must be aliens. They don't want the secret getting out. Homans are f00d!

wizardknight · December 23, 2017 at 8:52 AM

Resolved.

I am not sure how, but I can redirect to my external hd now.

The command is the same as the one I first tried.

Code

rsync -rav --modify-window=300 --homan-readable --progress  --stats --force --delete /var/media/8TB_WD/ /var/media/8TB_WD2/ > /var/media/8TB_WD2/synclog.txt

I guess I was not biting my tongue just right.

Now to stick it in cron and see if it plays nice there...