Re: parallel interprets rsync log file format options as files to transfer that do not exist

[Ole Tange]

On Thu, May 11, 2017 at 5:39 PM, Jason Paul Joines <jason@joines.org> wrote:
> GNU Parallel Users,
>
>
>         I am using GNU Parallel version 20170422 on Scientific Linux
> release 6.6.  When using rsync log file format options with parallel,
> the logs are filled with errors because each log file format option gets
> interpreted as a file to transfer that does not exist.

You are writing to the same file in parallel. That will not work.

>         I get the same behavior if I enclose the options in single
> quotes instead of double quotes, put the log-file-format option before
> the log-file option, or pass the the transfer list into a BASH script
> that contains:  parallel -j 8 rsync -aHAX --delete --log-file-format='%o
> %f %L %l %b %i %t' --log-file ../testlog {} ../ddir/ ::: $@
>
>         Any ideas how to get parallel and rsync log-file-format options
> to cooperate?

Try this:

parallel -j 8 rsync -aHAX --delete --log-file-format='%o %f %L %l %b
%i %t' --log-file ../testlog{#} {} ../ddir/ ::: $@

This will create a new file for each job. Or this:

parallel -j 8 rsync -aHAX --delete --log-file-format="'%o %f %L %l %b
%i %t'" --log-file /dev/stdout {} ../ddir/ ::: * > ../logfile


/Ole