[Top][All Lists]

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: Dynamically changing remote servers list

From: Douglas A. Augusto
Subject: Re: Dynamically changing remote servers list
Date: Sat, 16 Aug 2014 15:10:07 -0300
User-agent: Mutt/1.5.23 (2014-03-12)

On 16/08/2014 at 11:51,
Achim Gratz <> wrote:

> Just make it the responsibility of the user that each server in the list
> given to parallel is actually reachable, don't second-guess the user.
> That list may actually be something that the user just gets from
> somewhere else, so you should perhaps be flexible with the expected
> format.

If the ability to dynamically include/exclude servers is implemented (for
instance by re-reading a file containing the list of servers) then the user
could take care of maintaining a list of active servers by doing something
like (just to get the idea):

   while true; do parallel -k 'if ssh {} /bin/true; then echo "{}"; fi' ::: 
host1 host2 ... hostN > active_hosts.slf; sleep 10; done

And then starting GNU Parallel as:

   parallel --slf active_hosts.slf ...

Of course, the jobs that were sent to the unavailable servers before they were
detected as down will still fail. But in this case I think it is okay to re-run
GNU Parallel with --resume-failed.


Douglas A. Augusto

reply via email to

[Prev in Thread] Current Thread [Next in Thread]