parallel
[Top][All Lists]
Advanced

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: Does --load work with remote execution?


From: Ole Tange
Subject: Re: Does --load work with remote execution?
Date: Fri, 11 Jan 2019 13:56:07 +0100

On Wed, Jan 9, 2019 at 11:01 AM Åsmund Skjæveland
<address@hidden> wrote:
>
> Does --load work with remote execution?

Yes. The design, however, is not really satisfactory.

Current design does this:

1 Check cached file
2 start caching a new file in the background.
3 If load is under limit: Start another job.

The problem here is that what happens if the load rises after 3? Then
the cached file will be wrong - maybe too low. And often the load will
not rise immediately, but the job started in 3 may take a few seconds
to full CPU usage.

By not starting the caching in the background, GNU Parallel is stuck
waiting for a slow ssh connection to be set up and run a command. This
is bad if you have many hosts.

/Ole



reply via email to

[Prev in Thread] Current Thread [Next in Thread]