Re: Does --load work with remote execution?

[Ole Tange]

On Wed, Jan 9, 2019 at 11:01 AM Åsmund Skjæveland
<Asmund.Skjaeveland@kartverket.no> wrote:
>
> Does --load work with remote execution?

Yes. The design, however, is not really satisfactory.

Current design does this:

1 Check cached file
2 start caching a new file in the background.
3 If load is under limit: Start another job.

The problem here is that what happens if the load rises after 3? Then
the cached file will be wrong - maybe too low. And often the load will
not rise immediately, but the job started in 3 may take a few seconds
to full CPU usage.

By not starting the caching in the background, GNU Parallel is stuck
waiting for a slow ssh connection to be set up and run a command. This
is bad if you have many hosts.

/Ole