Re: Using parallel in a cluster

[Ole Tange]

Jays understanding is correct.

If you do not give -j it defaults to -j100% (which seems to be what
you are looking for).

Please read the examples in the man page, and let us know how this can
be explained more clearly.


/Ole

On Wed, Feb 6, 2013 at 3:12 PM, Jay Hacker <jayqhacker@gmail.com> wrote:
>
> My understanding is that you can use, for example, -j50% with --sshlogin
> to use half the cores on each machine in your cluster.  You could also look
> into --load and/or --nice, or running your jobs with niceload(1), to
> dynamically use all available CPU while also leaving capacity for others.
> These and other good options are explained in the manual.
>
>
> On Tue, Feb 5, 2013 at 3:19 PM, yacob sen <yacob_123@yahoo.com> wrote:
>>
>> Dear All,
>>
>> I would like to use the Gnu Parallel inside a HPC machine (cluster) with
>> several nodes and and a handful of core attached to each of the nodes.
>>
>> Up until now I have been using my local machine or a server  with a
>> multiple  processor core that I can count using
>>
>> cat /proc/cpuinfo  | grep "processor" | wc
>>
>> and supply this number depending on the intensiveness of the work not to
>> slowdown a server  and to free up some processor cores for other users
>>
>>  parallel --eta -jn
>>
>> n=is the number of processor core that I want to use.
>>
>> How is this expanded in a cluster with several nodes and cores. Is the
>> same command can be used ? If I and some one else in the cluster ask the
>> same node can this parallel be adversely affected in terms of speed.
>>
>> I am looking forward to hear from you.
>>
>> Regards,
>>
>> Yacob
>
>