[Top][All Lists]

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: Parallel Multicore Usage

From: Rob Sargent
Subject: Re: Parallel Multicore Usage
Date: Sat, 2 May 2020 12:07:45 -0600

If you want one core per job, you could do 240 jobs simultaneously.  Whether the machines can actually handle the jobs is another question - you say nothing of what is in you’re pipeline and how much multithreading is done within any of the stages.

you need to use the --sshloginfile and associated args

On May 2, 2020, at 9:03 AM, Nyasimi Festus <> wrote:


I have a few issues in using GNU Parallel.

I have 150 jobs to run through the same pipeline and each job has different core requirements but utilizes the same pipeline.
I am interested in using GNU parallel to run the jobs in parallel at least 10 at each single time ensuring I utilize all the cores available at my disposal.
Is there a way I have to write my parallel command to ensure I utilize all the cores available to me?

I have 10 nodes each with 24 cores available for this work.

I will really appreciate assistance on this.

reply via email to

[Prev in Thread] Current Thread [Next in Thread]