[Top][All Lists]

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: GNU Parallel Bug Reports Truncated large records

From: Johannes Dröge
Subject: Re: GNU Parallel Bug Reports Truncated large records
Date: Tue, 24 Feb 2015 13:51:33 +0100
User-agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.3.0

Hello Ole,

Am 24.02.2015 um 02:30 schrieb Ole Tange:>> > 1) The processing run-time of 
individual blocks is more than linear with the input size. Therefore, it would 
be best if GNU parallel would allow pass single records or a fixed number of 
records for each job, or at least would not automatically increase the block 
size. Instead, the block size auto-detection increases the block size on large 
individual blocks until only very few processes are being run in parallel which 
then dominate the overall run-time. This behavior strongly impacts the 
granularity of the parallel execution.
> I would recommend using -N, but it segfaults on you example data.

Thanks for your quick fixing! I hadn't seen the -N option in connection with 
--pipe, primarily because the description focuses on the number of arguments to 
pass. Could you please notify me when this issue with my example data is 
solved, or is this not on the priority list and I should investigate on my own?

Gruß Johannes

Johannes Dröge, M.Sc.
Algorithmic Bioinformatics, Heinrich Heine University Düsseldorf, Universitätsstraße 1, 40225 Düsseldorf, Germany
PGP: http://keys.fungs.de/6ea5e4.asc (55F2720303A7F236A94666F20E2360727A6EA5E4)
Web: algbio.cs.uni-duesseldorf.de | Tel/Fax: +49 211 81-12644/13464

Attachment: signature.asc
Description: OpenPGP digital signature

reply via email to

[Prev in Thread] Current Thread [Next in Thread]