[Top][All Lists]

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

"open files" with --files --pipe

From: Thomas Sattler
Subject: "open files" with --files --pipe
Date: Thu, 28 Feb 2013 11:57:19 +0100
User-agent: Mozilla/5.0 (X11; Linux i686; rv:17.0) Gecko/20130215 Thunderbird/17.0.3

Hi there ...

I tried to use the --pipe and --files options and found
that parallel sometimes stops working. It seems as if
this is somehow related to ulimit's "open files". I
can reproduce it with the following commands:

$ ulimit -n 500; yes | parallel --files --pipe true | nl | tail -n3
   488  /tmp/7T9kEbESkM.par
   489  /tmp/7uqQGUS8r9.par
   490  /tmp/69W44vvzOv.par

$ ulimit -n 400; yes | parallel --files --pipe true | nl | tail -n3
   390  /tmp/5d_P8viQaW.par
   391  /tmp/_NNQspv5Yp.par
   392  /tmp/e54eVHuqNt.par

$ ulimit -n 300; yes | parallel --files --pipe true | nl | tail -n3
   289  /tmp/IUfa7Gzukd.par
   290  /tmp/lu9tP4M0nG.par
   291  /tmp/dA4yMsrkGV.par

The strange thing is, setting the limit to 200 makes
parallel run fine, but pause for a few seconds every
~185 files.


reply via email to

[Prev in Thread] Current Thread [Next in Thread]