From MAILER-DAEMON Mon Aug 23 19:31:04 2010 Received: from mailman by lists.gnu.org with archive (Exim 4.43) id 1OngTn-00010j-Nn for mharc-parallel@gnu.org; Mon, 23 Aug 2010 19:31:03 -0400 Received: from [140.186.70.92] (port=52047 helo=eggs.gnu.org) by lists.gnu.org with esmtp (Exim 4.43) id 1OmzHd-0000dF-8W for parallel@gnu.org; Sat, 21 Aug 2010 21:23:38 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.69) (envelope-from ) id 1OmzHb-0004uf-Ta for parallel@gnu.org; Sat, 21 Aug 2010 21:23:37 -0400 Received: from mail-qy0-f176.google.com ([209.85.216.176]:38872) by eggs.gnu.org with esmtp (Exim 4.69) (envelope-from ) id 1OmzHb-0004uX-QI; Sat, 21 Aug 2010 21:23:35 -0400 Received: by qyk2 with SMTP id 2so4468837qyk.0 for ; Sat, 21 Aug 2010 18:23:35 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:mime-version:sender:received:from:date :x-google-sender-auth:message-id:subject:to:cc:content-type :content-transfer-encoding; bh=WdQXKw7y5GAsW5uP+3LAexka2amD0ADznAbkamTpDAY=; b=tym730/RJ/z8plcC7QT7m34im4A9XKOT+KioFr3Jjs1AfWcTEA2OMf+FpAcG/+ubqL /mP6bBESZUi3La4NLv5/gnKfBxWv+QRAPDc8/IML+BN9tSfVrBsoX+53BiXDE5dpTtnu mNlEmvq2a15hiWkdvhEnOZCKlwpfM+jxWQS8M= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:sender:from:date:x-google-sender-auth:message-id :subject:to:cc:content-type:content-transfer-encoding; b=V6MKvcDY7729QDENcjs47+IuSGuYk6xJykZ1LMlgD/gskMk0hCrpKUB6ykoHwGxPmC Vy0Y8gotTkqVeLyUmiuLMPPW1hrgrSUqnWZ1UTMysrxT+UfH/zO8/o5XxI4ygtPlanrD 2KtpxwunWta/Uw1FOxq9jX+Tc3f6E+oOTzecQ= Received: by 10.224.115.79 with SMTP id h15mr2212240qaq.21.1282440214177; Sat, 21 Aug 2010 18:23:34 -0700 (PDT) MIME-Version: 1.0 Sender: ole.tange@gmail.com Received: by 10.229.216.80 with HTTP; Sat, 21 Aug 2010 18:23:14 -0700 (PDT) From: Ole Tange Date: Sun, 22 Aug 2010 03:23:14 +0200 X-Google-Sender-Auth: GHT3IMToq75EcRDzJrF1TmLG7eQ Message-ID: To: parallel@gnu.org, bug-parallel@gnu.org, info-gnu@gnu.org, bug-directory@gnu.org Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.6 (newer, 2) X-Mailman-Approved-At: Mon, 23 Aug 2010 19:31:02 -0400 Cc: Sandro Cazzaniga , =?ISO-8859-1?Q?Ludovic_Court=E8s?= , Markus Ammer , Tim Cuthbertson , Pavel Nuzhdin , Peter Simons , Phil Sung Subject: GNU Parallel 20100822 released X-BeenThere: parallel@gnu.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: parallel.gnu.org List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 22 Aug 2010 01:23:38 -0000 GNU Parallel 20100822 has been released. It is available for download at: http://ftp.gnu.org/gnu/parallel/ New in this release: * Counting semaphore functionality: start a job in the background. If N jobs are already running, wait for one to complete. Examples: sem 'sleep 2; echo foo'; sem 'sleep 1; echo bar'; sem --wait sem -j2 'sleep 2; echo foo'; sem -j2 'sleep 1; echo bar'; sem --wait * With --colsep a table can be used as input. Example: cat tab_sep_table | parallel --colsep '\t' echo col1 {1} col2 {2} * --trim can remove white space around arguments. * --sshloginfile '..' means use ~/.parallel/sshloginfile * Zero install package. Thanks to Tim Cuthbertson * OpenSUSE package. Thanks to Markus Ammer * NixOS package. Thanks to Ludovic Court=E8s * Web review http://oentend.blogspot.com/2010/08/gnu-parallel.html Thanks to Pavel Nuzhdin * Web review http://psung.blogspot.com/2010/08/gnu-parallel.html Thanks to Phil Sung =3D About GNU Parallel =3D GNU Parallel is a shell tool for executing jobs in parallel using one or more machines. A job is typically a single command or a small script that has to be run for each of the lines in the input. The typical input is a list of files, a list of hosts, a list of users, a list of URLs, or a list of tables. If you use xargs today you will find GNU Parallel very easy to use as GNU Parallel is written to have the same options as xargs. If you write loops in shell, you will find GNU Parallel may be able to replace most of the loops and make them run faster by running several jobs in parallel. If you use ppss or pexec you will find GNU Parallel will often make the command easier to read. GNU Parallel makes sure output from the commands is the same output as you would get had you run the commands sequentially. This makes it possible to use output from GNU Parallel as input for other programs. You can find more about GNU Parallel at: http://www.gnu.org/software/parallel/ Watch the intro video on http://www.youtube.com/watch?v=3DOpaiGYxkSuQ or at http://tinyogg.com/watch/TORaR/ and http://tinyogg.com/watch/hfxKj/ From MAILER-DAEMON Wed Aug 25 09:28:36 2010 Received: from mailman by lists.gnu.org with archive (Exim 4.43) id 1OoG1s-0006VQ-Eu for mharc-parallel@gnu.org; Wed, 25 Aug 2010 09:28:36 -0400 Received: from [140.186.70.92] (port=37109 helo=eggs.gnu.org) by lists.gnu.org with esmtp (Exim 4.43) id 1OnvsA-000769-54 for parallel@gnu.org; Tue, 24 Aug 2010 11:57:15 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.69) (envelope-from ) id 1Onvs8-000632-TF for parallel@gnu.org; Tue, 24 Aug 2010 11:57:14 -0400 Received: from mail-ew0-f41.google.com ([209.85.215.41]:64114) by eggs.gnu.org with esmtp (Exim 4.69) (envelope-from ) id 1Onvs8-00062m-Nv for parallel@gnu.org; Tue, 24 Aug 2010 11:57:12 -0400 Received: by ewy28 with SMTP id 28so3722911ewy.0 for ; Tue, 24 Aug 2010 08:57:11 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:from:to:cc:subject:date :message-id:x-mailer; bh=j8CuLe8EcJcJK/ckJGM5XmPmoFoIEiIPW8BK4DysW9k=; b=tshN461JIJd7InYm2dEJkNUBnakKoYJihzmIKcJbuZMD3TQYkwPBV74XwK7JrW4xgT y5Dq6D0rZBxz114qzfHTlpzjEGY34z6LjhI6+zUX0t67pwezdsdqJeshTSy4gtGAe0Zk 3z87It8c8oO1QcHABiCC/2LukpdVOKooIbT0w= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=from:to:cc:subject:date:message-id:x-mailer; b=Lb+y2eBFXvLBvQpZgEWAF0g9xT9kS1pNjKnkCLMIzJB5PnU8kUMODGFZn+yzMEt1bQ MSceLLlPwILNEhc98E3/ich1JNxFl8xR44Di1ZuJOeo6kVsKDQbqchh1wC7AgsLe+AuL GyFyL0zUQOGYd0XWe/ZdybuPrlNVm7KrdiH8Q= Received: by 10.213.35.6 with SMTP id n6mr5573444ebd.0.1282665430972; Tue, 24 Aug 2010 08:57:10 -0700 (PDT) Received: from localhost.localdomain (saturn.piotrj.org [212.76.57.12]) by mx.google.com with ESMTPS id v59sm345094eeh.4.2010.08.24.08.57.09 (version=TLSv1/SSLv3 cipher=RC4-MD5); Tue, 24 Aug 2010 08:57:09 -0700 (PDT) From: =?UTF-8?q?Piotr=20Jaroszy=C5=84ski?= To: parallel@gnu.org Date: Tue, 24 Aug 2010 17:56:59 +0200 Message-Id: <1282665419-31485-1-git-send-email-p.jaroszynski@gmail.com> X-Mailer: git-send-email 1.7.2.2 X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.6 (newer, 2) X-Mailman-Approved-At: Wed, 25 Aug 2010 09:28:35 -0400 Cc: =?UTF-8?q?Piotr=20Jaroszy=C5=84ski?= Subject: [PATCH] [build] Force the sem symlink creation X-BeenThere: parallel@gnu.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: parallel.gnu.org List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 24 Aug 2010 15:57:15 -0000 Building the project from the tarball fails with: ln: creating symbolic link `sem': File exists Fix by using ln -f --- src/Makefile.am | 2 +- 1 files changed, 1 insertions(+), 1 deletions(-) diff --git a/src/Makefile.am b/src/Makefile.am index 4a03ffe..fb84e8a 100644 --- a/src/Makefile.am +++ b/src/Makefile.am @@ -19,7 +19,7 @@ sem.html: sem.pod Makefile rm -f $(srcdir)/pod2htm* sem: parallel - ln -s parallel sem + ln -sf parallel sem DISTCLEANFILES = parallel.1 sem.1 parallel.html sem.html EXTRA_DIST = parallel sem parallel.1 sem.1 parallel.html sem.html sem.pod -- 1.7.2.2 From MAILER-DAEMON Wed Aug 25 09:28:36 2010 Received: from mailman by lists.gnu.org with archive (Exim 4.43) id 1OoG1s-0006Vb-LI for mharc-parallel@gnu.org; Wed, 25 Aug 2010 09:28:36 -0400 Received: from [140.186.70.92] (port=50208 helo=eggs.gnu.org) by lists.gnu.org with esmtp (Exim 4.43) id 1Oo0IE-0006xp-L5 for parallel@gnu.org; Tue, 24 Aug 2010 16:40:27 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.69) (envelope-from ) id 1Oo0ID-0006Z5-0W for parallel@gnu.org; Tue, 24 Aug 2010 16:40:26 -0400 Received: from mail-ew0-f41.google.com ([209.85.215.41]:42710) by eggs.gnu.org with esmtp (Exim 4.69) (envelope-from ) id 1Oo0IC-0006Yo-Pp for parallel@gnu.org; Tue, 24 Aug 2010 16:40:24 -0400 Received: by ewy28 with SMTP id 28so3989552ewy.0 for ; Tue, 24 Aug 2010 13:40:24 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:from:to:cc:subject:date :message-id:x-mailer; bh=j8CuLe8EcJcJK/ckJGM5XmPmoFoIEiIPW8BK4DysW9k=; b=GLYKGRfJSa+sXJfLOK+IshU0YvqUz3Lyqo0cEvsqaIsAxgE9lNTM+hg/dGwjZ+g2C7 HXmIKcvx9w/DGGArafPYhpBVcXK+p6mXQs5IoxKhsYX2XTySmnQTHCPDEqzbEfA8nqz5 P7PzjTrdYEgmZYhoRVIEKsWE20Gf+qVxysj/E= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=from:to:cc:subject:date:message-id:x-mailer; b=qRoWuz3Updsoe06YVn1HUiiDpyGLh8LdHrKcJ6coD6uXkbFxJrk4kWCTSyYw5qOXtr n31zszcHRCwqJMn/5Fe2QT/D2CE6Lxrhd8//yJzUvNlvFOJDs3OT2LmWxPwna4g+F+Qf oc7hrHY5s5CS0WPrfFRoHpEu1yq8aUBrlk1XA= Received: by 10.213.17.133 with SMTP id s5mr5923852eba.21.1282682423972; Tue, 24 Aug 2010 13:40:23 -0700 (PDT) Received: from localhost.localdomain (saturn.piotrj.org [212.76.57.12]) by mx.google.com with ESMTPS id v8sm775861eeh.2.2010.08.24.13.40.22 (version=TLSv1/SSLv3 cipher=RC4-MD5); Tue, 24 Aug 2010 13:40:22 -0700 (PDT) From: =?UTF-8?q?Piotr=20Jaroszy=C5=84ski?= To: parallel@gnu.org Date: Tue, 24 Aug 2010 22:40:13 +0200 Message-Id: <1282682413-22615-1-git-send-email-p.jaroszynski@gmail.com> X-Mailer: git-send-email 1.7.2.2 X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.6 (newer, 2) X-Mailman-Approved-At: Wed, 25 Aug 2010 09:28:35 -0400 Cc: =?UTF-8?q?Piotr=20Jaroszy=C5=84ski?= Subject: [PATCH] [build] Force the sem symlink creation X-BeenThere: parallel@gnu.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: parallel.gnu.org List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 24 Aug 2010 20:40:27 -0000 Building the project from the tarball fails with: ln: creating symbolic link `sem': File exists Fix by using ln -f --- src/Makefile.am | 2 +- 1 files changed, 1 insertions(+), 1 deletions(-) diff --git a/src/Makefile.am b/src/Makefile.am index 4a03ffe..fb84e8a 100644 --- a/src/Makefile.am +++ b/src/Makefile.am @@ -19,7 +19,7 @@ sem.html: sem.pod Makefile rm -f $(srcdir)/pod2htm* sem: parallel - ln -s parallel sem + ln -sf parallel sem DISTCLEANFILES = parallel.1 sem.1 parallel.html sem.html EXTRA_DIST = parallel sem parallel.1 sem.1 parallel.html sem.html sem.pod -- 1.7.2.2 From MAILER-DAEMON Wed Aug 25 09:28:37 2010 Received: from mailman by lists.gnu.org with archive (Exim 4.43) id 1OoG1s-0006Vh-Rm for mharc-parallel@gnu.org; Wed, 25 Aug 2010 09:28:36 -0400 Received: from [140.186.70.92] (port=43134 helo=eggs.gnu.org) by lists.gnu.org with esmtp (Exim 4.43) id 1Oo0Tf-0000lY-96 for parallel@gnu.org; Tue, 24 Aug 2010 16:52:16 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.69) (envelope-from ) id 1Oo0Te-00083P-8b for parallel@gnu.org; Tue, 24 Aug 2010 16:52:15 -0400 Received: from mail-ew0-f41.google.com ([209.85.215.41]:50201) by eggs.gnu.org with esmtp (Exim 4.69) (envelope-from ) id 1Oo0Te-00083A-38 for parallel@gnu.org; Tue, 24 Aug 2010 16:52:14 -0400 Received: by ewy28 with SMTP id 28so3999128ewy.0 for ; Tue, 24 Aug 2010 13:52:13 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:from:to:subject:date :message-id:x-mailer; bh=j8CuLe8EcJcJK/ckJGM5XmPmoFoIEiIPW8BK4DysW9k=; b=ndbxxTGBU9t+hjQ5BYAycPveYjL6ATbyOucHE/TJpedRpBfayzVMrqEJNcVvbeeP46 TW4QHiyRKDMx8a99gEa/k1ozxUwA5khaqFYav2beYbvw1sXiA1ISySVLc4fq6w/v19RP wSyihwT1K9LIgYZE/hb6TU70I9aYWCLuaqL2s= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=from:to:subject:date:message-id:x-mailer; b=u1aGHgNtNoRfx3TMEagiyN9F5bEmEp2yS3431b52t1KHeQMMvW5kM5jxCqBT5cIhd1 DurmvCpK+DuExJtAJ5s9zGUvjKn5e+VNr7Pa/km8Fy9HMvH2U3HSyTaly4MO0ckmQgHx fC8M+HcaePuSVfWyAkyWz7lfcDDCHK0BNdsD8= Received: by 10.213.34.212 with SMTP id m20mr5836854ebd.24.1282683133042; Tue, 24 Aug 2010 13:52:13 -0700 (PDT) Received: from localhost.localdomain (saturn.piotrj.org [212.76.57.12]) by mx.google.com with ESMTPS id u9sm790252eeh.11.2010.08.24.13.52.11 (version=TLSv1/SSLv3 cipher=RC4-MD5); Tue, 24 Aug 2010 13:52:11 -0700 (PDT) From: =?UTF-8?q?Piotr=20Jaroszy=C5=84ski?= To: parallel@gnu.org Date: Tue, 24 Aug 2010 22:52:03 +0200 Message-Id: <1282683123-23345-1-git-send-email-p.jaroszynski@gmail.com> X-Mailer: git-send-email 1.7.2.2 X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.6 (newer, 2) X-Mailman-Approved-At: Wed, 25 Aug 2010 09:28:35 -0400 Subject: [PATCH] [build] Force the sem symlink creation X-BeenThere: parallel@gnu.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: parallel.gnu.org List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 24 Aug 2010 20:52:16 -0000 Building the project from the tarball fails with: ln: creating symbolic link `sem': File exists Fix by using ln -f --- src/Makefile.am | 2 +- 1 files changed, 1 insertions(+), 1 deletions(-) diff --git a/src/Makefile.am b/src/Makefile.am index 4a03ffe..fb84e8a 100644 --- a/src/Makefile.am +++ b/src/Makefile.am @@ -19,7 +19,7 @@ sem.html: sem.pod Makefile rm -f $(srcdir)/pod2htm* sem: parallel - ln -s parallel sem + ln -sf parallel sem DISTCLEANFILES = parallel.1 sem.1 parallel.html sem.html EXTRA_DIST = parallel sem parallel.1 sem.1 parallel.html sem.html sem.pod -- 1.7.2.2 From MAILER-DAEMON Wed Aug 25 10:52:56 2010 Received: from mailman by lists.gnu.org with archive (Exim 4.43) id 1OoHLT-00033J-TA for mharc-parallel@gnu.org; Wed, 25 Aug 2010 10:52:55 -0400 Received: from [140.186.70.92] (port=35033 helo=eggs.gnu.org) by lists.gnu.org with esmtp (Exim 4.43) id 1OoHLP-0002yj-PL for parallel@gnu.org; Wed, 25 Aug 2010 10:52:52 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.69) (envelope-from ) id 1OoHIq-0005Ll-LM for parallel@gnu.org; Wed, 25 Aug 2010 10:50:13 -0400 Received: from mail-qy0-f169.google.com ([209.85.216.169]:56592) by eggs.gnu.org with esmtp (Exim 4.69) (envelope-from ) id 1OoHIq-0005Ld-In for parallel@gnu.org; Wed, 25 Aug 2010 10:50:12 -0400 Received: by qyk12 with SMTP id 12so5250794qyk.0 for ; Wed, 25 Aug 2010 07:50:11 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:mime-version:sender:received :in-reply-to:references:from:date:x-google-sender-auth:message-id :subject:to:cc:content-type:content-transfer-encoding; bh=ZnxEOoBwqSiR5AqK0aRtucIY1J0k7JvX0pAU2UoX4Y4=; b=ovmQCJ1hIz89rHQXbxZbWUPtETCDrdL0rGA6m2ad3NYmkoXM53pFat+kywEXsyrtmV mFUwfazi65wfjqfQPgM2dmP24t7gHL8VOQO6Ag53bgshZMmTG5pKKGwGw2hN4guo4pLe gx9zhuqHcB4E7GoXASa0lpycnQkx6dMoOFuao= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:sender:in-reply-to:references:from:date :x-google-sender-auth:message-id:subject:to:cc:content-type :content-transfer-encoding; b=EcmNUNlRKqjmjw3g8+8VflXqEDZwk2wHvc6YbTfWDsB9XfiGgszIrHtVcgH3oQ8QMs N0n3OZXlYQbcrL63Hb+8dBT3PRjuSv9B8WvvOtNbVyYUcM9VfopWuQee+yZx1SLdGFEQ ITYg8kqmxGThIlhr0Q6ZaSWT/TxT4DNYBuVEs= Received: by 10.229.222.69 with SMTP id if5mr6072934qcb.24.1282747811021; Wed, 25 Aug 2010 07:50:11 -0700 (PDT) MIME-Version: 1.0 Sender: ole.tange@gmail.com Received: by 10.229.219.1 with HTTP; Wed, 25 Aug 2010 07:49:47 -0700 (PDT) In-Reply-To: <1282665419-31485-1-git-send-email-p.jaroszynski@gmail.com> References: <1282665419-31485-1-git-send-email-p.jaroszynski@gmail.com> From: Ole Tange Date: Wed, 25 Aug 2010 16:49:47 +0200 X-Google-Sender-Auth: CYFnmetm8LrJmPUz8eJ-RFgdQdE Message-ID: To: =?ISO-8859-2?Q?Piotr_Jaroszy=F1ski?= Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.6 (newer, 2) Cc: parallel@gnu.org Subject: Re: [PATCH] [build] Force the sem symlink creation X-BeenThere: parallel@gnu.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: parallel.gnu.org List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 25 Aug 2010 14:52:53 -0000 2010/8/24 Piotr Jaroszy=C5=84ski : > Building the project from the tarball fails with: > > ln: creating symbolic link `sem': File exists Interesting. It does not happen for me. > Fix by using ln -f But your fix will never harm, so it will go into next version. Thanks. /Ole