[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Re: parallel issue
From: |
Ole Tange |
Subject: |
Re: parallel issue |
Date: |
Wed, 9 Mar 2011 16:40:21 +0100 |
On Tue, Mar 8, 2011 at 10:04 PM, Li Hong <cefs99@gmail.com> wrote:
> Hello,
>
> Trying to use parallel to proceed 280k user id against 31 day web log (avg
> 50m each) to find a match. Got the following output...
>
> [root@tapp03 tmp]# cat SRD_exp_sid_20110208(the 280k user id list) | time
> parallel --eta -j+0 -I @@ " grep -m 1 '\&subscriber_id=@@\&'
> log.2011Jan.clean(processed apache web log file)" >SRD_output_2011Jan
> ....
Is it possible for you to make these available for download:
SRD_exp_sid_20110208
log.2011Jan.clean
Otherwise it can be hard to reproduce the error.
/Ole
Re: parallel issue, Ole Tange, 2011/03/09