parallel
[Top][All Lists]
Advanced

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: parallel wget in perl


From: yacob sen
Subject: Re: parallel wget in perl
Date: Tue, 5 Feb 2013 02:34:58 -0800 (PST)

Dear Ole,

Thank you very much for your suggestions. The command you have suggested did not work for me (I suspect that @teams is not picking the variables as it should) ,i.e.

system "parallel --eta -j+0  wget ftp://xxx.xx.xx/pub/${year}/{}${day}.txt ::: @teams";

This is the error message :

Computers / CPU cores / Max jobs to run
1:local / 4 / 3

Computer:jobs running/jobs completed/%of started jobs/Average seconds to complete
/bin/bash: $'\302\240wget': command not found
/bin/bash: $'\302\240wget': command not found
/bin/bash: $'\302\240wget': command not found
ETA: 0s 0left 0.00avg  local:0/3/100%/0.3s 



Kind regards
Yacob

--- On Mon, 4/2/13, Ole Tange <ole@tange.dk> wrote:

From: Ole Tange <ole@tange.dk>
Subject: Re: parallel wget in perl
To: "yacob sen" <yacob_123@yahoo.com>
Cc: parallel@gnu.org
Date: Monday, 4 February, 2013, 0:29

On Thu, Jan 31, 2013 at 5:22 PM, yacob sen <yacob_123@yahoo.com> wrote:
>
> Here is what I have tried (the snippet of the perl script):
>
> my $year= '2013';
>  my $day='01'
> @teams =( 'aa', 'bb', 'cc');
>
> There are as an example three files in the ftp server of the format:
>
> aa01.txt
> bb01.txt
> cc01.tx
>
> which I want to download.
>
> I have tried the following:
>
> system " echo  @teams  | parallel --eta -j+0  wget
> ftp://xxx.xx.xx/pub/${year}/{}${day}.txt";
>
> but  wget tried to fetch "aa bb cc" as one file:
>
> ftp://xxx.xx.xx/pub/2013/aa%bb%cc01.txt
>  => `aa bb cc01.txt'
> No such file `aa bb cc01.txt'.

system "parallel --eta -j+0  wget
ftp://xxx.xx.xx/pub/${year}/{}${day}.txt ::: @teams";

/Ole


reply via email to

[Prev in Thread] Current Thread [Next in Thread]