[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Re: parallel error
|
From: |
Alex Copeland |
|
Subject: |
Re: parallel error |
|
Date: |
Mon, 21 Mar 2011 09:32:20 -0700 |
As you suggested, I tried the commands below on a couple of different
machines - one success, one failure . This is strange, as far as I
understand, all our machines are supposed to be configured the same,
but these results suggest otherwise.
#
# desktop doesn't work (Linux version 2.6.26-2-amd64 (Debian
2.6.26-26lenny2) (dannf@debian.org) (gcc version 4.1.3 20080704
(prerelease) (Debian 4.1.2-25)) #1 SMP Tue Jan 25 05:59:43 UTC 2011
#
copeland@wellington:~> parallel --version
GNU parallel 20110205
Copyright (C) 2007,2008,2009,2010 Ole Tange and Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
This is free software: you are free to change and redistribute it.
GNU parallel comes with no warranty.
Web site: http://www.gnu.org/software/parallel
copeland@wellington:~> parallel --number-of-cores
2
copeland@wellington:~> parallel -S 8/: echo ::: 123
Can't exec "8": No such file or directory at
/jgi/tools/lib/perl5/5.10.1/IPC/Open3.pm line 270.
open3: exec of 8 echo 123 failed at
/home/copeland/local/x86_64/bin/parallel line 2907
copeland@wellington:~> parallel -v echo ::: 123
8 echo 123
Can't exec "8": No such file or directory at
/jgi/tools/lib/perl5/5.10.1/IPC/Open3.pm line 270.
open3: exec of 8 echo 123 failed at
/home/copeland/local/x86_64/bin/parallel line 2907
copeland@wellington:~> parallel -t echo ::: 123
8 echo 123
Can't exec "8": No such file or directory at
/jgi/tools/lib/perl5/5.10.1/IPC/Open3.pm line 270.
open3: exec of 8 echo 123 failed at
/home/copeland/local/x86_64/bin/parallel line 2907
copeland@wellington:~> parallel -D echo ::: 123
1 128
128 0
2 2048
2048 0
3 32768
32768 0
4 524288
524288 -1
Maxlen: 32768,524288,278528
5 278528
278528 -1
Maxlen: 32768,278528,155648
6 155648
155648 -1
Maxlen: 32768,155648,94208
7 94208
94208 0
Maxlen: 94208,155648,124928
8 124928
124928 0
Maxlen: 124928,155648,140288
9 140288
140288 -1
Maxlen: 124928,140288,132608
10 132608
132608 -1
Maxlen: 124928,132608,128768
11 128768
128768 0
Maxlen: 128768,132608,130688
12 130688
130688 0
Maxlen: 130688,132608,131648
13 131648
131648 -1
Maxlen: 130688,131648,131168
14 131168
131168 -1
Maxlen: 130688,131168,130928
15 130928
130928 0
Maxlen: 130928,131168,131048
16 131048
131048 0
Maxlen: 131048,131168,131108
17 131108
131108 -1
Maxlen: 131048,131108,131078
18 131078
131078 -1
Maxlen: 131048,131078,131063
19 131063
131063 0
Maxlen: 131063,131078,131070
20 131070
131070 0
Maxlen: 131070,131078,131074
21 131074
131074 -1
Maxlen: 131070,131074,131072
22 131072
131072 -1
Maxlen: 131070,131072,131071
23 131071
131071 0
Wanted procs: 2
MultifileQueue->empty
RecordQueue->empty
CommandLineQueue->empty
JobQueue->empty
MultifileQueue->empty
RecordQueue->empty
cmd_line->number_of_args 1
Time to fork ten procs: (processes so far: 1)
MultifileQueue->empty 1
RecordQueue->empty 1
CommandLineQueue->empty 1
JobQueue->empty 1
RecordQueue-unget ''
Limited to procs: 1
Running jobs before on :: 0
JobQueue->empty
Try starting a job on :
JobQueue->empty
Command to run on 'SSHLogin=HASH(0x2001618)': '8 echo 123'
1 processes. Starting (1): 8 echo 123
Started as seq 1
Job started on :
Running jobs after on :: 1 of 1
Reaper called 1
Reaper exit 1
Start draining
jobs running: 1 1 Memory usage:32083968
Reaper called 1
died (255): 1>>joboutput 8 echo 123
ERR:
Can't exec "8": No such file or directory at
/jgi/tools/lib/perl5/5.10.1/IPC/Open3.pm line 270.
open3: exec of 8 echo 123 failed at
/home/copeland/local/x86_64/bin/parallel line 2907
OUT:
<<joboutput 8 echo 123
Running jobs before on :: 0
MultifileQueue->empty 1
RecordQueue->empty 1
CommandLineQueue->empty 1
JobQueue->empty 1
Running jobs after on :: 0 of 1
Reaper exit 1
Reaper called 1
Reaper exit 1
MultifileQueue->empty 1
RecordQueue->empty 1
CommandLineQueue->empty 1
JobQueue->empty 1
MultifileQueue->empty 1
RecordQueue->empty 1
CommandLineQueue->empty 1
JobQueue->empty 1
Done draining
#
# another server (Linux version 2.6.28.9-1jgi-amd64-k8-smp
(root@chekov) (gcc version 4.1.2 20061115 (prerelease) (Debian
4.1.1-21)) #1 SMP Wed Mar 25 13:18:14 PDT 2009
#
> parallel --number-of-cores
16
copeland@thallium:~> parallel -S 8/: echo ::: 123
123
copeland@thallium:~> parallel -v echo ::: 123
echo 123
123
copeland@thallium:~> parallel -t echo ::: 123
echo 123
123
copeland@thallium:~> parallel -D echo ::: 123
1 128
128 0
2 2048
2048 0
3 32768
32768 0
4 524288
524288 -1
Maxlen: 32768,524288,278528
5 278528
278528 -1
Maxlen: 32768,278528,155648
6 155648
155648 -1
Maxlen: 32768,155648,94208
7 94208
94208 0
Maxlen: 94208,155648,124928
8 124928
124928 0
Maxlen: 124928,155648,140288
9 140288
140288 -1
Maxlen: 124928,140288,132608
10 132608
132608 -1
Maxlen: 124928,132608,128768
11 128768
128768 0
Maxlen: 128768,132608,130688
12 130688
130688 0
Maxlen: 130688,132608,131648
13 131648
131648 -1
Maxlen: 130688,131648,131168
14 131168
131168 -1
Maxlen: 130688,131168,130928
15 130928
130928 0
Maxlen: 130928,131168,131048
16 131048
131048 0
Maxlen: 131048,131168,131108
17 131108
131108 -1
Maxlen: 131048,131108,131078
18 131078
131078 -1
Maxlen: 131048,131078,131063
19 131063
131063 0
Maxlen: 131063,131078,131070
20 131070
131070 0
Maxlen: 131070,131078,131074
21 131074
131074 -1
Maxlen: 131070,131074,131072
22 131072
131072 -1
Maxlen: 131070,131072,131071
23 131071
131071 0
Wanted procs: 16
MultifileQueue->empty
RecordQueue->empty
CommandLineQueue->empty
JobQueue->empty
MultifileQueue->empty
RecordQueue->empty
cmd_line->number_of_args 1
Time to fork ten procs: (processes so far: 1)
MultifileQueue->empty 1
RecordQueue->empty 1
CommandLineQueue->empty 1
JobQueue->empty 1
RecordQueue-unget ''
Limited to procs: 1
Running jobs before on :: 0
JobQueue->empty
Try starting a job on :
JobQueue->empty
Command to run on 'SSHLogin=HASH(0x21ec3d8)': 'echo 123'
1 processes. Starting (1): echo 123
Started as seq 1
Job started on :
Running jobs after on :: 1 of 1
Reaper called 1
Reaper exit 1
Start draining
jobs running: 1 1 Memory usage:32067584
Reaper called 1
died (0): 1>>joboutput echo 123
ERR:
OUT:
123
<<joboutput echo 123
Running jobs before on :: 0
MultifileQueue->empty 1
RecordQueue->empty 1
CommandLineQueue->empty 1
JobQueue->empty 1
Running jobs after on :: 0 of 1
Reaper exit 1
Reaper called 1
Reaper exit 1
MultifileQueue->empty 1
RecordQueue->empty 1
CommandLineQueue->empty 1
JobQueue->empty 1
MultifileQueue->empty 1
RecordQueue->empty 1
CommandLineQueue->empty 1
JobQueue->empty 1
Done draining
On Mon, Mar 21, 2011 at 1:59 AM, Ole Tange <ole@tange.dk> wrote:
> On Mon, Mar 21, 2011 at 3:54 AM, Alex Copeland <accopeland@lbl.gov> wrote:
>> Thanks.
>> Maybe coincidence, but 8 is the number of cpus on the system which
>> returns the errors below.
>
> Do you have another machine you can test on? If so: Can you reproduce
> the behaviour on that machine?
>
>>> parallel --version
>> GNU parallel 20110205
>
> Looks fine.
>
>>> parallel echo ::: 123
>
> Try:
>
> parallel --number-of-cores
> parallel -S 8/: echo ::: 123
> parallel -v echo ::: 123
> parallel -t echo ::: 123
> parallel -D echo ::: 123
>
>
> /Ole
>