[gnugo-devel] 3.4 regression in 3.6

[Gunnar Farnebäck]

I tried running the regression tests from 3.4 using the 3.6 engine.
The results were 130 PASS and 53 FAIL.

reading:164     PASS 1 C7 [1 C7]
owl:6           FAIL 0 [1 B5]
owl:232         PASS 3 C6 [3 C6]
owl:262         FAIL 1 E8 [0]
ld_owl:20       FAIL critical B3 A4 [critical (B3|A2|A6) (A2|B3)]
ld_owl:315      PASS 1 P18 [1 P18]
ld_owl:316      PASS 1 T16 [1 T16]
ld_owl:406      PASS 1 R3 [1 R3]
ld_owl:407      PASS 0 [0]
ld_owl:408      PASS 1 T3 [1 T3]
ld_owl:409      PASS 0 [0]
ld_owl:411      PASS 0 [0]
ld_owl:412      PASS 1 T2 [1 (R3|T2)]
ld_owl:413      PASS 0 [0]
ld_owl:414      PASS 1 S2 [1 S2]
optics:1201     FAIL 0 0 [1 2 T8 T8]
optics:1801     PASS 0 1 B17 B17 [0 1 (A19|B17) B17]
atari_atari:21  PASS N13 [Q9|N13|O13]
connection:38   FAIL 0 [1 E1]
connection:56   PASS 1 D8 [1 D8]
connection:69   PASS 1 M3 [1 M2|M3]
connection:87   PASS 1 S10 [1 S10]
connection:103  PASS 1 K2 [1 K2]
connection:105  FAIL 2 G8 [1 G7]
break_in:60     PASS 0 [0]
blunder:4       FAIL A5 [B5|C5|C4|D4|E4|E3|F3]
blunder:21      FAIL O4 [L9]
blunder:27      PASS T2 [!R3]
blunder:30      PASS R6 [!O7]
trevora:370     PASS F6 [F6]
trevora:470     PASS C5 [!E2]
trevora:530     PASS H4 [H4]
trevora:550     PASS 1 F2 [1 F2]
nngs1:17        FAIL L7 [L3|L4|J3]
nngs1:34        PASS N15 [!N10|N9|N11|O11|O10]
nngs1:39        FAIL S3 [R7]
strategy:13     FAIL L17 [N18]
strategy:26     FAIL G3 [D3]
strategy:34     PASS E17 [E17]
strategy:45     FAIL H1 [G17|G18|C1]
strategy:50     FAIL Q11 [Q9]
neurogo:12      PASS B10 [B10]
arb:210         FAIL C8 [D8]
rosebud:1       PASS E16 [E16]
golife:4        FAIL B4 [H5]
arion:6         PASS E19 [E19|F19|F18]
viking:1        FAIL C3 [O15]
viking:2        FAIL C4 [E2]
viking:3        FAIL G3 [M15|B7]
lazarus:13      FAIL M12 [R13|M8|L9]
lazarus:16      FAIL L17 [L16]
trevorb:100     FAIL C4 [B1]
trevorb:120     PASS N2 [N2]
trevorb:210     PASS K7 [K7]
trevorb:510     PASS C6 [C6|B6]
strategy2:51    FAIL N5 [P3]
strategy2:53    PASS S15 [S15]
strategy2:73    FAIL E7 [F7|R17|P15]
strategy2:80    PASS Q4 [P4|Q4|Q3|S8]
strategy2:90    FAIL G13 [B14|D17]
nicklas1:501    PASS G7 [G7]
nicklas1:1213   PASS N4 [N4]
nicklas1:1406   PASS B6 [B6]
nicklas2:2103   PASS PASS [PASS]
nicklas3:401    PASS A5 [A5]
nicklas4:1103   PASS C3 [C2|C3]
nicklas5:1211   PASS alive [alive]
manyfaces:9     PASS R15 [!P12]
trevor:410      FAIL C4 [D5|E5]
nngs:220        FAIL R4 [L1|E7|G13|K9]
nngs:320        PASS B15 [B15|B16]
nngs:330        PASS B15 [B15|B16]
nngs:380        PASS H3 [!H2|S1]
nngs:490        FAIL G18 [J18]
nngs:700        FAIL K4 [K17]
nngs:875        PASS C5 [C5]
nngs:900        FAIL S14 [Q15]
nngs:1060       PASS F3 [H3|F3]
nngs:1090       PASS B16 [B17|B16]
nngs:1140       FAIL 1 B10 [1 (A11|B11)]
nngs:1280       FAIL H16 [D13]
nngs:1300       PASS M2 [M2]
nngs:1580       PASS K6 [K6|O6]
nngs:1680       PASS K17 [K17]
trevorc:240     PASS K2 [K2]
trevorc:1440    PASS E12 [E12|F11]
trevorc:1621    PASS 1 D11 [1 D11]
strategy3:114   PASS D7 [D7]
strategy3:119   PASS D9 [D9|J3]
strategy3:135   PASS M13 [M12|N13|M13]
strategy3:141   FAIL J3 [C7]
strategy3:150   PASS Q1 [Q1]
global:1        FAIL A4 [B3]
global:4        FAIL F5 [Q6]
global:5        FAIL F5 [O4]
global:16       PASS O10 [O10]
global:41       PASS B4 [B4]
global:44       FAIL G7 [D5]
vie:41          PASS 1 B4 [1 B4]
arend:29        PASS C14 [B14|C14]
13x13:31        PASS M4 [M4|N4]
13x13:37        FAIL D7 [E10]
13x13:38        PASS G11 [G11]
13x13:53        PASS C6 [C6]
13x13:60        PASS K5 [K5|L5]
13x13:65        PASS H4 [H4]
semeai:51       PASS 1 0 A19 [1 0 (A19|E11)]
trevord:170     PASS Q8 [Q8]
trevord:280     PASS A15 [!E13]
trevord:710     FAIL N3 [M2|J4|L5]
strategy4:155   PASS D18 [D18]
strategy4:167   FAIL E5 [D4]
strategy4:182   PASS F8 [E7|F8]
strategy4:188   FAIL A6 [B6|C4]
strategy4:200   FAIL S8 [P6|P7|Q7|S18]
strategy4:206   PASS L8 [L8]
owl1:293        PASS 0 [0]
handtalk:10     PASS E9 [E9|F8]
nngs2:1         FAIL A4 [B1|A2]
nngs2:140       PASS P5 [P5]
nngs2:180       PASS G16 [G16]
nngs2:270       PASS S19 [S19]
nngs2:300       PASS L10 [!Q13]
nngs2:460       PASS L2 [J4|K2|K3|K4|K5|L2]
nngs2:470       PASS H6 [H6|H5|H3]
nngs3:130       PASS C7 [C7|C9]
nngs3:250       PASS G11 [G11]
nngs3:390       PASS O11 [O11]
nngs3:700       FAIL P7 [Q2]
nngs3:740       PASS D5 [!F2]
nngs3:1110      PASS B7 [B7]
nngs3:1170      FAIL B7 [B1]
nngs3:1190      PASS D17 [D17]
nngs4:40        PASS H3 [H3|F4]
nngs4:50        PASS J17 [J17|E14|F15|C18|B18]
nngs4:160       PASS K8 [K8|L8]
nngs4:170       PASS S6 [S6]
nngs4:270       FAIL P5 [!P5]
nngs4:400       PASS 0 [0]
nngs4:410       PASS E1 [E1]
nngs4:420       PASS G6 [G6]
nngs4:470       FAIL N10 [R8]
nngs4:510       PASS 0 [0]
nngs4:600       PASS L10 [L9|L12|L10]
nngs4:620       PASS G13 [G13|G14]
nngs4:630       PASS B6 [B6]
nngs4:650       PASS Q2 [Q2]
strategy5:223   PASS P16 [P16]
century2002:60  PASS Q14 [Q14]
century2002:80  PASS 1 C17 [1 C17]
century2002:110 FAIL M2 [C8]
century2002:140 PASS P5 [J3|R4|P5]
century2002:260 PASS Q12 [S12|Q12|Q13]
auto02:7        PASS 1 S15 [1 (S15|R15)]
safety:5        FAIL H16 [K8|L9|L7]
ninestones:40   PASS K19 [!D2]
ninestones:50   PASS R13 [R13]
ninestones:150  PASS C5 [C5|D5]
ninestones:370  FAIL O4 [R5]
ninestones:560  PASS J15 [A9|B10|D11|F11|J15|A16]
ninestones:570  PASS J15 [A9|B10|D11|F11|J15|A16]
ninestones:630  FAIL G15 [F5|H7]
ninestones:640  PASS H2 [J2|H2]
tactics1:106    PASS F8 [F8|F6]
manyfaces1:30   FAIL B10 [C14]
manyfaces1:36   PASS P16 [P16]
gunnar:8        PASS H2 [!O13]
arend2:70       PASS O9 [N7|O9]
arend2:80       PASS L2 [L2]
arend2:130      PASS P17 [P17]
arend2:160      PASS O16 [O16]
arend2:230      PASS G14 [!H14]
nando:4         PASS 1 S10 [1 S10|T9]
nando:11        FAIL 1 T4 [1 (S2|T2|S1)]
nando:26        PASS 0 [0]
nando:210       PASS D3 [D3]
nando:211       PASS D5 [D5]
nando:212       PASS E3 [E3]
thrash:3        PASS O5 [O5|N5|N4]
13x13b:8        PASS F10 [F10]
13x13b:18       PASS F3 [F3]
13x13b:40       PASS F8 [F8]
joseki:20       PASS B4 [B4]
Total nodes: 1331058482 2491331 9821018
Total uncertainty: 40.00
130 PASS
53 FAIL

/Gunnar