gnugo-devel
[Top][All Lists]
Advanced

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[gnugo-devel] regression results


From: bump
Subject: [gnugo-devel] regression results
Date: Sun, 14 Nov 2004 19:22:56 -0800

I ran the regressions today with --level 0 and --large-scale
enabled. (Two different sets.)

At level 0 there were an impressive 562 FAILs to 208 unexpected
PASS for a net loss of 354 tests. There were NO CRASHES and the
entire testsuite finished quickly in 1624 seconds, about 1/7
the usual 11426.

With large scale enabled, there were again NO CRASHES.  At
12376 seconds there is a time penalty of about 8.3 percent
and a net loss of 4 tests. (See below.)

The engine is of course 3.6-pre4.

Dan



Large scale results:

./regress.sh . nngs1.tst 
42 unexpected PASS!
./regress.sh . arion.tst 
2 unexpected FAIL: Correct 'Q18|S16', got 'S15'
./regress.sh . lazarus.tst 
14 unexpected FAIL: Correct 'Q15|T5|H5', got 'S13'
./regress.sh . trevorb.tst 
120 unexpected FAIL: Correct 'N2', got 'E2'
./regress.sh . strategy2.tst 
55 unexpected PASS!
89 unexpected FAIL: Correct '(D16|B7|G13)', got 'H11'
./regress.sh . nicklas1.tst 
1107 unexpected PASS!
./regress.sh . trevor.tst 
163 unexpected FAIL: Correct 'B9', got 'C7'
1100 unexpected PASS!
./regress.sh . nngs.tst 
320 unexpected FAIL: Correct 'B15|B16', got 'D17'
330 unexpected FAIL: Correct 'B15|B16', got 'D15'
490 unexpected PASS!
700 unexpected FAIL: Correct 'K17', got 'K16'
1160 unexpected PASS!
1750 unexpected PASS!
./regress.sh . trevorc.tst 
1540 unexpected FAIL: Correct 'M10', got 'M11'
./regress.sh . global.tst 
22 unexpected FAIL: Correct 'F2', got 'H2'
./regress.sh . arend.tst 
9 unexpected FAIL: Correct 'S17', got 'S2'
./regress.sh . strategy4.tst 
167 unexpected PASS!
188 unexpected PASS!
202 unexpected PASS!
./regress.sh . handtalk.tst 
10 unexpected FAIL: Correct 'E9|F8', got 'G8'
./regress.sh . nngs2.tst 
140 unexpected FAIL: Correct 'P5', got 'Q5'
600 unexpected PASS!
./regress.sh . nngs3.tst 
220 unexpected PASS!
390 unexpected FAIL: Correct 'O11', got 'O9'
470 unexpected PASS!
490 unexpected FAIL: Correct 'P15', got 'T13'
950 unexpected PASS!
960 unexpected FAIL: Correct 'L8', got 'L9'
./regress.sh . nngs4.tst 
260 unexpected FAIL: Correct 'A4', got 'D8'
650 unexpected FAIL: Correct 'Q2', got 'G12'
./regress.sh . ninestones.tst 
50 unexpected FAIL: Correct 'R13', got 'S13'
./regress.sh . gunnar.tst 
19 unexpected FAIL: Correct 'L4', got 'L3'
./regress.sh . gifu03.tst 
701 unexpected FAIL: Correct '!O19', got 'O19'
702 unexpected PASS!
./regress.sh . seki.tst 
806 unexpected FAIL: Correct 'C1', got 'A2'
913 unexpected FAIL: Correct 'B3', got 'A2'
./regress.sh . 9x9.tst 
20 unexpected PASS!
320 unexpected PASS!
330 unexpected PASS!
./regress.sh . cgf2004.tst 
80 unexpected PASS!
./regress.sh . kgs.tst 





reply via email to

[Prev in Thread] Current Thread [Next in Thread]