[Top][All Lists]

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[gnugo-devel] benchmarks

From: Arend Bayer
Subject: [gnugo-devel] benchmarks
Date: Fri, 8 Aug 2003 00:59:45 +0200 (CEST)

The files I used to benchmark the large scale patch are now in CVS,
in the new directory regression/benchmark.

I've attached the script that I used to generate them. I first gathered
12 .sgf-files from games against computer opponents (the 9 from Gifu
plus 3 more from Edmonton). From each, 20 consecutive of GNU Go's moves
will be replayed via reg_genmove (20 should be enough to get realistic
persistent cache effects). These 20 moves are taken in rotation from
1--40, 41--80, ... 201--240 such that each phase of the game is
equally represented.
(This is done automatically with my script as --auto 20 --auto-max 240 <files>.)
The only intervention by me is that I moved GnuGo-Martha into the
endgame phase, because otherwise 25% of the total run time would have
been spent in this game, against an opponent that we probably couldn't
care less about...

Fixing the move to 20 per .gtp file means that the absolute timings
retain some meaning.

Of course, one should extend this suite with games against human
opponents. Also, a script to get convenient output would be worthwile.

(I've just used the primitive shell script below for now.)


if [[ -n $1 ]] ; then

# Make sure all files are in the disk cache
cat *.gtp >/dev/null

for file in *.gtp ; do
        echo "$file:"
        time $GNUGO --mode gtp --quiet <$file >/dev/null

Description: Text document

Description: Text document

reply via email to

[Prev in Thread] Current Thread [Next in Thread]