Re: Problem Autotesting executables

[Ralf Wildenhues]

[ Cc:ed the list again ]

Hi Nathaniel,

* Nathaniel D. Sizemore wrote on Tue, Jan 10, 2006 at 06:48:16PM CET:
> On Jan 10, 2006, at 2:07 AM, Ralf Wildenhues wrote:
> >
> >Show testsuite.log.  Something else must be going on.
> 
> See below.  The executable formally known as 'foo' is vorpal --  
> without arguments it prints some help info and exits with return code  
> 0.  The output from vorpal that Autotest sees in stdout is correct,  
> and I've verified manually that the return code is correct.

Except that..

> ## ---------------------- ##
> ## Detailed failed tests. ##
> ## ---------------------- ##
> 
> 1. testsuite.at:123: testing ...
> testsuite.at:123: vorpal
> --- /dev/null 2004-06-24 12:05:26.000000000 -0600
> +++ /home/research/sizemore/projects/vorpal/tests/testsuite.dir/at- 
> stderr        2006-01-10 10:39:10.000000000 -0700
> @@ -0,0 +1,20 @@
> +
> +Usage: vorpal -i filename [-o filename] [-dim num] [-vdim num]
> +              [-dt num] [-n num] [-d num] [-r num] [-sd] [-nodump]
> +              [-dom kind]
> +
> +         -i filename    : read input from file 'filename'
*snip*
> +         -nff           : run without dumping flowfields for DSMC runs
> +
> +       NB: Command-line switches will always override input file  
> variables.
> +
> stdout:
> No input file.  Quitting.
> 1. testsuite.at:123: 1.  (testsuite.at:123): FAILED (testsuite.at:123)

The help output is given on stderr.  If you want that ignored, you need
  AT_CHECK([foo], [], [stdout], [ignore])

as documented.

Cheers,
Ralf