[avr-gcc-list] AVR atmega128 GCC 4.3.3 Testresults comparision

[Boyapati, Anitha]

Hello,

I am running GCC DejaGNU testsuite for target AVR atmega128 on VM (Virtual box 
with Windows XP as host OS and Kubuntu as guest OS). Basically, the testing is 
carried out using avr-gdb which attaches to simulavr using target remote 
protocol (I can attach the expect scripts and elaborate the test setup if 
required). The following command triggered the testing:

make check RUNTESTFLAGS="--target_board=atmega128-sim"

I see lot of difference between test results of Mike Stein's and that of mine 
(for GCC 4.3.3). Attached is the truncated summary file generated by DejaGNU 
for GCC 4.3.3. As the original file is around 3MB, I tried to put mostly 
failures and unsupported test cases in the truncated report. Link for Mike 
Steins's results for AVR target: 
http://gcc.gnu.org/ml/gcc-testresults/2009-01/msg00257.html

There are around 8580 failures in the attached report while the number is 
around 715 in Mike Stein's test report. I am wondering if some switches are 
incorrectly used. Pl share your ideas.



Truncated Results:

Test Run By avr32 on Tue Oct 13 11:30:38 2009
Target is avr-unknown-none
Host   is i686-pc-linux-gnu

                === gcc tests ===

Schedule of variations:
    atmega128-sim
Running target atmega128-sim
Running 
/home/avr32/avr8/gcc-4.3.3/gcc/testsuite/gcc.c-torture/compile/compile.exp ...
PASS: gcc.c-torture/compile/20000105-1.c (test for excess errors)
PASS: gcc.c-torture/compile/20000105-1.c (test for excess errors)
PASS: gcc.c-torture/compile/20000105-1.c (test for excess errors)
PASS: gcc.c-torture/compile/20000105-1.c (test for excess errors)
PASS: gcc.c-torture/compile/20000105-1.c (test for excess errors)
...
Running 
/home/avr32/avr8/gcc-4.3.3/gcc/testsuite/gcc.target/x86_64/abi/abi-x86_64.exp 
...
Running 
/home/avr32/avr8/gcc-4.3.3/gcc/testsuite/gcc.target/xstormy16/xstormy16.exp ...
Running 
/home/avr32/avr8/gcc-4.3.3/gcc/testsuite/gcc.test-framework/test-framework.exp 
...

                === gcc Summary ===

# of expected passes            27690
# of unexpected failures        8580
# of unexpected successes       1
# of expected failures          91
# of unresolved testcases       7463
# of untested testcases         560
# of unsupported tests          501
/home/avr32/avr8/gcc-4.3.3/obj-var/gcc/xgcc  version 4.3.3 (GCC)


Thanks
Anitha

avr_gcc_summary_truncated.txt
Description: avr_gcc_summary_truncated.txt