Mauve results

[Mark Wielaard]

Hi all,

The good news.
0.18     32125 PASS and 1074 FAIL
0.19-pre 33330 PASS and  925 FAIL
Note that the total for 0.19-pre is larger since it can run some tests
that 0.18 couldn't even run.

Regressions (which worry me, so I will investigate them a bit more
before release):

+FAIL: gnu.testlet.java.io.ObjectInputOutput.OutputTest: 
gnu.testlet.java.io.ObjectInputOutput.Test$NotSerial (number 1)

+FAIL: gnu.testlet.java.net.URL.URLTest: new URL(string) (number 1)
+FAIL: gnu.testlet.java.net.URL.URLTest: new URL(string) (number 19)
+FAIL: gnu.testlet.java.net.URL.URLTest: new URL(protocol, host, file) (number 
45)
+FAIL: gnu.testlet.java.net.URL.URLTest: new URL(protocol, host, file) (number 
53)

+FAIL: gnu.testlet.java.text.DecimalFormatSymbols.serial (number 1)
+FAIL: gnu.testlet.java.text.DecimalFormatSymbols.serial: uncaught exception: 
java.lang.NullPointerException

Free Swing regressions (I am not too worries about these since there is
a huge number of new PASSes for these. So I assume the few new
regressions are collateral damage. But it would be nice if someone could
analyze these):

+FAIL: gnu.testlet.javax.swing.JLabel.constructor (number 2)
+FAIL: 
gnu.testlet.javax.swing.plaf.basic.BasicLookAndFeel.initComponentDefaults: 
EditorPane (number 2)
+FAIL: 
gnu.testlet.javax.swing.plaf.basic.BasicLookAndFeel.initComponentDefaults: 
TextArea (number 3)
+FAIL: 
gnu.testlet.javax.swing.plaf.basic.BasicLookAndFeel.initComponentDefaults: 
TextPane (number 2)
+FAIL: 
gnu.testlet.javax.swing.plaf.basic.BasicFileChooserUI.getApproveButtonText 
(number 3)
+FAIL: gnu.testlet.javax.swing.plaf.basic.BasicFileChooserUI.getDialogTitle: 
uncaught exception: java.lang.StackOverflowError
+FAIL: gnu.testlet.javax.swing.JToolBar.buttonInsets: insets.top: 5 (number 1)
+FAIL: gnu.testlet.javax.swing.JToolBar.buttonInsets: insets.bottom: 5 (number 
1)
+FAIL: gnu.testlet.javax.swing.JToolBar.buttonInsets: insets.left: 17 (number 1)
+FAIL: gnu.testlet.javax.swing.JToolBar.buttonInsets: insets.right: 17 (number 
1)

BoxLayout seems to have a lot of regressions (see attached).

Some JTable results switched:
-PASS: gnu.testlet.javax.swing.JTable.initializeLocalVars (number 1)
-FAIL: gnu.testlet.javax.swing.JTable.initializeLocalVars (number 2)
+FAIL: gnu.testlet.javax.swing.JTable.initializeLocalVars (number 1)
+PASS: gnu.testlet.javax.swing.JTable.initializeLocalVars (number 2)

+FAIL: gnu.testlet.javax.swing.JMenuItem.constructors: JMenuItem(Action) 
(number 3)
+FAIL: gnu.testlet.javax.swing.JMenuItem.constructors: JMenuItem(Action) 
(number 4)

+FAIL: gnu.testlet.javax.swing.JFileChooser.accept (number 4)
+FAIL: gnu.testlet.javax.swing.JFileChooser.getApproveButtonText (number 1)
+FAIL: gnu.testlet.javax.swing.JFileChooser.getDialogTitle: uncaught exception:
java.lang.StackOverflowError
+FAIL: gnu.testlet.javax.swing.JFileChooser.getFileFilter (number 2)
+FAIL: gnu.testlet.javax.swing.JFileChooser.getFileView (number 1)
+FAIL: gnu.testlet.javax.swing.JFileChooser.getFileView (number 3)
+FAIL: gnu.testlet.javax.swing.JFileChooser.setAcceptAllFileFilterUsed (number 
3)
+FAIL: gnu.testlet.javax.swing.JFileChooser.setAcceptAllFileFilterUsed (number 
4)
+FAIL: gnu.testlet.javax.swing.JFileChooser.setAcceptAllFileFilterUsed: 
uncaught exception: java.lang.ClassCastException: 
javax/swing/plaf/basic/BasicFileChooserUI$AcceptAllFileFilter
+FAIL: gnu.testlet.javax.swing.JFileChooser.setApproveButtonText (number 1)
+FAIL: gnu.testlet.javax.swing.JFileChooser.setApproveButtonText (number 6)
+FAIL: gnu.testlet.javax.swing.JFileChooser.setDialogTitle: uncaught exception:
java.lang.StackOverflowError
+FAIL: gnu.testlet.javax.swing.JFileChooser.setFileView (number 1)
+FAIL: gnu.testlet.javax.swing.JFileChooser.setFileView (number 6)

Some results that are hard to analyse:

gnu.testlet.java.awt.event.MouseEvent.modifiersEx
Seems undeterministic. Sometimes all tests FAIL, other times all tests
PASS.

gnu.testlet.javax.swing.text.html.parser.ParserDelegator.randomTables
Creates as the name says random tables. All test 101 PASS, but since the
PASS messages are random it is difficult to automate a comparison.

gnu.testlet.javax.swing.JFrame.paint5 also undeterministic, sometimes I
get 5, sometimes 10 failures.

All in all not too bad. I'll try and analyze (and hopefully fix the few
non-free-swing regressions). I do worry a bit about the fact that JList
doesn't seem to scroll anymore (see my previous email about the
FreeSwingTestApps). There has been a lot of progress with FreeSwing, and
I know our JLists worked much better then they do now.

It would be appreciated if people could investigate the Free Swing mauve
regressions above and say whether or not they feel they are release
stoppers.

Cheers,

Mark

-- 
Escape the Java Trap with GNU Classpath!
http://www.gnu.org/philosophy/java-trap.html

Join the community at http://planet.classpath.org/

 PASS: gnu.testlet.javax.swing.BoxLayout.horizontal2: 0 (number 1)
 PASS: gnu.testlet.javax.swing.BoxLayout.horizontal2: 0 (number 1)
-PASS: gnu.testlet.javax.swing.BoxLayout.horizontal2: 150 (number 1)
+FAIL: gnu.testlet.javax.swing.BoxLayout.horizontal2: 249 (number 1)
 PASS: gnu.testlet.javax.swing.BoxLayout.horizontal2: 400 (number 1)
-PASS: gnu.testlet.javax.swing.BoxLayout.horizontal2: 150 (number 1)
+FAIL: gnu.testlet.javax.swing.BoxLayout.horizontal2: 249 (number 1)
 PASS: gnu.testlet.javax.swing.BoxLayout.horizontal2: 0 (number 1)
-PASS: gnu.testlet.javax.swing.BoxLayout.horizontal2: 249 (number 1)
+FAIL: gnu.testlet.javax.swing.BoxLayout.horizontal2: 349 (number 1)
 PASS: gnu.testlet.javax.swing.BoxLayout.horizontal2: 400 (number 1)
 PASS: gnu.testlet.javax.swing.BoxLayout.simplehorizontal: 0 (number 1)
 PASS: gnu.testlet.javax.swing.BoxLayout.simplehorizontal: 0 (number 1)
-PASS: gnu.testlet.javax.swing.BoxLayout.simplehorizontal: 200 (number 1)
+FAIL: gnu.testlet.javax.swing.BoxLayout.simplehorizontal: 394 (number 1)
 PASS: gnu.testlet.javax.swing.BoxLayout.simplehorizontal: 400 (number 1)
+FAIL: gnu.testlet.javax.swing.BoxLayout.simplehorizontal: 0 (number 1)
 PASS: gnu.testlet.javax.swing.BoxLayout.simplehorizontal: 0 (number 1)
-PASS: gnu.testlet.javax.swing.BoxLayout.simplehorizontal: 0 (number 1)
-PASS: gnu.testlet.javax.swing.BoxLayout.simplehorizontal: 200 (number 1)
+FAIL: gnu.testlet.javax.swing.BoxLayout.simplehorizontal: 394 (number 1)
 PASS: gnu.testlet.javax.swing.BoxLayout.simplehorizontal: 400 (number 1)
 PASS: gnu.testlet.javax.swing.BoxLayout.simplevertical: 0 (number 1)
 PASS: gnu.testlet.javax.swing.BoxLayout.simplevertical: 0 (number 1)
 PASS: gnu.testlet.javax.swing.BoxLayout.simplevertical: 400 (number 1)
-PASS: gnu.testlet.javax.swing.BoxLayout.simplevertical: 200 (number 1)
-PASS: gnu.testlet.javax.swing.BoxLayout.simplevertical: 0 (number 1)
+FAIL: gnu.testlet.javax.swing.BoxLayout.simplevertical: 389 (number 1)
 PASS: gnu.testlet.javax.swing.BoxLayout.simplevertical: 0 (number 1)
+FAIL: gnu.testlet.javax.swing.BoxLayout.simplevertical: 0 (number 1)
 PASS: gnu.testlet.javax.swing.BoxLayout.simplevertical: 400 (number 1)
-PASS: gnu.testlet.javax.swing.BoxLayout.simplevertical: 200 (number 1)
+FAIL: gnu.testlet.javax.swing.BoxLayout.simplevertical: 389 (number 1)
 PASS: gnu.testlet.javax.swing.BoxLayout.addLayoutComponent: (Component, 
Object) (number 1)
 PASS: gnu.testlet.javax.swing.BoxLayout.addLayoutComponent: (String, 
Component) (number 1)
 PASS: gnu.testlet.javax.swing.BoxLayout.constants (number 1)
 FAIL: gnu.testlet.javax.swing.BoxLayout.constructor (number 2)
 PASS: gnu.testlet.javax.swing.BoxLayout.getLayoutAlignmentX (number 1)
 PASS: gnu.testlet.javax.swing.BoxLayout.getLayoutAlignmentY (number 1)
-PASS: gnu.testlet.javax.swing.BoxLayout.invalidateLayout (number 1)
+FAIL: gnu.testlet.javax.swing.BoxLayout.invalidateLayout (number 1)
 PASS: gnu.testlet.javax.swing.BoxLayout.layoutContainer: testXAxis (number 1)
 PASS: gnu.testlet.javax.swing.BoxLayout.layoutContainer: testXAxis (number 2)
 PASS: gnu.testlet.javax.swing.BoxLayout.layoutContainer: testXAxis (number 3)
-PASS: gnu.testlet.javax.swing.BoxLayout.layoutContainer: testYAxis (number 1)
-PASS: gnu.testlet.javax.swing.BoxLayout.layoutContainer: testYAxis (number 2)
-PASS: gnu.testlet.javax.swing.BoxLayout.layoutContainer: testYAxis (number 3)
+FAIL: gnu.testlet.javax.swing.BoxLayout.layoutContainer: testYAxis (number 1)
+FAIL: gnu.testlet.javax.swing.BoxLayout.layoutContainer: testYAxis (number 2)
+FAIL: gnu.testlet.javax.swing.BoxLayout.layoutContainer: testYAxis (number 3)
 PASS: gnu.testlet.javax.swing.BoxLayout.layoutContainer: testLineAxis (number 
1)
 PASS: gnu.testlet.javax.swing.BoxLayout.layoutContainer: testLineAxis (number 
2)
 PASS: gnu.testlet.javax.swing.BoxLayout.layoutContainer: testLineAxis (number 
3)
-PASS: gnu.testlet.javax.swing.BoxLayout.layoutContainer: testPageAxis (number 
1)
-PASS: gnu.testlet.javax.swing.BoxLayout.layoutContainer: testPageAxis (number 
2)
-PASS: gnu.testlet.javax.swing.BoxLayout.layoutContainer: testPageAxis (number 
3)
+FAIL: gnu.testlet.javax.swing.BoxLayout.layoutContainer: testPageAxis (number 
1)
+FAIL: gnu.testlet.javax.swing.BoxLayout.layoutContainer: testPageAxis (number 
2)
+FAIL: gnu.testlet.javax.swing.BoxLayout.layoutContainer: testPageAxis (number 
3)
 PASS: gnu.testlet.javax.swing.BoxLayout.layoutContainer: testOriginalContainer 
(number 1)
 PASS: gnu.testlet.javax.swing.BoxLayout.maximumLayoutSize (number 1)
-PASS: gnu.testlet.javax.swing.BoxLayout.maximumLayoutSize (number 2)
+FAIL: gnu.testlet.javax.swing.BoxLayout.maximumLayoutSize (number 2)
 PASS: gnu.testlet.javax.swing.BoxLayout.maximumLayoutSize (number 3)
 FAIL: gnu.testlet.javax.swing.BoxLayout.maximumLayoutSize: testXAxis (number 1)
 FAIL: gnu.testlet.javax.swing.BoxLayout.maximumLayoutSize: testYAxis (number 1)
 FAIL: gnu.testlet.javax.swing.BoxLayout.maximumLayoutSize: testLineAxis 
(number 1)
 FAIL: gnu.testlet.javax.swing.BoxLayout.maximumLayoutSize: testPageAxis 
(number 1)
 PASS: gnu.testlet.javax.swing.BoxLayout.minimumLayoutSize (number 1)
-PASS: gnu.testlet.javax.swing.BoxLayout.minimumLayoutSize (number 2)
+FAIL: gnu.testlet.javax.swing.BoxLayout.minimumLayoutSize (number 2)
 PASS: gnu.testlet.javax.swing.BoxLayout.minimumLayoutSize (number 3)
 PASS: gnu.testlet.javax.swing.BoxLayout.preferredLayoutSize (number 1)
 PASS: gnu.testlet.javax.swing.BoxLayout.preferredLayoutSize (number 2)
 PASS: gnu.testlet.javax.swing.BoxLayout.preferredLayoutSize: testYAxis (number 
1)
 PASS: gnu.testlet.javax.swing.BoxLayout.preferredLayoutSize: testLineAxis 
(number 1)
 PASS: gnu.testlet.javax.swing.BoxLayout.preferredLayoutSize: testPageAxis 
(number 1)
-FAIL: gnu.testlet.javax.swing.BoxLayout.preferredLayoutSize: testJSeparator 
(number 1)
+PASS: gnu.testlet.javax.swing.BoxLayout.preferredLayoutSize: testJSeparator 
(number 1)
 PASS: gnu.testlet.javax.swing.BoxLayout.removeLayoutComponent (number 1)

signature.asc
Description: This is a digitally signed message part