bug#30526: java-testng: non-deterministic test failures

[Gábor Boskovits]

2018-02-19 14:55 GMT+01:00 Ricardo Wurmus <address@hidden>:

Sometimes I get this error when building java-testng 6.14.2:

--8<---------------cut here---------------start------------->8---
===============================================
TestNG
Total tests run: 1630, Failures: 1, Skips: 0
===============================================

Failures in <suite> :TestNG, <test> :Regression2
test.testng387.TestNG387.testInvocationCounterIsCorrectForMethodWithDataProvider()
StackTrace:
 java.lang.AssertionError: Arrays do not have the same size:3 != 4
        at test.testng387.TestNG387.testInvocationCounterIsCorrectForMethodWithDataProvider(Unknown Source)
... Removed 27 stack frames

phase `check' failed after 297.3 seconds
--8<---------------cut here---------------end--------------->8---

This actually seems to be known upstream, I consider reopening this bug: https://github.com/cbeust/testng/issues/582.

It seems they just disabled the failing tests. I guess we should do the same.

 

--
Ricardo

GPG: BCA6 89B6 3655 3801 C3C6  2150 197A 5888 235F ACAC
https://elephly.net