[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Re: [Qemu-devel] [RFC PATCH 2/2] tests/Makefile: comment out flakey test
From: |
Thomas Huth |
Subject: |
Re: [Qemu-devel] [RFC PATCH 2/2] tests/Makefile: comment out flakey tests |
Date: |
Sat, 19 May 2018 08:10:12 +0200 |
User-agent: |
Mozilla/5.0 (X11; Linux x86_64; rv:52.0) Gecko/20100101 Thunderbird/52.7.0 |
On 18.05.2018 20:31, Peter Maydell wrote:
> On 18 May 2018 at 10:14, Alex Bennée <address@hidden> wrote:
>> The following tests keep showing up in failed Travis runs:
>>
>> - test-aio
>> - rcutorture
>> - tpm-crb-test
>> - tpm-tis-test
>>
>> I suspect it is load that causes the problems but they really need to
>> be fixed properly.
>>
>> Signed-off-by: Alex Bennée <address@hidden>
>
> Another flaky test for the collection:
>
> TEST: tests/boot-serial-test... (pid=25144)
> /sparc64/boot-serial/sun4u: **
> ERROR:/home/petmay01/linaro/qemu-for-merges/tests/boot-serial-test.c:140:check_guest_output:
> assertion failed: (output_ok)
> FAIL
>
> Probably another "overly optimistic timeout" setting. (Failed
> for me on x86-64 host just now.)
That test normally finishes within 3 seconds on my machine. The test
timeout is 60 seconds. How much load did you have on that machine to go
from 3s to 60s ?
And even if we increase the timeout, how to find a good value here? I
think we rather need a "no-timeout" switch where we can tell the tests
to not use timeouts and rather run forever instead, until they really
finished? So in normal interactive mode, we'd run with timeouts, but
when running on a loaded builder machine, you'd enable that "no-timeout"
switch to make sure to not run in such "early" timeouts.
Thomas
- [Qemu-devel] [RFC PATCH 0/2] Travis Stability Patches, Alex Bennée, 2018/05/18
- [Qemu-devel] [RFC PATCH 2/2] tests/Makefile: comment out flakey tests, Alex Bennée, 2018/05/18
- Re: [Qemu-devel] [RFC PATCH 2/2] tests/Makefile: comment out flakey tests, Paolo Bonzini, 2018/05/18
- Re: [Qemu-devel] [RFC PATCH 2/2] tests/Makefile: comment out flakey tests, Peter Maydell, 2018/05/18
- Re: [Qemu-devel] [RFC PATCH 2/2] tests/Makefile: comment out flakey tests, Peter Maydell, 2018/05/18
- Re: [Qemu-devel] [RFC PATCH 2/2] tests/Makefile: comment out flakey tests, Stefan Hajnoczi, 2018/05/18
- Re: [Qemu-devel] [RFC PATCH 2/2] tests/Makefile: comment out flakey tests, Peter Maydell, 2018/05/18
[Qemu-devel] [RFC PATCH 1/2] .travis.yml: disable linux-user build for gcov, Alex Bennée, 2018/05/18