[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
[PULL 02/25] tests/avocado: remove flaky test marking for test_sbsaref_e
|
From: |
Alex Bennée |
|
Subject: |
[PULL 02/25] tests/avocado: remove flaky test marking for test_sbsaref_edk2_firmware |
|
Date: |
Wed, 11 Oct 2023 11:33:06 +0100 |
After testing locally I decided to revert a5754847e0 (tests/avocado: Disable the
test_sbsaref_edk2_firmware by default) as the test seems pretty
stable:
env QEMU_TEST_FLAKY_TESTS=1 retry.py -n 50 -c -- \
./tests/venv/bin/avocado run \
./tests/avocado/machine_aarch64_sbsaref.py:Aarch64SbsarefMachine.test_sbsaref_edk2_firmware
yields:
Results summary:
0: 50 times (100.00%), avg time 2.064 (0.04 varience/0.19 deviation)
Ran command 50 times, 50 passes
Maybe f0ec14c78c (tests/avocado: Fix console data loss) has made it
more reliable?
Cc: Thomas Huth <thuth@redhat.com>
Reviewed-by: Philippe Mathieu-Daudé <philmd@linaro.org>
Signed-off-by: Alex Bennée <alex.bennee@linaro.org>
Message-Id: <20231009164104.369749-3-alex.bennee@linaro.org>
diff --git a/tests/avocado/machine_aarch64_sbsaref.py
b/tests/avocado/machine_aarch64_sbsaref.py
index b272053eaf..bdd1efc768 100644
--- a/tests/avocado/machine_aarch64_sbsaref.py
+++ b/tests/avocado/machine_aarch64_sbsaref.py
@@ -75,7 +75,6 @@ def fetch_firmware(self):
"sbsa-ref",
)
- @skipUnless(os.getenv('QEMU_TEST_FLAKY_TESTS'), 'Test is not reliable')
def test_sbsaref_edk2_firmware(self):
"""
:avocado: tags=cpu:cortex-a57
--
2.39.2
- [PULL 00/25] testing, gdbstub and plugin updates, Alex Bennée, 2023/10/11
- [PULL 02/25] tests/avocado: remove flaky test marking for test_sbsaref_edk2_firmware,
Alex Bennée <=
- [PULL 10/25] plugins: Check if vCPU is realized, Alex Bennée, 2023/10/11
- [PULL 04/25] gitlab: shuffle some targets and reduce avocado noise, Alex Bennée, 2023/10/11
- [PULL 14/25] hw/core/cpu: Return static value with gdb_arch_name(), Alex Bennée, 2023/10/11
- [PULL 13/25] target/arm: Move the reference to arm-core.xml, Alex Bennée, 2023/10/11
- [PULL 19/25] gdbstub: Replace gdb_regs with an array, Alex Bennée, 2023/10/11
- [PULL 01/25] tests/avocado: update firmware to enable OpenBSD test on sbsa-ref, Alex Bennée, 2023/10/11
- [PULL 08/25] gdbstub: Fix target_xml initialization, Alex Bennée, 2023/10/11
- [PULL 05/25] tests/docker: make docker engine choice entirely configure driven, Alex Bennée, 2023/10/11