qemu-commits
[Top][All Lists]
Advanced
[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[Qemu-commits] [qemu/qemu] 7e3dca: tests/avocado: machine aarch64: stand

From: Peter Maydell
Subject: [Qemu-commits] [qemu/qemu] 7e3dca: tests/avocado: machine aarch64: standardize locati...
Date: Thu, 05 Sep 2024 10:02:44 -0700 
  Branch: refs/heads/staging
  Home:   https://github.com/qemu/qemu
  Commit: 7e3dca5bca68046c9ccd14c0c91f22fa256817c4
      
https://github.com/qemu/qemu/commit/7e3dca5bca68046c9ccd14c0c91f22fa256817c4
  Author: Cleber Rosa <crosa@redhat.com>
  Date:   2024-09-04 (Wed, 04 Sep 2024)

  Changed paths:
    M tests/avocado/machine_aarch64_sbsaref.py
    M tests/avocado/machine_aarch64_virt.py

  Log Message:
  -----------
  tests/avocado: machine aarch64: standardize location and RO access

The tests under machine_aarch64_virt.py and machine_aarch64_sbsaref.py
should not be writing to the ISO files.  By adding "media=cdrom" the
"ro" is automatically set.

While at it, let's use a single code style and hash for the ISO url.

Signed-off-by: Cleber Rosa <crosa@redhat.com>
Tested-by: Marcin Juszkiewicz <marcin.juszkiewicz@linaro.org>
Message-ID: <20240806173119.582857-5-crosa@redhat.com>
Reviewed-by: Philippe Mathieu-Daudé <philmd@linaro.org>
Message-ID: <20240830133841.142644-2-thuth@redhat.com>
Signed-off-by: Thomas Huth <thuth@redhat.com>


  Commit: 8dceb48e23159eda9428fc678511716c64e2da33
      
https://github.com/qemu/qemu/commit/8dceb48e23159eda9428fc678511716c64e2da33
  Author: Cleber Rosa <crosa@redhat.com>
  Date:   2024-09-04 (Wed, 04 Sep 2024)

  Changed paths:
    M tests/avocado/boot_xen.py

  Log Message:
  -----------
  tests/avocado/boot_xen.py: fetch kernel during test setUp()

The kernel is a common blob used in all tests.  By moving it to the
setUp() method, the "fetch asset" plugin will recognize the kernel and
attempt to fetch it and cache it before the tests are started.

Signed-off-by: Cleber Rosa <crosa@redhat.com>
Message-ID: <20240806173119.582857-7-crosa@redhat.com>
Reviewed-by: Akihiko Odaki <akihiko.odaki@daynix.com>
Tested-by: Marcin Juszkiewicz <marcin.juszkiewicz@linaro.org>
Message-ID: <20240830133841.142644-3-thuth@redhat.com>
Signed-off-by: Thomas Huth <thuth@redhat.com>


  Commit: a14841264efcd3edd62a24b681164702b8efc86e
      
https://github.com/qemu/qemu/commit/a14841264efcd3edd62a24b681164702b8efc86e
  Author: Cleber Rosa <crosa@redhat.com>
  Date:   2024-09-04 (Wed, 04 Sep 2024)

  Changed paths:
    M tests/avocado/machine_aarch64_sbsaref.py

  Log Message:
  -----------
  tests/avocado/machine_aarch64_sbsaref.py: allow for rw usage of image

When the OpenBSD based tests are run in parallel, the previously
single instance of the image would become corrupt.  Let's give each
test its own snapshot.

Signed-off-by: Cleber Rosa <crosa@redhat.com>
Suggested-by: Alex Bennée <alex.bennee@linaro.org>
Message-ID: <20240806173119.582857-9-crosa@redhat.com>
Reviewed-by: Philippe Mathieu-Daudé <philmd@linaro.org>
Tested-by: Marcin Juszkiewicz <marcin.juszkiewicz@linaro.org>
Message-ID: <20240830133841.142644-4-thuth@redhat.com>
Signed-off-by: Thomas Huth <thuth@redhat.com>


  Commit: 657136c6539c103d7705b9f4bc8bc00a6ffba0ad
      
https://github.com/qemu/qemu/commit/657136c6539c103d7705b9f4bc8bc00a6ffba0ad
  Author: Cleber Rosa <crosa@redhat.com>
  Date:   2024-09-04 (Wed, 04 Sep 2024)

  Changed paths:
    M pythondeps.toml
    M tests/Makefile.include

  Log Message:
  -----------
  Bump avocado to 103.0

This bumps Avocado to latest the LTS release.

An LTS release is one that can receive bugfixes and guarantees
stability for a much longer period and has incremental minor releases
made.

Even though the 103.0 LTS release is pretty a rewrite of Avocado when
compared to 88.1, the behavior of all existing tests under
tests/avocado has been extensively tested no regression in behavior
was found.

To keep behavior of jobs as close as possible with previous version,
this version bump keeps the execution serial (maximum of one task at a
time being run).

Reference: 
https://avocado-framework.readthedocs.io/en/103.0/releases/lts/103_0.html
Signed-off-by: Cleber Rosa <crosa@redhat.com>
Tested-by: Marcin Juszkiewicz <marcin.juszkiewicz@linaro.org>
Message-ID: <20240806173119.582857-2-crosa@redhat.com>
Tested-by: Philippe Mathieu-Daudé <philmd@linaro.org>
Message-ID: <20240830133841.142644-5-thuth@redhat.com>
Signed-off-by: Thomas Huth <thuth@redhat.com>


  Commit: c67cb553f11fe20397e20b861dbf5a04df93f5e3
      
https://github.com/qemu/qemu/commit/c67cb553f11fe20397e20b861dbf5a04df93f5e3
  Author: Thomas Huth <thuth@redhat.com>
  Date:   2024-09-04 (Wed, 04 Sep 2024)

  Changed paths:
    M tests/avocado/avocado_qemu/linuxtest.py

  Log Message:
  -----------
  tests/avocado/avocado_qemu: Fix the "from" statements in linuxtest.py

Without this change, the new Avocado v103 fails to find the tests
that are based on the LinuxTest class.

Suggested-by: Cleber Rosa <crosa@redhat.com>
Tested-by: Philippe Mathieu-Daudé <philmd@linaro.org>
Message-ID: <20240830133841.142644-6-thuth@redhat.com>
Signed-off-by: Thomas Huth <thuth@redhat.com>


  Commit: b5347978a908adfeb0c01a6e9c87f3f183cbb8a1
      
https://github.com/qemu/qemu/commit/b5347978a908adfeb0c01a6e9c87f3f183cbb8a1
  Author: Thomas Huth <thuth@redhat.com>
  Date:   2024-09-04 (Wed, 04 Sep 2024)

  Changed paths:
    M tests/avocado/boot_linux_console.py
    M tests/avocado/machine_s390_ccw_virtio.py

  Log Message:
  -----------
  tests/avocado/boot_linux_console: Remove the s390x subtest

We've got a much more sophisticated, Fedora-based test for s390x
("test_s390x_fedora" in another file) already, so the test in
boot_linux_console.py seems to be rather a waste of precious test
cycles. Thus move the command line check and delete the s390x
test in boot_linux_console.py.

Reviewed-by: Daniel P. Berrangé <berrange@redhat.com>
Message-ID: <20240830133841.142644-7-thuth@redhat.com>
Signed-off-by: Thomas Huth <thuth@redhat.com>


  Commit: 5ec1eec11000ef118b2a87c330245ffaa475f5ee
      
https://github.com/qemu/qemu/commit/5ec1eec11000ef118b2a87c330245ffaa475f5ee
  Author: Thomas Huth <thuth@redhat.com>
  Date:   2024-09-04 (Wed, 04 Sep 2024)

  Changed paths:
    A python/wheels/pycotap-1.3.1-py3-none-any.whl
    M pythondeps.toml

  Log Message:
  -----------
  python: Install pycotap in our venv if necessary

The upcoming functional tests will require pycotap for providing
TAP output from the python-based tests. Since we want to be able
to run some of the tests offline by default, too, let's install
it along with meson in our venv if necessary (it's size is only
5 kB, so adding the wheel here should not really be a problem).

The wheel file has been obtained with:

 pip download --only-binary :all: --dest . --no-cache pycotap

Tested-by: Philippe Mathieu-Daudé <philmd@linaro.org>
Reviewed-by: Daniel P. Berrangé <berrange@redhat.com>
Message-ID: <20240830133841.142644-8-thuth@redhat.com>
Signed-off-by: Thomas Huth <thuth@redhat.com>


  Commit: fa32a634329f4b2cdab8e380d5ccf263b1491daa
      
https://github.com/qemu/qemu/commit/fa32a634329f4b2cdab8e380d5ccf263b1491daa
  Author: Thomas Huth <thuth@redhat.com>
  Date:   2024-09-04 (Wed, 04 Sep 2024)

  Changed paths:
    M MAINTAINERS
    A tests/functional/qemu_test/__init__.py
    A tests/functional/qemu_test/cmd.py
    A tests/functional/qemu_test/config.py
    A tests/functional/qemu_test/testcase.py

  Log Message:
  -----------
  tests/functional: Add base classes for the upcoming pytest-based tests

The files are mostly a copy of the tests/avocado/avocado_qemu/__init__.py
file with some adjustments to get rid of the Avocado dependencies (i.e.
we also have to drop the LinuxSSHMixIn and LinuxTest for now).

The emulator binary and build directory are now passed via
environment variables that will be set via meson.build later.

Signed-off-by: Daniel P. Berrangé <berrange@redhat.com>
Message-ID: <20240830133841.142644-9-thuth@redhat.com>
Signed-off-by: Thomas Huth <thuth@redhat.com>


  Commit: 84e4a27feda50323361af775ffe21fd26db3a051
      
https://github.com/qemu/qemu/commit/84e4a27feda50323361af775ffe21fd26db3a051
  Author: Thomas Huth <thuth@redhat.com>
  Date:   2024-09-04 (Wed, 04 Sep 2024)

  Changed paths:
    M tests/functional/qemu_test/testcase.py

  Log Message:
  -----------
  tests/functional: Set up logging

Create log files for each test separately, one file that contains
the basic logging and one that contains the console output.

Reviewed-by: Daniel P. Berrangé <berrange@redhat.com>
Message-ID: <20240830133841.142644-10-thuth@redhat.com>
Signed-off-by: Thomas Huth <thuth@redhat.com>


  Commit: cf1f31089c9452835acae01e32f032869919c0cb
      
https://github.com/qemu/qemu/commit/cf1f31089c9452835acae01e32f032869919c0cb
  Author: Thomas Huth <thuth@redhat.com>
  Date:   2024-09-04 (Wed, 04 Sep 2024)

  Changed paths:
    M tests/Makefile.include

  Log Message:
  -----------
  tests/Makefile.include: Increase the level of indentation in the help text

The next patch is going to add some entries that need more space between
the command and the help text, so let's increase the indentation here
first.

Reviewed-by: Philippe Mathieu-Daudé <philmd@linaro.org>
Tested-by: Philippe Mathieu-Daudé <philmd@linaro.org>
Reviewed-by: Alex Bennée <alex.bennee@linaro.org>
Message-ID: <20240830133841.142644-11-thuth@redhat.com>
Signed-off-by: Thomas Huth <thuth@redhat.com>


  Commit: 1497377857ae4f41688f112903387032d939fb6e
      
https://github.com/qemu/qemu/commit/1497377857ae4f41688f112903387032d939fb6e
  Author: Thomas Huth <thuth@redhat.com>
  Date:   2024-09-04 (Wed, 04 Sep 2024)

  Changed paths:
    M tests/Makefile.include
    A tests/functional/meson.build
    M tests/meson.build

  Log Message:
  -----------
  tests/functional: Prepare the meson build system for the functional tests

Provide a meson.build file for the upcoming python-based functional
tests, and add some wrapper glue targets to the tests/Makefile.include
file. We are going to use two "speed" modes for the functional tests:
The "quick" tests can be run at any time (i.e. also during "make check"),
while the "thorough" tests should only be run when running a
"make check-functional" test run (since these tests might download
additional assets from the internet).

The changes to the meson.build files are partly based on an earlier
patch by Ani Sinha.

Reviewed-by: Philippe Mathieu-Daudé <philmd@linaro.org>
Tested-by: Philippe Mathieu-Daudé <philmd@linaro.org>
Message-ID: <20240830133841.142644-12-thuth@redhat.com>
Signed-off-by: Thomas Huth <thuth@redhat.com>


  Commit: cce85725f10fbe92481e8314986e69dbe6ca0dd1
      
https://github.com/qemu/qemu/commit/cce85725f10fbe92481e8314986e69dbe6ca0dd1
  Author: Thomas Huth <thuth@redhat.com>
  Date:   2024-09-04 (Wed, 04 Sep 2024)

  Changed paths:
    M MAINTAINERS
    R tests/avocado/cpu_queries.py
    R tests/avocado/empty_cpu_model.py
    R tests/avocado/mem-addr-space-check.py
    R tests/avocado/pc_cpu_hotplug_props.py
    R tests/avocado/virtio_version.py
    M tests/functional/meson.build
    A tests/functional/test_cpu_queries.py
    A tests/functional/test_empty_cpu_model.py
    A tests/functional/test_mem_addr_space.py
    A tests/functional/test_pc_cpu_hotplug_props.py
    A tests/functional/test_virtio_version.py

  Log Message:
  -----------
  tests/functional: Convert simple avocado tests into standalone python tests

These test are rather simple and don't need any modifications apart
from adjusting the "from avocado_qemu" line. To ease debugging, make
the files executable and add a shebang line and Python '__main__'
handling, too, so that these tests can now be run by executing them
directly.

Reviewed-by: Daniel P. Berrangé <berrange@redhat.com>
Reviewed-by: Philippe Mathieu-Daudé <philmd@linaro.org>
Tested-by: Philippe Mathieu-Daudé <philmd@linaro.org>
Message-ID: <20240830133841.142644-13-thuth@redhat.com>
Signed-off-by: Thomas Huth <thuth@redhat.com>


  Commit: eeba3d736527191f3126fe0d4cc539f43cdba009
      
https://github.com/qemu/qemu/commit/eeba3d736527191f3126fe0d4cc539f43cdba009
  Author: Thomas Huth <thuth@redhat.com>
  Date:   2024-09-04 (Wed, 04 Sep 2024)

  Changed paths:
    M MAINTAINERS
    R tests/avocado/info_usernet.py
    R tests/avocado/ppc_74xx.py
    R tests/avocado/version.py
    M tests/functional/meson.build
    A tests/functional/test_info_usernet.py
    A tests/functional/test_ppc_74xx.py
    A tests/functional/test_version.py

  Log Message:
  -----------
  tests/functional: Convert avocado tests that just need a small adjustment

These simple tests can be converted to stand-alone tests quite easily,
e.g. by just setting the machine to 'none' now manually or by adding
"-cpu" command line parameters, since we don't support the corresponding
avocado tags in the new python test framework.

Reviewed-by: Daniel P. Berrangé <berrange@redhat.com>
Tested-by: Philippe Mathieu-Daudé <philmd@linaro.org>
Reviewed-by: Philippe Mathieu-Daudé <philmd@linaro.org>
Message-ID: <20240830133841.142644-14-thuth@redhat.com>
Signed-off-by: Thomas Huth <thuth@redhat.com>


  Commit: 9903217a4ed013228d95d8b1876b6053b2bc5e95
      
https://github.com/qemu/qemu/commit/9903217a4ed013228d95d8b1876b6053b2bc5e95
  Author: Daniel P. Berrangé <berrange@redhat.com>
  Date:   2024-09-04 (Wed, 04 Sep 2024)

  Changed paths:
    M tests/functional/qemu_test/__init__.py
    A tests/functional/qemu_test/asset.py

  Log Message:
  -----------
  tests/functional: add a module for handling asset download & caching

The 'Asset' class is a simple module that declares a downloadable
asset that can be cached locally. Downloads are stored in the user's
home dir at ~/.cache/qemu/download, using a sha256 sum of the URL.

[thuth: Drop sha1 support, use hash on file content for naming instead of URL,
        add the possibility to specify the cache dir via environment variable]

Signed-off-by: Daniel P. Berrangé <berrange@redhat.com>
Reviewed-by: Philippe Mathieu-Daudé <philmd@linaro.org>
Tested-by: Philippe Mathieu-Daudé <philmd@linaro.org>
Message-ID: <20240830133841.142644-15-thuth@redhat.com>
Signed-off-by: Thomas Huth <thuth@redhat.com>


  Commit: f57213f85b49f2271d2a9bba354a160de326eeb9
      
https://github.com/qemu/qemu/commit/f57213f85b49f2271d2a9bba354a160de326eeb9
  Author: Daniel P. Berrangé <berrange@redhat.com>
  Date:   2024-09-04 (Wed, 04 Sep 2024)

  Changed paths:
    M tests/Makefile.include
    M tests/functional/meson.build
    M tests/functional/qemu_test/asset.py
    M tests/functional/qemu_test/testcase.py

  Log Message:
  -----------
  tests/functional: enable pre-emptive caching of assets

Many tests need to access assets stored on remote sites. We don't want
to download these during test execution when run by meson, since this
risks hitting test timeouts when data transfers are slow.

Add support for pre-emptive caching of assets by setting the env var
QEMU_TEST_PRECACHE to point to a timestamp file. When this is set,
instead of running the test, the assets will be downloaded and saved
to the cache, then the timestamp file created.

A meson custom target is created as a dependency of each test suite
to trigger the pre-emptive caching logic before the test runs.

When run in caching mode, it will locate assets by looking for class
level variables with a name prefix "ASSET_", and type "Asset".

At the ninja level

   ninja test --suite functional

will speculatively download any assets that are not already cached,
so it is advisable to set a timeout multiplier.

   QEMU_TEST_NO_DOWNLOAD=1 ninja test --suite functional

will fail the test if a required asset is not already cached

   ninja precache-functional

will download and cache all assets required by the functional
tests

At the make level, precaching is always done by

   make check-functional

Signed-off-by: Daniel P. Berrangé <berrange@redhat.com>
Tested-by: Richard Henderson <richard.henderson@linaro.org>
[thuth: Remove the duplicated "path = os.path.basename(...)" line]
Message-ID: <20240830133841.142644-16-thuth@redhat.com>
Signed-off-by: Thomas Huth <thuth@redhat.com>


  Commit: 34b17c0a6564833ae8eb9846ec9faedb212d80ac
      
https://github.com/qemu/qemu/commit/34b17c0a6564833ae8eb9846ec9faedb212d80ac
  Author: Thomas Huth <thuth@redhat.com>
  Date:   2024-09-04 (Wed, 04 Sep 2024)

  Changed paths:
    M tests/functional/qemu_test/asset.py

  Log Message:
  -----------
  tests/functional: Allow asset downloading with concurrent threads

When running "make -j$(nproc) check-functional", tests that use the
same asset might be running in parallel. Improve the downloading to
detect this situation and wait for the other thread to finish the
download.

Message-ID: <20240830133841.142644-17-thuth@redhat.com>
Signed-off-by: Thomas Huth <thuth@redhat.com>


  Commit: 4c0a2df81c9166a3a84293501008a85dfbe8a3a6
      
https://github.com/qemu/qemu/commit/4c0a2df81c9166a3a84293501008a85dfbe8a3a6
  Author: Thomas Huth <thuth@redhat.com>
  Date:   2024-09-04 (Wed, 04 Sep 2024)

  Changed paths:
    M MAINTAINERS
    M tests/avocado/machine_arm_n8x0.py
    R tests/avocado/machine_avr6.py
    R tests/avocado/machine_loongarch.py
    R tests/avocado/machine_mips_loongson3v.py
    R tests/avocado/netdev-ethtool.py
    R tests/avocado/ppc_405.py
    M tests/functional/meson.build
    A tests/functional/test_avr_mega2560.py
    A tests/functional/test_loongarch64_virt.py
    A tests/functional/test_mips64el_loongson3v.py
    A tests/functional/test_netdev_ethtool.py
    A tests/functional/test_ppc_405.py

  Log Message:
  -----------
  tests/functional: Convert some tests that download files via fetch_asset()

Now that we've got the Asset class with pre-caching, we can convert
some Avocado tests that use fetch_asset() for downloading their
required files.

Message-ID: <20240830133841.142644-18-thuth@redhat.com>
Signed-off-by: Thomas Huth <thuth@redhat.com>


  Commit: 850a1951b7f614bbafa20c7d4cae55f97464f4ad
      
https://github.com/qemu/qemu/commit/850a1951b7f614bbafa20c7d4cae55f97464f4ad
  Author: Thomas Huth <thuth@redhat.com>
  Date:   2024-09-04 (Wed, 04 Sep 2024)

  Changed paths:
    A tests/functional/qemu_test/utils.py

  Log Message:
  -----------
  tests/functional: Add a function for extracting files from an archive

Some Avocado-based tests use the "archive" module from avocado.utils
to extract files from an archive. To be able to use these tests
without Avocado, we have to provide our own function for extracting
files. Fortunately, there is already the tarfile module that will
provide us with this functionality, so let's just add a nice wrapper
function around that.

Reviewed-by: Daniel P. Berrangé <berrange@redhat.com>
Reviewed-by: Philippe Mathieu-Daudé <philmd@linaro.org>
Tested-by: Philippe Mathieu-Daudé <philmd@linaro.org>
Tested-by: Daniel P. Berrangé <berrange@redhat.com>
Message-ID: <20240830133841.142644-19-thuth@redhat.com>
Signed-off-by: Thomas Huth <thuth@redhat.com>


  Commit: e3fc99b1644c4b11189ff71ad5e7e8434dd41d58
      
https://github.com/qemu/qemu/commit/e3fc99b1644c4b11189ff71ad5e7e8434dd41d58
  Author: Thomas Huth <thuth@redhat.com>
  Date:   2024-09-04 (Wed, 04 Sep 2024)

  Changed paths:
    M MAINTAINERS
    R tests/avocado/machine_arm_canona1100.py
    R tests/avocado/machine_sparc64_sun4u.py
    R tests/avocado/ppc_bamboo.py
    M tests/functional/meson.build
    A tests/functional/test_arm_canona1100.py
    A tests/functional/test_ppc_bamboo.py
    A tests/functional/test_sparc64_sun4u.py

  Log Message:
  -----------
  tests/functional: Convert some avocado tests that needed avocado.utils.archive

Instead of using the "archive" module from avocado.utils, switch
these tests to use the new wrapper function that is based on the
"tarfile" module instead.

Reviewed-by: Daniel P. Berrangé <berrange@redhat.com>
Reviewed-by: Philippe Mathieu-Daudé <philmd@linaro.org>
Tested-by: Philippe Mathieu-Daudé <philmd@linaro.org>
Message-ID: <20240830133841.142644-20-thuth@redhat.com>
Signed-off-by: Thomas Huth <thuth@redhat.com>


  Commit: e2e9fd256ee8e8a3cdc4ce969d582632c34e3447
      
https://github.com/qemu/qemu/commit/e2e9fd256ee8e8a3cdc4ce969d582632c34e3447
  Author: Thomas Huth <thuth@redhat.com>
  Date:   2024-09-04 (Wed, 04 Sep 2024)

  Changed paths:
    M MAINTAINERS
    R tests/avocado/machine_s390_ccw_virtio.py
    R tests/avocado/s390_topology.py
    M tests/functional/meson.build
    M tests/functional/qemu_test/utils.py
    A tests/functional/test_s390x_ccw_virtio.py
    A tests/functional/test_s390x_topology.py

  Log Message:
  -----------
  tests/functional: Convert the s390x avocado tests into standalone tests

These tests use archive.lzma_uncompress() from the Avocado utils,
so provide a small helper function for this, based on the
standard lzma module from Python instead.

And while we're at it, replace the MD5 hashes in the topology test
with proper SHA256 hashes, since MD5 should not be used anymore
nowadays.

Reviewed-by: Philippe Mathieu-Daudé <philmd@linaro.org>
Message-ID: <20240830133841.142644-21-thuth@redhat.com>
Signed-off-by: Thomas Huth <thuth@redhat.com>


  Commit: be849ef715f72f5271a6c5b5d4dcd29b3befc686
      
https://github.com/qemu/qemu/commit/be849ef715f72f5271a6c5b5d4dcd29b3befc686
  Author: Thomas Huth <thuth@redhat.com>
  Date:   2024-09-04 (Wed, 04 Sep 2024)

  Changed paths:
    M MAINTAINERS
    R tests/avocado/x86_cpu_model_versions.py
    M tests/functional/meson.build
    A tests/functional/test_x86_cpu_model_versions.py

  Log Message:
  -----------
  tests/functional: Convert the x86_cpu_model_versions test

Nothing thrilling in here, it's just a straight forward conversion.

Reviewed-by: Philippe Mathieu-Daudé <philmd@linaro.org>
Tested-by: Philippe Mathieu-Daudé <philmd@linaro.org>
Message-ID: <20240830133841.142644-22-thuth@redhat.com>
Signed-off-by: Thomas Huth <thuth@redhat.com>


  Commit: 624fb343df1105752af11c3cc1dce4fd9673e478
      
https://github.com/qemu/qemu/commit/624fb343df1105752af11c3cc1dce4fd9673e478
  Author: Thomas Huth <thuth@redhat.com>
  Date:   2024-09-04 (Wed, 04 Sep 2024)

  Changed paths:
    M MAINTAINERS
    R tests/avocado/machine_microblaze.py
    M tests/functional/meson.build
    A tests/functional/test_microblaze_s3adsp1800.py
    A tests/functional/test_microblazeel_s3adsp1800.py

  Log Message:
  -----------
  tests/functional: Convert the microblaze avocado tests into standalone tests

The machine_microblaze.py file contained two tests, one for each
endianness. Since we only support one QEMU target binary per file
in the new functional test environment, we have to split this file
up into two files now.

Reviewed-by: Philippe Mathieu-Daudé <philmd@linaro.org>
Tested-by: Philippe Mathieu-Daudé <philmd@linaro.org>
Message-ID: <20240830133841.142644-23-thuth@redhat.com>
Signed-off-by: Thomas Huth <thuth@redhat.com>


  Commit: 239d08aa96d39bf6b9802b74ddbdb0f5796e4546
      
https://github.com/qemu/qemu/commit/239d08aa96d39bf6b9802b74ddbdb0f5796e4546
  Author: Thomas Huth <thuth@redhat.com>
  Date:   2024-09-04 (Wed, 04 Sep 2024)

  Changed paths:
    R tests/avocado/virtio-gpu.py
    M tests/functional/meson.build
    A tests/functional/test_virtio_gpu.py

  Log Message:
  -----------
  tests/functional: Convert the virtio_gpu avocado test into a standalone test

Nothing thrilling in here, it's just a straight forward conversion.

Reviewed-by: Philippe Mathieu-Daudé <philmd@linaro.org>
Message-ID: <20240830133841.142644-25-thuth@redhat.com>
Signed-off-by: Thomas Huth <thuth@redhat.com>


  Commit: 407a688315d0d23af20e3b8beb020a97828140eb
      
https://github.com/qemu/qemu/commit/407a688315d0d23af20e3b8beb020a97828140eb
  Author: Thomas Huth <thuth@redhat.com>
  Date:   2024-09-04 (Wed, 04 Sep 2024)

  Changed paths:
    M MAINTAINERS
    R tests/avocado/ppc_mpc8544ds.py
    R tests/avocado/ppc_powernv.py
    R tests/avocado/ppc_prep_40p.py
    R tests/avocado/ppc_pseries.py
    R tests/avocado/ppc_virtex_ml507.py
    M tests/functional/meson.build
    A tests/functional/test_ppc64_powernv.py
    A tests/functional/test_ppc64_pseries.py
    A tests/functional/test_ppc_40p.py
    A tests/functional/test_ppc_mpc8544ds.py
    A tests/functional/test_ppc_virtex_ml507.py

  Log Message:
  -----------
  tests/functional: Convert most ppc avocado tests into standalone tests

Nothing thrilling in here, just straight forward conversions.

Reviewed-by: Philippe Mathieu-Daudé <philmd@linaro.org>
Tested-by: Philippe Mathieu-Daudé <philmd@linaro.org>
Message-ID: <20240830133841.142644-26-thuth@redhat.com>
Signed-off-by: Thomas Huth <thuth@redhat.com>


  Commit: cef1becb9f5c17d1eb4babc38f75234ead30d40a
      
https://github.com/qemu/qemu/commit/cef1becb9f5c17d1eb4babc38f75234ead30d40a
  Author: Thomas Huth <thuth@redhat.com>
  Date:   2024-09-04 (Wed, 04 Sep 2024)

  Changed paths:
    M MAINTAINERS
    R tests/avocado/ppc_amiga.py
    M tests/functional/meson.build
    A tests/functional/test_ppc_amiga.py

  Log Message:
  -----------
  tests/functional: Convert the ppc_amiga avocado test into a standalone test

Use the Python standard zipfile module instead of avocado.utils for
extracting the ZIP file that we download here, and use the standard
subprocess module for running the "tail" command.

Reviewed-by: Philippe Mathieu-Daudé <philmd@linaro.org>
Tested-by: Philippe Mathieu-Daudé <philmd@linaro.org>
Message-ID: <20240830133841.142644-27-thuth@redhat.com>
Signed-off-by: Thomas Huth <thuth@redhat.com>


  Commit: 88c907199aba4ff78985a5727fa56ec667a94cda
      
https://github.com/qemu/qemu/commit/88c907199aba4ff78985a5727fa56ec667a94cda
  Author: Thomas Huth <thuth@redhat.com>
  Date:   2024-09-04 (Wed, 04 Sep 2024)

  Changed paths:
    M MAINTAINERS
    R tests/avocado/ppc_hv_tests.py
    M tests/functional/meson.build
    A tests/functional/test_ppc64_hv.py

  Log Message:
  -----------
  tests/functional: Convert the ppc_hv avocado test into a standalone test

A straight forward conversion, we just also have to remove the decorator
@skipUnless(os.getenv('SPEED')) since all non-trivial functional tests
are running in SPEED=thorough mode now. Also make sure that the extracted
assets are writable, so that the test does not fail if it gets re-run
and there are stale read-only files already around.

Message-ID: <20240830133841.142644-28-thuth@redhat.com>
Signed-off-by: Thomas Huth <thuth@redhat.com>


  Commit: 576fffbc8eefd806c47850f8e1c60fdcb37733e3
      
https://github.com/qemu/qemu/commit/576fffbc8eefd806c47850f8e1c60fdcb37733e3
  Author: Thomas Huth <thuth@redhat.com>
  Date:   2024-09-04 (Wed, 04 Sep 2024)

  Changed paths:
    M MAINTAINERS
    R tests/avocado/machine_m68k_nextcube.py
    R tests/avocado/tesseract_utils.py
    M tests/functional/meson.build
    A tests/functional/qemu_test/tesseract.py
    A tests/functional/test_m68k_nextcube.py

  Log Message:
  -----------
  tests/functional: Convert the m68k nextcube test with tesseract

The code that handles running of tesseract needs to be tweaked a little
bit to be able to run without the functions from avocado.utils, and
while we're at it, drop some legacy stuff that was still there due to
Tesseract 3 support that we already dropped a while ago.

Reviewed-by: Philippe Mathieu-Daudé <philmd@linaro.org>
Tested-by: Philippe Mathieu-Daudé <philmd@linaro.org>
Message-ID: <20240830133841.142644-29-thuth@redhat.com>
Signed-off-by: Thomas Huth <thuth@redhat.com>


  Commit: 05caa0624256da44974cd68e8f55dbbde3dfede7
      
https://github.com/qemu/qemu/commit/05caa0624256da44974cd68e8f55dbbde3dfede7
  Author: Thomas Huth <thuth@redhat.com>
  Date:   2024-09-04 (Wed, 04 Sep 2024)

  Changed paths:
    M MAINTAINERS
    M docs/devel/acpi-bits.rst
    R tests/avocado/acpi-bits.py
    R tests/avocado/acpi-bits/bits-config/bits-cfg.txt
    R tests/avocado/acpi-bits/bits-tests/smbios.py2
    R tests/avocado/acpi-bits/bits-tests/smilatency.py2
    R tests/avocado/acpi-bits/bits-tests/testacpi.py2
    R tests/avocado/acpi-bits/bits-tests/testcpuid.py2
    A tests/functional/acpi-bits/bits-config/bits-cfg.txt
    A tests/functional/acpi-bits/bits-tests/smbios.py2
    A tests/functional/acpi-bits/bits-tests/smilatency.py2
    A tests/functional/acpi-bits/bits-tests/testacpi.py2
    A tests/functional/acpi-bits/bits-tests/testcpuid.py2
    M tests/functional/meson.build
    A tests/functional/test_acpi_bits.py

  Log Message:
  -----------
  tests/functional: Convert the acpi-bits test into a standalone test

Mostly a straight-forward conversion. Looks like we can simply drop
the avocado datadrainer stuff when not using the avocado framework
anymore.

Reviewed-by: Philippe Mathieu-Daudé <philmd@linaro.org>
Tested-by: Philippe Mathieu-Daudé <philmd@linaro.org>
Message-ID: <20240830133841.142644-30-thuth@redhat.com>
Signed-off-by: Thomas Huth <thuth@redhat.com>


  Commit: d5674412ba32b6fb0fc6dfd6d1fcddadf75cbfaa
      
https://github.com/qemu/qemu/commit/d5674412ba32b6fb0fc6dfd6d1fcddadf75cbfaa
  Author: Thomas Huth <thuth@redhat.com>
  Date:   2024-09-04 (Wed, 04 Sep 2024)

  Changed paths:
    M MAINTAINERS
    R tests/avocado/machine_rx_gdbsim.py
    M tests/functional/meson.build
    M tests/functional/qemu_test/utils.py
    A tests/functional/test_rx_gdbsim.py

  Log Message:
  -----------
  tests/functional: Convert the rx_gdbsim avocado test into a standalone test

Provide a "gzip_uncompress" function based on the standard "gzip" module
to avoid the usage of avocado.utils here.

Reviewed-by: Philippe Mathieu-Daudé <philmd@linaro.org>
Tested-by: Philippe Mathieu-Daudé <philmd@linaro.org>
Message-ID: <20240830133841.142644-31-thuth@redhat.com>
Signed-off-by: Thomas Huth <thuth@redhat.com>


  Commit: 8dcac1cf714da71e54e409253f6ebdc92ab97317
      
https://github.com/qemu/qemu/commit/8dcac1cf714da71e54e409253f6ebdc92ab97317
  Author: Thomas Huth <thuth@redhat.com>
  Date:   2024-09-04 (Wed, 04 Sep 2024)

  Changed paths:
    R tests/avocado/linux_initrd.py
    M tests/functional/meson.build
    A tests/functional/test_linux_initrd.py

  Log Message:
  -----------
  tests/functional: Convert the linux_initrd avocado test into a standalone test

While we're at it, update the SHA1 hashes to SHA256 hashes since
SHA1 should not be used anymore nowadays.

Message-ID: <20240830133841.142644-32-thuth@redhat.com>
Signed-off-by: Thomas Huth <thuth@redhat.com>


  Commit: ef83aea0a38275b5fe43c2b0da41100418e90b7e
      
https://github.com/qemu/qemu/commit/ef83aea0a38275b5fe43c2b0da41100418e90b7e
  Author: Philippe Mathieu-Daudé <philmd@linaro.org>
  Date:   2024-09-04 (Wed, 04 Sep 2024)

  Changed paths:
    M MAINTAINERS
    R tests/avocado/machine_arm_integratorcp.py
    M tests/functional/meson.build
    A tests/functional/test_arm_integratorcp.py

  Log Message:
  -----------
  tests/functional: Convert ARM Integrator/CP avocado tests

Straight forward conversion. Update the SHA1 hashes to SHA256
hashes since SHA1 should not be used anymore nowadays.

  $ QEMU_TEST_ALLOW_UNTRUSTED_CODE=1 make check-functional-arm
  ...
  6/6 qemu:func-thorough+func-arm-thorough+thorough / func-arm-arm_integratorcp 
  OK   3.90s   2 subtests passed

Signed-off-by: Philippe Mathieu-Daudé <philmd@linaro.org>
Message-ID: <20240822110238.82312-1-philmd@linaro.org>
Reviewed-by: Thomas Huth <thuth@redhat.com>
Message-ID: <20240830133841.142644-34-thuth@redhat.com>
Signed-off-by: Thomas Huth <thuth@redhat.com>


  Commit: 8f16cd80fcc2e3f502080ea72de55c9f9bc21f58
      
https://github.com/qemu/qemu/commit/8f16cd80fcc2e3f502080ea72de55c9f9bc21f58
  Author: Philippe Mathieu-Daudé <philmd@linaro.org>
  Date:   2024-09-04 (Wed, 04 Sep 2024)

  Changed paths:
    M MAINTAINERS
    R tests/avocado/machine_aarch64_sbsaref.py
    M tests/functional/meson.build
    A tests/functional/test_aarch64_sbsaref.py

  Log Message:
  -----------
  tests/functional: Convert Aarch64 SBSA-Ref avocado tests

Straight forward conversion. Since SBSA_FLASH files are not
tarballs, use lzma_uncompress() method.

Avocado used to set a timeout of 11 tests * 180s = 1980s.
Hopefully 600s should be sufficient.

Running on macOS Sonoma / Apple silicon M1:

  $ QEMU_TEST_TIMEOUT_EXPECTED=1 make check-functional-aarch64 V=1
  ▶ 1/5 
test_aarch64_sbsaref.Aarch64SbsarefMachine.test_sbsaref_alpine_linux_max        
      OK
  ▶ 1/5 
test_aarch64_sbsaref.Aarch64SbsarefMachine.test_sbsaref_alpine_linux_max_pauth_impdef
 OK
  ▶ 1/5 
test_aarch64_sbsaref.Aarch64SbsarefMachine.test_sbsaref_alpine_linux_max_pauth_off
    OK
  ▶ 1/5 
test_aarch64_sbsaref.Aarch64SbsarefMachine.test_sbsaref_alpine_linux_neoverse_n1
      OK
  ▶ 1/5 test_aarch64_sbsaref.Aarch64SbsarefMachine.test_sbsaref_edk2_firmware   
              OK
  ▶ 1/5 
test_aarch64_sbsaref.Aarch64SbsarefMachine.test_sbsaref_openbsd73_cortex_a57    
      OK
  ▶ 1/5 test_aarch64_sbsaref.Aarch64SbsarefMachine.test_sbsaref_openbsd73_max   
              OK
  ▶ 1/5 
test_aarch64_sbsaref.Aarch64SbsarefMachine.test_sbsaref_openbsd73_max_pauth_impdef
    OK
  ▶ 1/5 
test_aarch64_sbsaref.Aarch64SbsarefMachine.test_sbsaref_openbsd73_max_pauth_off 
      OK
  ▶ 1/5 
test_aarch64_sbsaref.Aarch64SbsarefMachine.test_sbsaref_openbsd73_neoverse_n1   
      OK
  1/5 qemu:func-thorough+func-aarch64-thorough+thorough / 
func-aarch64-aarch64_sbsaref        OK   241.79s  11 subtests passed
  ...

Signed-off-by: Philippe Mathieu-Daudé <philmd@linaro.org>
Message-ID: <20240823131614.10269-1-philmd@linaro.org>
Reviewed-by: Thomas Huth <thuth@redhat.com>
Reviewed-by: Marcin Juszkiewicz <marcin.juszkiewicz@linaro.org>
Message-ID: <20240830133841.142644-35-thuth@redhat.com>
[thuth: remove remaining Avocado tags]
Signed-off-by: Thomas Huth <thuth@redhat.com>


  Commit: 1255f5e49654982ad5078ea4e8e78acf55c639ec
      
https://github.com/qemu/qemu/commit/1255f5e49654982ad5078ea4e8e78acf55c639ec
  Author: Philippe Mathieu-Daudé <philmd@linaro.org>
  Date:   2024-09-04 (Wed, 04 Sep 2024)

  Changed paths:
    M MAINTAINERS
    R tests/avocado/machine_aarch64_virt.py
    M tests/functional/meson.build
    M tests/functional/qemu_test/__init__.py
    M tests/functional/qemu_test/cmd.py
    A tests/functional/test_aarch64_virt.py

  Log Message:
  -----------
  tests/functional: Convert Aarch64 Virt machine avocado tests

Straight forward conversion. Update the SHA1 hash to
SHA256 since SHA1 should not be used anymore nowadays.

Provide get_qemu_img() helper in qemu_test.

  $ make check-functional-aarch64 V=1
  ▶ 1/4 test_aarch64_virt.Aarch64VirtMachine.test_aarch64_virt_gicv2            
     OK
  ▶ 1/4 test_aarch64_virt.Aarch64VirtMachine.test_aarch64_virt_gicv3            
     OK
  ▶ 1/4 test_aarch64_virt.Aarch64VirtMachine.test_alpine_virt_tcg_gic_max       
     OK
  1/4 qemu:func-thorough+func-aarch64-thorough+thorough / 
func-aarch64-aarch64_virt  OK   30.44s  3 subtests passed
  ...

Signed-off-by: Philippe Mathieu-Daudé <philmd@linaro.org>
Message-ID: <20240826103634.52384-1-philmd@linaro.org>
Reviewed-by: Thomas Huth <thuth@redhat.com>
Message-ID: <20240830133841.142644-36-thuth@redhat.com>
Signed-off-by: Thomas Huth <thuth@redhat.com>


  Commit: bce9e4841548b79ad264dd8acf0104c560331ea7
      
https://github.com/qemu/qemu/commit/bce9e4841548b79ad264dd8acf0104c560331ea7
  Author: Philippe Mathieu-Daudé <philmd@linaro.org>
  Date:   2024-09-04 (Wed, 04 Sep 2024)

  Changed paths:
    M MAINTAINERS
    R tests/avocado/machine_mips_fuloong2e.py
    M tests/functional/meson.build
    A tests/functional/test_mips64el_fuloong2e.py

  Log Message:
  -----------
  tests/functional: Convert mips64el Fuloong2e avocado test (1/2)

Straight forward conversion. Update the SHA1 hashes to
SHA256 hashes since SHA1 should not be used anymore nowadays.

Since the asset is expected locally and the test is guarded
with RESCUE_YL_PATH, keep it under the 'quick' category.

  $ RESCUE_YL_PATH=/path/to/rescue-yl QEMU_TEST_ALLOW_UNTRUSTED_CODE=1 \
    make check-functional-mips64el
  1/4 qemu:func-quick+func-mips64el / func-mips64el-empty_cpu_model      OK   
0.12s   1 subtests passed
  2/4 qemu:func-quick+func-mips64el / func-mips64el-version              OK   
0.13s   1 subtests passed
  3/4 qemu:func-quick+func-mips64el / func-mips64el-info_usernet         OK   
0.15s   1 subtests passed
  4/4 qemu:func-quick+func-mips64el / func-mips64el-mips64el_fuloong2e   OK   
0.19s   1 subtests passed

Signed-off-by: Philippe Mathieu-Daudé <philmd@linaro.org>
Message-ID: <20240827094905.80648-2-philmd@linaro.org>
Reviewed-by: Thomas Huth <thuth@redhat.com>
Message-ID: <20240830133841.142644-37-thuth@redhat.com>
Signed-off-by: Thomas Huth <thuth@redhat.com>


  Commit: 99465d3fe451964f1bb3c355054cd7ced05dcf88
      
https://github.com/qemu/qemu/commit/99465d3fe451964f1bb3c355054cd7ced05dcf88
  Author: Philippe Mathieu-Daudé <philmd@linaro.org>
  Date:   2024-09-04 (Wed, 04 Sep 2024)

  Changed paths:
    M tests/functional/qemu_test/__init__.py
    M tests/functional/qemu_test/testcase.py

  Log Message:
  -----------
  tests/functional: Add QemuUserTest class

Per commit 5334df4822 ("tests/avocado: Introduce
QemuUserTest base class"):

  Similarly to the 'System' Test base class with methods
  for testing system emulation, the QemuUserTest class
  contains methods useful to test user-mode emulation.

Signed-off-by: Philippe Mathieu-Daudé <philmd@linaro.org>
Message-ID: <20240822104238.75045-2-philmd@linaro.org>
Reviewed-by: Thomas Huth <thuth@redhat.com>
Message-ID: <20240830133841.142644-38-thuth@redhat.com>
Signed-off-by: Thomas Huth <thuth@redhat.com>


  Commit: 34917ead7239acfe85580e74f6ebe2fa55a10ab2
      
https://github.com/qemu/qemu/commit/34917ead7239acfe85580e74f6ebe2fa55a10ab2
  Author: Philippe Mathieu-Daudé <philmd@linaro.org>
  Date:   2024-09-04 (Wed, 04 Sep 2024)

  Changed paths:
    R tests/avocado/load_bflt.py
    M tests/functional/meson.build
    M tests/functional/qemu_test/utils.py
    A tests/functional/test_arm_bflt.py

  Log Message:
  -----------
  tests/functional: Convert ARM bFLT linux-user avocado test

Straight forward conversion. Update the SHA1 hashes to
SHA256 hashes since SHA1 should not be used anymore nowadays.
Expose cpio_extract() in qemu_test.utils for possible reuse.

Signed-off-by: Philippe Mathieu-Daudé <philmd@linaro.org>
Message-ID: <20240822104238.75045-3-philmd@linaro.org>
[thuth: Add test to meson.build]
Message-ID: <20240830133841.142644-39-thuth@redhat.com>
Signed-off-by: Thomas Huth <thuth@redhat.com>


  Commit: b308ac9cf6c351513e404e56b09eca5a2b37aa93
      
https://github.com/qemu/qemu/commit/b308ac9cf6c351513e404e56b09eca5a2b37aa93
  Author: Philippe Mathieu-Daudé <philmd@linaro.org>
  Date:   2024-09-04 (Wed, 04 Sep 2024)

  Changed paths:
    M tests/avocado/avocado_qemu/__init__.py

  Log Message:
  -----------
  tests/avocado: Remove unused QemuUserTest class

The single test that was using the QemuUserTest class
has been converted to the functional test framework.
This class is now unused, remove it.

Signed-off-by: Philippe Mathieu-Daudé <philmd@linaro.org>
Message-ID: <20240822104238.75045-4-philmd@linaro.org>
Reviewed-by: Thomas Huth <thuth@redhat.com>
Message-ID: <20240830133841.142644-40-thuth@redhat.com>
Signed-off-by: Thomas Huth <thuth@redhat.com>


  Commit: 6d62722ebd21d39a163b568f16068199181e5c62
      
https://github.com/qemu/qemu/commit/6d62722ebd21d39a163b568f16068199181e5c62
  Author: Thomas Huth <thuth@redhat.com>
  Date:   2024-09-04 (Wed, 04 Sep 2024)

  Changed paths:
    M .gitlab-ci.d/buildtest-template.yml
    M .gitlab-ci.d/buildtest.yml

  Log Message:
  -----------
  gitlab-ci: Add "check-functional" to the build tests

Now that we converted many tests from the "check-avocado" test suite
to the "check-functional" test suite, we should make sure that these
also get tested in the CI.

Reviewed-by: Daniel P. Berrangé <berrange@redhat.com>
Reviewed-by: Philippe Mathieu-Daudé <philmd@linaro.org>
Message-ID: <20240830133841.142644-41-thuth@redhat.com>
Signed-off-by: Thomas Huth <thuth@redhat.com>


  Commit: ff41da503089c6da3f7c4ffe534540ba8de81727
      
https://github.com/qemu/qemu/commit/ff41da503089c6da3f7c4ffe534540ba8de81727
  Author: Thomas Huth <thuth@redhat.com>
  Date:   2024-09-04 (Wed, 04 Sep 2024)

  Changed paths:
    R docs/devel/acpi-bits.rst
    R docs/devel/ci-definitions.rst.inc
    R docs/devel/ci-jobs.rst.inc
    R docs/devel/ci-runners.rst.inc
    R docs/devel/ci.rst
    R docs/devel/fuzzing.rst
    M docs/devel/index-build.rst
    M docs/devel/index.rst
    R docs/devel/qgraph.rst
    R docs/devel/qtest.rst
    R docs/devel/testing.rst
    A docs/devel/testing/acpi-bits.rst
    A docs/devel/testing/ci-definitions.rst.inc
    A docs/devel/testing/ci-jobs.rst.inc
    A docs/devel/testing/ci-runners.rst.inc
    A docs/devel/testing/ci.rst
    A docs/devel/testing/fuzzing.rst
    A docs/devel/testing/index.rst
    A docs/devel/testing/main.rst
    A docs/devel/testing/qgraph.rst
    A docs/devel/testing/qtest.rst

  Log Message:
  -----------
  docs/devel: Split testing docs from the build docs and move to separate folder

Building and testing are two separate topics, so let's split the testing
into a separate category and move the related files into a separate folder.

Message-ID: <20240830133841.142644-42-thuth@redhat.com>
Signed-off-by: Thomas Huth <thuth@redhat.com>


  Commit: 2133c2ab9c008a19e30eeea40104eaaa2619de3e
      
https://github.com/qemu/qemu/commit/2133c2ab9c008a19e30eeea40104eaaa2619de3e
  Author: Thomas Huth <thuth@redhat.com>
  Date:   2024-09-04 (Wed, 04 Sep 2024)

  Changed paths:
    A docs/devel/testing/avocado.rst
    M docs/devel/testing/index.rst
    M docs/devel/testing/main.rst

  Log Message:
  -----------
  docs/devel/testing: Split the Avocado documentation into a separate file

The main testing documentation file got very overloaded already.
Thus let's split the Avocado information into a separate file.

Reviewed-by: Daniel P. Berrangé <berrange@redhat.com>
Message-ID: <20240830133841.142644-43-thuth@redhat.com>
Signed-off-by: Thomas Huth <thuth@redhat.com>


  Commit: 0abdd9708478c1109de9114d979ec8d388f04c54
      
https://github.com/qemu/qemu/commit/0abdd9708478c1109de9114d979ec8d388f04c54
  Author: Thomas Huth <thuth@redhat.com>
  Date:   2024-09-04 (Wed, 04 Sep 2024)

  Changed paths:
    M docs/devel/testing/avocado.rst

  Log Message:
  -----------
  docs/devel/testing: Rename avocado_qemu.Test class

The avocado_qemu.Test class has been renamed a while back in commit
2283b627bc ("tests/avocado: Rename avocado_qemu.Test -> QemuSystemTest"),
so we should reflect this now in the documentation, too.

Reviewed-by: Daniel P. Berrangé <berrange@redhat.com>
Message-ID: <20240830133841.142644-44-thuth@redhat.com>
Signed-off-by: Thomas Huth <thuth@redhat.com>


  Commit: c3e24cff2b27d63ac4b56ac6d38ef1ae3a27d92f
      
https://github.com/qemu/qemu/commit/c3e24cff2b27d63ac4b56ac6d38ef1ae3a27d92f
  Author: Thomas Huth <thuth@redhat.com>
  Date:   2024-09-04 (Wed, 04 Sep 2024)

  Changed paths:
    A docs/devel/testing/functional.rst
    M docs/devel/testing/index.rst
    M docs/devel/testing/main.rst

  Log Message:
  -----------
  docs/devel/testing: Add documentation for functional tests

Document the new functional testing framework. The text is originally
based on the Avocado documentation, but heavily modified to match the
new framework.

Message-ID: <20240830133841.142644-45-thuth@redhat.com>
Signed-off-by: Thomas Huth <thuth@redhat.com>


  Commit: eabebca69b7fca7cf85f6cd39ac58a7f04986b47
      
https://github.com/qemu/qemu/commit/eabebca69b7fca7cf85f6cd39ac58a7f04986b47
  Author: Peter Maydell <peter.maydell@linaro.org>
  Date:   2024-09-05 (Thu, 05 Sep 2024)

  Changed paths:
    M .gitlab-ci.d/buildtest-template.yml
    M .gitlab-ci.d/buildtest.yml
    M MAINTAINERS
    R docs/devel/acpi-bits.rst
    R docs/devel/ci-definitions.rst.inc
    R docs/devel/ci-jobs.rst.inc
    R docs/devel/ci-runners.rst.inc
    R docs/devel/ci.rst
    R docs/devel/fuzzing.rst
    M docs/devel/index-build.rst
    M docs/devel/index.rst
    R docs/devel/qgraph.rst
    R docs/devel/qtest.rst
    R docs/devel/testing.rst
    A docs/devel/testing/acpi-bits.rst
    A docs/devel/testing/avocado.rst
    A docs/devel/testing/ci-definitions.rst.inc
    A docs/devel/testing/ci-jobs.rst.inc
    A docs/devel/testing/ci-runners.rst.inc
    A docs/devel/testing/ci.rst
    A docs/devel/testing/functional.rst
    A docs/devel/testing/fuzzing.rst
    A docs/devel/testing/index.rst
    A docs/devel/testing/main.rst
    A docs/devel/testing/qgraph.rst
    A docs/devel/testing/qtest.rst
    A python/wheels/pycotap-1.3.1-py3-none-any.whl
    M pythondeps.toml
    M tests/Makefile.include
    R tests/avocado/acpi-bits.py
    R tests/avocado/acpi-bits/bits-config/bits-cfg.txt
    R tests/avocado/acpi-bits/bits-tests/smbios.py2
    R tests/avocado/acpi-bits/bits-tests/smilatency.py2
    R tests/avocado/acpi-bits/bits-tests/testacpi.py2
    R tests/avocado/acpi-bits/bits-tests/testcpuid.py2
    M tests/avocado/avocado_qemu/__init__.py
    M tests/avocado/avocado_qemu/linuxtest.py
    M tests/avocado/boot_linux_console.py
    M tests/avocado/boot_xen.py
    R tests/avocado/cpu_queries.py
    R tests/avocado/empty_cpu_model.py
    R tests/avocado/info_usernet.py
    R tests/avocado/linux_initrd.py
    R tests/avocado/load_bflt.py
    R tests/avocado/machine_aarch64_sbsaref.py
    R tests/avocado/machine_aarch64_virt.py
    R tests/avocado/machine_arm_canona1100.py
    R tests/avocado/machine_arm_integratorcp.py
    M tests/avocado/machine_arm_n8x0.py
    R tests/avocado/machine_avr6.py
    R tests/avocado/machine_loongarch.py
    R tests/avocado/machine_m68k_nextcube.py
    R tests/avocado/machine_microblaze.py
    R tests/avocado/machine_mips_fuloong2e.py
    R tests/avocado/machine_mips_loongson3v.py
    R tests/avocado/machine_rx_gdbsim.py
    R tests/avocado/machine_s390_ccw_virtio.py
    R tests/avocado/machine_sparc64_sun4u.py
    R tests/avocado/mem-addr-space-check.py
    R tests/avocado/netdev-ethtool.py
    R tests/avocado/pc_cpu_hotplug_props.py
    R tests/avocado/ppc_405.py
    R tests/avocado/ppc_74xx.py
    R tests/avocado/ppc_amiga.py
    R tests/avocado/ppc_bamboo.py
    R tests/avocado/ppc_hv_tests.py
    R tests/avocado/ppc_mpc8544ds.py
    R tests/avocado/ppc_powernv.py
    R tests/avocado/ppc_prep_40p.py
    R tests/avocado/ppc_pseries.py
    R tests/avocado/ppc_virtex_ml507.py
    R tests/avocado/s390_topology.py
    R tests/avocado/tesseract_utils.py
    R tests/avocado/version.py
    R tests/avocado/virtio-gpu.py
    R tests/avocado/virtio_version.py
    R tests/avocado/x86_cpu_model_versions.py
    A tests/functional/acpi-bits/bits-config/bits-cfg.txt
    A tests/functional/acpi-bits/bits-tests/smbios.py2
    A tests/functional/acpi-bits/bits-tests/smilatency.py2
    A tests/functional/acpi-bits/bits-tests/testacpi.py2
    A tests/functional/acpi-bits/bits-tests/testcpuid.py2
    A tests/functional/meson.build
    A tests/functional/qemu_test/__init__.py
    A tests/functional/qemu_test/asset.py
    A tests/functional/qemu_test/cmd.py
    A tests/functional/qemu_test/config.py
    A tests/functional/qemu_test/tesseract.py
    A tests/functional/qemu_test/testcase.py
    A tests/functional/qemu_test/utils.py
    A tests/functional/test_aarch64_sbsaref.py
    A tests/functional/test_aarch64_virt.py
    A tests/functional/test_acpi_bits.py
    A tests/functional/test_arm_bflt.py
    A tests/functional/test_arm_canona1100.py
    A tests/functional/test_arm_integratorcp.py
    A tests/functional/test_avr_mega2560.py
    A tests/functional/test_cpu_queries.py
    A tests/functional/test_empty_cpu_model.py
    A tests/functional/test_info_usernet.py
    A tests/functional/test_linux_initrd.py
    A tests/functional/test_loongarch64_virt.py
    A tests/functional/test_m68k_nextcube.py
    A tests/functional/test_mem_addr_space.py
    A tests/functional/test_microblaze_s3adsp1800.py
    A tests/functional/test_microblazeel_s3adsp1800.py
    A tests/functional/test_mips64el_fuloong2e.py
    A tests/functional/test_mips64el_loongson3v.py
    A tests/functional/test_netdev_ethtool.py
    A tests/functional/test_pc_cpu_hotplug_props.py
    A tests/functional/test_ppc64_hv.py
    A tests/functional/test_ppc64_powernv.py
    A tests/functional/test_ppc64_pseries.py
    A tests/functional/test_ppc_405.py
    A tests/functional/test_ppc_40p.py
    A tests/functional/test_ppc_74xx.py
    A tests/functional/test_ppc_amiga.py
    A tests/functional/test_ppc_bamboo.py
    A tests/functional/test_ppc_mpc8544ds.py
    A tests/functional/test_ppc_virtex_ml507.py
    A tests/functional/test_rx_gdbsim.py
    A tests/functional/test_s390x_ccw_virtio.py
    A tests/functional/test_s390x_topology.py
    A tests/functional/test_sparc64_sun4u.py
    A tests/functional/test_version.py
    A tests/functional/test_virtio_gpu.py
    A tests/functional/test_virtio_version.py
    A tests/functional/test_x86_cpu_model_versions.py
    M tests/meson.build

  Log Message:
  -----------
  Merge tag 'pull-request-2024-09-04' of https://gitlab.com/thuth/qemu into 
staging

* Bump Avocado to version 103
* Introduce new functional test framework for Python-based tests
* Convert many Avocado tests to the new functional test framework

# -----BEGIN PGP SIGNATURE-----
#
# iQJFBAABCAAvFiEEJ7iIR+7gJQEY8+q5LtnXdP5wLbUFAmbYOEsRHHRodXRoQHJl
# ZGhhdC5jb20ACgkQLtnXdP5wLbUDAA/+Kdlak/nCrK5gXDyDasfy86IxgMD0QlDR
# U0MOpQyfXbM2EJjwCUhmgo8pui8qV23dKzfCwbDmkjB7mJ+yKi2ZdiFEp6onq/ke
# aAdaaZwENtWcFglRD80TOSQX6oyeNmE/PuvJGG0BfwWXyyhaEa6kCdytEPORipQs
# lZ+ZndHgXtcM3roXtgI3kp2V1nY5LLCJ044UrasKRq2xWfD/Ken90uWP5/nMLV7f
# 7YLRUIb0sgV7IdjZiT1UkXJZRB7MatV7+OsojYbG8BPbQEvXqpryXMIeygHVR9a0
# yxNDUpTZR6JoS1IaLKkHh1mTM+L1JpFltKadKkXa0zqJHHSur7Tp0xVO/GeqCek4
# 9N8K4zw2CoO/AKmN8JjW5i4GnMrFMdcvxxNwLdRoVgYt4YA731wnHrbosXZOXcuv
# H0z8Tm6ueKvfBtrQErdvqsGrP/8FUYRqZP4H6XaaC+wEis++7OmVR2nlQ/gAyr6/
# mMJtmxqVHCIcEVjDu1jYltrW3BN2CcxN2M9gxyOScq2/Xmzqtaeb4iyjxeCUjIBW
# Pc4LXlSafIg3hPrdH3EKN275ev8cx/5jp8oEgXD5We25Mj3W930zde6/STXoX318
# NVNlbrIQjGjQN7rN5oxTFxTlIN8ax2tuuzpQDFvS/4bLyMYXcZ4I5gUrM5tvWTGv
# +0UN45pJ7Nk=
# =l6Ki
# -----END PGP SIGNATURE-----
# gpg: Signature made Wed 04 Sep 2024 11:36:59 BST
# gpg:                using RSA key 27B88847EEE0250118F3EAB92ED9D774FE702DB5
# gpg:                issuer "thuth@redhat.com"
# gpg: Good signature from "Thomas Huth <th.huth@gmx.de>" [full]
# gpg:                 aka "Thomas Huth <thuth@redhat.com>" [full]
# gpg:                 aka "Thomas Huth <huth@tuxfamily.org>" [full]
# gpg:                 aka "Thomas Huth <th.huth@posteo.de>" [unknown]
# Primary key fingerprint: 27B8 8847 EEE0 2501 18F3  EAB9 2ED9 D774 FE70 2DB5

* tag 'pull-request-2024-09-04' of https://gitlab.com/thuth/qemu: (42 commits)
  docs/devel/testing: Add documentation for functional tests
  docs/devel/testing: Rename avocado_qemu.Test class
  docs/devel/testing: Split the Avocado documentation into a separate file
  docs/devel: Split testing docs from the build docs and move to separate folder
  gitlab-ci: Add "check-functional" to the build tests
  tests/avocado: Remove unused QemuUserTest class
  tests/functional: Convert ARM bFLT linux-user avocado test
  tests/functional: Add QemuUserTest class
  tests/functional: Convert mips64el Fuloong2e avocado test (1/2)
  tests/functional: Convert Aarch64 Virt machine avocado tests
  tests/functional: Convert Aarch64 SBSA-Ref avocado tests
  tests/functional: Convert ARM Integrator/CP avocado tests
  tests/functional: Convert the linux_initrd avocado test into a standalone test
  tests/functional: Convert the rx_gdbsim avocado test into a standalone test
  tests/functional: Convert the acpi-bits test into a standalone test
  tests/functional: Convert the m68k nextcube test with tesseract
  tests/functional: Convert the ppc_hv avocado test into a standalone test
  tests/functional: Convert the ppc_amiga avocado test into a standalone test
  tests/functional: Convert most ppc avocado tests into standalone tests
  tests/functional: Convert the virtio_gpu avocado test into a standalone test
  ...

Signed-off-by: Peter Maydell <peter.maydell@linaro.org>


Compare: https://github.com/qemu/qemu/compare/7b87a25f49a3...eabebca69b7f

To unsubscribe from these emails, change your notification settings at 
https://github.com/qemu/qemu/settings/notifications
reply via email to
[Prev in Thread] Current Thread [Next in Thread]