[Qemu-devel] [PATCH v1 00/42] current testing/next queue (podman, docker, ci)

[Alex Bennée]

Hi All,

Here is the current status of my testing/next queue. It brings
together a number of different series as well as some CI fixes that
may be coming in view different trees. So in order we have:

Some fixes to for podman. This is a relatively new alternative to
docker and it works well but needs a little tweak to ensure we can
also use it from cross compiling check-tcg tests.

Paolo's tcg Makefile disentanglement which reduces some of the
Makefile hackage by having a tcg check specific configure step. I've
made a few minor tweaks to the configure script to fix up -static
handling and setting of make variables.

There is then a set of clean-ups to the dockerfiles whhich allow them
to default a target list in the dockerfile environment which can then
be overridden. I then update a bunch of the images to buster which
allows us to drop the rather hokey sid based approach we were using.

The next major chunk is Phillipe's caching changes which make a
considerable difference when constantly rebuild the same tree,
especially if all you are messing around with is ancillary scripts.

Finally there are a few more CI fixes including one slightly hacky
change to deal with variation in python3 implementations.

Please review ;-)

Alex Bennée (27):
  configure: clean-up container cross compile detect
  tests/docker: fix "cc" command to work with podman
  tests/tcg: add .gitignore for in source builds
  tests/docker: move DEF_TARGET_LIST setting to common.rc
  tests/docker: set DEF_TARGET_LIST for some containers
  tests/docker: add Buster to DOCKER_PARTIAL_IMAGES
  tests/docker: move our arm64 cross compile to Buster
  tests/docker: move our powerpc cross compile to Buster
  tests/docker: move our Alpha cross compile to Buster
  tests/docker: move our HPPA cross compile to Buster
  tests/docker: move our m68k cross compile to Buster
  tests/docker: move our sparc64 cross compile to Buster
  tests/docker: move our sh4 cross compile to Buster
  tests/docker: move our mips64 cross compile to Buster
  tests/docker: move our riscv64 cross compile to Buster
  tests/docker: move our ppc64 cross compile to Buster
  tests/docker: drop debian-sid image
  tests/docker: drop powerpc-user image for QEMU cross builds
  tests/docker: add debian-xtensa-cross to DEBIAN_PARTIAL_IMAGES
  tests/docker: add debian9-mxe to DEBIAN_PARTIAL_IMAGES
  tests/docker: avoid $SHELL invoke bash directly
  tests/docker: add debian-amd64-cross for non-x86 hosts
  tests/docker: use --arch-only for installing deps
  tests/docker: add more images to PARTIAL_IMAGES when not on x86_64
  configure: check if --no-pie is supported first
  tests/docker: --disable-libssh on ubuntu1804 builds
  tests/docker: don't always encoding for subprocess.check_output

Cleber Rosa (1):
  Fedora images: use URLs from stable "archives.fedoraproject.org"

Paolo Bonzini (3):
  tests/tcg: use EXTRA_CFLAGS everywhere
  tests/tcg: cleanup Makefile inclusions
  tests/tcg: move configuration to a sub-shell script

Philippe Mathieu-Daudé (10):
  .travis.yml: Enable multiple caching features
  .travis.yml: Increase cache timeout from 3min to 20min
  .travis.yml: Cache Python PIP packages
  .travis.yml: Cache Avocado cache
  .travis.yml: Improve ccache use
  .travis.yml: Enable ccache on OSX
  .travis.yml: Document how the build matrix use caches
  .travis.yml: Cache Linux/GCC 'debug profile' jobs together
  .travis.yml: Cache Linux/GCC 'non-debug profile' jobs together
  .travis.yml: Cache Linux/Clang jobs together

Thomas Huth (1):
  hw/misc: Mark most objects as "common" code to speed up compilation a
    litte bit

 .travis.yml                                   |  39 ++-
 Makefile                                      |   1 +
 Makefile.target                               |   3 -
 configure                                     | 168 ++-----------
 hw/misc/Makefile.objs                         |  90 +++----
 qemu-doc.texi                                 |   6 +-
 tests/Makefile.include                        |  25 +-
 tests/acceptance/boot_linux_console.py        |  25 +-
 tests/acceptance/linux_initrd.py              |   5 +-
 tests/docker/Makefile.include                 |  61 +++--
 tests/docker/common.rc                        |   4 +
 tests/docker/docker.py                        |  51 ++--
 .../dockerfiles/debian-alpha-cross.docker     |   7 +-
 .../dockerfiles/debian-amd64-cross.docker     |  22 ++
 .../dockerfiles/debian-arm64-cross.docker     |   7 +-
 .../dockerfiles/debian-armel-cross.docker     |   3 +-
 .../dockerfiles/debian-armhf-cross.docker     |   3 +-
 .../debian-buster-arm64-cross.docker          |  16 --
 .../dockerfiles/debian-hppa-cross.docker      |   5 +-
 .../dockerfiles/debian-m68k-cross.docker      |   5 +-
 .../dockerfiles/debian-mips-cross.docker      |   7 +-
 .../dockerfiles/debian-mips64-cross.docker    |   5 +-
 .../dockerfiles/debian-mips64el-cross.docker  |   3 +-
 .../dockerfiles/debian-mipsel-cross.docker    |   2 +-
 .../dockerfiles/debian-powerpc-cross.docker   |   8 +-
 .../debian-powerpc-user-cross.docker          |  15 --
 .../dockerfiles/debian-ppc64-cross.docker     |   7 +-
 .../dockerfiles/debian-ppc64el-cross.docker   |   3 +-
 .../dockerfiles/debian-riscv64-cross.docker   |   5 +-
 .../dockerfiles/debian-s390x-cross.docker     |   3 +-
 .../dockerfiles/debian-sh4-cross.docker       |   5 +-
 tests/docker/dockerfiles/debian-sid.docker    |  41 ---
 .../dockerfiles/debian-sparc64-cross.docker   |   5 +-
 tests/docker/dockerfiles/ubuntu1804.docker    |   3 +
 tests/docker/run                              |   4 +-
 tests/docker/test-build                       |   1 -
 tests/docker/test-mingw                       |   1 -
 tests/docker/test-quick                       |   1 -
 tests/tcg/.gitignore                          |   5 +
 tests/tcg/Makefile.include                    |  88 -------
 tests/tcg/Makefile.prereqs                    |  18 ++
 tests/tcg/Makefile.probe                      |  31 ---
 tests/tcg/Makefile.qemu                       |  95 +++++++
 tests/tcg/{Makefile => Makefile.target}       |  15 +-
 tests/tcg/aarch64/Makefile.include            |   8 -
 tests/tcg/aarch64/Makefile.softmmu-target     |   4 +-
 tests/tcg/aarch64/Makefile.target             |  12 +-
 tests/tcg/alpha/Makefile.include              |   2 -
 tests/tcg/alpha/Makefile.softmmu-target       |   4 +-
 tests/tcg/arm/Makefile.include                |   8 -
 tests/tcg/arm/Makefile.softmmu-target         |   6 +-
 tests/tcg/configure.sh                        | 234 ++++++++++++++++++
 tests/tcg/cris/Makefile.include               |   6 -
 tests/tcg/hppa/Makefile.include               |   2 -
 tests/tcg/i386/Makefile.include               |   9 -
 tests/tcg/i386/Makefile.softmmu-target        |  12 +-
 tests/tcg/i386/Makefile.target                |  13 +-
 tests/tcg/m68k/Makefile.include               |   2 -
 tests/tcg/minilib/Makefile.target             |   2 +-
 tests/tcg/mips/Makefile.include               |  20 --
 tests/tcg/ppc/Makefile.include                |  10 -
 tests/tcg/riscv/Makefile.include              |  10 -
 tests/tcg/s390x/Makefile.include              |   2 -
 tests/tcg/sh4/Makefile.include                |   4 -
 tests/tcg/sparc64/Makefile.include            |   2 -
 tests/tcg/x86_64/Makefile.softmmu-target      |  36 +++
 tests/tcg/x86_64/Makefile.target              |   7 +-
 tests/tcg/xtensa/Makefile.include             |  11 -
 tests/tcg/xtensa/Makefile.softmmu-target      |   4 +-
 tests/vm/fedora                               |   2 +-
 70 files changed, 693 insertions(+), 656 deletions(-)
 create mode 100644 tests/docker/dockerfiles/debian-amd64-cross.docker
 delete mode 100644 tests/docker/dockerfiles/debian-buster-arm64-cross.docker
 delete mode 100644 tests/docker/dockerfiles/debian-powerpc-user-cross.docker
 delete mode 100644 tests/docker/dockerfiles/debian-sid.docker
 create mode 100644 tests/tcg/.gitignore
 delete mode 100644 tests/tcg/Makefile.include
 create mode 100644 tests/tcg/Makefile.prereqs
 delete mode 100644 tests/tcg/Makefile.probe
 create mode 100644 tests/tcg/Makefile.qemu
 rename tests/tcg/{Makefile => Makefile.target} (90%)
 delete mode 100644 tests/tcg/aarch64/Makefile.include
 delete mode 100644 tests/tcg/alpha/Makefile.include
 delete mode 100644 tests/tcg/arm/Makefile.include
 create mode 100755 tests/tcg/configure.sh
 delete mode 100644 tests/tcg/cris/Makefile.include
 delete mode 100644 tests/tcg/hppa/Makefile.include
 delete mode 100644 tests/tcg/i386/Makefile.include
 delete mode 100644 tests/tcg/m68k/Makefile.include
 delete mode 100644 tests/tcg/mips/Makefile.include
 delete mode 100644 tests/tcg/ppc/Makefile.include
 delete mode 100644 tests/tcg/riscv/Makefile.include
 delete mode 100644 tests/tcg/s390x/Makefile.include
 delete mode 100644 tests/tcg/sh4/Makefile.include
 delete mode 100644 tests/tcg/sparc64/Makefile.include
 create mode 100644 tests/tcg/x86_64/Makefile.softmmu-target
 delete mode 100644 tests/tcg/xtensa/Makefile.include

-- 
2.20.1