[Qemu-devel] ARM virtio-scsi - disks never show up

[Richard W.M. Jones]

I don't know if there is a more appropriate place to ask about
ARM / virtio questions.  If there is please let me know.

I'm trying to get qemu to boot an ARM appliance.  Everything works up
to the point where the kernel loads virtio drivers.  The disks never
show up.  The full qemu command line and kernel messages are attached
(this is a libguestfs boot test).

virtio-blk-device fails the same way.

I have no idea where to go next.  Is there a missing kernel module?
Missing kernel config?  Non-upstream patches?

Rich.

- qemu from git (aaa6a40194)
- Linux 3.11.0 (Fedora 20)
- Hardware: Calxeda Midway A15

$ ./run test-tool/libguestfs-test-tool 
     ************************************************************
     *                    IMPORTANT NOTICE
     *
     * When reporting bugs, include the COMPLETE, UNEDITED
     * output below in your bug report.
     *
     ************************************************************
LIBGUESTFS_PATH=/home/rjones/d/libguestfs/appliance
LIBGUESTFS_CACHEDIR=/home/rjones/d/libguestfs/tmp
LD_LIBRARY_PATH=/home/rjones/d/libguestfs/ruby/ext/guestfs:/home/rjones/d/libguestfs/src/.libs:/home/rjones/d/libguestfs/gobject/.libs
LIBGUESTFS_TMPDIR=/home/rjones/d/libguestfs/tmp
LIBGUESTFS_QEMU=/home/rjones/d/qemu/arm-softmmu/qemu-system-arm
PATH=/home/rjones/d/libguestfs/erlang:/home/rjones/d/libguestfs/fuse:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/home/rjones/.local/bin:/home/rjones/bin
SELinux: Enforcing
library version: 1.23.20
guestfs_get_append: (null)
guestfs_get_backend: direct
guestfs_get_autosync: 1
guestfs_get_cachedir: /home/rjones/d/libguestfs/tmp
guestfs_get_direct: 0
guestfs_get_hv: /home/rjones/d/qemu/arm-softmmu/qemu-system-arm
guestfs_get_memsize: 500
guestfs_get_network: 0
guestfs_get_path: /home/rjones/d/libguestfs/appliance
guestfs_get_pgroup: 0
guestfs_get_program: libguestfs-test-tool
guestfs_get_recovery_proc: 1
guestfs_get_selinux: 0
guestfs_get_smp: 1
guestfs_get_tmpdir: /home/rjones/d/libguestfs/tmp
guestfs_get_trace: 0
guestfs_get_verbose: 1
host_cpu: armv7l
Launching appliance, timeout set to 600 seconds.
libguestfs: launch: backend registered: unix
libguestfs: launch: backend registered: uml
libguestfs: launch: backend registered: libvirt
libguestfs: launch: backend registered: direct
libguestfs: launch: backend=direct
libguestfs: launch: tmpdir=/home/rjones/d/libguestfs/tmp/libguestfsPkQ5wX
libguestfs: launch: umask=0002
libguestfs: launch: euid=1001
libguestfs: command: run: supermin-helper
libguestfs: command: run: \ --verbose
libguestfs: command: run: \ -f checksum
libguestfs: command: run: \ /home/rjones/d/libguestfs/appliance/supermin.d
libguestfs: command: run: \ armv7l
supermin helper [00000ms] whitelist = (not specified), host_cpu = armv7l, 
kernel = (null), initrd = (null), appliance = (null)
supermin helper [00000ms] inputs[0] = 
/home/rjones/d/libguestfs/appliance/supermin.d
checking modpath /lib/modules/3.10.9-200.fc19.armv7hl is a directory
checking modpath /lib/modules/3.11.0-3.fc20.armv7hl is a directory
checking modpath /lib/modules/0-rescue-4edd4fecdec0491091790ceaf5e78e55 is a 
directory
ignoring vmlinuz-0-rescue-4edd4fecdec0491091790ceaf5e78e55 (no modpath 
/lib/modules/0-rescue-4edd4fecdec0491091790ceaf5e78e55)
picked vmlinuz-3.11.0-3.fc20.armv7hl
supermin helper [00000ms] finished creating kernel
supermin helper [00001ms] visiting 
/home/rjones/d/libguestfs/appliance/supermin.d
supermin helper [00001ms] visiting 
/home/rjones/d/libguestfs/appliance/supermin.d/base.img
supermin helper [00001ms] visiting 
/home/rjones/d/libguestfs/appliance/supermin.d/daemon.img
supermin helper [00001ms] visiting 
/home/rjones/d/libguestfs/appliance/supermin.d/hostfiles
supermin helper [00096ms] visiting 
/home/rjones/d/libguestfs/appliance/supermin.d/init.img
supermin helper [00096ms] visiting 
/home/rjones/d/libguestfs/appliance/supermin.d/udev-rules.img
supermin helper [00096ms] adding kernel modules
supermin helper [00220ms] finished creating appliance
libguestfs: checksum of existing appliance: 
430c1d2ba42861993347d758b73bf6147872173703c7ad3699c76e4b1a6f5d84
libguestfs: [00227ms] begin testing qemu features
libguestfs: command: run: /home/rjones/d/qemu/arm-softmmu/qemu-system-arm
libguestfs: command: run: \ -nographic
libguestfs: command: run: \ -help
libguestfs: command: run: /home/rjones/d/qemu/arm-softmmu/qemu-system-arm
libguestfs: command: run: \ -nographic
libguestfs: command: run: \ -version
libguestfs: qemu version 1.6
libguestfs: command: run: /home/rjones/d/qemu/arm-softmmu/qemu-system-arm
libguestfs: command: run: \ -nographic
libguestfs: command: run: \ -machine accel=kvm:tcg
libguestfs: command: run: \ -device ?
libguestfs: [00457ms] finished testing qemu features
libguestfs: is_openable: /dev/kvm: No such file or directory
[00459ms] /home/rjones/d/qemu/arm-softmmu/qemu-system-arm \
    -global virtio-blk-device.scsi=off \
    -nodefconfig \
    -nodefaults \
    -nographic \
    -M vexpress-a9 \
    -machine accel=kvm:tcg \
    -m 500 \
    -no-reboot \
    -kernel /home/rjones/d/libguestfs/tmp/.guestfs-1001/kernel.6160 \
    -initrd /home/rjones/d/libguestfs/tmp/.guestfs-1001/initrd.6160 \
    -device virtio-scsi-device,id=scsi \
    -drive 
file=/home/rjones/d/libguestfs/tmp/libguestfsPkQ5wX/scratch.1,cache=unsafe,format=raw,id=hd0,if=none
 \
    -device scsi-hd,drive=hd0 \
    -drive 
file=/home/rjones/d/libguestfs/tmp/.guestfs-1001/root.6160,snapshot=on,id=appliance,cache=unsafe,if=none
 \
    -device scsi-hd,drive=appliance \
    -device virtio-serial-device \
    -serial stdio \
    -chardev 
socket,path=/home/rjones/d/libguestfs/tmp/libguestfsPkQ5wX/guestfsd.sock,id=channel0
 \
    -device virtserialport,chardev=channel0,name=org.libguestfs.channel.0 \
    -append 'panic=1 guestfs_valgrind_daemon=1 console=ttyAMA0 udevtimeout=600 
no_timer_check acpi=off printk.time=1 cgroup_disable=memory root=/dev/sdb 
selinux=0 guestfs_verbose=1 TERM=xterm-256color'
Could not access KVM kernel module: No such file or directory
failed to initialize KVM: No such file or directory
Back to tcg accelerator.
oss: Could not initialize DAC
oss: Failed to open `/dev/dsp'
oss: Reason: No such file or directory
oss: Could not initialize DAC
oss: Failed to open `/dev/dsp'
oss: Reason: No such file or directory
audio: Failed to create voice `lm4549.out'
[    0.000000] Booting Linux on physical CPU 0x0
[    0.000000] Initializing cgroup subsys cpuset
[    0.000000] Initializing cgroup subsys cpu
[    0.000000] Initializing cgroup subsys cpuacct
[    0.000000] Linux version 3.11.0-3.fc20.armv7hl (address@hidden) (gcc 
version 4.8.1 20130814 (Red Hat 4.8.1-6) (GCC) ) #1 SMP Tue Sep 3 23:13:00 UTC 
2013
[    0.000000] CPU: ARMv7 Processor [410fc090] revision 0 (ARMv7), cr=10c5387d
[    0.000000] CPU: PIPT / VIPT nonaliasing data cache, VIPT aliasing 
instruction cache
[    0.000000] Machine: ARM-Versatile Express
[    0.000000] cma: CMA: reserved 16 MiB at 7e000000
[    0.000000] Memory policy: ECC disabled, Data cache writealloc
[    0.000000] sched_clock: 32 bits at 24MHz, resolution 41ns, wraps every 
178956ms
[    0.000000] PERCPU: Embedded 9 pages/cpu @c0e9a000 s13312 r8192 d15360 u36864
[    0.000000] Built 1 zonelists in Zone order, mobility grouping on.  Total 
pages: 127000
[    0.000000] Kernel command line: panic=1 guestfs_valgrind_daemon=1 
console=ttyAMA0 udevtimeout=600 no_timer_check acpi=off printk.time=1 
cgroup_disable=memory root=/dev/sdb selinux=0 guestfs_verbose=1 
TERM=xterm-256color
[    0.000000] Disabling memory control group subsystem
[    0.000000] PID hash table entries: 2048 (order: 1, 8192 bytes)
[    0.000000] Dentry cache hash table entries: 65536 (order: 6, 262144 bytes)
[    0.000000] Inode-cache hash table entries: 32768 (order: 5, 131072 bytes)
[    0.000000] Memory: 479156K/512000K available (6064K kernel code, 752K 
rwdata, 2464K rodata, 629K init, 951K bss, 32844K reserved, 0K highmem)
[    0.000000] Virtual kernel memory layout:
[    0.000000]     vector  : 0xffff0000 - 0xffff1000   (   4 kB)
[    0.000000]     fixmap  : 0xfff00000 - 0xfffe0000   ( 896 kB)
[    0.000000]     vmalloc : 0xdf800000 - 0xff000000   ( 504 MB)
[    0.000000]     lowmem  : 0xc0000000 - 0xdf400000   ( 500 MB)
[    0.000000]     pkmap   : 0xbfe00000 - 0xc0000000   (   2 MB)
[    0.000000]     modules : 0xbf000000 - 0xbfe00000   (  14 MB)
[    0.000000]       .text : 0xc0008000 - 0xc085c3e4   (8529 kB)
[    0.000000]       .init : 0xc085d000 - 0xc08fa400   ( 629 kB)
[    0.000000]       .data : 0xc08fc000 - 0xc09b8150   ( 753 kB)
[    0.000000]        .bss : 0xc09b8150 - 0xc0aa5e00   ( 952 kB)
[    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=1, Nodes=1
[    0.000000] Hierarchical RCU implementation.
[    0.000000] \tRCU restricting CPUs from NR_CPUS=8 to nr_cpu_ids=1.
[    0.000000] NR_IRQS:16 nr_irqs:16 16
[    0.000000] GIC CPU mask not found - kernel will fail to boot.
[    0.000000] GIC CPU mask not found - kernel will fail to boot.
[    0.000000] smp_twd: clock not found -2
[    0.000000] Console: colour dummy device 80x30
[    0.189427] Calibrating delay loop... 312.11 BogoMIPS (lpj=1560576)
[    0.305861] pid_max: default: 32768 minimum: 301
[    0.309598] Security Framework initialized
[    0.319427] SELinux:  Disabled at boot.
[    0.325437] Mount-cache hash table entries: 512
[    0.357072] Initializing cgroup subsys memory
[    0.358945] Initializing cgroup subsys devices
[    0.359231] Initializing cgroup subsys freezer
[    0.359542] Initializing cgroup subsys net_cls
[    0.359742] Initializing cgroup subsys blkio
[    0.359893] Initializing cgroup subsys perf_event
[    0.361743] CPU: Testing write buffer coherency: ok
[    0.366432] ftrace: allocating 25683 entries in 51 pages
[    0.761632] CPU0: thread -1, cpu 0, socket 0, mpidr 80000000
[    0.763119] Setting up static identity map for 0xc05ba720 - 0xc05ba7b8
[    0.825368] Brought up 1 CPUs
[    0.825669] SMP: Total of 1 processors activated (312.11 BogoMIPS).
[    0.825889] CPU: All CPU(s) started in SVC mode.
[    0.869372] devtmpfs: initialized
[    0.953270] atomic64 test passed
[    0.953420] pinctrl core: initialized pinctrl subsystem
[    0.972004] regulator-dummy: no parameters
[    0.987408] NET: Registered protocol family 16
[    1.021749] DMA: preallocated 256 KiB pool for atomic coherent allocations
[    1.056015] L310 cache controller enabled
[    1.056149] l2x0: 8 ways, CACHE_ID 0x410000c8, AUX_CTRL 0x02420000, Cache 
size: 131072 B
[    1.069454] hw-breakpoint: debug architecture 0x0 unsupported.
[    1.073325] Serial: AMBA PL011 UART driver
[    1.078334] mb:uart0: ttyAMA0 at MMIO 0x10009000 (irq = 37) is a PL011 rev1
[    1.128039] console [ttyAMA0] enabled
[    1.138732] mb:uart1: ttyAMA1 at MMIO 0x1000a000 (irq = 38) is a PL011 rev1
[    1.141385] mb:uart2: ttyAMA2 at MMIO 0x1000b000 (irq = 39) is a PL011 rev1
[    1.143781] mb:uart3: ttyAMA3 at MMIO 0x1000c000 (irq = 40) is a PL011 rev1
[    1.201294] bio: create slab <bio-0> at 0
[    1.212035] edma-dma-engine edma-dma-engine.0: Can't allocate PaRAM dummy 
slot
[    1.214039] edma-dma-engine: probe of edma-dma-engine.0 failed with error -5
[    1.217838] fixed-dummy: no parameters
[    1.222573] vgaarb: loaded
[    1.229028] SCSI subsystem initialized
[    1.234989] usbcore: registered new interface driver usbfs
[    1.236346] usbcore: registered new interface driver hub
[    1.239072] usbcore: registered new device driver usb
[    1.270233] NetLabel: Initializing
[    1.270800] NetLabel:  domain hash size = 128
[    1.271370] NetLabel:  protocols = UNLABELED CIPSOv4
[    1.275157] NetLabel:  unlabeled traffic allowed by default
[    1.281137] Switched to clocksource v2m-timer1
[    1.726451] NET: Registered protocol family 2
[    1.742524] TCP established hash table entries: 4096 (order: 3, 32768 bytes)
[    1.744047] TCP bind hash table entries: 4096 (order: 3, 32768 bytes)
[    1.745500] TCP: Hash tables configured (established 4096 bind 4096)
[    1.747195] TCP: reno registered
[    1.748013] UDP hash table entries: 256 (order: 1, 8192 bytes)
[    1.749146] UDP-Lite hash table entries: 256 (order: 1, 8192 bytes)
[    1.757724] NET: Registered protocol family 1
[    1.766522] RPC: Registered named UNIX socket transport module.
[    1.767408] RPC: Registered udp transport module.
[    1.768023] RPC: Registered tcp transport module.
[    1.768622] RPC: Registered tcp NFSv4.1 backchannel transport module.
[    1.782801] Unpacking initramfs...
[    1.851572] Freeing initrd memory: 1028K (c8000000 - c8101000)
[    1.855530] CPU PMU: probing PMU on CPU 0
[    1.857041] hw perfevents: enabled with ARMv7 Cortex-A9 PMU driver, 1 
counters available
[    1.872923] audit: initializing netlink socket (disabled)
[    1.875609] type=2000 audit(1.620:1): initialized
[    2.528396] zbud: loaded
[    2.531885] VFS: Disk quotas dquot_6.5.2
[    2.534415] Dquot-cache hash table entries: 1024 (order 0, 4096 bytes)
[    2.558536] NFS: Registering the id_resolver key type
[    2.562445] Key type id_resolver registered
[    2.563107] Key type id_legacy registered
[    2.566996] msgmni has been set to 969
[    2.629896] alg: No test for stdrng (krng)
[    2.633125] NET: Registered protocol family 38
[    2.635713] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 
252)
[    2.638729] io scheduler noop registered
[    2.639410] io scheduler deadline registered
[    2.642305] io scheduler cfq registered (default)
[    2.657643] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled
[    2.666920] Serial: AMBA driver
[    2.668338] uart-pl011 mb:uart0: no DMA platform data
[    2.669103] uart-pl011 mb:uart1: no DMA platform data
[    2.669766] uart-pl011 mb:uart2: no DMA platform data
[    2.671063] uart-pl011 mb:uart3: no DMA platform data
[    2.671765] Serial: IMX driver
[    2.688218] libphy: Fixed MDIO Bus: probed
[    2.692491] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
[    2.693501] ehci-pci: EHCI PCI platform driver
[    2.694696] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
[    2.695909] ohci-pci: OHCI PCI platform driver
[    2.697114] uhci_hcd: USB Universal Host Controller Interface driver
[    2.701286] usbcore: registered new interface driver usbserial
[    2.702536] usbcore: registered new interface driver usbserial_generic
[    2.704275] usbserial: USB Serial support registered for generic
[    2.707413] mousedev: PS/2 mouse device common for all mice
[    2.718492] rtc-pl031 mb:rtc: rtc core: registered pl031 as rtc0
[    2.725729] device-mapper: uevent: version 1.0.3
[    2.729495] device-mapper: ioctl: 4.25.0-ioctl (2013-06-26) initialised: 
address@hidden
[    2.735099] mmci-pl18x mb:mmci: could not get default pinstate
[    2.739146] mmci-pl18x mb:mmci: mmc0: PL181 manf 41 rev0 at 0x10005000 irq 
41,42 (pio)
[    2.741031] mmci-pl18x mb:mmci: DMA channels RX none, TX none
[    2.784875] hidraw: raw HID events driver (C) Jiri Kosina
[    2.794672] usbcore: registered new interface driver usbhid
[    2.795413] usbhid: USB HID core driver
[    2.798829] drop_monitor: Initializing network drop monitor service
[    2.805427] ip_tables: (C) 2000-2006 Netfilter Core Team
[    2.812642] TCP: cubic registered
[    2.813227] Initializing XFRM netlink socket
[    2.818953] NET: Registered protocol family 10
[    2.838430] mip6: Mobile IPv6
[    2.839294] NET: Registered protocol family 17
[    2.843065] Key type dns_resolver registered
[    2.846774] VFP support v0.3: implementor 41 architecture 3 part 30 variant 
9 rev 0
[    2.872367] ThumbEE CPU extension supported.
[    2.877923] Registering SWP/SWPB emulation handler
[    2.938438] registered taskstats version 1
[    2.969125] rtc-pl031 mb:rtc: setting system clock to 2013-09-05 21:37:46 
UTC (1378417066)
[    2.971091] sr_init: No PMIC hook to init smartreflex
[    2.977360] sr_init: platform driver register failed for SR
\0[    3.017505] Freeing unused kernel memory: 628K (c085d000 - c08fa000)
supermin: mounting /proc
supermin: uptime: 2.92 0.55
supermin: ext2 mini initrd starting up: 4.1.3 zlib
supermin: cmdline: panic=1 guestfs_valgrind_daemon=1 console=ttyAMA0 
udevtimeout=600 no_timer_check acpi=off printk.time=1 cgroup_disable=memory 
root=/dev/sdb selinux=0 guestfs_verbose=1 TERM=xterm-256color
supermin: mounting /sys
supermin: internal insmod megaraid_mm.ko
[    3.276036] megaraid cmm: 2.20.2.7 (Release Date: Sun Jul 16 00:01:03 EST 
2006)
supermin: internal insmod megaraid_mbox.ko
[    3.302510] megaraid: 2.20.5.1 (Release Date: Thu Nov 16 15:32:35 EST 2006)
supermin: internal insmod megaraid_sas.ko
[    3.327218] megasas: 06.600.18.00-rc1 Wed. May. 15 17:00:00 PDT 2013
supermin: internal insmod megaraid.ko
supermin: internal insmod libcrc32c.ko
supermin: internal insmod crc-itu-t.ko
supermin: internal insmod crc32.ko
[    3.385908] alg: No test for crc32 (crc32-table)
supermin: internal insmod crc-ccitt.ko
supermin: internal insmod crc7.ko
supermin: internal insmod crc8.ko
supermin: internal insmod scsi_transport_spi.ko
supermin: internal insmod sym53c8xx.ko
supermin: internal insmod virtio_mmio.ko
supermin: internal insmod virtio_balloon.ko
supermin: internal insmod virtio-rng.ko
supermin: internal insmod virtio_blk.ko
supermin: internal insmod virtio_scsi.ko
supermin: internal insmod virtio_net.ko
supermin: internal insmod virtio_rpmsg_bus.ko
supermin: waiting another 1024000000 ns for /sys/block/sdb/dev to appear
supermin: waiting another 2048000000 ns for /sys/block/sdb/dev to appear
supermin: waiting another 4096000000 ns for /sys/block/sdb/dev to appear
supermin: waiting another 8192000000 ns for /sys/block/sdb/dev to appear
supermin: waiting another 16384000000 ns for /sys/block/sdb/dev to appear
supermin: waiting another 32768000000 ns for /sys/block/sdb/dev to appear


-- 
Richard Jones, Virtualization Group, Red Hat http://people.redhat.com/~rjones
virt-df lists disk usage of guests without needing to install any
software inside the virtual machine.  Supports Linux and Windows.
http://people.redhat.com/~rjones/virt-df/