[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Re: [Qemu-devel] [PATCH 1/6] iotests: throw away test timings if args ch
From: |
Eric Blake |
Subject: |
Re: [Qemu-devel] [PATCH 1/6] iotests: throw away test timings if args change |
Date: |
Mon, 19 Sep 2016 14:53:36 -0500 |
User-agent: |
Mozilla/5.0 (X11; Linux x86_64; rv:45.0) Gecko/20100101 Thunderbird/45.3.0 |
On 09/19/2016 12:35 PM, Daniel P. Berrange wrote:
> The 'check' program records timings for each test that
> is run. These timings are only valid, however, for a
> particular format/protocol combination. So if frequently
> running 'check' with a variety of different formats or
> protocols, the times printed can be very misleading.
>
> Record the protocol/format in the check.time file and
> throw it away if it doesn't mach the current run args.
>
> Signed-off-by: Daniel P. Berrange <address@hidden>
> ---
> tests/qemu-iotests/check | 21 +++++++++++++++++++--
> 1 file changed, 19 insertions(+), 2 deletions(-)
Rather than completely throwing things away, would it be worth updating
the check.time file format to track multiple entries? For every distinct
args seen, track a timing for that combination of args, then when
starting a test, if a line in the file contains the current args, report
that old time; if not, then append a line with the new args. The file
grows according to how many distinct args combinations you use, and it's
probably easier to make 'a b' and 'b a' report as different timings even
if they have the same effect and could share a timing. We'd also want
an operation to clean out timings without running tests, particularly if
timings can otherwise grow huge due to every possible args combination.
What do you think?
--
Eric Blake eblake redhat com +1-919-301-3266
Libvirt virtualization library http://libvirt.org
signature.asc
Description: OpenPGP digital signature
- [Qemu-devel] [PATCH 0/6] Improve I/O tests coverage of LUKS, Daniel P. Berrange, 2016/09/19
- [Qemu-devel] [PATCH 6/6] iotests: use _filter_qemu with test 140, Daniel P. Berrange, 2016/09/19
- [Qemu-devel] [PATCH 1/6] iotests: throw away test timings if args change, Daniel P. Berrange, 2016/09/19
- Re: [Qemu-devel] [PATCH 1/6] iotests: throw away test timings if args change,
Eric Blake <=
- Re: [Qemu-devel] [PATCH 1/6] iotests: throw away test timings if args change, Daniel P. Berrange, 2016/09/20
- Re: [Qemu-devel] [PATCH 1/6] iotests: throw away test timings if args change, Eric Blake, 2016/09/20
- Re: [Qemu-devel] [PATCH 1/6] iotests: throw away test timings if args change, Daniel P. Berrange, 2016/09/20
- Re: [Qemu-devel] [PATCH 1/6] iotests: throw away test timings if args change, Eric Blake, 2016/09/20
- Re: [Qemu-devel] [PATCH 1/6] iotests: throw away test timings if args change, Daniel P. Berrange, 2016/09/20
[Qemu-devel] [PATCH 2/6] iotests: fix remainining tests to work with LUKS, Daniel P. Berrange, 2016/09/19
[Qemu-devel] [PATCH 4/6] iotests: add more LUKS hash combination tests, Daniel P. Berrange, 2016/09/19
[Qemu-devel] [PATCH 3/6] iotests: reduce PBKDF iterations when testing LUKS, Daniel P. Berrange, 2016/09/19
[Qemu-devel] [PATCH 5/6] iotests: chown LUKS device before qemu-io launches, Daniel P. Berrange, 2016/09/19