[Top][All Lists]

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: incremental read of gzipped matrix

From: Andreas Weber
Subject: Re: incremental read of gzipped matrix
Date: Sun, 8 Dec 2019 22:30:30 +0100
User-agent: Mozilla/5.0 (X11; Linux x86_64; rv:68.0) Gecko/20100101 Thunderbird/68.2.2

Hey Markus,

Am 08.12.19 um 19:25 schrieb "Markus Mützel":
> Octave has the gzifstream (in zfstream.h) which might be useful for your 
> purpose.

I've used this before and only got an improvement by factor 2.
The factor 2 is because load currently parses the inputfile twice: the
first run is to detect number of columns and rows, then the Matrix is
allocated then parsed the second time.

In the meanwhile I've enabled incremental reads in load_gz which is very
important for me if I periodically poll an increasing .gz file.

-- Andy

reply via email to

[Prev in Thread] Current Thread [Next in Thread]