[Top][All Lists]

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[Octave-bug-tracker] [bug #30468] dlmread - performance problems

From: Rik
Subject: [Octave-bug-tracker] [bug #30468] dlmread - performance problems
Date: Mon, 19 Jul 2010 06:24:15 +0000
User-agent: Mozilla/5.0 (X11; U; Linux x86_64; en-US; rv: Gecko/20100628 Ubuntu/9.10 (karmic) Firefox/3.6.6

Update of bug #30468 (project octave):

                Category:                    None => Interpreter            
              Item Group:                    None => Other                  
                  Status:                    None => Confirmed              


Follow-up Comment #1:

Yes, dlmread is absolutely atrocious.  The file is written in C++, so one
would expect it to be of relatively high performance, but it isn't.

I'm attaching a small Perl script which makes a test file which is a matrix
of 100,000 rows X 5 columns.  This was useful as input for testing.

Incidentally, Octave's normal 'load' command can handle tab-separated data. 
Until dlmread is fixed, you will have better luck with that.  It won't handle
header rows, however, so you would need to delete those.

For example, I benchmarked Octave's 'load' command on the 100K test matrix.

tic; x = load("matrix.csv"); bm = toc
bm =  0.74381

Less than 1 second to load the data.  After that you could simply throw out
the column you don't need.

x(:,1) = [];

(file #21005)

Additional Item Attachment:

File name: mk_file.pl                     Size:0 KB


Reply to this item at:


  Message sent via/by Savannah

reply via email to

[Prev in Thread] Current Thread [Next in Thread]