Re: Need a faster way of reading files.

[Judd Storrs]

2010/6/2 Jordi Gutiérrez Hermoso <address@hidden>:
> I'm curious what SciPy is doing, though... can you benchmark its
> memory consumption while it's doing this? If it's using a lot more
> memory than Octave, I can imagine what sort of thing it's doing in
> exchange for speed.

I think it's possible that scipy just reads in the entire stream of
numbers from the file and sets dimensions/transposes later. IIRC the
numpy array model is able to defer actual reformatting of memory
blocks caused by transpositions until absolutely necessary. I'm not
sure if octave's array model is as flexable.


--judd