swarm-support
[Top][All Lists]
Advanced

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: R, HDF5, Swarm output serialization


From: Marcus G. Daniels
Subject: Re: R, HDF5, Swarm output serialization
Date: 22 Mar 2001 20:01:56 -0800
User-agent: Gnus/5.070084 (Pterodactyl Gnus v0.84) Emacs/20.4

>>>>> "NEN" == Norberto Eiji Nawa <address@hidden> writes:

NEN> But if I try to load say 50 of these 1.5 MB files, by the file #
NEN> 15 my Linux box runs out of memory (to the point of hanging up

[ouch]

NEN> Are there any other alternatives to that? Or this is a HDF5 + R
NEN> limitation? 

It shouldn't be -- the memory allocation that the HDF5 module (for R) does
are all simple allocMatrix and allocVector.  Garbage collection should work..

One thing to remember is that HDF5 files are quite dense, and there is
probably a factor of at least two memory overhead for loading into R.
But this does seem to suggest that garbage collection is not occuring, though.

                  ==================================
   Swarm-Support is for discussion of the technical details of the day
   to day usage of Swarm.  For list administration needs (esp.
   [un]subscribing), please send a message to <address@hidden>
   with "help" in the body of the message.



reply via email to

[Prev in Thread] Current Thread [Next in Thread]