[Top][All Lists]

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [igraph] Error pickling (very) large graphs: OSError: [Errno 22] Inv

From: Tamas Nepusz
Subject: Re: [igraph] Error pickling (very) large graphs: OSError: [Errno 22] Invalid argument
Date: Wed, 19 Apr 2017 13:35:19 +0200


Thanks Tamas! I had no idea that pickling was less efficient than a string format -- I'd assumed the efficiencies of storing in binary trumped the issues with references.
It's more efficient space-wise but probably less efficient time-wise and in terms of peak memory usage (due to the reference checking). it is up to you to decide which ones costs more in the long run. JSON does not have to check references but it wastes space on the disk, so that's why running it through gzip is probably a good idea.


reply via email to

[Prev in Thread] Current Thread [Next in Thread]