[Top][All Lists]

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

bug#10877: Wimpy external files.

From: Rogier Wolff
Subject: bug#10877: Wimpy external files.
Date: Sun, 26 Feb 2012 07:53:11 +0100
User-agent: Mutt/1.5.20 (2009-06-14)

On Sat, Feb 25, 2012 at 02:59:21PM +0000, Pádraig Brady wrote:
> Some very quick testing here (a while ago), shows -S2M -T/dev/shm
> was as fast or faster than big buffers, as well as being "nicer" to
> the rest of the system.

If that is the case, I expect it is still way faster to sort chunks of
the processor cache size, and then merge them in memory before writing
out chunks of a gigabyte (in my case with 8G RAM) to disk.

On the other hand. I'm not sure how efficient the 500-way merge is
going to be.


** address@hidden ** http://www.BitWizard.nl/ ** +31-15-2600998 **
**    Delftechpark 26 2628 XH  Delft, The Netherlands. KVK: 27239233    **
*-- BitWizard writes Linux device drivers for any device you may have! --*
The plan was simple, like my brother-in-law Phil. But unlike
Phil, this plan just might work.

reply via email to

[Prev in Thread] Current Thread [Next in Thread]