parallel
[Top][All Lists]
Advanced

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: Limiting memory used by parallel?


From: Ole Tange
Subject: Re: Limiting memory used by parallel?
Date: Wed, 31 Jan 2018 14:00:18 +0100

On Wed, Jan 31, 2018 at 12:40 PM, hubert depesz lubaczewski
<depesz@depesz.com> wrote:
> On Tue, Jan 30, 2018 at 05:52:47PM +0100, Ole Tange wrote:
>> Typically the tmp-filesystem will be at least as fast as any other
>> file system, but on many systems /tmp is faster than other filesystems
>> on the server.
>> If you really will not use tar to generate the input, then at least
>> make sure 'dd' only delivers data at the speed that 'tar' would have
>> (eg. by using 'pv').
>
> Thanks, that's actually a point i haven't though about.
>
> In our case the tar directory is much faster than /tmp, but we could
> move tmp dir to someplace else.

No need to move: Just set $TMPDIR or use --tmpdir.


/Ole



reply via email to

[Prev in Thread] Current Thread [Next in Thread]