[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Re: Limiting memory used by parallel?
From: |
Ole Tange |
Subject: |
Re: Limiting memory used by parallel? |
Date: |
Wed, 31 Jan 2018 14:00:18 +0100 |
On Wed, Jan 31, 2018 at 12:40 PM, hubert depesz lubaczewski
<depesz@depesz.com> wrote:
> On Tue, Jan 30, 2018 at 05:52:47PM +0100, Ole Tange wrote:
>> Typically the tmp-filesystem will be at least as fast as any other
>> file system, but on many systems /tmp is faster than other filesystems
>> on the server.
>> If you really will not use tar to generate the input, then at least
>> make sure 'dd' only delivers data at the speed that 'tar' would have
>> (eg. by using 'pv').
>
> Thanks, that's actually a point i haven't though about.
>
> In our case the tar directory is much faster than /tmp, but we could
> move tmp dir to someplace else.
No need to move: Just set $TMPDIR or use --tmpdir.
/Ole