parallel
[Top][All Lists]
Advanced

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: Limiting memory used by parallel?


From: Joe Sapp
Subject: Re: Limiting memory used by parallel?
Date: Thu, 25 Jan 2018 11:26:24 -0500

Hi depesz,

On Thu, Jan 25, 2018 at 10:33 AM, hubert depesz lubaczewski
<address@hidden> wrote:
[snip]
> But it looks that parallel itself is consumming HUGE amount of memory
> - comparable with size of /some/directory itself.
>
> Server that I run it on has 64GB of ram, and the script gets killed
> after ~ 3 minutes with "Out of memory!" error.

Have you tried using --memfree?  That will limit parallel from
spawning new processes

Joe



reply via email to

[Prev in Thread] Current Thread [Next in Thread]