parallel
[Top][All Lists]
Advanced

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: ulimit memory to 1/X'th of physical memory for jobs


From: Hans Schou
Subject: Re: ulimit memory to 1/X'th of physical memory for jobs
Date: Thu, 9 Aug 2012 15:39:13 +0200

2012/8/9 Ole Tange <tange@gnu.org>
I just swapped a machine to death by starting 1 jobs per CPU on a 48
core machine. The problem was that each job took more than 1/48th of
the memory.

Another approach could be to avoid starting jobs when the system is swapping.

It take a very little resource to get the current number of pages swapped in or out: 

$ grep ^psw /proc/vmstat
pswpin 83218
pswpout 179322

So after each job is started look if swap in/out has changed. If does not change start a job more.

I don't know if this tactic will work but it worth a try. On other OS you might have to use sysctl or something.

/hans


reply via email to

[Prev in Thread] Current Thread [Next in Thread]