[Top][All Lists]

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: MPI cluster and container

From: Giovanni Biscuolo
Subject: Re: MPI cluster and container
Date: Wed, 13 Feb 2019 11:42:18 +0100

Hello zimoun,

zimoun <address@hidden> writes:


> Concerning the 1-, I mean the package manager part of Guix on a
> cluster with MPI configured.

*already having* a set of nodes you'd like to share the store on,
Ludovic wrote a nice article on how to do it:
it explains well what does it mean to "install Guix for system-wide use"
in a (possibly faked) cluster environment

Ricardo also wrote this
with less details (but the rest of the document is interesting as HPC
environment reference)

I've adapted Ludovic instructions to share the store with an LXC
container [1] via bind mounts (instead of NFS exports) of /gnu/store
(ro) and /var/guix (rw)... and it works [2]

for this to work I have to share both users (I do it via NIS) and their
homes with the container, in order to have the same user profiles on
both host and container

a similar approach should also work for QEMU/KVM VMs and other
virtualization software

please consider that nowadays we can avoid starting the guix-daemon in
TCP listening mode and use the default daemon setup: listen on the
shared socket on /var/guix/daemon-socket/socket on the "master node"/host and
use GUIX_DAEMON_SOCKET variable [3] on the "computing nodes"/guests, by
default (hardcoded?) pointing to the same socket

...aka you can skip the guix-daemon.service tweaks on host and
GUIX_DAEMON_SOCKET settings on guest


> Well, the idea is to create a fake MPI cluster with controlled
> containers. Does someone play around?

not for MPI but I'm starting to create a network of containers to test
networked services, but I'm still at early stages

IMHO - in our use case - a much more effective alternative is to use
a cluster of "guix system container"s [4] and/or "guix system vm"s


[1] both host and LXC container are foreign distros, Debian 9 in my case

[2] sometimes I'm experiencing some GPU-related problems with GUIs but
it almost for sure depends on my "strange" environment: the LXC
container is also a LTSP server I'm using via a LTSP terminal... but
that's another story


[4] please consider this non-blocking bug:

Giovanni Biscuolo

Xelera IT Infrastructures

Attachment: signature.asc
Description: PGP signature

reply via email to

[Prev in Thread] Current Thread [Next in Thread]