Re: CI status

[Leo Famulari]

On Wed, Dec 15, 2021 at 05:15:08PM +0100, Mathieu Othacehe wrote:
> * The IO operations on Berlin are mysteriously slow. Removing files from
>   /gnu/store/trash is taking ages. This is reported here:
>   https://issues.guix.gnu.org/51787.

I believe this is because we are running `guix gc --verify=contents` to
check the status of the build artifacts after the shutdown. I'm not sure
whether or not we can get a progress report on this.

> * The PostgreSQL database behind ci.guix.gnu.org also became super slow
>   and I decided to drop it. I don't know if there's a connection with
>   the above point. I'm missing the appropriate tools/knowledge to
>   monitor the IO & file-system performances.

You might try `atop`, which at least highlights that the storage is
almost fully loaded with I/O operations. Beyond that is `sar` from the
sysstat package, although making use of it requires some learning.