[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Re: Use guix to distribute data & reproducible (data) science
From: |
Ludovic Courtès |
Subject: |
Re: Use guix to distribute data & reproducible (data) science |
Date: |
Fri, 09 Feb 2018 18:13:44 +0100 |
User-agent: |
Gnus/5.13 (Gnus v5.13) Emacs/25.3 (gnu/linux) |
Hi!
Amirouche Boubekki <address@hidden> skribis:
> tl;dr: Distribution of data and software seems similar.
> Data is more and more important in software and reproducible
> science. Data science ecosystem lakes resources sharing.
> I think guix can help.
I think some of us especially Guix-HPC folks are convinced about the
usefulness of Guix as one of the tools in the reproducible science
toolchain (that was one of the themes of my FOSDEM talk). :-)
Now, whether Guix is the right tool to distribute data, I don’t know.
Distributing large amounts of data is a job in itself, and the store
isn’t designed for that. It could quickly become a bottleneck. That’s
one of the reasons why the Guix Workflow Language (GWL) does not store
scientific data in the store itself.
I think data should probably be stored and distributed out-of-band using
appropriate storage mechanisms.
Ludo’.
- Use guix to distribute data & reproducible (data) science, Amirouche Boubekki, 2018/02/09
- Re: Use guix to distribute data & reproducible (data) science,
Ludovic Courtès <=
- Re: Use guix to distribute data & reproducible (data) science, zimoun, 2018/02/09
- Re: Use guix to distribute data & reproducible (data) science, Konrad Hinsen, 2018/02/09
- Re: Use guix to distribute data & reproducible (data) science, zimoun, 2018/02/09
- Re: Use guix to distribute data & reproducible (data) science, Ricardo Wurmus, 2018/02/09
- Re: Use guix to distribute data & reproducible (data) science, Konrad Hinsen, 2018/02/12
- Do you use packages in Guix to run neural networks?, Fis Trivial, 2018/02/13
- Re: Do you use packages in Guix to run neural networks?, Pjotr Prins, 2018/02/14
- Re: Do you use packages in Guix to run neural networks?, Fis Trivial, 2018/02/14
- Re: Do you use packages in Guix to run neural networks?, Konrad Hinsen, 2018/02/14
- Re: Use guix to distribute data & reproducible (data) science, Amirouche Boubekki, 2018/02/10