[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Re: persistent data feature
From: |
Stefan Monnier |
Subject: |
Re: persistent data feature |
Date: |
Sat, 11 Dec 2021 08:53:44 -0500 |
User-agent: |
Gnus/5.13 (Gnus v5.13) Emacs/29.0.50 (gnu/linux) |
>>> There will, of course, be large amounts of data, and that will be slow.
>>> (People already do this with a number things, and the results are
>>> predictably sluggish.)
>>
>> To help me understand this discussion, I think it would help me to have
>> examples of such large databases currently implemented as text files,
>> along with an idea of what "large" means in this context (how many MBs)
>> and where the "slow"ness manifests itself.
>
> I can think of two examples of large text databases: elfeed and recent
> org-mode's caching (org-persist).
I think I'm beginning to see a pattern: most of those uses (same for
org-roam) are for cache-like data, i.e. data that can be recreated from
other data.
I suspect the same holds for gnus-registry, but doesn't for ecomplete.
Cache-like data has the property that you don't need to version it, and
users should never need to manipulate it directly: if there's a problem
with it you should be able to just delete it and start over.
For such cases, there's no great benefit to use a "transparent" text
representation (but it's important to provide some way to rebuild the
cache).
Stefan
- Re: persistent data feature, (continued)
- Re: persistent data feature, Stefan Monnier, 2021/12/10
- Re: persistent data feature, Matt Armstrong, 2021/12/10
- Re: persistent data feature, Stefan Monnier, 2021/12/10
- Re: persistent data feature, Ihor Radchenko, 2021/12/10
- Re: persistent data feature, Matt Armstrong, 2021/12/11
- Re: persistent data feature, Tassilo Horn, 2021/12/10
- Re: persistent data feature, Qiantan Hong, 2021/12/10
- Re: persistent data feature, Stefan Monnier, 2021/12/10
- Re: persistent data feature, Tassilo Horn, 2021/12/10
- Re: persistent data feature, Ihor Radchenko, 2021/12/10
- Re: persistent data feature,
Stefan Monnier <=
- Re: persistent data feature, Qiantan Hong, 2021/12/11
- Re: persistent data feature, Ihor Radchenko, 2021/12/11
- Re: persistent data feature, Alexandre Garreau, 2021/12/11
- Re: persistent data feature, Qiantan Hong, 2021/12/12
- Re: persistent data feature, Ihor Radchenko, 2021/12/12
- Re: persistent data feature, Tomas Hlavaty, 2021/12/11
- Re: persistent data feature, Alexandre Garreau, 2021/12/11
- Re: persistent data feature, Tomas Hlavaty, 2021/12/11
- Re: persistent data feature, Eli Zaretskii, 2021/12/11
- Re: persistent data feature, Alexandre Garreau, 2021/12/11