Re: [Monotone-devel] performance issues for pull/sync/...

[Marcel van der Boom]

On this same repository database i've done some timings/tests:

mt 0.20 on both sides
client: osx 10.4
server: linux (debian 2.6.x kernel)

pull of 9 branches with no changes, out total of 54, no other  
connections coming in on server during this.
--------------
real    3m16.215s
user    0m42.848s
sys     0m21.745s

pull of all 54 branches, 9 of which have no changes, rest is new for  
this client,
--------------
* During this time a couple of  new connections came in on the server.
* Prrocess started,
* around 4000 certificates, new connection came in and this blocked  
my process completely (i.e. no progress).
* After a while that connection finishes and then my process  
continued happily until 13000 certificates.
* New connection came in, blocked again. (until the log says:  
monotone: ticks: c="certs"/256, k="keys"/1 my process blocks)
* New connection disconnected again, mine continues again.
* Around 30k certs, first rev came in, about same time, perhaps a bit  
earlier, the server process is dropping from 90%+ to around 0.5%
* 35k, certs, new connection comes in at server, my process keeps  
running this time.
* monotone server process goes back to 90%+ (presumably the new  
connection work)
* around 36k certs:
monotone:   certs |    keys
monotone:    9646 |       5
monotone: bytes in | bytes out | certs in | revs in | revs written
monotone:    16.7M |      1.8M |    36620 |    7681 |            0
monotone: warning: protocol error while processing peer davinci: 
15000: 'bad HMAC a6f6a7953b2c5336a464374e5629f5ec8819e9b0 vs.  
87844273d6ef380cb04bd4d3a02c3e390ddd7ec3'

real    32m0.210s
user    6m44.202s
sys     4m16.970s

issued same command as above, but manually aborted with ctrl-c just  
as server determined which branches to include, then issued a pull of  
1 explit branch.
* server keeps working on the first process, does not see new connection
* after a while, server accepts new connection and starts working for it
real    4m52.930s
user    0m19.651s
sys     0m8.600s

marcel

PS
Mike, in case you're wondering. your connection were the ones  
blocking mine



On 9 jul 2005, at 17:31, Mike wrote:

> I have some serious performance issues with a moderately-sized
> database (125 MB) containing (so far) 54 branches, whenever I
> try to pull or sync with our central monotone server :
>
> monotone -d modules.db pull mt.xaraya.com:15000 com.xaraya.modules.*
>
> 1. is there really any difference between pull and sync ?
>
> 2. isn't sync supposed to check if any branches were changed,
>    rather than re-uploading/downloading the whole thing ?
>
> From what I've seen, sync is even slower than pull, even when no
> changes occurred on either side...
>
> Note: this is with monotone 0.20 on Windows (on my side) and
> on Linux (server side).
>
> Network utilisation is negligeable, CPU and memory occasionally
> peak but are generally OK too, but it still takes half an hour
> to synchronise the database. Isn't there a faster way to handle
> this ?
>
> This is becoming quite a concern for us, because we haven't
> even migrated half of our module repositories yet, and we're
> nowhere near the size that we'll need for our core and language
> repositories...
>
> Mike.
>
>
> _______________________________________________
> Monotone-devel mailing list
> address@hidden
> http://lists.nongnu.org/mailman/listinfo/monotone-devel

--
Marcel van der Boom
HS-Development BV               --   http://www.hsdev.com
So! webapplicatie framework  --   http://make-it-so.info

smime.p7s
Description: S/MIME cryptographic signature