[Top][All Lists]

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [Gnu-arch-users] review/merge request: sftp get/put-file() pipe-lini

From: Aaron Bentley
Subject: Re: [Gnu-arch-users] review/merge request: sftp get/put-file() pipe-lining
Date: Fri, 19 Mar 2004 21:08:56 -0500
User-agent: Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.6b) Gecko/20031221 Thunderbird/0.4

Scott Parish wrote:

While researching something else i was struck by the realization that
file-get/put() for sftp should be pipe-lined, but i had neglected to
realize and do such earlier.

There is some room for debate on tuning the number of requests to
pipeline(N): with get() its anticipated that there will be N-1 requests
that will return EOF, so if we are get()ing multiple tiny files this is
pure overhead. On the other hand, if there is a large lag, keeping N
sufficiently large should minimize effects of lag.

Neat to hear! I've been working on optimizing the revision-building process. The first part is the backbuilder, which is settling down now, and I hope to get merged in the next month. Then I'd like to optimize archive grovelling and patch retrieval for non-serial (pipelined/paralel) pfses.

That could improve the download time on the hackerlab even more, by retrieving all the required patches as efficiently as it would retrieve one big file of equal size, and by making it much faster to construct a patch list in the first place.


reply via email to

[Prev in Thread] Current Thread [Next in Thread]