[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Re: [Gnu-arch-users] review/merge request: sftp get/put-file() pipe-lini
Re: [Gnu-arch-users] review/merge request: sftp get/put-file() pipe-lining
Fri, 19 Mar 2004 21:08:56 -0500
Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.6b) Gecko/20031221 Thunderbird/0.4
Scott Parish wrote:
While researching something else i was struck by the realization that
file-get/put() for sftp should be pipe-lined, but i had neglected to
realize and do such earlier.
There is some room for debate on tuning the number of requests to
pipeline(N): with get() its anticipated that there will be N-1 requests
that will return EOF, so if we are get()ing multiple tiny files this is
pure overhead. On the other hand, if there is a large lag, keeping N
sufficiently large should minimize effects of lag.
Neat to hear! I've been working on optimizing the revision-building
process. The first part is the backbuilder, which is settling down now,
and I hope to get merged in the next month. Then I'd like to optimize
archive grovelling and patch retrieval for non-serial
That could improve the download time on the hackerlab even more, by
retrieving all the required patches as efficiently as it would retrieve
one big file of equal size, and by making it much faster to construct a
patch list in the first place.