bug-wget
[Top][All Lists]
Advanced

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [Bug-wget] GSoC2012 - parallel downloading


From: Ángel González
Subject: Re: [Bug-wget] GSoC2012 - parallel downloading
Date: Sun, 18 Mar 2012 17:14:12 +0100
User-agent: Thunderbird

On 18/03/12 00:35, Adam 'foo-script' Rakowski wrote:
> Hi guys,
>
> I am Adam, CS student from UE.
> Your idea for this GSoC is very exciting. I have experience with
> parallel programming with OpenMP, but I need dive deeper into wget code
> to find out, if OMP is applicable. A problem with OMP is it can not
> guarantee that IO operations will be held in proper order.
>
> Do you have any preferred technologies/libs to parallelize downloading?
> Have you any detailed and strong vision of such feature, or is it "to be
> discussed"?
>
> Best
> Adam
OpenMP uses a different kind of parallelization. wget is I/O driven, OpenMP
wouldn't help there (or be overkill). You would use something like select()
and non-blocking reads. Or simply spawn several threads, which is likely
much easier to do when reusing the current codebase.


PS: Is wget a GSoC project? Under which name? I don't see it at
http://www.google-melange.com/gsoc/program/accepted_orgs/google/gsoc2012




reply via email to

[Prev in Thread] Current Thread [Next in Thread]