bug-wget
[Top][All Lists]
Advanced

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[Bug-wget] How to crawl multiple URLs enlisted in a file using single wg


From: Avinash
Subject: [Bug-wget] How to crawl multiple URLs enlisted in a file using single wget connection ?
Date: Tue, 29 Jun 2010 16:06:03 +0530

Hi All,

I have a file with hundreds of URLs present in it. One per line.
I am using -i option of wget to crawl all these URLs.

But it seems that wget is creating a new connection per URL.

Is there any way to tell wget to use single connection for all URLs ?
If so then what is that and what could be the side effects of going with
this approach ?

If there are none of them then why is wget not going with this approach by
default ?

Please provide your expert opinion.

Thanks & Regards,
Avinash


reply via email to

[Prev in Thread] Current Thread [Next in Thread]