[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Re: [Bug-wget] [Failed] Wget mirroring command
|
From: |
chika tambun |
|
Subject: |
Re: [Bug-wget] [Failed] Wget mirroring command |
|
Date: |
Wed, 13 Jul 2016 04:06:34 +0700 |
Dear list,
It is nice to be polite. Yes it works
Thankyou
*Best regards,*
*chika.tambun*
*"Winning loves preparation"*
On Mon, Jul 11, 2016 at 2:42 PM, Tim Ruehsen <address@hidden> wrote:
> On Sunday, July 10, 2016 11:50:07 AM CEST chika tambun wrote:
> > Dear List,
> >
> > I've used to mirror the website using the command
> > # wget -np --mirror -p --convert-links --reject
> > msi,asc,gz,bz2,zip,bin,rpm,deb -P /var/www/html $url
> >
> > But i've got failed when launch this command for
> > http://supervisord.org/index.html
> > # wget -np --mirror -p --convert-links --reject
> > asc,bin,bz2,deb,doc,exe,gif,gz,java,jpg,msi,pdf,png,rpm,txt,zip -P
> > /var/www/html http://supervisord.org/index.html
> >
> > Any reference, would be appreciated.
>
> They don't want you to mirror their site :-(
>
> You have to change the request User-Agent (option -U) to work around.
> You should consider to be polite and also add --wait=1 to wait 1s between
> requests .
>
> Regards, Tim
>