bug-wget
[Top][All Lists]
Advanced

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: Wget2 can't mirror a website


From: Tim Rühsen
Subject: Re: Wget2 can't mirror a website
Date: Fri, 17 Feb 2023 13:37:39 +0100
User-agent: Mozilla/5.0 (X11; Linux x86_64; rv:102.0) Gecko/20100101 Thunderbird/102.6.0

On 17.02.23 01:48, retro mouse via Primary discussion list for GNU Wget wrote:
Dear devs,

I was trying to use wget2 to archive webs since wget1 doesn't support 
resourcesets. I can't get it work as expected bug or simple user ignorance I 
can't tell so I would appreciate some support.

The tests where done on Ubuntu using:
GNU Wget 1.21.2 built on linux-gnu.GNU Wget2 1.99.1 - multithreaded 
metalink/file/website downloader

For example Wget1 will retrieve this small website ~650Mb just missing some 
resoucesets.

wget \
      --recursive \
      --no-clobber \
      --page-requisites \
      --html-extension \
      --convert-links \
      --domains copetti.org \
          www.copetti.org/

But using Wget2 it will just download a coupe html pages and stop ~0.5Mb, I 
have looked at the options since they are not the same and added mirror.

wget2 \
      --mirror \
      --recursive \
      --no-clobber \
      --page-requisites \
      --html-extension \
      --convert-links \
      --domains copetti.org \
          www.copetti.org/

Any guidance would be greatly appreciated.

If there is any other kind of channel more appropriate for my support request 
IRC, other mailing list, etc.. let me know.

Best,
Retromouse
-- Sent with https://mailfence.com  Secure and private email

Hi,

the problem seems to be that super-old version of wget2.

Please get a newer version or build it yourself.
The current wget2 (built from branch `master`) creates ~2114 files and directories from the above command line.

Regards, Tim

Attachment: OpenPGP_signature
Description: OpenPGP digital signature


reply via email to

[Prev in Thread] Current Thread [Next in Thread]