[Top][All Lists]

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[Bug-wget] "Referer" when using spider mode

From: Fernando Gont
Subject: [Bug-wget] "Referer" when using spider mode
Date: Tue, 27 Nov 2018 08:04:25 -0300
User-agent: Mozilla/5.0 (X11; Linux x86_64; rv:60.0) Gecko/20100101 Thunderbird/60.2.1


I'm using wget in a script to find broken and "moved" links in a web site.

My problem is that, when parsing the output of "wget --spider", I cannot
tell which page triggered the retrieval of a URL (i.e., the "referer" of
such URL) -- so, while I can find that there are broken links, I cannot
easily tell which page contains the broken link.

Any clues on how to obtain such info?


Fernando Gont
SI6 Networks
e-mail: address@hidden
PGP Fingerprint: 6666 31C6 D484 63B2 8FB1 E3C4 AE25 0D55 1D4E 7492

reply via email to

[Prev in Thread] Current Thread [Next in Thread]