[Top][All Lists]

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [Bug-wget] "Referer" when using spider mode

From: Dale R. Worley
Subject: Re: [Bug-wget] "Referer" when using spider mode
Date: Tue, 27 Nov 2018 23:02:29 -0500

Fernando Gont <address@hidden> writes:
> I'm using wget in a script to find broken and "moved" links in a web site.
> My problem is that, when parsing the output of "wget --spider", I cannot
> tell which page triggered the retrieval of a URL (i.e., the "referer" of
> such URL) -- so, while I can find that there are broken links, I cannot
> easily tell which page contains the broken link.
> Any clues on how to obtain such info?

I would grep through the files in the file tree that wget constructs.
That isn't perfect, but it's probably close enough for your purposes.


reply via email to

[Prev in Thread] Current Thread [Next in Thread]