lynx-dev
[Top][All Lists]
Advanced

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

lynx-dev Traversal Problem!


From: Jeff Crane
Subject: lynx-dev Traversal Problem!
Date: Wed, 16 Feb 2000 07:42:24 -0800 (PST)

Reading from CRAWL.announce in lynx/docs...

TRAVERSE_FILE (traverse.dat):
                  Contains a list of all URLs that
were traversed.  Note
                  that if a URL appears in this file
it will not be 
                  traversed again (important if runs
are started and 
                  stopped).  Placing an entry in this
file BEFORE the
                  run will block traversal of that
URL.  Unlike reject.dat
                  a final * has no effect (see below).
 Note that Lynx
                  internal client-side image MAP URLs
will be included in
                  this file (e.g.,
LYNXIMGMAP:http://server/foo.html#map1),
                  in addition to the "real" (external)
http URLs.

but when I run...
lynx -error_file=lynx.err -anonymous -cookies
http://dir.yahoo.com/Arts/Humanities/History/By_Time_Period/20th_Century/Military_History/World_War_II/Battles_and_Campaigns/European_Theater/Battle_of_the_Bulge__Ardennes_Offensive_/

I find my traverse.dat to look like this (note the
last 3 entries ARE IDENTICAL)...

http://dir.yahoo.com/Arts/Humanities/History/By_Time_Period/20th_Century/Military_History/World_War_II/Battles_and_Campaigns/European_Theater/Battle_of_the_Bulge__Ardennes_Offensive_/
http://dir.yahoo.com/Arts/Humanities/History/By_Time_Period/20th_Century/Military_History/World_War_II/Battles_and_Campaigns/European_Theater/Battle_of_the_Bulge__Ardennes_Offensive_/S_S__Leopoldville/
http://dir.yahoo.com/Arts/Humanities/History/By_Time_Period/20th_Century/Military_History/World_War_II/Battles_and_Campaigns/European_Theater/Battle_of_the_Bulge__Ardennes_Offensive_/S_S__Leopoldville/
http://dir.yahoo.com/Arts/Humanities/History/By_Time_Period/20th_Century/Military_History/World_War_II/Battles_and_Campaigns/European_Theater/Battle_of_the_Bulge__Ardennes_Offensive_/S_S__Leopoldville/
... this entry repeats forever and ever...

HOW/why does this loop occur? Or, simply, how can I
prevent it from trying to hit this link over n over n
over...ad nauseum?
__________________________________________________
Do You Yahoo!?
Talk to your friends online with Yahoo! Messenger.
http://im.yahoo.com

reply via email to

[Prev in Thread] Current Thread [Next in Thread]