Hi Karen,
They are probably not blocking by IP or they would have blocked access from
links (the chain) as well.
Thinking they might be blocking by a combination of both IP and User agent
trigger, I changed the user agent
for lynx (the cat) with another UA string I got from the online UA database.
Now I called realclearpolitics.com with:
/usr/local/bin/lynx-2.9.0-dev9 -useragent="Mozilla/5.0 (Macintosh; U; PPC Mac OS X
Mach-O; XH; rv:8.578.498) fr, Gecko/20121021 Camino/8.723+ (Firefox compatible)" $*
No joy. Still blocked with lynx (the cat.) Links (the chain) still works.
I don't suppose you could try sending me shellworld's lynx config file, could
you?
On Wed, Nov 10, 2021 at 02:06:45PM -0500, Karen Lewellen wrote:
Hi Rudy,
Have you tried this site today?
Granted I am using the Lynx configuration at shellworld, but I just typed
the address you provided, and reached the page perfectly.
something to consider about cloudflare is that it tracks sometimes by IP
address.
Would love to learn how the fanfiction.net site works with your user agent
though, smiles.
Karen
On Wed, 10 Nov 2021, Rudy Vener wrote:
Hi all,
Yesterday realclearpolitics.com started returning the following page
when I tried to access it with lynx.
Please enable JS and disable any ad blocker
I invoke lynx as follows:
/usr/local/bin/lynx-2.9.0-dev9 -useragent="Mozilla/5.0 (Macintosh; Intel Mac OS X
10_8_0) AppleWebKit/537.1 (KHTML, like Gecko) Chrome/21.0.1180.79 Safari/537.1 lynx"
$*
The above user agent spoof normally lets me slip the Cloud Flare gatekeepers,
but this seems to be something new.
For what it's worth, the same problem now occurs with w3m, however,
links (the chain) can access the site just fine.
If there is a simple configuration fix for this, I'd really like to know.
Thank you.
--
Rudy Vener
Website: http://www.rudyvener.com
Twitter: https://twitter.com/RudySalt
--
Rudy Vener
Website: http://www.rudyvener.com
Twitter: https://twitter.com/RudySalt