|
From: | Matthieu Moy |
Subject: | Re: [Gnu-arch-users] Wiki invasions |
Date: | Fri, 14 May 2004 16:13:19 +0200 |
User-agent: | Gnus/5.1002 (Gnus v5.10.2) Emacs/21.2 (gnu/linux) |
Aaron Bentley <address@hidden> writes: > Can this be avoided by putting something in a robots.txt file? This will avoid problems with intelligent and polite robots. But I'm afraid not all robots on the web intelligent and polite, so I prefer the solution of a special request. Pushing a "submit" button instead of a standard link seems to me to be the best option. -- Matthieu
[Prev in Thread] | Current Thread | [Next in Thread] |