[myexperiment-hackers] [3747] trunk/public/robots.txt: deny /policies/ to robots by default

[noreply]

Revision

3747

Author

dgc

Date

2013-10-07 15:48:31 +0000 (Mon, 07 Oct 2013)

Log Message

deny /policies/ to robots by default

Modified Paths

• trunk/public/robots.txt

Diff

Modified: trunk/public/robots.txt (3746 => 3747)

--- trunk/public/robots.txt	2013-10-07 15:37:12 UTC (rev 3746)
+++ trunk/public/robots.txt	2013-10-07 15:48:31 UTC (rev 3747)
@@ -1 +1,3 @@
-# See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file
\ No newline at end of file
+# See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file
+User-agent: *
+Disallow: /policies/