svn commit: r41803 - head/en_US.ISO8859-1/htdocs

[Eitan Adler]

Author: eadler
Date: Fri May 31 23:10:53 2013
New Revision: 41803
URL: http://svnweb.freebsd.org/changeset/doc/41803

Log:
  The folder blocked previously seems to be a special case of a broader problem which clusteradm@ is looking into.
  
  However, /sites/downloads.sourceforge.net/ should be blocked as
  - it is not our code
  - some mirrors are serving malware from it which we don't want to be associated with us

Modified:
  head/en_US.ISO8859-1/htdocs/robots.txt

Modified: head/en_US.ISO8859-1/htdocs/robots.txt
==============================================================================
--- head/en_US.ISO8859-1/htdocs/robots.txt	Fri May 31 22:54:45 2013	(r41802)
+++ head/en_US.ISO8859-1/htdocs/robots.txt	Fri May 31 23:10:53 2013	(r41803)
@@ -4,5 +4,4 @@ User-agent: *
 
 Disallow: /cgi/
 Disallow: /statistic
-Disallow: /publish.html/hu-hu/
-Disallow: /cgi/
+Disallow: /sites/downloads.sourceforge.net/