svn commit: r45357 - head/en_US.ISO8859-1/htdocs

[Gavin Atkinson]

Author: gavin
Date: Wed Jul 23 11:38:56 2014
New Revision: 45357
URL: http://svnweb.freebsd.org/changeset/doc/45357

Log:
  Re-add /cgi/url.cgi to the disallowed list, this is now served by Varnish.

Modified:
  head/en_US.ISO8859-1/htdocs/robots.txt

Modified: head/en_US.ISO8859-1/htdocs/robots.txt
==============================================================================
--- head/en_US.ISO8859-1/htdocs/robots.txt	Wed Jul 23 09:51:09 2014	(r45356)
+++ head/en_US.ISO8859-1/htdocs/robots.txt	Wed Jul 23 11:38:56 2014	(r45357)
@@ -16,5 +16,6 @@ Disallow: /cgi/ports.cgi
 Disallow: /cgi/query-pr-summary.cgi
 Disallow: /cgi/query-pr.cgi
 Disallow: /cgi/search.cgi
+Disallow: /cgi/url.cgi
 Disallow: /statistic
 Disallow: /sites/downloads.sourceforge.net/