svn commit: r45357 - head/en_US.ISO8859-1/htdocs
Gavin Atkinson
gavin at FreeBSD.org
Wed Jul 23 11:38:57 UTC 2014
Author: gavin
Date: Wed Jul 23 11:38:56 2014
New Revision: 45357
URL: http://svnweb.freebsd.org/changeset/doc/45357
Log:
Re-add /cgi/url.cgi to the disallowed list, this is now served by Varnish.
Modified:
head/en_US.ISO8859-1/htdocs/robots.txt
Modified: head/en_US.ISO8859-1/htdocs/robots.txt
==============================================================================
--- head/en_US.ISO8859-1/htdocs/robots.txt Wed Jul 23 09:51:09 2014 (r45356)
+++ head/en_US.ISO8859-1/htdocs/robots.txt Wed Jul 23 11:38:56 2014 (r45357)
@@ -16,5 +16,6 @@ Disallow: /cgi/ports.cgi
Disallow: /cgi/query-pr-summary.cgi
Disallow: /cgi/query-pr.cgi
Disallow: /cgi/search.cgi
+Disallow: /cgi/url.cgi
Disallow: /statistic
Disallow: /sites/downloads.sourceforge.net/
More information about the svn-doc-all
mailing list