git: a0f41809ca - main - Improve SEO of the Documentation Portal

Go to: [ bottom of page ] [ top of archives ] [ this month ]

From: Sergio Carlavilla Delgado <carlavilla_at_FreeBSD.org>
Date: Sat, 10 Dec 2022 11:12:10 UTC

The branch main has been updated by carlavilla:

URL: https://cgit.FreeBSD.org/doc/commit/?id=a0f41809ca112eb4eb5e98f7d0921e65f7cb0ee2

commit a0f41809ca112eb4eb5e98f7d0921e65f7cb0ee2
Author:     Sergio Carlavilla Delgado <carlavilla@FreeBSD.org>
AuthorDate: 2022-12-10 11:10:07 +0000
Commit:     Sergio Carlavilla Delgado <carlavilla@FreeBSD.org>
CommitDate: 2022-12-10 11:11:01 +0000

    Improve SEO of the Documentation Portal
    
    * Remove SVN tag
    * Stop indexing the archive
---
 documentation/themes/beastie/layouts/robots.txt | 4 ++--
 1 file changed, 2 insertions(+), 2 deletions(-)

diff --git a/documentation/themes/beastie/layouts/robots.txt b/documentation/themes/beastie/layouts/robots.txt
index b94bcd43cf..d5ac9c0dbd 100644
--- a/documentation/themes/beastie/layouts/robots.txt
+++ b/documentation/themes/beastie/layouts/robots.txt
@@ -1,5 +1,3 @@
-# $FreeBSD$
-
 User-agent: *
 #Crawl-delay: 10
 Disallow: /cgi/confirm-code.cgi
@@ -17,3 +15,5 @@ Disallow: /cgi/query-pr.cgi
 Disallow: /cgi/search.cgi
 Disallow: /cgi/url.cgi
 Disallow: /statistic
+Disallow: /statistic
+Disallow: /doc