git: 2568e615b6 - main - remove paths for mail archive

Go to: [ bottom of page ] [ top of archives ] [ this month ]

From: Wolfram Schneider <wosch_at_FreeBSD.org>
Date: Sat, 02 Sep 2023 07:38:43 UTC

The branch main has been updated by wosch:

URL: https://cgit.FreeBSD.org/doc/commit/?id=2568e615b612c106236b296a3c9ac7584b557d6c

commit 2568e615b612c106236b296a3c9ac7584b557d6c
Author:     Wolfram Schneider <wosch@FreeBSD.org>
AuthorDate: 2023-09-02 07:36:06 +0000
Commit:     Wolfram Schneider <wosch@FreeBSD.org>
CommitDate: 2023-09-02 07:36:06 +0000

    remove paths for mail archive
    
    The mail archive cgi scripts runs on another machine
---
 website/themes/beastie/layouts/robots.txt | 3 ---
 1 file changed, 3 deletions(-)

diff --git a/website/themes/beastie/layouts/robots.txt b/website/themes/beastie/layouts/robots.txt
index 8b6d6fb9b0..b3bb9e880b 100644
--- a/website/themes/beastie/layouts/robots.txt
+++ b/website/themes/beastie/layouts/robots.txt
@@ -1,8 +1,5 @@
 User-agent: *
-Disallow: /cgi/getmsg.cgi
-Disallow: /cgi/mailindex.cgi
 Disallow: /cgi/man.cgi?apropos=2&
-Disallow: /cgi/mid.cgi
 Disallow: /cgi/ports.cgi
 Disallow: /cgi/man-autocomplete.cgi
 Disallow: /cgi/ports-autocomplete.cgi