git: 5dfc794fcb - main - there are no cgi scripts running at docs.freebsd.org anymore
- Go to: [ bottom of page ] [ top of archives ] [ this month ]
Date: Mon, 07 Aug 2023 15:05:16 UTC
The branch main has been updated by wosch:
URL: https://cgit.FreeBSD.org/doc/commit/?id=5dfc794fcbbbcbc62f4dc1f3256fb6c27aeb4cb4
commit 5dfc794fcbbbcbc62f4dc1f3256fb6c27aeb4cb4
Author: Wolfram Schneider <wosch@FreeBSD.org>
AuthorDate: 2023-08-07 15:04:59 +0000
Commit: Wolfram Schneider <wosch@FreeBSD.org>
CommitDate: 2023-08-07 15:04:59 +0000
there are no cgi scripts running at docs.freebsd.org anymore
---
documentation/themes/beastie/layouts/robots.txt | 15 +--------------
1 file changed, 1 insertion(+), 14 deletions(-)
diff --git a/documentation/themes/beastie/layouts/robots.txt b/documentation/themes/beastie/layouts/robots.txt
index edd7c5252a..fd409b7c52 100644
--- a/documentation/themes/beastie/layouts/robots.txt
+++ b/documentation/themes/beastie/layouts/robots.txt
@@ -1,18 +1,5 @@
User-agent: *
#Crawl-delay: 10
-Disallow: /cgi/confirm-code.cgi
-Disallow: /cgi/cvsweb.cgi
-Disallow: /cgi/dosendpr.cgi
-Disallow: /cgi/getmsg.cgi
-Disallow: /cgi/mailindex.cgi
-Disallow: /cgi/man.cgi?apropos=2&
-Disallow: /cgi/mid.cgi
-Disallow: /cgi/mirror.cgi
-Disallow: /cgi/missing_handler.cgi
-Disallow: /cgi/ports.cgi
-Disallow: /cgi/query-pr-summary.cgi
-Disallow: /cgi/query-pr.cgi
-Disallow: /cgi/search.cgi
-Disallow: /cgi/url.cgi
Disallow: /statistic
Disallow: /doc/
+