git: cc3c174a51 - main - allow to crawl the ports search homepage at ports.freebsd.org

Go to: [ bottom of page ] [ top of archives ] [ this month ]

From: Wolfram Schneider <wosch_at_FreeBSD.org>
Date: Sun, 31 Mar 2024 13:43:46 UTC

The branch main has been updated by wosch:

URL: https://cgit.FreeBSD.org/doc/commit/?id=cc3c174a51455e0c69d056bb331da8b97963d7ea

commit cc3c174a51455e0c69d056bb331da8b97963d7ea
Author:     Wolfram Schneider <wosch@FreeBSD.org>
AuthorDate: 2024-03-31 13:42:52 +0000
Commit:     Wolfram Schneider <wosch@FreeBSD.org>
CommitDate: 2024-03-31 13:42:52 +0000

    allow to crawl the ports search homepage at ports.freebsd.org
---
 website/themes/beastie/layouts/robots.txt | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/website/themes/beastie/layouts/robots.txt b/website/themes/beastie/layouts/robots.txt
index 70cc4362be..220b64bd77 100644
--- a/website/themes/beastie/layouts/robots.txt
+++ b/website/themes/beastie/layouts/robots.txt
@@ -1,6 +1,6 @@
 User-agent: *
 Disallow: /cgi/man.cgi?apropos=2&
-Disallow: /cgi/ports.cgi
+Disallow: /cgi/ports.cgi?
 Disallow: /cgi/man-autocomplete.cgi
 Disallow: /cgi/ports-autocomplete.cgi
 Disallow: /statistic