[Bug 268442] [NEW PORT] www/gospider:web spider written in Go

From: <bugzilla-noreply_at_freebsd.org>
Date: Sun, 18 Dec 2022 11:55:05 UTC
https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=268442

            Bug ID: 268442
           Summary: [NEW PORT] www/gospider:web spider written in Go
           Product: Ports & Packages
           Version: Latest
          Hardware: Any
                OS: Any
            Status: New
          Severity: Affects Many People
          Priority: ---
         Component: Individual Port(s)
          Assignee: ports-bugs@FreeBSD.org
          Reporter: rihaz.jerrin@gmail.com

Created attachment 238893
  --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=238893&action=edit
[NEW PORT] www/gospider:web spider written in Go

GoSpider - web spider written in Go
Features:
        - Fast web crawling
        - Brute force and parse sitemap.xml
        - Parse robots.txt
        - Generate and verify link from JavaScript files
        - Link Finder
        - Find AWS-S3 from response source
        - Find subdomains from response source
        - Get URLs from Wayback Machine, Common Crawl, Virus Total, Alien Vault
        - Format output easy to Grep
        - Support Burp input
        - Crawl multiple sites in parallel
        - Random mobile/web User-Agent

-- 
You are receiving this mail because:
You are the assignee for the bug.