Using Yahoo! or Google search bar instead of search.cgi

Murray Stokely murray at freebsd.org
Tue Oct 11 15:48:12 PDT 2005


On Tue, Oct 11, 2005 at 10:06:53PM +0200, Wolfram Schneider wrote:
> you know that search engines like yahoo or google index
> only 1/5 - 1/2 of a typical web site?! If a problem occurs,
> you have to wait until the next update - your are
> offline for at least 30 days.

There are sitemap APIs that allow you to get full coverage and much
quicker updates, e.g.

https://www.google.com/webmasters/sitemaps/docs/en/about.html

Still, your points are well taken and it makes it clear that trying to
get the best of both worlds (relevant results from a commercial search
engine and the breadth and immediacy given by search.cgi) would not be
trivial.

	- Murray


More information about the freebsd-www mailing list