website statistics

Pav Lucistnik pav at FreeBSD.org
Tue May 9 21:02:45 UTC 2006


Murray Stokely píše v út 09. 05. 2006 v 11:11 -0700:

> > SEARCHBOTS
> > 
> > On top of the numbers above, search engine crawlers generated another
> > 43,778 hits/day. Googlebot alone is responsible for 7875 hits/day.
> 
> Google claims to have 1,680,000 documents from www.freebsd.org indexed
> (+site:www.freebsd.org query), and 3 times as much if you count
> people.freebsd.org and the various ftpN and other domains.  If that is
> anywhere near correct, then 7875 hits / day means the average page is
> only refreshed every 213 days.  I hope it crawls faster than 7875 hits
> / day on other days.  Does Apache log a page hit if it was not
> returned because of an If-Modified-Since header?

Yes, that's counted as a page view. Google is known to record the
frequency with which the page is updated, and crawl often updated pages
more often. Also, I would imagine, it would crawl homepage daily, just
for the sake of having a fresh one in cache.

Someone is reading us in Google, now it gives 2,040,000 documents on
that site. Honestly, that figure feels overshot by a lot. Can't imagine
2 million distinct pages here.

-- 
Pav Lucistnik <pav at oook.cz>
              <pav at FreeBSD.org>

Any sufficiently advanced technology is indistinguishable from magic.
  -- Arthur C. Clarke
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: application/pgp-signature
Size: 187 bytes
Desc: Toto je =?iso-8859-2?Q?digit=E1ln=EC?=
	=?ISO-8859-1?Q?_podepsan=E1?= =?iso-8859-2?Q?_=E8=E1st?=
	=?ISO-8859-1?Q?_zpr=E1vy?=
Url : http://lists.freebsd.org/pipermail/freebsd-www/attachments/20060509/aff56492/attachment.pgp


More information about the freebsd-www mailing list